tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.01 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2 # Disk image does not exist, creating the virtualisation disk image... worker1 # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 51) worker1: QEMU running (pid 49) worker2 # Formatting '/build/vm-state-worker2/tmp.MscljpRps9', fmt=raw size=1073741824 worker1 # Formatting '/build/vm-state-worker1/tmp.asaXROMU0N', fmt=raw size=1073741824 lb # Disk image does not exist, creating the virtualisation disk image... worker2 # mke2fs 1.47.4 (6-Mar-2025) client: QEMU running (pid 52) lb: QEMU running (pid 50) client # Disk image does not exist, creating the virtualisation disk image... worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done lb # Formatting '/build/vm-state-lb/tmp.uGjGeNs5Ks', fmt=raw size=1073741824 client # Formatting '/build/vm-state-client/tmp.uJu5sPStHs', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done client # Discarding device blocks: 0/262144 done worker1 # Discarding device blocks: 0/262144 done worker2 # Filesystem UUID: 5fd6ac4b-0f1e-4014-96b8-3efb70ce294f client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Superblock backups stored on blocks: client # Filesystem UUID: 224d6ce9-fd00-40c1-bc06-3685d99f74c7 worker1 # Filesystem UUID: aa9f7eca-7407-4473-9e5a-cc243630f32b worker2 # 32768, 98304, 163840, 229376 client # Superblock backups stored on blocks: (finished: start all VMs, in 0.43 seconds) lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # 32768, 98304, 163840, 229376 worker1 # Superblock backups stored on blocks: worker2 # client: waiting for unit network-addresses-eth1.service worker1 # 32768, 98304, 163840, 229376 worker2 # Allocating group tables: 0/8 done client: waiting for the VM to finish booting worker1 # worker2 # Writing inode tables: 0/8 done lb # Filesystem UUID: 6a2479e4-ad18-428d-84c1-8aa1abf45027 client # worker1 # Allocating group tables: 0/8 done worker2 # Creating journal (8192 blocks): done lb # Superblock backups stored on blocks: client # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # 32768, 98304, 163840, 229376 client # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done lb # worker2 # client # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # Allocating group tables: 0/8 done worker2 # Virtualisation disk image created. client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # client # worker1 # Virtualisation disk image created. client # Virtualisation disk image created. lb # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # worker2 # worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker2 # worker2 # worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker1 # worker1 # client # client # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:08.0)... client # lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)... lb # lb # client # worker2 # Booting from ROM... worker1 # Booting from ROM... worker1 # Probing EDD (edd=off to disable)... ok worker2 # Probing EDD (edd=off to disable)... ok lb # Booting from ROM... client # Booting from ROM... lb # Probing EDD (edd=off to disable)... ok client # Probing EDD (edd=off to disable)... ok worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8kpqmrhi2ysjv2lzzbs4kwkqigrnq7rp-nixos-system-worker1-test/init regInfo=/nix/store/73z9971ny8gkwdzknxyrbhzswk2v5jr4-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/740kgpv5n4wafyn7r0lx6yn52fgir5zj-nixos-system-worker2-test/init regInfo=/nix/store/3ha7iid6n7y7pck1mk7866h4f1x97961-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test/init regInfo=/nix/store/b7672wjba7g7xvs0xbisc17mbs2br5bd-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000001] kvm-clock: using sched offset of 581679884 cycles worker1 # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000007] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] kvm-clock: using sched offset of 579398696 cycles lb # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000925] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000956] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000928] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000960] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.003103] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000960] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.003120] Using GB pages for direct mapping worker1 # [ 0.000963] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.003202] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker1 # [ 0.003115] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.003212] ACPI: Early table checksum verification disabled worker1 # [ 0.003131] Using GB pages for direct mapping lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] kvm-clock: using sched offset of 575635433 cycles worker1 # [ 0.003230] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker2 # [ 0.003216] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.003240] ACPI: Early table checksum verification disabled client # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.003245] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.003221] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000006] tsc: Detected 2400.012 MHz processor lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.003250] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000921] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.003226] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.003234] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003255] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] APIC: Static calls initialized client # [ 0.000952] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.003263] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.003237] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.000955] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.003266] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.003099] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.003238] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.003114] Using GB pages for direct mapping lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.003255] RAMDISK: [mem 0x5e366000-0x5ffcffff] worker1 # [ 0.003267] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.003240] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] Hypervisor detected: KVM client # [ 0.003264] ACPI: Early table checksum verification disabled worker1 # [ 0.003269] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.003242] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.003268] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.003271] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003244] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000001] kvm-clock: using sched offset of 585452475 cycles client # [ 0.003272] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003273] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003245] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.003278] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.003274] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.003246] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.000006] tsc: Detected 2400.012 MHz processor client # [ 0.003286] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003247] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.003275] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.000911] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.003288] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.003247] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.003276] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.000944] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.003290] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003248] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.003276] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.000947] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.003291] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003249] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.003277] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.003060] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.003075] Using GB pages for direct mapping worker2 # [ 0.003249] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.003293] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003278] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.003247] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker2 # [ 0.003511] No NUMA configuration found worker1 # [ 0.003278] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.003295] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.003256] ACPI: Early table checksum verification disabled worker2 # [ 0.003512] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.003533] No NUMA configuration found lb # [ 0.003260] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.003296] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.003515] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.003534] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.005830] Zone ranges: client # [ 0.003298] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.003265] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003537] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.005831] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.005916] Zone ranges: client # [ 0.003298] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.005833] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.003270] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005918] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.005834] Normal empty client # [ 0.003299] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.005844] Device empty lb # [ 0.003278] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005921] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.005845] Movable zone start for each node worker1 # [ 0.005923] Normal empty client # [ 0.003299] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.003281] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.005846] Early memory node ranges worker1 # [ 0.005924] Device empty client # [ 0.003300] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.005846] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.005925] Movable zone start for each node lb # [ 0.003282] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005926] Early memory node ranges worker2 # [ 0.005848] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.003300] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.005926] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.003578] No NUMA configuration found lb # [ 0.003284] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005849] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.005928] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.003578] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.003286] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005872] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.003581] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.005929] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.006146] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.006155] Zone ranges: lb # [ 0.003288] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005952] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.036478] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.006156] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.003289] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.037009] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.006226] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.006158] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.006159] Normal empty worker2 # [ 0.037024] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.036457] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.003290] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.006160] Device empty worker1 # [ 0.036986] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.037052] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.006161] Movable zone start for each node lb # [ 0.003291] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.037001] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.006162] Early memory node ranges worker2 # [ 0.037055] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.003291] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.006162] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.037034] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.037057] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.003292] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.006163] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.037037] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.037059] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.003292] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.006165] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.037038] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.037060] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.006187] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.003293] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.037040] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.003546] No NUMA configuration found worker2 # [ 0.037061] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.006482] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.037041] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.003547] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.037064] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.036269] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.037042] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.037065] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.036808] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.003550] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.006027] Zone ranges: worker2 # [ 0.037070] TSC deadline timer available client # [ 0.036822] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.037044] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.037075] CPU topo: Max. logical packages: 1 lb # [ 0.006029] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.037046] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.036858] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.037075] CPU topo: Max. logical dies: 1 lb # [ 0.006030] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.037051] TSC deadline timer available lb # [ 0.006032] Normal empty worker2 # [ 0.037076] CPU topo: Max. dies per package: 1 client # [ 0.036861] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.037056] CPU topo: Max. logical packages: 1 lb # [ 0.006033] Device empty worker2 # [ 0.037080] CPU topo: Max. threads per core: 1 worker1 # [ 0.037056] CPU topo: Max. logical dies: 1 lb # [ 0.006033] Movable zone start for each node client # [ 0.036863] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.037081] CPU topo: Num. cores per package: 1 lb # [ 0.006034] Early memory node ranges worker1 # [ 0.037057] CPU topo: Max. dies per package: 1 client # [ 0.036864] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.037081] CPU topo: Num. threads per package: 1 worker1 # [ 0.037061] CPU topo: Max. threads per core: 1 lb # [ 0.006035] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.037081] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.036865] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.037062] CPU topo: Num. cores per package: 1 lb # [ 0.006036] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.037062] CPU topo: Num. threads per package: 1 worker2 # [ 0.037106] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.036866] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.006037] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.037062] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.036869] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.037144] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.006060] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.036870] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.037087] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.006362] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.037146] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.036875] TSC deadline timer available client # [ 0.036880] CPU topo: Max. logical packages: 1 worker1 # [ 0.037127] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.037147] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.036000] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.036881] CPU topo: Max. logical dies: 1 lb # [ 0.036538] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.037150] Booting paravirtualized kernel on KVM worker1 # [ 0.037129] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.036881] CPU topo: Max. dies per package: 1 lb # [ 0.036553] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.036885] CPU topo: Max. threads per core: 1 worker1 # [ 0.037130] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.037153] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.036588] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.036886] CPU topo: Num. cores per package: 1 worker1 # [ 0.037132] Booting paravirtualized kernel on KVM worker2 # [ 0.042255] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.036886] CPU topo: Num. threads per package: 1 lb # [ 0.036590] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.036887] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.044743] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.036592] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.037136] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.044794] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.036593] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.036912] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.042193] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.036595] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.036951] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.044581] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.036595] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.036953] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.044642] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.036598] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.036954] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.036599] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.036956] Booting paravirtualized kernel on KVM lb # [ 0.036605] TSC deadline timer available worker2 # [ 0.044795] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/740kgpv5n4wafyn7r0lx6yn52fgir5zj-nixos-system-worker2-test/init regInfo=/nix/store/3ha7iid6n7y7pck1mk7866h4f1x97961-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.036610] CPU topo: Max. logical packages: 1 client # [ 0.036960] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.036611] CPU topo: Max. logical dies: 1 lb # [ 0.036611] CPU topo: Max. dies per package: 1 client # [ 0.042005] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.044913] Unknown kernel command line parameters "regInfo=/nix/store/3ha7iid6n7y7pck1mk7866h4f1x97961-closure-info/registration", will be passed to user space. lb # [ 0.036615] CPU topo: Max. threads per core: 1 worker2 # [ 0.044928] random: crng init done client # [ 0.044349] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.044644] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8kpqmrhi2ysjv2lzzbs4kwkqigrnq7rp-nixos-system-worker1-test/init regInfo=/nix/store/73z9971ny8gkwdzknxyrbhzswk2v5jr4-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.036616] CPU topo: Num. cores per package: 1 worker2 # [ 0.044929] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.044398] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.036616] CPU topo: Num. threads per package: 1 worker2 # [ 0.047319] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.036617] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.044751] Unknown kernel command line parameters "regInfo=/nix/store/73z9971ny8gkwdzknxyrbhzswk2v5jr4-closure-info/registration", will be passed to user space. worker1 # [ 0.044766] random: crng init done lb # [ 0.036642] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.048446] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.048487] Fallback order for Node 0: 0 worker1 # [ 0.044767] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.036680] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.048491] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.048492] Policy zone: DMA32 worker1 # [ 0.047128] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.036682] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.044400] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test/init regInfo=/nix/store/b7672wjba7g7xvs0xbisc17mbs2br5bd-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.051141] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.036684] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.048443] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.036686] Booting paravirtualized kernel on KVM worker1 # [ 0.048483] Fallback order for Node 0: 0 worker2 # [ 0.054811] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.044507] Unknown kernel command line parameters "regInfo=/nix/store/b7672wjba7g7xvs0xbisc17mbs2br5bd-closure-info/registration", will be passed to user space. worker2 # [ 0.058456] allocated 3145728 bytes of page_ext client # [ 0.044532] random: crng init done worker1 # [ 0.048487] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.036689] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.048488] Policy zone: DMA32 worker2 # [ 0.069521] ftrace: allocating 48731 entries in 192 pages client # [ 0.044533] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.069525] ftrace: allocated 192 pages with 2 groups lb # [ 0.041711] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.051115] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.070558] Dynamic Preempt: lazy client # [ 0.046827] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.043974] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.070750] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.054756] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.070750] rcu: RCU event tracing is enabled. lb # [ 0.044027] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.058277] allocated 3145728 bytes of page_ext client # [ 0.048105] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.048145] Fallback order for Node 0: 0 worker2 # [ 0.070751] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.069283] ftrace: allocating 48731 entries in 192 pages worker2 # [ 0.070753] Trampoline variant of Tasks RCU enabled. client # [ 0.048149] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.069286] ftrace: allocated 192 pages with 2 groups client # [ 0.048150] Policy zone: DMA32 worker2 # [ 0.070754] Rude variant of Tasks RCU enabled. worker1 # [ 0.070290] Dynamic Preempt: lazy worker2 # [ 0.070754] Tracing variant of Tasks RCU enabled. client # [ 0.050793] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.070430] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.070431] rcu: RCU event tracing is enabled. client # [ 0.054425] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.070755] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.044028] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.058009] allocated 3145728 bytes of page_ext worker1 # [ 0.070432] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.070756] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.069092] ftrace: allocating 48731 entries in 192 pages worker1 # [ 0.070433] Trampoline variant of Tasks RCU enabled. client # [ 0.069097] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.070775] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.070434] Rude variant of Tasks RCU enabled. lb # [ 0.044134] Unknown kernel command line parameters "regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration", will be passed to user space. client # [ 0.070116] Dynamic Preempt: lazy lb # [ 0.044148] random: crng init done worker1 # [ 0.070434] Tracing variant of Tasks RCU enabled. client # [ 0.070295] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.070777] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.044149] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.070296] rcu: RCU event tracing is enabled. worker1 # [ 0.070435] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.070778] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.070296] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.046415] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.070436] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.075640] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.070298] Trampoline variant of Tasks RCU enabled. lb # [ 0.047543] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.070299] Rude variant of Tasks RCU enabled. worker2 # [ 0.075948] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.070453] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.047582] Fallback order for Node 0: 0 client # [ 0.070299] Tracing variant of Tasks RCU enabled. lb # [ 0.047586] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.075954] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.070455] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.047587] Policy zone: DMA32 client # [ 0.070300] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.050367] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.070301] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.076075] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.070456] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.080076] Console: colour VGA+ 80x25 lb # [ 0.053913] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.070329] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.075534] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.080079] printk: legacy console [tty0] enabled lb # [ 0.057401] allocated 3145728 bytes of page_ext worker2 # [ 0.113548] printk: legacy console [ttyS0] enabled lb # [ 0.068530] ftrace: allocating 48731 entries in 192 pages worker1 # [ 0.075854] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.070331] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.068534] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.224459] ACPI: Core revision 20250807 lb # [ 0.069501] Dynamic Preempt: lazy client # [ 0.070332] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.075863] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.069635] rcu: Preemptible hierarchical RCU implementation. client # [ 0.075474] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.069636] rcu: RCU event tracing is enabled. worker2 # [ 0.225468] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.075983] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.075796] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.069636] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.080071] Console: colour VGA+ 80x25 worker2 # [ 0.227119] APIC: Switch to symmetric I/O mode setup lb # [ 0.069638] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.080075] printk: legacy console [tty0] enabled client # [ 0.075806] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.228168] x2apic enabled lb # [ 0.069638] Rude variant of Tasks RCU enabled. worker1 # [ 0.113762] printk: legacy console [ttyS0] enabled lb # [ 0.069638] Tracing variant of Tasks RCU enabled. worker2 # [ 0.228975] APIC: Switched APIC routing to: physical x2apic client # [ 0.075931] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.232102] ACPI: Core revision 20250807 client # [ 0.080035] Console: colour VGA+ 80x25 lb # [ 0.069639] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.080039] printk: legacy console [tty0] enabled lb # [ 0.069640] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.113673] printk: legacy console [ttyS0] enabled worker2 # [ 0.230955] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.233110] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.222507] ACPI: Core revision 20250807 lb # [ 0.069650] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.235023] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.232000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.069652] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.236151] x2apic enabled client # [ 0.223483] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.069653] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.233795] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.236999] APIC: Switched APIC routing to: physical x2apic client # [ 0.225239] APIC: Switch to symmetric I/O mode setup lb # [ 0.074573] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.226304] x2apic enabled worker2 # [ 0.235888] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.074862] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.227122] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.239150] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.236920] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.074870] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.237793] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.074985] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.229129] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.240314] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.078973] Console: colour VGA+ 80x25 lb # [ 0.078977] printk: legacy console [tty0] enabled worker2 # [ 0.238796] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.112600] printk: legacy console [ttyS0] enabled worker1 # [ 0.242308] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.230169] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.222425] ACPI: Core revision 20250807 worker2 # [ 0.240792] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.243399] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.231955] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.241792] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.223387] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.245436] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.234053] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.242792] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.225097] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.246305] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.235095] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.243792] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.226154] x2apic enabled client # [ 0.235952] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.226958] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.247309] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.236957] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.249305] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.229063] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.244792] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.238952] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.251305] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.246800] Spectre V2 : Enabling IBPB for BPF lb # [ 0.230188] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.239952] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.252304] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.240952] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.247792] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.231953] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.253305] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.241952] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.248793] active return thunk: srso_alias_return_thunk lb # [ 0.234044] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.250507] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.235081] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.251792] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.235949] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.252791] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.254304] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.242952] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.236953] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.256313] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.253792] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.244960] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.254792] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.238949] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.257306] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.245953] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.255791] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.240949] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.258306] active return thunk: srso_alias_return_thunk client # [ 0.246953] active return thunk: srso_alias_return_thunk lb # [ 0.241949] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.256791] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.260050] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' client # [ 0.247955] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.242949] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.258792] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.261305] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.248952] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.259792] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.262304] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.249951] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.260791] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.263304] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.250952] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.261792] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.264305] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.251951] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.243949] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.262792] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.245956] Spectre V2 : Enabling IBPB for BPF client # [ 0.252952] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.266305] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.263792] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.246950] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.254808] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.267305] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.247950] active return thunk: srso_alias_return_thunk client # [ 0.255952] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.268305] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.256951] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.248893] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.270166] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.257952] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.249949] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.271304] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.258952] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.250949] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.272304] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.259952] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.251949] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.273304] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.252949] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.260951] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.274304] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.253949] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.254948] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.256949] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.257949] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.258949] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.259948] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.260949] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.261949] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.302055] Freeing SMP alternatives memory: 44K worker2 # [ 0.302797] pid_max: default: 32768 minimum: 301 worker2 # [ 0.303884] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.304906] landlock: Up and running. worker2 # [ 0.305590] Yama: becoming mindful. worker2 # [ 0.306495] LSM support for eBPF active worker2 # [ 0.307401] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.308829] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.300755] Freeing SMP alternatives memory: 44K worker1 # [ 0.313056] Freeing SMP alternatives memory: 44K client # [ 0.301576] pid_max: default: 32768 minimum: 301 worker1 # [ 0.313963] pid_max: default: 32768 minimum: 301 client # [ 0.302048] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.311501] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.314445] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.303060] landlock: Up and running. client # [ 0.304436] Yama: becoming mindful. worker1 # [ 0.315428] landlock: Up and running. worker2 # [ 0.312377] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.316791] Yama: becoming mindful. client # [ 0.305209] LSM support for eBPF active worker2 # [ 0.312797] ... version: 2 worker1 # [ 0.317547] LSM support for eBPF active worker2 # [ 0.313548] ... bit width: 48 client # [ 0.306077] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.313795] ... generic counters: 6 worker1 # [ 0.318412] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.314579] ... generic bitmap: 000000000000003f client # [ 0.306990] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.315542] ... fixed-purpose counters: 0 worker1 # [ 0.319344] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.300436] Freeing SMP alternatives memory: 44K worker2 # [ 0.315794] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.300953] pid_max: default: 32768 minimum: 301 worker2 # [ 0.316753] ... value mask: 0000ffffffffffff client # [ 0.310110] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.302051] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.317538] ... max period: 00007fffffffffff worker1 # [ 0.322654] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.303069] landlock: Up and running. client # [ 0.311568] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.317794] ... global_ctrl mask: 000000000000003f lb # [ 0.303950] Yama: becoming mindful. client # [ 0.311962] ... version: 2 worker1 # [ 0.323943] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.318903] signal: max sigframe size: 3376 lb # [ 0.305057] LSM support for eBPF active client # [ 0.312740] ... bit width: 48 worker1 # [ 0.324315] ... version: 2 worker2 # [ 0.319751] rcu: Hierarchical SRCU implementation. client # [ 0.312954] ... generic counters: 6 worker1 # [ 0.325085] ... bit width: 48 worker2 # [ 0.320417] rcu: Max phase no-delay instances is 400. lb # [ 0.305866] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.313708] ... generic bitmap: 000000000000003f worker1 # [ 0.325308] ... generic counters: 6 client # [ 0.313954] ... fixed-purpose counters: 0 worker1 # [ 0.326106] ... generic bitmap: 000000000000003f lb # [ 0.306986] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.327069] ... fixed-purpose counters: 0 client # [ 0.314739] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.327307] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.315787] ... value mask: 0000ffffffffffff lb # [ 0.309668] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.316720] ... max period: 00007fffffffffff worker1 # [ 0.328307] ... value mask: 0000ffffffffffff client # [ 0.316955] ... global_ctrl mask: 000000000000003f worker1 # [ 0.329307] ... max period: 00007fffffffffff worker2 # [ 0.325882] smp: Bringing up secondary CPUs ... lb # [ 0.310554] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.318059] signal: max sigframe size: 3376 worker1 # [ 0.330307] ... global_ctrl mask: 000000000000003f worker2 # [ 0.326695] smp: Brought up 1 node, 1 CPU lb # [ 0.310955] ... version: 2 client # [ 0.318970] rcu: Hierarchical SRCU implementation. worker1 # [ 0.331436] signal: max sigframe size: 3376 lb # [ 0.311710] ... bit width: 48 worker2 # [ 0.327353] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.319834] rcu: Max phase no-delay instances is 400. lb # [ 0.311952] ... generic counters: 6 worker1 # [ 0.332381] rcu: Hierarchical SRCU implementation. lb # [ 0.312750] ... generic bitmap: 000000000000003f worker1 # [ 0.333286] rcu: Max phase no-delay instances is 400. lb # [ 0.313762] ... fixed-purpose counters: 0 worker2 # [ 0.328026] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) lb # [ 0.314580] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.329059] devtmpfs: initialized lb # [ 0.314952] ... value mask: 0000ffffffffffff worker2 # [ 0.329966] x86/mm: Memory block size: 128MB lb # [ 0.315939] ... max period: 00007fffffffffff client # [ 0.325790] smp: Bringing up secondary CPUs ... lb # [ 0.316725] ... global_ctrl mask: 000000000000003f worker2 # [ 0.331966] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.326614] smp: Brought up 1 node, 1 CPU lb # [ 0.317842] signal: max sigframe size: 3376 worker1 # [ 0.339152] smp: Bringing up secondary CPUs ... client # [ 0.326957] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.318632] rcu: Hierarchical SRCU implementation. worker1 # [ 0.339977] smp: Brought up 1 node, 1 CPU worker2 # [ 0.332827] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.318956] rcu: Max phase no-delay instances is 400. worker2 # [ 0.333895] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.340308] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.328131] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved) worker2 # [ 0.335060] PM: RTC time: 13:25:51, date: 2026-09-20 client # [ 0.329229] devtmpfs: initialized worker1 # [ 0.341489] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) client # [ 0.330066] x86/mm: Memory block size: 128MB worker1 # [ 0.342580] devtmpfs: initialized worker1 # [ 0.343555] x86/mm: Memory block size: 128MB worker2 # [ 0.338658] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.332041] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.324983] smp: Bringing up secondary CPUs ... lb # [ 0.325853] smp: Brought up 1 node, 1 CPU worker2 # [ 0.340148] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.332981] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.345447] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.326498] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.334050] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.340814] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.346337] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.335310] PM: RTC time: 13:25:51, date: 2026-09-20 worker1 # [ 0.347403] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.342077] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.327158] Memory: 1454616K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) worker2 # [ 0.342807] audit: initializing netlink subsys (disabled) lb # [ 0.328239] devtmpfs: initialized worker1 # [ 0.348630] PM: RTC time: 13:25:51, date: 2026-09-20 lb # [ 0.329186] x86/mm: Memory block size: 128MB worker2 # [ 0.344094] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.344097] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.338942] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.344797] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.331165] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.352182] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.340316] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.345799] audit: type=2000 audit(1789910751.785:1): state=initialized audit_enabled=0 res=1 lb # [ 0.331986] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.340976] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.347796] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.353780] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.333050] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.347798] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.342247] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.334322] PM: RTC time: 13:25:51, date: 2026-09-20 worker1 # [ 0.354332] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.348817] cpuidle: using governor menu client # [ 0.342971] audit: initializing netlink subsys (disabled) worker1 # [ 0.355595] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.351302] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.344343] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.356324] audit: initializing netlink subsys (disabled) client # [ 0.344346] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.337820] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.352065] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.344956] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.357679] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.352799] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.357681] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.339293] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.345959] audit: type=2000 audit(1789910751.796:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.353810] PCI: Using configuration type 1 for base access client # [ 0.347956] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.339974] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.358312] audit: type=2000 audit(1789910751.787:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.354995] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.347958] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.360310] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.341238] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.348998] cpuidle: using governor menu worker1 # [ 0.360311] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.341966] audit: initializing netlink subsys (disabled) client # [ 0.351340] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.361307] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.343276] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.362330] cpuidle: using governor menu lb # [ 0.343279] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.352257] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.364746] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.343953] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.352961] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.344956] audit: type=2000 audit(1789910751.803:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.365572] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.353995] PCI: Using configuration type 1 for base access lb # [ 0.346954] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.366311] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.346955] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.364024] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.367324] PCI: Using configuration type 1 for base access client # [ 0.355325] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.347975] cpuidle: using governor menu worker2 # [ 0.364797] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.368529] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.350306] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.351228] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.351956] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.352967] PCI: Using configuration type 1 for base access client # [ 0.360420] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.369796] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.373446] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.370794] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.360958] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.354183] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.374309] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.361959] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.379309] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.380307] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.368959] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.363161] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.381255] ACPI: Added _OSI(Module Device) lb # [ 0.363954] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.381797] ACPI: Added _OSI(Processor Device) worker2 # [ 0.382598] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.388585] ACPI: Added _OSI(Module Device) lb # [ 0.368953] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.389309] ACPI: Added _OSI(Processor Device) lb # [ 0.369952] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.390145] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.378622] ACPI: Added _OSI(Module Device) client # [ 0.378959] ACPI: Added _OSI(Processor Device) worker2 # [ 0.391655] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.395691] ACPI: Interpreter enabled client # [ 0.383958] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.396287] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.396796] ACPI: Using IOAPIC for interrupt routing lb # [ 0.380446] ACPI: Added _OSI(Module Device) worker2 # [ 0.397753] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.380954] ACPI: Added _OSI(Processor Device) lb # [ 0.381780] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.402727] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.402795] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.406773] ACPI: Interpreter enabled worker2 # [ 0.403952] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.407326] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.408130] ACPI: Using IOAPIC for interrupt routing client # [ 0.396697] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.392091] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.411388] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.412308] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.412599] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.396272] ACPI: Interpreter enabled worker1 # [ 0.415469] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.396966] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.413644] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.397735] ACPI: Using IOAPIC for interrupt routing client # [ 0.404434] ACPI: Interpreter enabled client # [ 0.404974] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.414890] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.405758] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.415931] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.417188] PCI host bridge to bus 0000:00 lb # [ 0.401035] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.417800] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.401953] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.418795] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.409006] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.409956] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.419795] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.411113] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.405120] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.420802] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.424652] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.421795] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.422824] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.426892] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.423795] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.427397] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.424897] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.428444] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.412237] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.426317] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.429818] PCI host bridge to bus 0000:00 lb # [ 0.412959] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.430314] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.420328] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.414040] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.431308] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.415106] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.421866] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.432308] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.416347] PCI host bridge to bus 0000:00 client # [ 0.423059] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.433308] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.416958] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.424093] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.434307] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.417952] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.425356] PCI host bridge to bus 0000:00 worker2 # [ 0.428898] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.435308] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.418952] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.429808] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.425959] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.436309] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.419961] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.430836] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.426955] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.437409] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.427955] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.420952] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.431996] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.428955] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.421989] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.438847] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.433617] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.429955] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.422955] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.430955] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.424129] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.431956] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.436828] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.433044] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.425491] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.437795] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.438818] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.434505] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.439801] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.441498] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.441458] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.442324] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.443334] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.443825] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.444546] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.428037] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.428971] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.444786] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.437050] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.446217] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.445836] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.429986] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.437969] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.438979] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.431279] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.449354] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.440236] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.447493] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.450316] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.432902] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.441853] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.451333] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.450833] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.452315] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.451802] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.435990] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.452820] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.444992] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.436964] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.454040] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.445933] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.437985] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.454480] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.446785] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.457349] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.438965] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.447954] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.458315] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.440651] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.459334] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.449619] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.458214] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] worker2 # [ 0.459549] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.461472] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.442988] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.451988] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.459819] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.452964] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.443963] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.463317] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.453980] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.461452] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.444986] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.464299] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.463803] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] client # [ 0.455667] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.446685] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.464751] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.465332] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.457996] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.465639] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.448979] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.458963] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.449963] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.467476] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.467019] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.459979] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.450984] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.461592] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.469829] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.470348] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] lb # [ 0.452668] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.470802] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.471315] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.471820] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.472331] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.465181] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] worker2 # [ 0.473526] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.454986] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] client # [ 0.465991] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.474008] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.455980] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.466988] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.457003] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.476803] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] worker2 # [ 0.477802] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.478203] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] lb # [ 0.458666] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.478833] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.479082] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.479801] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.469586] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.480179] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.481441] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.482026] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.462855] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker2 # [ 0.482835] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.463796] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.473025] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker1 # [ 0.485337] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.483819] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.464914] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.473965] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.474983] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.486300] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.485426] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.466691] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.488126] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.476727] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.487815] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] worker1 # [ 0.490024] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.488774] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.489672] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.492352] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] lb # [ 0.470707] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.491434] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.493316] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.471813] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.479991] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.494334] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.472904] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.480976] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.494802] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker1 # [ 0.495314] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.495776] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.482000] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.474736] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.496974] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.496608] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.477705] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] client # [ 0.484087] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.499322] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.498403] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.500333] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.478787] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.499461] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] lb # [ 0.479985] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.501958] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.500042] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.480965] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.486991] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] worker2 # [ 0.501828] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] client # [ 0.487972] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.482686] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.505192] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] client # [ 0.488989] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.506071] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.489968] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.484991] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.507170] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.485984] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.491861] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.508995] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.487645] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.511343] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] client # [ 0.494993] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.512315] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.489982] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] client # [ 0.495988] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.490962] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.513332] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.491984] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.497828] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.514986] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.503064] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.493665] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.517030] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.505461] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker1 # [ 0.517548] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.506104] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.496986] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] client # [ 0.501035] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] worker1 # [ 0.519007] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker2 # [ 0.507430] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.497962] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.501970] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.498985] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.502995] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.508111] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.509115] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.500648] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.504856] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.510105] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.502747] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.511783] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] lb # [ 0.504048] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.512514] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.507996] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] lb # [ 0.505648] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] client # [ 0.508979] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.513176] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.510000] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.514391] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.519535] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.512101] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.518175] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.522954] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker2 # [ 0.518930] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.514024] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.519905] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.523626] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.520905] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.515451] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.525316] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.521916] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.522901] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.526604] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.518004] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker2 # [ 0.523904] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.506206] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.527635] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.524973] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.508726] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker2 # [ 0.526042] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.528600] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.526814] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.510093] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.527816] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.528810] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.530341] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] lb # [ 0.511961] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.531315] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.529811] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.513295] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.530808] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.532708] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.531808] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.514273] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.532808] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.534405] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.515263] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.535016] iommu: Default domain type: Translated worker2 # [ 0.535803] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.517008] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker2 # [ 0.537070] ACPI: bus type USB registered lb # [ 0.517959] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.537853] usbcore: registered new interface driver usbfs client # [ 0.519570] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.538808] usbcore: registered new interface driver hub worker1 # [ 0.539227] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.519764] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.539807] usbcore: registered new device driver usb worker1 # [ 0.540241] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.521994] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] lb # [ 0.521603] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.541309] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.541720] NetLabel: Initializing worker1 # [ 0.542417] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.542422] NetLabel: domain hash size = 128 client # [ 0.523490] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.543421] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.542799] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.524891] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.543868] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.544450] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.525648] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.544824] PCI: Using ACPI for IRQ routing worker1 # [ 0.545425] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.526075] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.526417] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.546432] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.527063] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.547348] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.527291] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.528063] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.548324] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.529059] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.528297] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.549321] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.530091] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.550323] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.531061] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.529992] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker1 # [ 0.551321] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.532058] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.530941] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.552321] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.532994] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.553323] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.533966] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.532167] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.554323] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.534969] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.535968] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.556480] iommu: Default domain type: Translated client # [ 0.534002] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.536967] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.557315] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.537974] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.558588] ACPI: bus type USB registered lb # [ 0.538969] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.559372] usbcore: registered new interface driver usbfs worker1 # [ 0.560327] usbcore: registered new interface driver hub lb # [ 0.539968] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.561292] usbcore: registered new device driver usb client # [ 0.538473] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.542113] iommu: Default domain type: Translated client # [ 0.539086] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.562951] NetLabel: Initializing lb # [ 0.542960] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.563309] NetLabel: domain hash size = 128 client # [ 0.540069] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.544222] ACPI: bus type USB registered worker1 # [ 0.564116] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.541073] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.545015] usbcore: registered new interface driver usbfs worker1 # [ 0.565101] NetLabel: unlabeled traffic allowed by default client # [ 0.542082] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.566073] PCI: Using ACPI for IRQ routing lb # [ 0.545967] usbcore: registered new interface driver hub lb # [ 0.546976] usbcore: registered new device driver usb client # [ 0.543065] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.544117] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.549078] NetLabel: Initializing lb # [ 0.549744] NetLabel: domain hash size = 128 client # [ 0.545074] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.550569] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.546003] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.551024] NetLabel: unlabeled traffic allowed by default client # [ 0.546973] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.551965] PCI: Using ACPI for IRQ routing client # [ 0.547973] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.548975] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.549968] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.550970] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.551971] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.552969] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.555457] iommu: Default domain type: Translated client # [ 0.555964] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.557319] ACPI: bus type USB registered client # [ 0.558033] usbcore: registered new interface driver usbfs client # [ 0.558973] usbcore: registered new interface driver hub client # [ 0.559947] usbcore: registered new device driver usb client # [ 0.562075] NetLabel: Initializing client # [ 0.562787] NetLabel: domain hash size = 128 client # [ 0.563568] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.564028] NetLabel: unlabeled traffic allowed by default client # [ 0.564973] PCI: Using ACPI for IRQ routing worker2 # [ 0.604639] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.604790] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.604790] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.604800] vgaarb: loaded worker2 # [ 0.605634] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.606466] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.610897] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.612775] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.617634] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.615628] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.618303] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.617161] pnp: PnP ACPI init worker1 # [ 0.618303] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.618075] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.618315] vgaarb: loaded worker2 # [ 0.619199] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.601907] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.619214] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.601948] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.620062] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.621043] pnp: PnP ACPI: found 6 devices lb # [ 0.601948] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.601960] vgaarb: loaded lb # [ 0.602789] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.603608] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.625500] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.630101] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.608083] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.629497] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.632121] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.630499] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.633519] NET: Registered PF_INET protocol family worker1 # [ 0.632734] pnp: PnP ACPI init lb # [ 0.612813] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.633769] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.635191] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.613673] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.634966] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.615389] pnp: PnP ACPI init worker1 # [ 0.636732] pnp: PnP ACPI: found 6 devices lb # [ 0.616434] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.615765] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.615950] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.617664] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.615950] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.619584] pnp: PnP ACPI: found 6 devices client # [ 0.615966] vgaarb: loaded client # [ 0.616841] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.617637] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.644875] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.646490] clocksource: Switched to clocksource acpi_pm client # [ 0.621116] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.647618] NET: Registered PF_INET protocol family worker1 # [ 0.648971] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.623081] VFS: Disk quotas dquot_6.6.0 lb # [ 0.628177] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.629995] clocksource: Switched to clocksource acpi_pm lb # [ 0.631167] NET: Registered PF_INET protocol family client # [ 0.626476] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.632566] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.628320] pnp: PnP ACPI init client # [ 0.629320] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.630491] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.658714] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.632302] pnp: PnP ACPI: found 6 devices worker2 # [ 0.660913] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.662587] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.664474] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.666217] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.667829] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.640622] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.669573] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.642278] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.668659] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.671089] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.643411] NET: Registered PF_INET protocol family worker1 # [ 0.670294] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.672797] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.644764] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.671805] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.674237] NET: Registered PF_XDP protocol family worker1 # [ 0.673295] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.675484] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.674731] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.676866] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.653538] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.676004] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.678228] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.655536] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.677436] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.679880] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.657251] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.678699] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.681417] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.680100] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.659013] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.681231] NET: Registered PF_XDP protocol family worker2 # [ 0.682998] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.660610] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.682186] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.683317] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.685351] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.662140] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.684606] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.663834] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.685959] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.688431] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.665307] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.687380] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.666990] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.688749] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.668327] NET: Registered PF_XDP protocol family worker2 # [ 0.691295] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.669462] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.690749] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.670739] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.694343] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.665459] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.693247] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.671929] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.667298] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.673324] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.697448] PCI: CLS 0 bytes, default 64 lb # [ 0.674609] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.668838] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.696846] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.675864] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.699034] Trying to unpack rootfs image as initramfs... client # [ 0.670439] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.671864] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.677944] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.699292] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.673305] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.680451] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.701592] PCI: CLS 0 bytes, default 64 client # [ 0.674810] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.676068] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.702711] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.682928] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.677544] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.705351] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.704633] Trying to unpack rootfs image as initramfs... client # [ 0.678790] NET: Registered PF_XDP protocol family lb # [ 0.685475] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.679806] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.680955] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.687355] PCI: CLS 0 bytes, default 64 client # [ 0.682084] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.688334] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.683342] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.690247] Trying to unpack rootfs image as initramfs... client # [ 0.684590] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.685854] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.688013] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.690768] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.693073] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.695345] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.697269] PCI: CLS 0 bytes, default 64 client # [ 0.698383] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.700434] Trying to unpack rootfs image as initramfs... worker1 # [ 0.760976] Initialise system trusted keyrings lb # [ 0.742662] Initialise system trusted keyrings worker1 # [ 0.764532] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.767789] Initialise system trusted keyrings lb # [ 0.746166] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.771091] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.754306] Initialise system trusted keyrings client # [ 0.757254] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.789628] Key type asymmetric registered lb # [ 0.770732] Key type asymmetric registered lb # [ 0.771533] Asymmetric key parser 'x509' registered worker1 # [ 0.792514] Asymmetric key parser 'x509' registered worker1 # [ 0.793784] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.774188] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.777159] io scheduler mq-deadline registered lb # [ 0.777977] io scheduler kyber registered worker1 # [ 0.799702] io scheduler mq-deadline registered worker1 # [ 0.800927] io scheduler kyber registered lb # [ 0.780976] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.804902] Key type asymmetric registered lb # [ 0.784441] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.807886] Asymmetric key parser 'x509' registered worker1 # [ 0.805783] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.809194] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.782246] Key type asymmetric registered client # [ 0.783076] Asymmetric key parser 'x509' registered worker1 # [ 0.809757] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.790605] Linux agpgart interface v0.103 lb # [ 0.791568] ACPI: bus type drm_connector registered worker2 # [ 0.815043] io scheduler mq-deadline registered client # [ 0.786279] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.816091] io scheduler kyber registered client # [ 0.787885] io scheduler mq-deadline registered lb # [ 0.794639] usbcore: registered new interface driver usbserial_generic client # [ 0.790224] io scheduler kyber registered lb # [ 0.795796] usbserial: USB Serial support registered for generic worker1 # [ 0.816958] Linux agpgart interface v0.103 worker1 # [ 0.818080] ACPI: bus type drm_connector registered client # [ 0.793469] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.821931] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.799116] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.799116] Please enable it if your BIOS has the CPPC option. client # [ 0.794956] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.823624] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.801444] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.823299] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.824923] usbserial: USB Serial support registered for generic lb # [ 0.805356] drop_monitor: Initializing network drop monitor service client # [ 0.800407] Linux agpgart interface v0.103 lb # [ 0.806721] NET: Registered PF_INET6 protocol family client # [ 0.801362] ACPI: bus type drm_connector registered worker2 # [ 0.829956] Linux agpgart interface v0.103 worker1 # [ 0.829521] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.832969] ACPI: bus type drm_connector registered worker1 # [ 0.829521] Please enable it if your BIOS has the CPPC option. lb # [ 0.811887] Segment Routing with IPv6 client # [ 0.806419] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.835020] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.832758] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.812752] In-situ OAM (IOAM) with IPv6 client # [ 0.807634] usbserial: USB Serial support registered for generic worker2 # [ 0.836373] usbserial: USB Serial support registered for generic lb # [ 0.816494] IPI shorthand broadcast: enabled client # [ 0.811192] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.811192] Please enable it if your BIOS has the CPPC option. client # [ 0.813625] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.841882] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.840806] drop_monitor: Initializing network drop monitor service worker2 # [ 0.841882] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.842677] NET: Registered PF_INET6 protocol family worker2 # [ 0.844903] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.817440] drop_monitor: Initializing network drop monitor service client # [ 0.818832] NET: Registered PF_INET6 protocol family lb # [ 0.825433] sched_clock: Marking stable (672015373, 153078855)->(908563807, -83469579) worker1 # [ 0.847105] Segment Routing with IPv6 worker2 # [ 0.850170] drop_monitor: Initializing network drop monitor service client # [ 0.823944] Segment Routing with IPv6 worker1 # [ 0.850538] In-situ OAM (IOAM) with IPv6 client # [ 0.824772] In-situ OAM (IOAM) with IPv6 lb # [ 0.830491] registered taskstats version 1 worker1 # [ 0.852156] IPI shorthand broadcast: enabled lb # [ 0.831623] Loading compiled-in X.509 certificates worker2 # [ 0.855075] NET: Registered PF_INET6 protocol family client # [ 0.828756] IPI shorthand broadcast: enabled worker2 # [ 0.859539] Segment Routing with IPv6 worker2 # [ 0.862907] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.864601] IPI shorthand broadcast: enabled worker1 # [ 0.864418] sched_clock: Marking stable (702030764, 161441058)->(947428223, -83956401) client # [ 0.841083] sched_clock: Marking stable (689035240, 151145799)->(938524057, -98343018) worker1 # [ 0.869850] registered taskstats version 1 client # [ 0.844602] registered taskstats version 1 worker1 # [ 0.871287] Loading compiled-in X.509 certificates client # [ 0.846010] Loading compiled-in X.509 certificates lb # [ 0.853143] Demotion targets for Node 0: null lb # [ 0.854184] Key type .fscrypt registered lb # [ 0.854918] Key type fscrypt-provisioning registered worker2 # [ 0.877011] sched_clock: Marking stable (724023911, 152837431)->(956045949, -79184607) lb # [ 0.858245] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.859257] ima: Allocated hash algorithm: sha1 worker2 # [ 0.884384] registered taskstats version 1 lb # [ 0.862129] ima: No architecture policies found lb # [ 0.863161] PM: Magic number: 10:275:433 lb # [ 0.864939] RAS: Correctable Errors collector initialized. worker2 # [ 0.888067] Loading compiled-in X.509 certificates worker1 # [ 0.898043] Demotion targets for Node 0: null lb # [ 0.878307] clk: Disabling unused clocks lb # [ 0.879156] PM: genpd: Disabling unused power domains client # [ 0.874199] Demotion targets for Node 0: null worker1 # [ 0.901564] Key type .fscrypt registered client # [ 0.875575] Key type .fscrypt registered worker1 # [ 0.902583] Key type fscrypt-provisioning registered client # [ 0.879206] Key type fscrypt-provisioning registered worker1 # [ 0.906660] ima: No TPM chip found, activating TPM-bypass! client # [ 0.880606] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.907759] ima: Allocated hash algorithm: sha1 client # [ 0.883211] ima: Allocated hash algorithm: sha1 client # [ 0.884357] ima: No architecture policies found worker1 # [ 0.910517] ima: No architecture policies found worker2 # [ 0.913021] Demotion targets for Node 0: null worker1 # [ 0.913471] PM: Magic number: 10:275:433 worker2 # [ 0.917001] Key type .fscrypt registered worker1 # [ 0.915303] RAS: Correctable Errors collector initialized. client # [ 0.889216] PM: Magic number: 10:275:433 worker2 # [ 0.917983] Key type fscrypt-provisioning registered worker2 # [ 0.921104] ima: No TPM chip found, activating TPM-bypass! client # [ 0.893282] RAS: Correctable Errors collector initialized. worker2 # [ 0.922369] ima: Allocated hash algorithm: sha1 worker2 # [ 0.924937] ima: No architecture policies found worker2 # [ 0.927885] PM: Magic number: 10:275:433 worker1 # [ 0.926646] clk: Disabling unused clocks worker1 # [ 0.929477] PM: genpd: Disabling unused power domains worker2 # [ 0.933153] RAS: Correctable Errors collector initialized. client # [ 0.909786] clk: Disabling unused clocks client # [ 0.910722] PM: genpd: Disabling unused power domains worker2 # [ 0.950032] clk: Disabling unused clocks worker2 # [ 0.954907] PM: genpd: Disabling unused power domains lb # [ 1.093895] Freeing initrd memory: 29092K lb # [ 1.097379] Freeing unused decrypted memory: 2028K lb # [ 1.100165] Freeing unused kernel image (initmem) memory: 3644K lb # [ 1.101330] Write protecting the kernel read-only data: 32768k lb # [ 1.103403] Freeing unused kernel image (text/rodata gap) memory: 1208K lb # [ 1.104994] Freeing unused kernel image (rodata/data gap) memory: 752K worker1 # [ 1.137779] Freeing initrd memory: 29092K worker1 # [ 1.141238] Freeing unused decrypted memory: 2028K worker1 # [ 1.144039] Freeing unused kernel image (initmem) memory: 3644K worker1 # [ 1.145240] Write protecting the kernel read-only data: 32768k worker1 # [ 1.147339] Freeing unused kernel image (text/rodata gap) memory: 1208K worker1 # [ 1.149039] Freeing unused kernel image (rodata/data gap) memory: 752K lb # [ 1.161886] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.163141] Run /init as init process client # [ 1.169617] Freeing initrd memory: 29096K lb # [ 1.176307] systemd[1]: Inserted module 'autofs4' client # [ 1.173080] Freeing unused decrypted memory: 2028K client # [ 1.175842] Freeing unused kernel image (initmem) memory: 3644K client # [ 1.177040] Write protecting the kernel read-only data: 32768k client # [ 1.179186] Freeing unused kernel image (text/rodata gap) memory: 1208K worker1 # [ 1.205953] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 1.207156] Run /init as init process client # [ 1.180799] Freeing unused kernel image (rodata/data gap) memory: 752K worker2 # [ 1.212741] Freeing initrd memory: 29092K worker2 # [ 1.216527] Freeing unused decrypted memory: 2028K lb # [ 1.194739] fuse: init (API version 7.45) worker2 # [ 1.219671] Freeing unused kernel image (initmem) memory: 3644K worker1 # [ 1.218494] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.220982] Write protecting the kernel read-only data: 32768k worker2 # [ 1.223351] Freeing unused kernel image (text/rodata gap) memory: 1208K lb # [ 1.201387] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.225137] Freeing unused kernel image (rodata/data gap) memory: 752K lb # [ 1.203988] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.207348] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.209634] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.236983] fuse: init (API version 7.45) worker1 # [ 1.243749] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.246419] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.250826] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.254557] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.238349] systemd[1]: Successfully made /usr/ read-only. client # [ 1.237542] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 1.238770] Run /init as init process client # [ 1.250577] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.283740] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 1.285125] Run /init as init process client # [ 1.269434] fuse: init (API version 7.45) worker1 # [ 1.298183] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.301036] systemd[1]: Inserted module 'autofs4' client # [ 1.276300] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.278992] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.282418] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.284819] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.324712] fuse: init (API version 7.45) worker2 # [ 1.333308] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.336717] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.312376] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.341080] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.344224] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.380250] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.574497] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.580040] systemd[1]: Detected virtualization kvm. lb # [ 1.581005] systemd[1]: Detected architecture x86-64. lb # [ 1.581986] systemd[1]: Running in initrd. lb # [ 1.583280] systemd[1]: Initializing machine ID from random generator. lb # [ 1.584569] systemd[1]: Hostname set to . worker1 # [ 1.634383] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.639774] systemd[1]: Detected virtualization kvm. worker1 # [ 1.640770] systemd[1]: Detected architecture x86-64. worker1 # [ 1.641711] systemd[1]: Running in initrd. worker1 # [ 1.642912] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.644207] systemd[1]: Hostname set to . client # [ 1.648120] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.653407] systemd[1]: Detected virtualization kvm. client # [ 1.654333] systemd[1]: Detected architecture x86-64. client # [ 1.655254] systemd[1]: Running in initrd. client # [ 1.656477] systemd[1]: Initializing machine ID from random generator. client # [ 1.657764] systemd[1]: Hostname set to . worker2 # [ 1.716232] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.723311] systemd[1]: Detected virtualization kvm. worker2 # [ 1.725670] systemd[1]: Detected architecture x86-64. worker2 # [ 1.727920] systemd[1]: Running in initrd. worker2 # [ 1.730627] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.733669] systemd[1]: Hostname set to . lb # [ 1.784389] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.840685] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.850902] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.829756] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.834782] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.836159] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.837661] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.838865] systemd[1]: Reached target Path Units. lb # [ 1.839810] systemd[1]: Reached target Slice Units. lb # [ 1.840774] systemd[1]: Reached target Swaps. lb # [ 1.841607] systemd[1]: Reached target Timer Units. lb # [ 1.842707] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.844026] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.845337] systemd[1]: Listening on Journal Sockets. lb # [ 1.846444] systemd[1]: Listening on udev Control Socket. lb # [ 1.847533] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.848553] systemd[1]: Reached target Socket Units. lb # [ 1.851030] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.857187] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.883239] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.866446] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.888078] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.862334] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.889412] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.890978] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.892179] systemd[1]: Reached target Path Units. worker1 # [ 1.893138] systemd[1]: Reached target Slice Units. worker2 # [ 1.895075] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.894080] systemd[1]: Reached target Swaps. worker1 # [ 1.894926] systemd[1]: Reached target Timer Units. worker1 # [ 1.895992] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.899422] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.897432] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.898763] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.900721] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.899881] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.902170] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.900971] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.903319] systemd[1]: Reached target Path Units. worker1 # [ 1.901984] systemd[1]: Reached target Socket Units. worker2 # [ 1.904333] systemd[1]: Reached target Slice Units. worker2 # [ 1.905289] systemd[1]: Reached target Swaps. worker2 # [ 1.906144] systemd[1]: Reached target Timer Units. worker1 # [ 1.904206] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.907208] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.908468] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.909702] systemd[1]: Listening on Journal Sockets. lb # [ 1.887397] systemd[1]: Starting Journal Service... worker1 # [ 1.908550] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.910868] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.911931] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.912894] systemd[1]: Reached target Socket Units. worker2 # [ 1.915235] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.916800] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.920952] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.926514] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.905237] systemd[1]: Starting Load Kernel Modules... client # [ 1.906424] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.936565] systemd[1]: Starting Journal Service... client # [ 1.910645] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.911942] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.913476] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.914650] systemd[1]: Reached target Path Units. worker2 # [ 1.943099] systemd[1]: Starting Journal Service... client # [ 1.915579] systemd[1]: Reached target Slice Units. client # [ 1.916529] systemd[1]: Reached target Swaps. client # [ 1.917391] systemd[1]: Reached target Timer Units. client # [ 1.918446] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.919729] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.920941] systemd[1]: Listening on Journal Sockets. lb # [ 1.914317] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.921987] systemd[1]: Listening on udev Control Socket. client # [ 1.923206] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.929641] netfs: FS-Cache loaded client # [ 1.924234] systemd[1]: Reached target Socket Units. client # [ 1.926404] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.953574] systemd[1]: Starting Load Kernel Modules... lb # [ 1.935360] 9pnet: Installing 9P2000 support client # [ 1.932274] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.962963] systemd[1]: Starting Load Kernel Modules... client # [ 1.937812] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.948217] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.959593] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.966969] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.978515] netfs: FS-Cache loaded worker2 # [ 1.985616] netfs: FS-Cache loaded client # [ 1.957286] systemd[1]: Starting Journal Service... worker1 # [ 1.984336] 9pnet: Installing 9P2000 support lb # [ 1.965215] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.991976] 9pnet: Installing 9P2000 support lb # [ 1.972998] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.999843] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.975309] systemd[1]: Starting Load Kernel Modules... lb # [ 1.982676] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 2.005716] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.987678] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.993324] systemd-journald[67]: Collecting audit messages is disabled. lb # [ 1.996186] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 2.023701] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.982324] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 2.023628] systemd[1]: Finished Create List of Static Device Nodes. client # [ 2.000040] netfs: FS-Cache loaded lb # [ 2.004795] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 2.007940] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 2.031502] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 2.005994] 9pnet: Installing 9P2000 support worker1 # [ 2.034948] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 2.017423] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 2.041005] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 2.019135] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 2.044315] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 2.018297] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 2.047585] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 2.049560] systemd-journald[67]: Collecting audit messages is disabled. worker1 # [ 2.052254] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 2.055478] systemd-journald[67]: Collecting audit messages is disabled. worker2 # [ 2.057974] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 2.062178] systemd[1]: Finished Load Kernel Module configfs. client # [ 2.035895] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 2.064597] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 2.067468] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 2.044059] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 2.070313] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 2.077113] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 2.054811] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.079237] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 2.076519] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 2.054332] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 2.084518] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 2.059737] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 2.066030] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.087086] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 2.067439] systemd-journald[67]: Collecting audit messages is disabled. client # [ 2.069259] systemd[1]: Finished Load Kernel Module configfs. client # [ 2.075845] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 2.079011] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 2.086209] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 2.116959] systemd[1]: Finished Load Kernel Modules. client # [ 2.089314] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 2.098211] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 2.093225] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 2.125297] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.128963] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.137096] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.143054] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 2.125504] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.977168] systemd-modules-load[68]: Inserted module 'dm_mod' worker1 # [ 2.152785] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.979335] systemd-modules-load[68]: Inserted module 'virtio_balloon' lb # [ 2.133894] systemd[1]: Started Journal Service. client # [ 2.128881] systemd[1]: Finished Load Kernel Modules. lb # [ 1.982421] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 2.159992] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 2.139511] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.169880] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 2.002187] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.004724] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.009113] systemd[1]: Reached target Local File Systems. lb # [ 2.011125] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.187020] systemd[1]: Finished Apply Kernel Variables. client # [ 2.162283] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 2.016262] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.192404] systemd[1]: Started Journal Service. worker2 # [ 2.042220] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 2.043700] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 2.047223] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 2.198192] systemd[1]: Finished Apply Kernel Variables. client # [ 2.173314] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 2.035910] systemd-modules-load[68]: Inserted module 'dm_mod' worker1 # [ 2.041101] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 2.203823] systemd[1]: Started Journal Service. worker1 # [ 2.043364] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 2.067303] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.068516] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.069647] systemd[1]: Reached target Local File Systems. worker2 # [ 2.074113] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.064166] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.065343] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 2.066367] systemd[1]: Reached target Local File Systems. client # [ 2.201370] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.071164] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.083089] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.061905] systemd[1]: Finished Create System Files and Directories. client # [ 2.058479] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.210888] systemd[1]: Started Journal Service. client # client # [ 2.062361] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 2.079443] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.063631] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 2.081182] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.088520] systemd-udevd[83]: Using default interface naming scheme 'v261'. client # [ 2.085104] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.086248] systemd[1]: Reached target Local File Systems. client # [ 2.087702] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.117595] systemd[1]: Finished Create System Files and Directories. client # [ 2.095105] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.121110] systemd[1]: Finished Create System Files and Directories. lb # [ 2.117267] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.148416] systemd-udevd[82]: Using default interface naming scheme 'v261'. worker1 # [ 2.143365] systemd-udevd[83]: Using default interface naming scheme 'v261'. client # [ 2.137575] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.175465] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.170764] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.160247] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.162837] systemd[1]: Reached target System Initialization. lb # [ 2.163757] systemd[1]: Reached target Basic System. client # [ 2.163430] systemd-udevd[83]: Using default interface naming scheme 'v261'. client # [ 2.191506] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.221246] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.223209] systemd[1]: Reached target System Initialization. worker2 # [ 2.224135] systemd[1]: Reached target Basic System. worker1 # [ 2.217099] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.219424] systemd[1]: Reached target System Initialization. worker1 # [ 2.220460] systemd[1]: Reached target Basic System. client # [ 2.230193] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.231372] systemd[1]: Reached target System Initialization. client # [ 2.232321] systemd[1]: Reached target Basic System. worker1 # [ 2.589318] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.569587] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.576528] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 2.601773] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 2.583010] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.583831] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.588534] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.615299] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 2.618043] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.598338] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.599413] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.623227] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.603434] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.603027] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 2.612260] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.634296] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.633821] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.636980] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.639095] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.616344] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.611885] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.618060] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.620925] usb usb1: Product: EHCI Host Controller worker1 # [ 2.643379] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.624126] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker2 # [ 2.649910] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.626811] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.650740] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.629868] hub 1-0:1.0: USB hub found worker2 # [ 2.653976] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.632058] hub 1-0:1.0: 6 ports detected worker1 # [ 2.654826] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.655728] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.658696] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.638452] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.639526] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.663936] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.665036] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.636829] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.666893] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.666542] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.640462] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.669363] usb usb1: Product: EHCI Host Controller worker1 # [ 2.667606] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.670970] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker2 # [ 2.671769] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.670360] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.674524] hub 1-0:1.0: USB hub found worker1 # [ 2.673618] usb usb1: Product: EHCI Host Controller worker2 # [ 2.676240] hub 1-0:1.0: 6 ports detected worker1 # [ 2.674413] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd client # [ 2.648389] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.676287] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.678692] hub 1-0:1.0: USB hub found worker1 # [ 2.679307] hub 1-0:1.0: 6 ports detected lb # [ 2.659161] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.682682] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.686874] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.667447] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 worker2 # [ 2.690406] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.667440] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.698468] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.669456] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.696268] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.674542] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.679493] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.681241] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.708497] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 client # [ 2.682203] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.709560] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.683596] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.710814] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 client # [ 2.686763] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.688872] usb usb1: Product: EHCI Host Controller client # [ 2.692187] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd client # [ 2.693408] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.695326] hub 1-0:1.0: USB hub found worker2 # [ 2.723094] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.724601] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.697760] hub 1-0:1.0: 6 ports detected worker2 # [ 2.731582] SCSI subsystem initialized client # [ 2.703394] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.731129] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.706523] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.713130] usb usb2: Product: UHCI Host Controller client # [ 2.707888] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.711806] SCSI subsystem initialized lb # [ 2.722834] SCSI subsystem initialized worker2 # [ 2.746729] usb usb2: Product: UHCI Host Controller worker2 # [ 2.748093] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.725722] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.746600] SCSI subsystem initialized worker1 # [ 2.749913] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.726093] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 worker2 # [ 2.760363] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.738292] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.763822] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.736996] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.766478] usb usb2: Product: UHCI Host Controller worker2 # [ 2.772190] hub 2-0:1.0: USB hub found lb # [ 2.749627] hub 2-0:1.0: USB hub found worker2 # [ 2.623320] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.774715] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.603848] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.752298] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.606703] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.784895] hub 2-0:1.0: 2 ports detected worker1 # [ 2.621198] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.764155] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.613298] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.627343] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.640576] systemd[1]: Starting Virtual Console Setup... client # [ 2.766791] usb usb2: Product: UHCI Host Controller lb # [ 2.772492] hub 2-0:1.0: 2 ports detected lb # [ 2.621110] systemd[1]: Starting Virtual Console Setup... client # [ 2.775259] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.639405] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.642340] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.652418] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.654630] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.806675] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.809714] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.786263] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.791713] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.800122] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.800925] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.644715] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.823560] hub 2-0:1.0: USB hub found client # [ 2.647863] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.650073] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.655371] systemd[1]: Starting Virtual Console Setup... client # [ 2.808490] hub 2-0:1.0: USB hub found worker2 # [ 2.839551] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.840439] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.813058] hub 2-0:1.0: 2 ports detected worker1 # [ 2.842483] hub 2-0:1.0: 2 ports detected lb # [ 2.668760] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.692678] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.694780] systemd[1]: Finished Virtual Console Setup. lb # [ 2.672919] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.689423] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.695220] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.858930] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.836343] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.863152] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 lb # [ 2.843236] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker2 # [ 2.868909] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.870201] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.720808] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.850458] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.851908] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.722700] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.876226] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.851294] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.877282] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.852115] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.728112] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.882077] usb usb3: Product: UHCI Host Controller lb # [ 2.859166] usb usb3: Product: UHCI Host Controller lb # [ 2.859942] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.703791] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.706174] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.887862] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.712176] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.888749] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.713170] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.887281] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.867448] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.868306] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.892293] hub 3-0:1.0: USB hub found worker1 # [ 2.890627] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker2 # [ 2.893473] hub 3-0:1.0: 2 ports detected lb # [ 2.717181] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.872433] hub 3-0:1.0: USB hub found worker1 # [ 2.896548] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.898145] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.878122] hub 3-0:1.0: 2 ports detected client # [ 2.721266] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.738171] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.723166] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.739490] systemd[1]: Reached target Initrd Root Device. client # [ 2.875835] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.904964] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.876765] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker2 # [ 2.905770] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.883922] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.743091] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.728170] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.911482] usb usb3: Product: UHCI Host Controller lb # [ 2.891110] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.886117] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.915978] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.914541] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.915761] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.917871] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.889348] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.896142] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.897018] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 worker2 # [ 2.921164] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 worker1 # [ 2.920486] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.896214] usb usb3: Product: UHCI Host Controller client # [ 2.896957] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.923935] hub 3-0:1.0: USB hub found worker2 # [ 2.926812] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.776380] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.928310] hub 3-0:1.0: 2 ports detected client # [ 2.902241] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.908277] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.931888] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.758936] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.784439] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.909828] hub 3-0:1.0: USB hub found lb # [ 2.915351] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.916823] usb usb4: Product: UHCI Host Controller worker2 # [ 2.939789] usb usb4: Product: UHCI Host Controller client # [ 2.911474] hub 3-0:1.0: 2 ports detected worker2 # [ 2.940793] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.918129] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.919042] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.942686] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.941128] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.943915] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.942229] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.945489] hub 4-0:1.0: USB hub found lb # [ 2.770319] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.947386] hub 4-0:1.0: 2 ports detected worker2 # [ 2.948196] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.769461] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.953040] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.930627] hub 4-0:1.0: USB hub found lb # [ 2.931711] hub 4-0:1.0: 2 ports detected client # [ 2.774779] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.928237] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.929046] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.957410] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.933407] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.798293] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.935285] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.936661] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 lb # [ 2.943204] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.965037] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 lb # [ 2.944557] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.938660] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.940212] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.941316] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.970310] scsi host0: ahci worker1 # [ 2.806604] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.942833] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.943999] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.973249] scsi host1: ahci worker1 # [ 2.971395] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.946222] usb usb4: Product: UHCI Host Controller worker2 # [ 2.975559] scsi host2: ahci client # [ 2.947035] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.949338] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.975528] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.979552] scsi host3: ahci lb # [ 2.956743] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.952744] scsi host0: ahci worker1 # [ 2.978354] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.979987] usb usb4: Product: UHCI Host Controller client # [ 2.953936] hub 4-0:1.0: USB hub found lb # [ 2.807665] systemd[1]: Mounting /sysroot... worker2 # [ 2.983944] scsi host4: ahci worker1 # [ 2.981579] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.955745] scsi host1: ahci worker1 # [ 2.982895] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.958373] hub 4-0:1.0: 2 ports detected worker1 # [ 2.984724] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.985911] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.988473] scsi host5: ahci client # [ 2.960261] scsi host2: ahci worker1 # [ 2.987801] hub 4-0:1.0: USB hub found client # [ 2.962461] scsi host3: ahci worker1 # [ 2.989185] hub 4-0:1.0: 2 ports detected worker2 # [ 2.992067] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 client # [ 2.964758] scsi host4: ahci client # [ 2.966406] scsi host5: ahci client # [ 2.967056] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker2 # [ 2.999951] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 lb # [ 2.980173] scsi host0: ahci worker2 # [ 3.003169] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 worker2 # [ 3.005606] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 lb # [ 2.984138] scsi host1: ahci client # [ 2.978293] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker2 # [ 3.006910] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker2 # [ 3.008153] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 client # [ 2.984550] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 worker1 # [ 3.012000] scsi host0: ahci lb # [ 2.992779] scsi host2: ahci worker1 # [ 2.854100] systemd[1]: Mounting /sysroot... worker1 # [ 3.016587] scsi host1: ahci worker2 # [ 2.866183] systemd[1]: Mounting /sysroot... worker1 # [ 3.020184] scsi host2: ahci lb # [ 2.999202] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.993893] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 lb # [ 3.000417] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.995276] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 lb # [ 3.002978] usb 1-1: Product: QEMU USB Tablet lb # [ 3.003820] usb 1-1: Manufacturer: QEMU lb # [ 3.006887] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 3.002205] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 lb # [ 3.013720] scsi host3: ahci worker1 # [ 3.035768] scsi host3: ahci lb # [ 3.022865] scsi host4: ahci worker2 # [ 3.047716] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 3.046581] scsi host4: ahci worker2 # [ 3.048927] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 3.050293] usb 1-1: Product: QEMU USB Tablet worker2 # [ 3.051074] usb 1-1: Manufacturer: QEMU worker2 # [ 3.051659] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 3.030141] scsi host5: ahci lb # [ 3.030799] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker1 # [ 3.052493] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 3.053740] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 3.057474] usb 1-1: Product: QEMU USB Tablet client # [ 2.880499] systemd[1]: Mounting /sysroot... worker1 # [ 3.058262] usb 1-1: Manufacturer: QEMU worker1 # [ 3.060506] scsi host5: ahci lb # [ 3.040146] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker1 # [ 3.061184] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker2 # [ 3.066504] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 3.064488] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 3.043924] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 lb # [ 3.050200] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 lb # [ 3.056181] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 lb # [ 3.061104] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker1 # [ 3.086485] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 client # [ 3.072075] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 3.073400] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 3.099817] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 client # [ 3.074893] usb 1-1: Product: QEMU USB Tablet lb # [ 3.080590] hid: raw HID events driver (C) Jiri Kosina client # [ 3.075695] usb 1-1: Manufacturer: QEMU client # [ 3.076419] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 3.111473] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker1 # [ 3.119589] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 client # [ 3.096269] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 3.124460] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker1 # [ 3.148820] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 3.315338] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 3.316345] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 3.317567] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 3.318604] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 3.319737] ata3.00: applying bridge limits worker2 # [ 3.320592] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 3.321677] ata3.00: configured for UDMA/100 worker2 # [ 3.322855] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 3.326761] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 3.327706] ata6: SATA link down (SStatus 0 SControl 300) client # [ 3.314235] ata4: SATA link down (SStatus 0 SControl 300) client # [ 3.315358] ata2: SATA link down (SStatus 0 SControl 300) client # [ 3.316702] ata1: SATA link down (SStatus 0 SControl 300) client # [ 3.317822] ata6: SATA link down (SStatus 0 SControl 300) client # [ 3.318987] ata5: SATA link down (SStatus 0 SControl 300) client # [ 3.320006] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 3.321181] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 3.322089] ata3.00: applying bridge limits client # [ 3.323260] ata3.00: configured for UDMA/100 client # [ 3.324377] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 3.385202] usbcore: registered new interface driver usbhid worker2 # [ 3.390347] usbhid: USB HID core driver lb # [ 3.378465] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 3.400728] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.379492] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 3.380514] ata3.00: applying bridge limits lb # [ 3.381321] ata3.00: configured for UDMA/100 lb # [ 3.382219] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 3.383224] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 3.384222] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 3.385220] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 3.407657] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 3.386226] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 3.387494] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 3.384927] usbcore: registered new interface driver usbhid client # [ 3.389244] usbhid: USB HID core driver worker2 # [ 3.429056] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 3.408337] EXT4-fs (vda): mounted filesystem 6a2479e4-ad18-428d-84c1-8aa1abf45027 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.435650] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 3.261938] systemd[1]: Mounted /sysroot. worker2 # [ 3.440002] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.265258] systemd[1]: Reached target Initrd Root File System. client # [ 3.413655] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 3.442680] EXT4-fs (vda): mounted filesystem 5fd6ac4b-0f1e-4014-96b8-3efb70ce294f r/w with ordered data mode. Quota mode: none. worker1 # [ 3.444191] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 3.445191] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 3.294524] systemd[1]: Mounted /sysroot. lb # [ 3.271956] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.446357] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 3.447480] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 3.420600] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 3.448556] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 3.449425] ata3.00: applying bridge limits worker2 # [ 3.298689] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.450417] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 3.276700] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.451530] ata3.00: configured for UDMA/100 worker1 # [ 3.452899] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 3.302592] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.427576] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 3.284709] systemd[1]: Mounting /sysroot/run... client # [ 3.437569] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.443865] usbcore: registered new interface driver usbhid lb # [ 3.294197] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.449102] usbhid: USB HID core driver client # [ 3.442820] EXT4-fs (vda): mounted filesystem 224d6ce9-fd00-40c1-bc06-3685d99f74c7 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.474056] EXT4-fs (vda): mounted filesystem aa9f7eca-7407-4473-9e5a-cc243630f32b r/w with ordered data mode. Quota mode: none. client # [ 3.300319] systemd[1]: Mounted /sysroot. worker2 # [ 3.327553] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.301868] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.322359] systemd[1]: Mounted /sysroot. worker2 # [ 3.332248] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.310073] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.306767] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.334110] systemd[1]: Reloading... worker1 # [ 3.325342] systemd[1]: Reached target Initrd Root File System. lb # [ 3.466489] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.472408] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 3.332122] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.321087] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.477284] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 3.338106] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.483862] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 3.350096] systemd[1]: Mounting /sysroot/run... client # [ 3.332617] systemd-sysroot-fstab-check[141]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.337578] systemd[1]: Reload requested from client PID 141 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.341237] systemd[1]: Reloading... worker1 # [ 3.359246] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.523292] usbcore: registered new interface driver usbhid worker1 # [ 3.526897] usbhid: USB HID core driver worker1 # [ 3.373547] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.549121] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.377811] systemd-sysroot-fstab-check[146]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.557588] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 3.400895] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.564544] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 3.544853] 9p: Installing v9fs 9p2000 file system support worker1 # [ 3.576784] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.412853] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.416105] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.417102] systemd[1]: Mounted /sysroot/run. lb # [ 3.420285] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.421165] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.423457] systemd[1]: Reload requested from client PID 146 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.426072] systemd[1]: Reloading... worker2 # [ 3.450282] systemd[1]: Reloading finished in 118 ms. worker2 # [ 3.458667] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.464218] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... worker2 # [ 3.467743] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.469285] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.471195] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.623554] 9p: Installing v9fs 9p2000 file system support worker2 # [ 3.473526] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 3.463899] systemd-sysroot-fstab-check[145]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.475734] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.481119] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.466506] systemd[1]: Reloading finished in 125 ms. worker1 # [ 3.485159] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.485911] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.486692] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.475725] systemd-sysroot-fstab-check[141]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.494834] systemd[1]: Reload requested from client PID 145 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.497164] systemd[1]: Reloading... client # [ 3.481213] systemd-sysroot-fstab-check[141]: Requesting swap.target/start/replace... client # [ 3.484549] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.487104] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.488197] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.490634] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 3.510257] systemd[1]: Reloading finished in 84 ms. lb # [ 3.520550] systemd-sysroot-fstab-check[146]: Requesting initrd-fs.target/start/replace... lb # [ 3.528092] systemd-sysroot-fstab-check[146]: Requesting swap.target/start/replace... lb # [ 3.533229] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.534660] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.536238] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.538119] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.550351] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.552077] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.585976] systemd[1]: Reloading finished in 88 ms. worker1 # [ 3.594378] systemd-sysroot-fstab-check[145]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.599342] systemd-sysroot-fstab-check[145]: Requesting swap.target/start/replace... worker1 # [ 3.603823] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.604941] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.606123] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.609839] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.621216] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.622878] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.807380] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.835951] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.837891] systemd[1]: Reached target Initrd File Systems. lb # [ 3.841107] systemd[1]: Starting Find NixOS closure... worker1 # [ 3.854873] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.843897] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.869214] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.875957] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.885187] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.896377] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.875594] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.879490] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 3.882127] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.885238] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.890789] systemd[1]: Finished Find NixOS closure. worker1 # [ 3.903753] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.914242] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.892939] systemd[1]: Reached target Initrd Default Target. client # [ 3.890196] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.907205] systemd[1]: Reached target Initrd File Systems. lb # [ 3.895994] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.896240] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.912134] systemd[1]: Starting Find NixOS closure... worker1 # [ 3.915872] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.903223] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.915331] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.916459] systemd[1]: Stopped target Basic System. lb # [ 3.918056] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.918895] systemd[1]: Stopped target Path Units. lb # [ 3.919603] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 3.920775] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.922170] systemd[1]: Stopped target Slice Units. lb # [ 3.923527] systemd[1]: Stopped target Socket Units. lb # [ 3.924518] systemd[1]: Stopped target System Initialization. lb # [ 3.925662] systemd[1]: Stopped target Swaps. lb # [ 3.927117] systemd[1]: Stopped target Timer Units. lb # [ 3.927981] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.928856] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.929712] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.943172] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.931114] systemd[1]: Stopped Find NixOS closure. lb # [ 3.931839] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 3.946071] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.110163] 9p: Installing v9fs 9p2000 file system support lb # [ 3.934245] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.935198] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 3.937364] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.961680] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.938499] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.939814] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.940781] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.953741] systemd[1]: Finished Find NixOS closure. worker1 # [ 3.955420] systemd[1]: Reached target Initrd Default Target. lb # [ 3.943077] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.944217] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.957632] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.946111] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.969676] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.947065] systemd[1]: Stopped target Local File Systems. lb # [ 3.949566] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.097119] 9p: Installing v9fs 9p2000 file system support lb # [ 3.950532] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.951524] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.974890] systemd[1]: Mounted /sysroot/run. client # [ 3.948183] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.950816] systemd[1]: Mounted /sysroot/run. lb # [ 3.954301] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.955527] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.956571] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.979965] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.954985] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.983427] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.974049] systemd[1]: Stopped target Initrd Default Target. client # [ 3.958528] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.975597] systemd[1]: Stopped target Basic System. client # [ 3.959849] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.987783] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.978065] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 3.979106] systemd[1]: Stopped target Path Units. worker1 # [ 3.979993] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 3.967595] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.981522] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.966332] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.982854] systemd[1]: Stopped target Slice Units. worker1 # [ 3.983752] systemd[1]: Stopped target Socket Units. lb # [ 3.971064] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.984633] systemd[1]: Stopped target System Initialization. worker1 # [ 3.985602] systemd[1]: Stopped target Swaps. worker1 # [ 3.986745] systemd[1]: Stopped target Timer Units. lb # [ 3.974225] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.987717] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.975306] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.989150] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.990520] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.001418] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.991824] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.003228] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.993143] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 3.982183] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.995596] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.983464] systemd[1]: Closed udev Control Socket. client # [ 3.980594] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.997123] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 3.998448] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.982378] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.986399] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.999739] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.987345] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.985188] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.001578] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.989071] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.990035] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 4.003386] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.991202] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.992242] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.004964] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.994154] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.006558] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 3.995383] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.008105] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.010401] systemd[1]: Stopped target Local File Systems. lb # [ 3.998142] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.011615] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.013061] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.014614] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.017256] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.019086] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.020373] systemd[1]: Stopped Virtual Console Setup. client # [ 4.011824] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.013313] systemd[1]: Reached target Initrd File Systems. lb # [ 4.017774] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 4.015400] systemd[1]: Starting Find NixOS closure... lb # [ 4.020113] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.032866] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.021919] systemd[1]: Reached target Switch Root. lb # [ 4.023104] systemd[1]: Starting NixOS Activation... client # [ 4.019199] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.035860] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.041147] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.044068] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.047081] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 4.048441] systemd[1]: Closed udev Control Socket. worker1 # [ 4.050473] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.052159] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.053518] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.054552] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 4.056127] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.057437] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 4.042212] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.059155] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.060643] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.063165] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.052120] systemd[1]: Finished Find NixOS closure. client # [ 4.053734] systemd[1]: Reached target Initrd Default Target. client # [ 4.056272] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.082707] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.085095] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.086337] systemd[1]: Reached target Switch Root. worker1 # [ 4.088403] systemd[1]: Starting NixOS Activation... client # [ 4.076163] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 4.077963] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 4.081486] systemd[1]: Stopped target Initrd Default Target. client # [ 4.082528] systemd[1]: Stopped target Basic System. client # [ 4.084206] systemd[1]: Stopped target Initrd Root Device. client # [ 4.085101] systemd[1]: Stopped target Path Units. client # [ 4.085837] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.086977] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.089240] systemd[1]: Stopped target Slice Units. client # [ 4.090097] systemd[1]: Stopped target Socket Units. client # [ 4.090845] systemd[1]: Stopped target System Initialization. client # [ 4.091723] systemd[1]: Stopped target Swaps. client # [ 4.092462] systemd[1]: Stopped target Timer Units. client # [ 4.093533] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.094546] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.095937] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.097095] systemd[1]: Stopped Find NixOS closure. client # [ 4.098112] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 4.100187] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.101128] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.102152] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.103128] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.105161] systemd[1]: Stopped Load Kernel Modules. client # [ 4.105991] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.107209] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.108537] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.109783] systemd[1]: Stopped Create System Files and Directories. client # [ 4.111152] systemd[1]: Stopped target Local File Systems. client # [ 4.111989] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.113967] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.115605] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.116491] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 4.118163] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.119250] systemd[1]: Stopped Virtual Console Setup. client # [ 4.134451] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 4.139201] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 4.140449] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 4.141523] systemd[1]: Closed udev Control Socket. client # [ 4.145182] systemd[1]: Starting Cleanup udev Database... client # [ 4.146094] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 4.148182] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 4.149230] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 4.150481] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 4.151639] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 4.152751] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 4.155218] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.156708] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.177236] initrd-nixos-activation-start[199]: booting system configuration /nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test client # [ 4.176411] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 4.178408] systemd[1]: Finished Cleanup udev Database. client # [ 4.179991] systemd[1]: Reached target Switch Root. client # [ 4.182456] systemd[1]: Starting NixOS Activation... lb # [ 4.232385] initrd-nixos-activation-start[199]: running activation script... worker1 # [ 4.267245] initrd-nixos-activation-start[194]: booting system configuration /nix/store/8kpqmrhi2ysjv2lzzbs4kwkqigrnq7rp-nixos-system-worker1-test worker1 # [ 4.337437] initrd-nixos-activation-start[194]: running activation script... client # [ 4.352731] initrd-nixos-activation-start[195]: booting system configuration /nix/store/b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test client # [ 4.422169] initrd-nixos-activation-start[195]: running activation script... lb # [ 4.610446] initrd-nixos-activation-start[222]: setting up /etc... worker1 # [ 4.733825] initrd-nixos-activation-start[217]: setting up /etc... worker2 # [ 4.867307] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.852381] initrd-nixos-activation-start[218]: setting up /etc... lb # [ 4.858200] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.859586] systemd[1]: Finished NixOS Activation. lb # [ 4.860826] systemd[1]: Starting Switch Root... worker2 # [ 4.892169] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.893850] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.895969] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.898749] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.877662] systemd[1]: Switching root. worker2 # [ 4.923084] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.925177] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.934990] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.936434] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.938529] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.956167] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.957270] systemd[1]: Stopped target Basic System. worker2 # [ 4.959060] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.959874] systemd[1]: Stopped target Path Units. worker2 # [ 4.960617] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.961671] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.962926] systemd[1]: Stopped target Slice Units. worker2 # [ 4.963710] systemd[1]: Stopped target Socket Units. worker2 # [ 4.964694] systemd[1]: Stopped target System Initialization. worker2 # [ 4.965892] systemd[1]: Stopped target Swaps. worker2 # [ 4.967141] systemd[1]: Stopped target Timer Units. worker2 # [ 4.968127] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.969269] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.970375] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.971674] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.972773] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 4.975747] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.976700] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.978190] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.978936] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.980052] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.981128] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.983266] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.984584] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.985851] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.987123] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.987939] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.990224] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.991416] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.993107] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.982484] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.994150] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.984109] systemd[1]: Finished NixOS Activation. worker2 # [ 4.995790] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.985824] systemd[1]: Starting Switch Root... worker2 # [ 5.005259] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 5.007969] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.998969] systemd[1]: Switching root. worker2 # [ 5.016703] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 5.018230] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.020835] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.153284] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.023922] systemd[1]: Closed udev Control Socket. worker2 # [ 5.025298] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.026200] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 5.028152] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 5.029057] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 5.030162] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.031173] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 5.032141] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.033108] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.035487] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.056669] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 5.059076] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.059858] systemd[1]: Reached target Switch Root. worker2 # [ 5.061616] systemd[1]: Starting NixOS Activation... client # [ 5.098214] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.255599] NET: Registered PF_VSOCK protocol family client # [ 5.100095] systemd[1]: Finished NixOS Activation. client # [ 5.102152] systemd[1]: Starting Switch Root... worker1 # [ 5.291351] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). client # [ 5.117976] systemd[1]: Switching root. worker2 # [ 5.192264] initrd-nixos-activation-start[192]: booting system configuration /nix/store/740kgpv5n4wafyn7r0lx6yn52fgir5zj-nixos-system-worker2-test worker2 # [ 5.247451] initrd-nixos-activation-start[192]: running activation script... client # [ 5.400551] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.431029] NET: Registered PF_VSOCK protocol family client # [ 5.590933] NET: Registered PF_VSOCK protocol family lb # [ 5.628255] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.632475] systemd[1]: Detected virtualization kvm. lb # [ 5.633236] systemd[1]: Detected architecture x86-64. lb # [ 5.634093] systemd[1]: Detected first boot. lb # [ 5.637652] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.621060] initrd-nixos-activation-start[215]: setting up /etc... lb # [ 5.762593] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.831474] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.835597] systemd[1]: Detected virtualization kvm. worker1 # [ 5.836372] systemd[1]: Detected architecture x86-64. worker1 # [ 5.837226] systemd[1]: Detected first boot. worker1 # [ 5.840940] systemd[1]: Initializing machine ID from random generator. lb # [ 5.872465] systemd[1]: Applying preset policy. worker2 # [ 5.830048] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.831618] systemd[1]: Finished NixOS Activation. worker2 # [ 5.833783] systemd[1]: Starting Switch Root... client # [ 5.967797] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.971994] systemd[1]: Detected virtualization kvm. client # [ 5.972729] systemd[1]: Detected architecture x86-64. client # [ 5.973553] systemd[1]: Detected first boot. worker2 # [ 5.850346] systemd[1]: Switching root. client # [ 5.976979] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.082828] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.130185] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.195388] systemd[1]: Applying preset policy. lb # [ 6.196590] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.241455] NET: Registered PF_VSOCK protocol family client # [ 6.222449] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.330612] systemd[1]: Applying preset policy. worker1 # [ 6.583750] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.576539] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.577884] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.580744] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.582812] systemd[1]: Created slice Slice /system/getty. lb # [ 6.584183] systemd[1]: Created slice User and Session Slice. lb # [ 6.585135] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.586345] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.587485] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.588213] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.588945] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.589796] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.590529] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 6.591391] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 6.592273] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 6.593201] systemd[1]: Reached target Path Units. lb # [ 6.593909] systemd[1]: Reached target Remote File Systems. lb # [ 6.594727] systemd[1]: Reached target Slice Units. lb # [ 6.595431] systemd[1]: Reached target Swaps. lb # [ 6.609650] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.626331] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.612805] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.635026] systemd[1]: Detected virtualization kvm. worker2 # [ 6.636909] systemd[1]: Detected architecture x86-64. lb # [ 6.615115] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 6.638915] systemd[1]: Detected first boot. lb # [ 6.617696] systemd[1]: Listening on Factory Reset Management. lb # [ 6.618616] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.621871] systemd[1]: Starting Journal Log Access Socket... lb # [ 6.623365] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 6.645200] systemd[1]: Initializing machine ID from random generator. lb # [ 6.626308] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.627434] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.628898] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.630252] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.637231] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.638293] systemd[1]: Listening on udev Control Socket. lb # [ 6.639225] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.642256] systemd[1]: Mounting Huge Pages File System... lb # [ 6.645211] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 6.652000] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.658645] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.663335] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 6.667785] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 6.677159] systemd[1]: Starting Load Kernel Module configfs... lb # [ 6.678028] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.680578] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.696564] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.718417] systemd[1]: Mounting FUSE Control File System... lb # [ 6.722309] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.720500] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.736877] systemd[1]: Starting Journal Service... lb # [ 6.742835] systemd[1]: Starting Load Kernel Modules... lb # [ 6.752011] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.766522] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 6.774787] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.794617] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.797265] systemd-journald[292]: Collecting audit messages is enabled. lb # [ 6.820376] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.826365] systemd[1]: Mounted Huge Pages File System. lb # [ 6.832578] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.681326] systemd[1]: Queued start job for default target Multi-User System. lb # [ 6.685867] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.840282] systemd[1]: Started Journal Service. lb # [ 6.694701] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.851246] loop: module loaded lb # [ 6.700772] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.702900] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.704341] systemd-modules-load[293]: Inserted module 'loop' lb # [ 6.706689] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 6.709314] systemd[1]: Finished Load Kernel Module configfs. lb # [ 6.711249] systemd[1]: Mounted FUSE Control File System. lb # [ 6.866250] EXT4-fs (vda): re-mounted 6a2479e4-ad18-428d-84c1-8aa1abf45027. lb # [ 6.719201] systemd[1]: Finished Load Kernel Modules. worker2 # [ 6.896011] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.726108] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 6.735383] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 6.744070] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.747157] systemd[1]: Starting Firewall... lb # [ 6.757296] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.761065] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.765364] systemd-oomd[294]: No swap; memory pressure usage will be degraded lb # [ 6.780042] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 6.794076] systemd[1]: Starting Apply Kernel Variables... lb # [ 6.807341] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.808493] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.809700] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.005210] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 7.006748] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 7.010160] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 7.012626] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.014774] systemd[1]: Applying preset policy. lb # [ 6.992436] systemd-journald[292]: Received client request to flush runtime journal. worker1 # [ 7.014170] systemd[1]: Created slice User and Session Slice. worker1 # [ 7.015191] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 7.016558] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 7.017781] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 7.018566] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 7.019375] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 7.020296] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 7.021115] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 7.021939] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 7.022859] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 7.023818] systemd[1]: Reached target Path Units. worker1 # [ 7.024573] systemd[1]: Reached target Remote File Systems. worker1 # [ 7.025400] systemd[1]: Reached target Slice Units. worker1 # [ 7.026179] systemd[1]: Reached target Swaps. worker1 # [ 7.041660] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 7.045681] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 7.048460] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 7.051147] systemd[1]: Listening on Factory Reset Management. worker1 # [ 7.052134] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 7.056119] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.057748] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 7.061553] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.062853] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 7.064263] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.065662] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.073705] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 7.074830] systemd[1]: Listening on udev Control Socket. worker1 # [ 7.075802] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 7.079510] systemd[1]: Mounting Huge Pages File System... worker1 # [ 7.083122] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.090383] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 7.097602] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 7.106443] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.110816] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 7.121832] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 7.123318] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 7.126325] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.137092] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.145687] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 7.147184] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 7.175945] systemd[1]: Mounting FUSE Control File System... client # [ 7.150241] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 7.152493] systemd[1]: Created slice Slice /system/getty. client # [ 7.154002] systemd[1]: Created slice User and Session Slice. client # [ 7.155069] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 7.180467] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.156439] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 7.157698] systemd[1]: Expecting device /dev/hvc0... client # [ 7.158507] systemd[1]: Expecting device /dev/ttyS0... client # [ 7.159397] systemd[1]: Reached target Local Encrypted Volumes. client # [ 7.160357] systemd[1]: Stopped target initrd-fs.target. client # [ 7.161184] systemd[1]: Stopped target initrd-root-fs.target. client # [ 7.162056] systemd[1]: Stopped target initrd-switch-root.target. client # [ 7.163022] systemd[1]: Reached target Virtual Machines and Containers. client # [ 7.164050] systemd[1]: Reached target Path Units. client # [ 7.164832] systemd[1]: Reached target Remote File Systems. lb # [ 7.017681] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.165743] systemd[1]: Reached target Slice Units. lb # [ 7.021063] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 7.023258] systemd[1]: Reached target First Boot Complete. lb # [ 7.026536] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.201380] systemd[1]: Starting Journal Service... lb # [ 7.028165] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 7.030298] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 7.166531] systemd[1]: Reached target Swaps. lb # [ 7.032777] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 7.208784] systemd[1]: Starting Load Kernel Modules... client # [ 7.182234] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 7.185763] systemd[1]: Listening on Process Core Dump Socket. client # [ 7.188514] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 7.191177] systemd[1]: Listening on Factory Reset Management. worker1 # [ 7.218367] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 7.192194] systemd[1]: Listening on Hostname Service Socket. client # [ 7.196094] systemd[1]: Starting Journal Log Access Socket... client # [ 7.197791] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 7.224504] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.226522] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.200852] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 7.202619] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 7.204071] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.205593] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.233792] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 7.239287] systemd[1]: Listening on Journal Log Access Socket. client # [ 7.213338] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 7.214510] systemd[1]: Listening on udev Control Socket. worker1 # [ 7.241805] systemd[1]: Mounted Huge Pages File System. client # [ 7.215548] systemd[1]: Listening on udev Varlink Socket. lb # [ 7.068937] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.243983] systemd[1]: Mounted POSIX Message Queue File System. client # [ 7.219067] systemd[1]: Mounting Huge Pages File System... worker1 # [ 7.246510] systemd[1]: Mounted Kernel Debug File System. lb # [ 7.073178] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.248685] systemd[1]: Mounted Kernel Trace File System. client # [ 7.222232] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.251736] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 7.078276] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.255101] systemd[1]: Mounted FUSE Control File System. client # [ 7.229016] systemd[1]: Mounting Kernel Debug File System... client # [ 7.235262] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 7.262336] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.241831] systemd[1]: Starting Create List of Static Device Nodes... client # [ 7.244053] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 7.254453] systemd[1]: Starting Load Kernel Module configfs... client # [ 7.256352] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 7.284895] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 7.258987] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.287503] systemd[1]: Finished Load Kernel Module configfs. client # [ 7.265322] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.294699] systemd[1]: Mounting Kernel Configuration File System... client # [ 7.272475] systemd[1]: Mounting FUSE Control File System... client # [ 7.281188] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.322953] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.314215] systemd[1]: Starting Journal Service... worker1 # [ 7.342732] EXT4-fs (vda): re-mounted aa9f7eca-7407-4473-9e5a-cc243630f32b. lb # [ 7.168941] systemd-udevd[334]: Using default interface naming scheme 'v261'. worker1 # [ 7.354031] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 7.355890] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.358211] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.336702] systemd[1]: Starting Load Kernel Modules... worker1 # [ 7.368649] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.370506] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.373356] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.372014] systemd-journald[287]: Collecting audit messages is enabled. lb # [ 7.207266] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.363019] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 7.377369] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.404614] loop: module loaded client # [ 7.384536] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.412963] systemd[1]: Finished Load Kernel Modules. worker1 # [ 7.420123] systemd[1]: Starting Firewall... client # [ 7.397014] systemd-journald[288]: Collecting audit messages is enabled. worker1 # [ 7.424915] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 7.427668] systemd[1]: Started Journal Service. client # [ 7.402450] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 7.261517] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 7.272175] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 7.281063] systemd-modules-load[288]: Inserted module 'loop' lb # [ 7.274389] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 7.287348] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 7.433359] systemd[1]: Listening on Journal Log Access Socket. client # [ 7.287241] systemd[1]: Queued start job for default target Multi-User System. client # [ 7.290367] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 7.444991] systemd[1]: Started Journal Service. client # [ 7.299454] systemd[1]: Mounted Huge Pages File System. client # [ 7.300924] systemd[1]: Mounted POSIX Message Queue File System. client # [ 7.307109] systemd[1]: Mounted Kernel Debug File System. client # [ 7.307915] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.325168] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.313136] systemd[1]: Finished Create List of Static Device Nodes. client # [ 7.466891] loop: module loaded worker1 # [ 7.332454] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 7.316562] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 7.318789] systemd[1]: Finished Load Kernel Module configfs. client # [ 7.322189] systemd[1]: Mounted FUSE Control File System. client # [ 7.323669] systemd-modules-load[289]: Inserted module 'loop' client # [ 7.475664] EXT4-fs (vda): re-mounted 224d6ce9-fd00-40c1-bc06-3685d99f74c7. worker1 # [ 7.348787] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 7.350324] systemd[1]: Reached target First Boot Complete. client # [ 7.337398] systemd[1]: Finished Load Kernel Modules. client # [ 7.340348] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 7.349309] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 7.356110] systemd[1]: Mounting Kernel Configuration File System... client # [ 7.361223] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 7.377711] systemd-oomd[289]: No swap; memory pressure usage will be degraded client # [ 7.362264] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.543507] systemd-journald[287]: Received client request to flush runtime journal. client # [ 7.377566] systemd[1]: Starting Load/Save OS Random Seed... client # [ 7.391447] systemd-oomd[291]: No swap; memory pressure usage will be degraded client # [ 7.397389] systemd[1]: Starting Apply Kernel Variables... client # [ 7.410618] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.414095] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.412383] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.416178] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 7.428398] systemd[1]: Mounting /run/wrappers... client # [ 7.594022] systemd-journald[288]: Received client request to flush runtime journal. lb # [ 7.464168] systemd[1]: Mounted /run/wrappers. lb # [ 7.467947] systemd[1]: Reached target Local File Systems. lb # [ 7.472788] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.476553] systemd[1]: Starting register-nix-paths.service... lb # [ 7.482825] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 7.483950] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.496156] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 7.512441] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.535488] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.538634] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.540354] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.542143] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.543353] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.545178] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.570750] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 7.750177] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.751560] systemd[1]: Stopped initrd-switch-root.service. client # [ 7.573655] systemd[1]: Reached target First Boot Complete. worker1 # [ 7.590613] systemd-udevd[319]: Using default interface naming scheme 'v261'. client # [ 7.574643] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 7.754427] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 7.576206] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 7.756593] systemd[1]: Created slice Slice /system/getty. lb # [ 7.579802] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 7.758061] systemd[1]: Created slice User and Session Slice. client # [ 7.578573] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.579583] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 7.759008] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 7.580863] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 7.760252] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.761382] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.762140] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 7.762920] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.763730] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.764497] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.765327] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.766229] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.767202] systemd[1]: Reached target Path Units. worker2 # [ 7.767924] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.768736] systemd[1]: Reached target Slice Units. lb # [ 7.597585] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.769472] systemd[1]: Reached target Swaps. lb # [ 7.608215] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.784095] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.787115] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.789372] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.791827] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.792737] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.796373] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.797760] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.800401] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.802107] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.803507] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.804902] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.812029] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.813358] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.814363] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.818414] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.821908] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 7.828509] systemd[1]: Mounting Kernel Debug File System... client # [ 7.650850] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.654134] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 7.834138] systemd[1]: Mounting Kernel Trace File System... client # [ 7.657520] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.841042] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 7.669519] systemd[1]: Finished Create System Files and Directories. worker2 # [ 7.845321] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 7.858150] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 7.859469] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 7.684404] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 7.861652] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.863653] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.705948] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 7.871135] systemd[1]: Mounting FUSE Control File System... lb # [ 7.703446] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.881972] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.719987] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.705385] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.710663] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 7.737429] systemd-udevd[319]: Using default interface naming scheme 'v261'. worker2 # [ 7.918549] systemd[1]: Starting Journal Service... worker2 # [ 7.932518] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.949524] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.957572] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.959728] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.965859] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.970279] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.973169] systemd[1]: Mounted Huge Pages File System. lb # [ 7.798455] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.975974] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.977536] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.978997] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.981923] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 7.984165] systemd[1]: Mounted FUSE Control File System. worker2 # [ 7.990395] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.827400] (udev-worker)[374]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 7.847840] systemd[1]: Mounting /run/wrappers... client # [ 7.832754] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 8.020186] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 7.844958] (udev-worker)[374]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 8.022758] systemd[1]: Finished Load Kernel Module configfs. lb # [ 7.846837] (udev-worker)[367]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 8.028123] systemd[1]: Mounting Kernel Configuration File System... lb # [ 7.857163] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.868941] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.864507] systemd[1]: Starting Update is Completed... worker1 # [ 7.888891] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.890752] systemd[1]: Reached target Local File Systems. worker2 # [ 8.058313] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 7.896072] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.902978] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.905061] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.906129] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.072888] EXT4-fs (vda): re-mounted 5fd6ac4b-0f1e-4014-96b8-3efb70ce294f. worker1 # [ 7.911110] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.915425] systemd[1]: Starting Create System Files and Directories... worker2 # [ 8.079320] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.081972] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.083917] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.090538] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.092194] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.924295] systemd[1]: Finished Update is Completed. worker2 # [ 8.109734] systemd-journald[285]: Collecting audit messages is enabled. client # [ 7.929477] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 8.123022] loop: module loaded worker2 # [ 8.129590] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.136577] systemd[1]: Starting Firewall... worker2 # [ 8.144446] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 7.982382] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.988281] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 8.164555] systemd[1]: Started Journal Service. client # [ 7.986238] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 8.018861] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.024826] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 8.000665] systemd[1]: Mounting /run/wrappers... worker2 # [ 8.028375] systemd-modules-load[286]: Inserted module 'loop' worker2 # [ 8.033792] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 8.039596] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.045086] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.047916] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 8.024832] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 8.053570] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.056318] systemd[1]: Finished Create System Files and Directories. worker1 # [ 8.060081] systemd[1]: Starting Rebuild Journal Catalog... client # [ 8.045883] systemd[1]: Mounted /run/wrappers. worker1 # [ 8.064224] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.048304] systemd[1]: Reached target Local File Systems. client # [ 8.051969] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 8.057341] systemd[1]: Starting register-nix-paths.service... client # [ 8.063264] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 8.064361] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.096344] systemd-oomd[287]: No swap; memory pressure usage will be degraded client # [ 8.074476] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 8.108235] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 8.087321] systemd[1]: Starting Create System Files and Directories... worker2 # [ 8.272124] systemd-journald[285]: Received client request to flush runtime journal. client # [ 8.119393] (udev-worker)[322]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 8.128121] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 8.142326] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 8.130199] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.144737] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 8.132374] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.134835] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.133593] (udev-worker)[322]: Network interface NamePolicy= disabled on kernel command line. lb # [ 8.137156] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 8.139216] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.136881] (udev-worker)[331]: Network interface NamePolicy= disabled on kernel command line. lb # [ 8.141895] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.198255] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 8.202816] systemd[1]: Starting Update is Completed... lb # [ 8.216178] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.229967] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 8.219490] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.222410] systemd[1]: Finished Create System Files and Directories. client # [ 8.231937] systemd[1]: Starting Rebuild Journal Catalog... client # [ 8.237985] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.248904] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.265941] systemd[1]: Finished Update is Completed. client # [ 8.257749] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 8.426413] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 8.429867] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 8.305287] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 8.317187] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.448206] ACPI: button: Power Button [PWRF] worker2 # [ 8.319797] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.322530] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 8.324240] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 8.326304] systemd-udevd[317]: Using default interface naming scheme 'v261'. worker2 # [ 8.328035] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 8.309243] systemd[1]: Finished Firewall. worker1 # [ 8.330283] (udev-worker)[358]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 8.333884] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. client # [ 8.319465] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 8.362799] systemd[1]: Finished Rebuild Journal Catalog. client # [ 8.369720] systemd[1]: Starting Update is Completed... client # [ 8.405511] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 8.407956] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.438828] systemd[1]: Finished Coldplug All udev Devices. client # [ 8.412137] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 8.413603] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.443093] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 8.416090] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.418563] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.420540] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.429401] systemd[1]: Finished Update is Completed. lb # [ 8.464178] systemd[1]: Finished register-nix-paths.service. lb # [ 8.465082] systemd[1]: Reached target System Initialization. lb # [ 8.467070] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.468159] systemd[1]: Started niks3 garbage collection timer. lb # [ 8.469158] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 8.471149] systemd[1]: Reached target Timer Units. lb # [ 8.471899] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 8.480988] mousedev: PS/2 mouse device common for all mice lb # [ 8.554231] rtc_cmos 00:04: RTC can wake from S4 lb # [ 8.576965] rtc_cmos 00:04: registered as rtc0 lb # [ 8.587749] rtc_cmos 00:04: setting system clock to 2026-09-20T13:26:00 UTC (1789910760) lb # [ 8.477064] systemd[1]: Listening on niks3 server socket. lb # [ 8.477880] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.479880] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.481087] systemd[1]: Reached target Socket Units. lb # [ 8.481802] systemd[1]: Reached target Basic System. lb # [ 8.485071] systemd[1]: Started backdoor.service. lb # [ 8.492488] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 8.504074] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.587884] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 8.593874] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 lb # [ 8.600705] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.515984] systemd[1]: Starting Post-Boot Actions... lb # [ 8.527903] systemd[1]: Started Reset console on configuration changes. lb # [ 8.552528] systemd[1]: Starting resolvconf update... worker2 # [ 8.583108] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 8.584222] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.586281] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 8.576468] systemd[1]: Started rustfs.service. worker2 # [ 8.602544] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.592074] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 8.594762] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.597793] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 8.598750] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.600786] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.605088] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.600634] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.603508] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.739294] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.741025] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 8.607624] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.608894] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.600742] systemd[1]: Starting rustfs-bucket.service... lb # connecting to host... worker2 # [ 8.641715] systemd[1]: Mounted /run/wrappers. worker2 # [ 8.643251] systemd[1]: Reached target Local File Systems. client # [ 8.770296] ACPI: button: Power Button [PWRF] worker2 # [ 8.645776] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 8.650457] systemd[1]: Starting register-nix-paths.service... worker2 # [ 8.653934] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 8.655147] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.658797] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 8.667461] systemd[1]: Starting Create System Files and Directories... lb # [ 8.626908] Console: switching to colour dummy device 80x25 lb # [ 8.803913] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.803915] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.665545] nsncd[528]: Sep 20 13:26:00.739 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.672091] systemd[1]: Finished Post-Boot Actions. worker1 # [ 8.685925] systemd[1]: Finished Firewall. lb # [ 8.676621] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.701753] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.699719] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.704187] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.702212] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 8.860787] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.717262] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 8.740906] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 8.745397] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 8.893592] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 8.894548] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.749276] systemd[1]: Starting User Login Management... worker2 # [ 8.777088] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 8.754543] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 8.912678] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.937477] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.806585] mousedev: PS/2 mouse device common for all mice client # [ 8.883613] rtc_cmos 00:04: RTC can wake from S4 worker2 # [ 8.818110] systemd[1]: Finished Create System Files and Directories. worker2 # [ 8.823649] systemd[1]: Starting Rebuild Journal Catalog... client # [ 8.896210] rtc_cmos 00:04: registered as rtc0 client # [ 8.896325] rtc_cmos 00:04: setting system clock to 2026-09-20T13:26:00 UTC (1789910760) worker2 # [ 8.827875] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.896414] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 8.910789] parport_pc 00:02: reported by Plug and Play ACPI client # [ 8.910898] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 8.923375] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 client # [ 8.932031] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 8.940252] Console: switching to colour dummy device 80x25 worker2 # [ 8.890105] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 9.014942] [drm] Found bochs VGA, ID 0xb0c5. client # [ 9.014945] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 9.025371] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 8.901288] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.026062] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 9.033472] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 9.034492] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.919981] dbus-broker-launch[554]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.925364] dbus-broker-launch[554]: NSS returned no entry for 'systemd-timesync' lb # [ 8.926447] dbus-broker-launch[554]: Invalid user-name in /nix/store/0vgm8r903b3kyr8fcdjkv3g9zyy4h8rn-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 8.972313] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 8.951904] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 8.975468] systemd[1]: Starting Update is Completed... worker2 # [ 9.000474] (udev-worker)[363]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 9.004441] (udev-worker)[363]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 9.009863] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. client # [ 9.008664] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.044730] systemd[1]: Finished Update is Completed. worker1 # [ 8.953757] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 9.105298] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 8.967183] ACPI: button: Power Button [PWRF] worker1 # [ 9.000458] mousedev: PS/2 mouse device common for all mice worker1 # [ 9.095132] rtc_cmos 00:04: RTC can wake from S4 client # [ 9.105549] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 9.121324] rtc_cmos 00:04: registered as rtc0 worker1 # [ 9.122113] systemd-journald[287]: Time jumped backwards, rotating. worker1 # [ 9.126601] rtc_cmos 00:04: setting system clock to 2026-09-20T13:26:00 UTC (1789910760) client # [ 9.184416] Console: switching to colour frame buffer device 160x50 client # [ 9.242111] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 9.095899] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 9.098186] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.118074] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 9.119340] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.108527] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.126733] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 9.111354] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 9.152861] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 9.152961] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 9.202945] Console: switching to colour dummy device 80x25 lb # [ 9.111597] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 9.218204] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 9.324231] ppdev: user-space parallel port driver worker1 # [ 9.244183] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 worker1 # [ 9.359453] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 9.359592] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 9.259686] Console: switching to colour frame buffer device 160x50 worker1 # [ 9.401254] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 9.401256] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 9.423204] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 9.434821] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 9.436225] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 9.411765] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.442997] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 9.421938] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 8.979753] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 9.276805] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 9.284291] systemd[1]: Stopped target User and Group Name Lookups. client # [ 9.435665] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 9.287804] nsncd[613]: Sep 20 13:26:01.180 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.295113] systemd[1]: Stopping User and Group Name Lookups... lb # [ 9.298079] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.323407] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 9.301255] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 9.325279] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 9.304509] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 9.327538] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.330251] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 9.309589] network-addresses-eth1-start[638]: adding address 192.168.1.2/24... done worker2 # [ 9.333194] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 9.312381] dbus-broker-launch[554]: Ready worker2 # [ 9.335685] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 9.337788] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.316503] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 9.319225] systemd[1]: Finished resolvconf update. lb # [ 9.319972] systemd[1]: Reached target Preparation for Network. lb # [ 9.322730] systemd[1]: Starting DHCP Client... lb # [ 9.325973] systemd[1]: Starting Address configuration of eth1... client # [ 9.323157] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.327482] systemd[1]: Starting Extra networking commands.... client # [ 9.325644] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.330105] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.330943] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.333365] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.334603] systemd[1]: Starting Virtual Console Setup... lb # [ 9.339898] systemd-logind[557]: New seat seat0. client # [ 9.338041] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.365304] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 9.342573] systemd[1]: Started User Login Management. worker2 # [ 9.367205] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 9.344922] systemd-logind[557]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 9.347512] systemd[1]: Starting linger-users.service... lb # [ 9.352139] network-addresses-eth1-start[638]: adding address 2001:db8:1::2/64... done worker1 # [ 9.376707] systemd[1]: Starting Virtual Console Setup... lb # [ 9.366785] systemd-logind[557]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 9.378171] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.386528] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.399395] systemd[1]: Finished register-nix-paths.service. worker1 # [ 9.403956] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.406201] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.394546] systemd[1]: Finished Address configuration of eth1. worker1 # [ 9.410553] systemd[1]: Starting Virtual Console Setup... lb # [ 9.415211] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.442887] systemd[1]: Finished Firewall. client # [ 9.419923] systemd[1]: Finished register-nix-paths.service. client # [ 9.583236] kvm_amd: TSC scaling supported client # [ 9.583642] kvm_amd: Nested Virtualization enabled client # [ 9.584091] kvm_amd: Nested Paging enabled worker1 # [ 9.580248] Console: switching to colour frame buffer device 160x50 client # [ 9.584815] kvm_amd: LBR virtualization supported client # [ 9.585466] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 9.585962] kvm_amd: Virtual GIF supported client # [ 9.586568] kvm_amd: Virtual NMI enabled worker1 # [ 9.621844] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 9.450606] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 9.625346] ppdev: user-space parallel port driver lb # [ 9.456764] systemd[1]: Finished linger-users.service. worker2 # [ 9.645538] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 9.624668] EDAC MC: Ver: 3.0.0 worker1 # [ 9.672982] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 9.679371] ACPI: button: Power Button [PWRF] lb # [ 9.506900] dhcpcd[647]: dhcpcd-10.3.2 starting worker2 # [ 9.693713] mousedev: PS/2 mouse device common for all mice worker1 # [ 9.693317] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 9.521758] dhcpcd[708]: dev: loaded udev worker1 # [ 9.542792] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.544155] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.547317] systemd[1]: Starting Virtual Console Setup... lb # [ 9.545269] systemd[1]: Finished Extra networking commands.. lb # [ 9.548072] systemd[1]: Reached target Network. lb # [ 9.704216] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.704665] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 9.731647] rtc_cmos 00:04: RTC can wake from S4 lb # [ 9.558241] systemd[1]: Starting PostgreSQL Server... worker2 # [ 9.745341] rtc_cmos 00:04: registered as rtc0 lb # [ 9.570508] systemd[1]: Starting Permit User Sessions... worker2 # [ 9.750501] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 9.753163] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 9.755543] rtc_cmos 00:04: setting system clock to 2026-09-20T13:26:01 UTC (1789910761) worker2 # [ 9.758219] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 9.798838] kvm_amd: TSC scaling supported worker1 # [ 9.799312] kvm_amd: Nested Virtualization enabled lb # [ 9.778339] ppdev: user-space parallel port driver worker1 # [ 9.800184] kvm_amd: Nested Paging enabled worker1 # [ 9.800808] kvm_amd: LBR virtualization supported worker1 # [ 9.801299] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 9.802008] kvm_amd: Virtual GIF supported worker1 # [ 9.802572] kvm_amd: Virtual NMI enabled client # [ 9.636211] systemd-vconsole-setup[423]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 9.639699] systemd[1]: Finished Virtual Console Setup. client # [ 9.640764] systemd[1]: Reached target System Initialization. client # [ 9.642153] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 9.645831] systemd-logind[557]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 9.643259] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 9.644217] systemd[1]: Reached target Timer Units. client # [ 9.646009] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 9.646884] systemd[1]: Listening on Nix Daemon Socket. client # [ 9.647625] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 9.648737] systemd[1]: Reached target Socket Units. client # [ 9.650159] systemd[1]: Reached target Basic System. client # [ 9.652069] systemd[1]: Started backdoor.service. lb # [ 9.658780] systemd[1]: Finished Permit User Sessions. client # [ 9.656147] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 9.659192] systemd[1]: Starting nftables firewall... worker1 # [ 9.844923] EDAC MC: Ver: 3.0.0 lb # [ 9.674613] systemd[1]: Started Getty on tty1. client # [ 9.669869] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 9.676872] systemd[1]: Reached target Login Prompts. client # [ 9.674261] systemd[1]: Starting Post-Boot Actions... client # [ 9.685352] systemd[1]: Started Reset console on configuration changes. lb # [ 9.853784] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 9.706051] systemd[1]: Starting resolvconf update... worker2 # [ 9.772767] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 9.783443] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 client # connecting to host... worker2 # [ 9.802935] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 9.907993] Console: switching to colour dummy device 80x25 client # [ 9.761397] systemd[1]: Finished Post-Boot Actions. worker2 # [ 9.918526] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 9.918650] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 9.785676] nsncd[431]: Sep 20 13:26:01.538 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.943468] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 9.974431] [drm] Found bochs VGA, ID 0xb0c5. client # [ 9.790095] systemd[1]: Started Name Service Cache Daemon (nsncd). client: connected to guest root shell worker2 # [ 9.974434] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client: (connecting took 10.57 seconds) client # [ 9.797490] systemd[1]: Reached target Host and Network Name Lookups. client: (finished: waiting for the VM to finish booting, in 10.58 seconds) client # [ 9.799895] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 9.981641] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 9.803598] systemd[1]: Starting D-Bus System Message Bus... client # [ 9.817157] systemd[1]: Starting User Login Management... client # [ 9.820088] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 9.982366] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 10.016166] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 10.018048] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 9.861742] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.862817] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.883959] systemd-vconsole-setup[582]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.888074] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.889089] systemd[1]: Reached target System Initialization. worker1 # [ 9.890729] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 9.892172] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 9.894400] systemd[1]: Reached target Timer Units. worker1 # [ 9.895203] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 9.896205] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 9.899514] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 9.900686] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 9.901906] systemd[1]: Reached target Socket Units. worker1 # [ 9.902752] systemd[1]: Reached target Basic System. worker1 # [ 9.906714] systemd[1]: Started backdoor.service. lb # [ 9.896964] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.910066] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 9.913174] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.918086] systemd[1]: Starting Post-Boot Actions... lb # [ 10.064421] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 9.924083] systemd[1]: Started Reset console on configuration changes. worker1 # [ 9.929191] systemd[1]: Starting resolvconf update... worker1 # [ 9.939580] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 9.965393] systemd[1]: Starting Virtual Console Setup... lb # [ 9.942927] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 10.100842] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 10.103474] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 10.110003] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 10.110922] cfg80211: failed to load regulatory.db worker2 # [ 10.100711] Console: switching to colour frame buffer device 160x50 client # [ 9.963578] dbus-broker-launch[460]: Looking up NSS user entry for 'systemd-timesync'... client # [ 9.974210] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 9.975262] systemd[1]: Stopping Host and Network Name Lookups... client # [ 9.976095] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 10.156099] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 9.976892] systemd[1]: Stopping User and Group Name Lookups... client # [ 9.979286] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 9.987381] systemd[1]: nscd.service: Deactivated successfully. client # [ 9.989403] dbus-broker-launch[460]: NSS returned no entry for 'systemd-timesync' lb # [ 9.996287] postgresql-pre-start[733]: The files belonging to this database system will be owned by user "postgres". client # [ 9.991560] dbus-broker-launch[460]: Invalid user-name in /nix/store/i187syzbavbkjz7z897lklr60jwf2ymx-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 9.997643] postgresql-pre-start[733]: This user must also own the server process. worker1 # [ 10.012864] systemd[1]: Finished Post-Boot Actions. client # [ 9.996548] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 9.998841] systemd-logind[461]: New seat seat0. lb # [ 10.007777] postgresql-pre-start[733]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 10.009126] postgresql-pre-start[733]: The default database encoding has accordingly been set to "UTF8". lb # [ 10.010327] postgresql-pre-start[733]: The default text search configuration will be set to "english". lb # [ 10.012265] postgresql-pre-start[733]: Data page checksums are enabled. client # [ 10.008658] systemd-logind[461]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 10.013383] postgresql-pre-start[733]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok client # [ 10.011448] systemd-logind[461]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 10.015906] postgresql-pre-start[733]: creating subdirectories ... ok lb # [ 10.017104] postgresql-pre-start[733]: selecting dynamic shared memory implementation ... posix worker2 # [ 10.193938] ppdev: user-space parallel port driver client # [ 10.014279] systemd-logind[461]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 10.016436] systemd[1]: Started User Login Management. worker2 # [ 10.052620] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 10.054750] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 10.061256] systemd[1]: Starting Virtual Console Setup... worker1 # [ 10.050240] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.054141] systemd[1]: Reached target Host and Network Name Lookups. client # [ 10.039357] systemd[1]: Starting linger-users.service... worker1 # [ 10.056738] nsncd[589]: Sep 20 13:26:01.587 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.070422] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.060947] systemd[1]: Reached target User and Group Name Lookups. client # [ 10.045429] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # connecting to host... worker1 # [ 10.063201] systemd[1]: Starting User Login Management... client # [ 10.056370] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 10.075163] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 10.082992] dbus-broker-launch[460]: Ready worker2 # [ 10.265700] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 10.254385] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 10.105193] dhcpcd[708]: eth0: waiting for carrier worker1 # [ 10.121671] dbus-broker-launch[593]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 10.109726] dhcpcd[708]: libudev: received NULL device worker2 # [ 10.286473] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 10.111086] dhcpcd[708]: libudev: received NULL device lb # [ 10.113572] dhcpcd[708]: eth0: carrier acquired client # [ 10.112840] systemd[1]: Finished resolvconf update. client # [ 10.115855] systemd[1]: linger-users.service: Deactivated successfully. client # [ 10.117737] systemd[1]: Finished linger-users.service. worker1 # [ 10.136870] dbus-broker-launch[593]: NSS returned no entry for 'systemd-timesync' worker2 # [ 10.149571] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 10.137990] dbus-broker-launch[593]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 10.150895] systemd[1]: Stopped Virtual Console Setup. client # [ 10.125337] nsncd[528]: Sep 20 13:26:01.879 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.153568] systemd[1]: Starting Virtual Console Setup... lb # [ 10.130378] dhcpcd[708]: DUID 00:01:00:01:32:42:9b:6a:52:54:00:12:34:56 lb # [ 10.132466] dhcpcd[708]: eth0: IAID 00:12:34:56 client # [ 10.129964] systemd[1]: Starting DHCP Client... lb # [ 10.133738] dhcpcd[708]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 10.132142] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 10.133887] systemd[1]: Reached target Host and Network Name Lookups. client # [ 10.135540] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.162844] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 10.305676] kvm_amd: TSC scaling supported lb # [ 10.306343] kvm_amd: Nested Virtualization enabled worker1 # [ 10.165848] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 10.306893] kvm_amd: Nested Paging enabled worker1 # [ 10.168883] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 10.169913] systemd[1]: Stopping User and Group Name Lookups... lb # [ 10.312667] kvm_amd: LBR virtualization supported worker1 # [ 10.171843] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 10.313661] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 10.314688] kvm_amd: Virtual GIF supported worker1 # [ 10.174749] systemd[1]: nscd.service: Deactivated successfully. lb # [ 10.315798] kvm_amd: Virtual NMI enabled worker1 # [ 10.176178] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 10.183334] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.189754] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 10.195026] systemd-logind[612]: New seat seat0. worker1 # [ 10.201639] systemd-logind[612]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 10.203599] systemd-logind[612]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 10.205770] systemd-logind[612]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 10.209406] systemd[1]: Started User Login Management. worker1 # [ 10.213953] systemd[1]: Starting linger-users.service... worker2 # [ 10.396458] kvm_amd: TSC scaling supported lb # [ 10.220444] postgresql-pre-start[733]: selecting default "max_connections" ... 100 worker2 # [ 10.397039] kvm_amd: Nested Virtualization enabled worker2 # [ 10.397521] kvm_amd: Nested Paging enabled worker2 # [ 10.398307] kvm_amd: LBR virtualization supported worker2 # [ 10.398961] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 10.399419] kvm_amd: Virtual GIF supported worker2 # [ 10.400026] kvm_amd: Virtual NMI enabled worker1 # [ 10.251307] dbus-broker-launch[593]: Ready lb # [ 10.404637] EDAC MC: Ver: 3.0.0 worker1 # [ 10.267314] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.269358] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.271108] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.273145] nsncd[659]: Sep 20 13:26:01.810 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.442038] EDAC MC: Ver: 3.0.0 client # [ 10.262427] dhcpcd[558]: dhcpcd-10.3.2 starting worker1 # [ 10.282409] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 10.283886] systemd[1]: Finished linger-users.service. client # [ 10.270677] dhcpcd[568]: dev: loaded udev worker1 # [ 10.297336] systemd[1]: Finished resolvconf update. worker1 # [ 10.298090] systemd[1]: Reached target Preparation for Network. worker1 # [ 10.302140] systemd[1]: Starting DHCP Client... client # [ 10.441614] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 10.306860] systemd[1]: Starting Address configuration of eth1... worker1 # [ 10.309057] systemd[1]: Starting Extra networking commands.... client # [ 10.328071] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 10.357828] systemd-vconsole-setup[738]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 10.366246] systemd[1]: Finished Virtual Console Setup. lb # [ 10.373858] postgresql-pre-start[733]: selecting default "shared_buffers" ... 128MB client # [ 10.371264] systemd[1]: Finished nftables firewall. client # [ 10.372151] systemd[1]: Reached target Preparation for Network. client # [ 10.380891] systemd[1]: Starting Address configuration of eth1... client # [ 10.385767] systemd[1]: Starting Extra networking commands.... worker1 # [ 10.407833] network-addresses-eth1-start[689]: adding address 192.168.1.3/24... done worker1 # [ 10.423338] network-addresses-eth1-start[689]: adding address 2001:db8:1::3/64... done client # [ 10.566767] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 10.447267] systemd[1]: Finished Address configuration of eth1. client # [ 10.601391] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 10.602595] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 10.605964] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 10.606949] cfg80211: failed to load regulatory.db worker1 # [ 10.481707] dhcpcd[697]: dhcpcd-10.3.2 starting worker1 # [ 10.492361] dhcpcd[752]: dev: loaded udev client # [ 10.629672] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 10.495199] systemd[1]: Finished Extra networking commands.. worker1 # [ 10.497186] systemd[1]: Reached target Network. worker1 # [ 10.500786] systemd[1]: Starting Permit User Sessions... client # [ 10.495802] network-addresses-eth1-start[578]: adding address 192.168.1.1/24... done worker1 # [ 10.679797] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 10.680241] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 10.533634] systemd-vconsole-setup[521]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 10.538080] systemd[1]: Finished Virtual Console Setup. worker2 # [ 10.538854] systemd[1]: Reached target System Initialization. worker2 # [ 10.539900] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 10.513348] dhcpcd[596]: /nix/store/gz6c2i5x5b1lmdy71d4h3i8kd7nwnnl7-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (582) - Operation not permitted worker2 # [ 10.541134] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 10.515158] dhcpcd[596]: .resolvconf-wrapped: clearing stale lock pid 582 worker2 # [ 10.542029] systemd[1]: Reached target Timer Units. worker1 # [ 10.532297] systemd[1]: Finished Permit User Sessions. worker2 # [ 10.543932] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 10.516967] network-addresses-eth1-start[578]: adding address 2001:db8:1::1/64... done worker2 # [ 10.544869] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.536250] systemd[1]: Started Getty on tty1. worker2 # [ 10.547472] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 10.537747] systemd[1]: Reached target Login Prompts. worker2 # [ 10.548616] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 10.550158] systemd[1]: Reached target Socket Units. worker2 # [ 10.550864] systemd[1]: Reached target Basic System. worker2 # [ 10.554546] systemd[1]: Started backdoor.service. worker2 # [ 10.557554] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 10.562675] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 10.536462] systemd[1]: Finished Address configuration of eth1. worker1 # [ 10.552938] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 10.567173] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.575065] systemd[1]: Started Reset console on configuration changes. client # [ 10.701883] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 10.553248] dhcpcd[568]: eth0: waiting for carrier worker2 # [ 10.580289] systemd[1]: Starting resolvconf update... client # [ 10.554312] dhcpcd[568]: eth0: carrier acquired worker2 # [ 10.590983] systemd[1]: Starting D-Bus System Message Bus... client # [ 10.565777] dhcpcd[568]: DUID 00:01:00:01:32:42:9b:6a:52:54:00:12:34:56 client # [ 10.566673] dhcpcd[568]: eth0: IAID 00:12:34:56 client # [ 10.567340] dhcpcd[568]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 10.577475] systemd[1]: Finished Extra networking commands.. client # [ 10.579398] systemd[1]: Reached target Network. client # [ 10.582318] systemd[1]: Starting Permit User Sessions... worker1 # [ 10.773209] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 10.604482] systemd[1]: Finished Permit User Sessions. client # [ 10.608127] systemd[1]: Started Getty on tty1. client # [ 10.609132] systemd[1]: Reached target Login Prompts. worker1 # [ 10.801835] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 10.803243] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 10.806255] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 10.807104] cfg80211: failed to load regulatory.db worker2 # [ 10.658173] systemd[1]: Finished Post-Boot Actions. worker2 # [ 10.700263] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.703448] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 10.704385] systemd[1]: Reached target User and Group Name Lookups. worker2 # connecting to host... worker1 # [ 10.861032] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 10.709453] systemd[1]: Starting User Login Management... worker1 # [ 10.701057] dhcpcd[752]: eth0: waiting for carrier worker1 # [ 10.701793] dhcpcd[752]: eth0: carrier acquired worker2 # [ 10.711973] nsncd[528]: Sep 20 13:26:02.595 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.710404] dhcpcd[752]: DUID 00:01:00:01:32:42:9b:6a:52:54:00:12:34:56 worker1 # [ 10.711386] dhcpcd[752]: eth0: IAID 00:12:34:56 worker1 # [ 10.712118] dhcpcd[752]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 10.725517] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 10.774644] dbus-broker-launch[532]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 10.792311] dbus-broker-launch[532]: NSS returned no entry for 'systemd-timesync' worker2 # [ 10.794191] dbus-broker-launch[532]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 10.822754] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 10.825426] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 10.827180] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 10.831871] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 10.834354] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 10.835582] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 10.837450] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 10.843192] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.845314] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 10.851413] systemd-logind[551]: New seat seat0. worker2 # [ 10.859699] systemd-logind[551]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 10.862459] systemd-logind[551]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 10.864662] systemd-logind[551]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 10.868481] systemd[1]: Started User Login Management. worker2 # [ 10.875544] systemd[1]: Starting linger-users.service... worker2 # [ 10.896322] dbus-broker-launch[532]: Ready worker2 # [ 10.928158] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.930330] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 10.931621] nsncd[599]: Sep 20 13:26:02.826 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.934320] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.940761] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 10.942581] systemd[1]: Finished linger-users.service. worker2 # [ 10.956741] systemd[1]: Finished resolvconf update. worker2 # [ 10.958078] systemd[1]: Reached target Preparation for Network. worker2 # [ 10.963071] systemd[1]: Starting DHCP Client... worker2 # [ 10.966149] systemd[1]: Starting Address configuration of eth1... worker2 # [ 10.969228] systemd[1]: Starting Extra networking commands.... worker2 # [ 11.062818] network-addresses-eth1-start[628]: adding address 192.168.1.4/24... done worker2 # [ 11.080599] network-addresses-eth1-start[628]: adding address 2001:db8:1::4/64... done client: (finished: waiting for unit network-addresses-eth1.service, in 11.83 seconds) worker2 # [ 11.100683] systemd[1]: Finished Address configuration of eth1. client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2 # [ 11.139727] dhcpcd[636]: dhcpcd-10.3.2 starting worker2 # [ 11.147695] systemd[1]: Finished Extra networking commands.. worker2 # [ 11.149600] systemd[1]: Reached target Network. worker2 # [ 11.153460] systemd[1]: Starting Permit User Sessions... worker2 # [ 11.155074] dhcpcd[692]: dev: loaded udev worker2 # [ 11.330755] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 11.331357] 8021q: adding VLAN 0 to HW filter on device eth1 lb: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker2 # [ 11.186586] systemd[1]: Finished Permit User Sessions. worker2 # [ 11.191191] systemd[1]: Started Getty on tty1. worker2 # [ 11.192913] systemd[1]: Reached target Login Prompts. lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2 # [ 11.210712] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 11.420631] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker2 # [ 11.449643] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 11.450495] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 11.453838] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 11.454692] cfg80211: failed to load regulatory.db worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 11.299988] dhcpcd[752]: eth0: soliciting a DHCP lease worker1 # [ 11.474219] NET: Registered PF_PACKET protocol family worker1 # [ 11.316480] dhcpcd[752]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 11.318159] dhcpcd[752]: eth0: probing address 10.0.2.15/24 worker2 # [ 11.525686] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 11.374383] dhcpcd[692]: eth0: waiting for carrier worker2 # [ 11.375564] dhcpcd[692]: eth0: carrier acquired worker2 # [ 11.387652] dhcpcd[692]: DUID 00:01:00:01:32:42:9b:6b:52:54:00:12:34:56 worker2 # [ 11.388722] dhcpcd[692]: eth0: IAID 00:12:34:56 worker2 # [ 11.390240] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:3456 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit niks3.service worker2 # [ 11.861201] dhcpcd[692]: eth0: soliciting a DHCP lease worker2 # [ 12.040041] NET: Registered PF_PACKET protocol family lb # [ 11.864673] dhcpcd[708]: eth0: soliciting a DHCP lease worker2 # [ 11.895111] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 11.899395] dhcpcd[692]: eth0: probing address 10.0.2.15/24 lb # [ 12.032878] NET: Registered PF_PACKET protocol family lb # [ 11.883465] dhcpcd[708]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 11.886163] dhcpcd[708]: eth0: probing address 10.0.2.15/24 lb # [ 12.159490] postgresql-pre-start[733]: selecting default time zone ... UTC lb # [ 12.163993] postgresql-pre-start[733]: creating configuration files ... ok client # [ 12.365480] dhcpcd[568]: eth0: soliciting a DHCP lease client # [ 12.532871] NET: Registered PF_PACKET protocol family client # [ 12.385461] dhcpcd[568]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 12.388190] dhcpcd[568]: eth0: probing address 10.0.2.15/24 lb # [ 12.411382] postgresql-pre-start[733]: running bootstrap script ... ok lb # [ 12.418954] dhcpcd[708]: eth0: soliciting an IPv6 router lb # [ 12.420916] dhcpcd[708]: eth0: Router Advertisement from fe80::2 lb # [ 12.421750] dhcpcd[708]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 12.422575] dhcpcd[708]: eth0: adding route to fec0::/64 lb # [ 12.423281] dhcpcd[708]: eth0: adding default route via fe80::2 worker1 # [ 12.597475] dhcpcd[752]: eth0: soliciting an IPv6 router worker1 # [ 12.599195] dhcpcd[752]: eth0: Router Advertisement from fe80::2 worker1 # [ 12.600333] dhcpcd[752]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 12.601582] dhcpcd[752]: eth0: adding route to fec0::/64 worker1 # [ 12.602576] dhcpcd[752]: eth0: adding default route via fe80::2 lb # [ 13.012121] postgresql-pre-start[733]: performing post-bootstrap initialization ... ok lb # [ 13.153749] postgresql-pre-start[733]: syncing data to disk ... ok lb # [ 13.154698] postgresql-pre-start[733]: initdb: warning: enabling "trust" authentication for local connections lb # [ 13.155855] postgresql-pre-start[733]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 13.157615] postgresql-pre-start[733]: Success. You can now start the database server using: lb # [ 13.158604] postgresql-pre-start[733]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 13.298080] postgres[804]: [804] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 13.302694] postgres[804]: [804] LOG: listening on IPv6 address "::1", port 5432 lb # [ 13.303712] postgres[804]: [804] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 13.307288] postgres[804]: [804] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 13.319153] postgres[813]: [813] LOG: database system was shut down at 2026-09-20 13:26:05 GMT lb # [ 13.323571] postgres[804]: [804] LOG: database system is ready to accept connections lb # [ 13.327981] systemd[1]: Started PostgreSQL Server. lb # [ 13.334745] systemd[1]: Starting PostgreSQL Setup Scripts... client # [ 13.356940] dhcpcd[568]: eth0: soliciting an IPv6 router client # [ 13.358401] dhcpcd[568]: eth0: Router Advertisement from fe80::2 client # [ 13.359317] dhcpcd[568]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 13.360186] dhcpcd[568]: eth0: adding route to fec0::/64 client # [ 13.360906] dhcpcd[568]: eth0: adding default route via fe80::2 lb # [ 13.515963] postgresql-setup-start[824]: CREATE DATABASE lb # [ 13.568880] postgresql-setup-start[829]: CREATE ROLE lb # [ 13.598343] postgresql-setup-start[835]: ALTER DATABASE lb # [ 13.604742] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 13.606561] systemd[1]: Reached target PostgreSQL. worker2 # [ 14.067456] dhcpcd[692]: eth0: soliciting an IPv6 router worker2 # [ 14.068852] dhcpcd[692]: eth0: Router Advertisement from fe80::2 worker2 # [ 14.069703] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 14.070584] dhcpcd[692]: eth0: adding route to fec0::/64 worker2 # [ 14.071398] dhcpcd[692]: eth0: adding default route via fe80::2 worker1 # [ 16.006427] dhcpcd[752]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 16.007777] dhcpcd[752]: eth0: adding route to 10.0.2.0/24 worker1 # [ 16.009307] dhcpcd[752]: eth0: adding default route via 10.0.2.2 worker1 # [ 16.116794] systemd[1]: Started DHCP Client. worker1 # [ 16.119325] systemd[1]: Reached target Multi-User System. worker1 # [ 16.120615] systemd[1]: Startup finished in 1.049s (kernel) + 4.155s (initrd) + 10.915s (userspace) = 16.120s. worker2 # [ 16.595267] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 16.596278] dhcpcd[692]: eth0: adding route to 10.0.2.0/24 worker2 # [ 16.597224] dhcpcd[692]: eth0: adding default route via 10.0.2.2 lb # [ 16.576792] dhcpcd[708]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 16.578193] dhcpcd[708]: eth0: adding route to 10.0.2.0/24 lb # [ 16.579141] dhcpcd[708]: eth0: adding default route via 10.0.2.2 worker2 # [ 16.693659] systemd[1]: Started DHCP Client. worker2 # [ 16.695930] systemd[1]: Reached target Multi-User System. worker2 # [ 16.696994] systemd[1]: Startup finished in 1.138s (kernel) + 4.899s (initrd) + 10.658s (userspace) = 16.695s. lb # [ 16.685793] systemd[1]: Started DHCP Client. lb # [ 16.688725] systemd[1]: Reached target Network is Online. lb # [ 16.693577] systemd[1]: Started Envoy reverse proxy. lb # [ 16.698940] systemd[1]: Started mock-oidc.service. lb # [ 16.828524] mock-oidc-server[923]: Mock OIDC Server running lb # [ 16.829795] mock-oidc-server[923]: OIDC Address: 192.168.1.2:8080 lb # [ 16.831159] mock-oidc-server[923]: Issue Address: 0.0.0.0:8081 lb # [ 16.832803] mock-oidc-server[923]: Issuer: http://192.168.1.2:8080/oidc lb # [ 16.834165] mock-oidc-server[923]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 16.835743] mock-oidc-server[923]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 16.837878] mock-oidc-server[923]: Issue tokens: http://0.0.0.0:8081/issue?sub=... client # [ 17.161253] dhcpcd[568]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 17.162334] dhcpcd[568]: eth0: adding route to 10.0.2.0/24 client # [ 17.163524] dhcpcd[568]: eth0: adding default route via 10.0.2.2 client # [ 17.271150] systemd[1]: Started DHCP Client. client # [ 17.273482] systemd[1]: Reached target Multi-User System. client # [ 17.274672] systemd[1]: Startup finished in 1.091s (kernel) + 4.292s (initrd) + 11.890s (userspace) = 17.274s. lb # [ 17.404453] envoy[922]: [2026-09-20 13:26:09.479][922][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 17.407697] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 17.409668] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 17.412043] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 17.416355] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 17.436869] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 17.445758] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 17.448916] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 17.452169] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 17.455062] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 17.457254] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 17.460358] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 17.468531] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 17.470553] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 17.473920] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 17.475884] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 17.479055] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 17.481811] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 17.484477] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 17.487216] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 17.489058] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 17.496920] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 17.498784] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 17.503393] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 17.506110] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 17.510102] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 17.512574] envoy[922]: [2026-09-20 13:26:09.483][922][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 17.514408] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 17.516800] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 17.518878] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 17.522166] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 17.524609] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 17.526487] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 17.529429] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 17.532380] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 17.534216] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 17.539514] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 17.542134] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 17.544350] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 17.546723] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 17.549048] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 17.551099] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 17.553369] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 17.556927] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 17.558665] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 17.560254] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 17.561955] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 17.565091] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 17.566959] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 17.569151] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 17.573775] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 17.577221] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 17.580107] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 17.584205] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 17.586086] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 17.588437] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 17.591023] envoy[922]: [2026-09-20 13:26:09.502][922][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 17.593270] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 17.595820] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 17.597669] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 17.600154] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 17.601821] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 17.607205] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 17.609116] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 17.618785] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 17.625900] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 17.629702] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 17.631918] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 17.636821] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 17.639671] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 17.642313] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 17.644420] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 17.646542] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 17.648903] envoy[922]: [2026-09-20 13:26:09.503][922][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 17.652153] envoy[922]: [2026-09-20 13:26:09.504][922][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 17.656731] envoy[922]: [2026-09-20 13:26:09.504][922][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 17.659420] envoy[922]: [2026-09-20 13:26:09.504][922][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 17.661319] envoy[922]: [2026-09-20 13:26:09.504][922][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 17.663381] envoy[922]: [2026-09-20 13:26:09.504][922][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 17.665072] envoy[922]: [2026-09-20 13:26:09.504][922][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 17.668270] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 17.670436] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 17.672927] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 17.674489] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 17.676237] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 17.678149] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 17.680422] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 17.683143] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 17.685255] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 17.688506] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 17.690453] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 17.695531] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 17.707358] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 17.709305] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 17.711948] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 17.713890] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 17.715902] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 17.717597] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 17.720105] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 17.725730] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 17.728231] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 17.731421] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 17.733777] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 17.739659] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 17.746924] envoy[922]: [2026-09-20 13:26:09.505][922][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 17.748899] envoy[922]: [2026-09-20 13:26:09.506][922][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 17.777492] envoy[922]: [2026-09-20 13:26:09.718][922][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 17.779127] envoy[922]: [2026-09-20 13:26:09.766][922][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 17.793301] envoy[922]: [2026-09-20 13:26:09.766][922][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 17.795043] envoy[922]: [2026-09-20 13:26:09.766][922][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 17.803343] envoy[922]: [2026-09-20 13:26:09.766][922][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 17.854712] envoy[922]: [2026-09-20 13:26:09.930][922][info][main] [source/server/server.cc:968] runtime: {} lb # [ 17.864054] envoy[922]: [2026-09-20 13:26:09.939][922][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 17.867685] envoy[922]: [2026-09-20 13:26:09.943][922][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 17.871983] envoy[922]: [2026-09-20 13:26:09.947][922][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 17.876553] envoy[922]: [2026-09-20 13:26:09.952][922][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 17.879123] envoy[922]: [2026-09-20 13:26:09.954][922][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 17.881426] envoy[922]: [2026-09-20 13:26:09.954][922][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) worker1 # [ 17.979907] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 17.971611] envoy[922]: [2026-09-20 13:26:10.047][922][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 17.994324] systemd[1]: Reached target Network is Online. worker2 # [ 18.000396] systemd[1]: Starting scheduler-token.service... lb # [ 18.015723] envoy[922]: [2026-09-20 13:26:10.091][922][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 18.019699] envoy[922]: [2026-09-20 13:26:10.095][922][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 18.023971] envoy[922]: [2026-09-20 13:26:10.099][922][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 18.102116] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 18.103383] systemd[1]: Finished scheduler-token.service. worker2 # [ 18.104936] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 102ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 18.110421] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 18.195106] nix-grpc-daemon[846]: ts=2026-09-20T13:26:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 18.207905] nix-grpc-daemon[846]: ts=2026-09-20T13:26:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 18.214802] nix-grpc-daemon[846]: ts=2026-09-20T13:26:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 18.270097] nix-grpc-daemon[846]: ts=2026-09-20T13:26:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 18.281994] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 18.275378] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 18.290225] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 18.296603] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 18.346716] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 18.325426] envoy[922]: [2026-09-20 13:26:10.401][922][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker1 # [ 18.337644] nix-grpc-daemon[846]: ts=2026-09-20T13:26:09Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 18.328189] envoy[922]: [2026-09-20 13:26:10.404][922][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker2 # [ 18.353254] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 18.330506] envoy[922]: [2026-09-20 13:26:10.404][922][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 18.332737] envoy[922]: [2026-09-20 13:26:10.406][922][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 18.413386] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.426388] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.539084] nix-grpc-daemon[846]: ts=2026-09-20T13:26:10Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 18.629088] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.631727] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.832795] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.835272] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.939510] nix-grpc-daemon[846]: ts=2026-09-20T13:26:10Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 19.036515] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.039065] nix-grpc-daemon[786]: ts=2026-09-20T13:26:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.239897] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.242376] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.444586] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.446649] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.645764] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.648437] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.743189] nix-grpc-daemon[846]: ts=2026-09-20T13:26:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.746252] nix-grpc-daemon[846]: ts=2026-09-20T13:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.849344] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.851257] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.947126] nix-grpc-daemon[846]: ts=2026-09-20T13:26:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.949655] nix-grpc-daemon[846]: ts=2026-09-20T13:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.052264] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.054631] nix-grpc-daemon[786]: ts=2026-09-20T13:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.150348] nix-grpc-daemon[846]: ts=2026-09-20T13:26:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.152964] nix-grpc-daemon[846]: ts=2026-09-20T13:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.255838] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.258265] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.353763] nix-grpc-daemon[846]: ts=2026-09-20T13:26:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.356617] nix-grpc-daemon[846]: ts=2026-09-20T13:26:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.459272] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.461106] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.557265] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.559671] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.662130] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.664532] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.761113] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.763853] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.865298] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.867282] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.964827] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.967425] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.068668] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.072636] nix-grpc-daemon[786]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.168165] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.170477] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.273948] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.278688] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.371437] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.373960] nix-grpc-daemon[846]: ts=2026-09-20T13:26:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.479928] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.482256] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.574966] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.577902] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.682969] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.684942] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.779568] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.782279] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.886404] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.890474] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.983250] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.985838] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.091298] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.094498] nix-grpc-daemon[786]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.186757] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.189394] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.295440] nix-grpc-daemon[786]: ts=2026-09-20T13:26:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.300149] nix-grpc-daemon[786]: ts=2026-09-20T13:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.390099] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.392865] nix-grpc-daemon[846]: ts=2026-09-20T13:26:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.501120] nix-grpc-daemon[786]: ts=2026-09-20T13:26:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.503240] nix-grpc-daemon[786]: ts=2026-09-20T13:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.593537] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.595610] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.704504] nix-grpc-daemon[786]: ts=2026-09-20T13:26:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.706966] nix-grpc-daemon[786]: ts=2026-09-20T13:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.796530] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.798584] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.908359] nix-grpc-daemon[786]: ts=2026-09-20T13:26:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.911176] nix-grpc-daemon[786]: ts=2026-09-20T13:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.999347] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.001340] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.112562] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.115364] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.202068] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.204278] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.316397] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.318875] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.406585] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.409939] nix-grpc-daemon[846]: ts=2026-09-20T13:26:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.520708] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.523194] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.607422] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.609984] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.724290] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.726522] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.812781] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.816214] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.927561] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.929685] nix-grpc-daemon[786]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.014064] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.018486] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.130878] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.133722] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 24.114863] rustfs-bucket-start[1003]: mb s3://farm lb # [ 24.123603] systemd[1]: Finished rustfs-bucket.service. lb # [ 24.133078] systemd[1]: Starting niks3 server... worker1 # [ 24.219848] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.224337] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.334485] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.336503] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.424820] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.426830] nix-grpc-daemon[846]: ts=2026-09-20T13:26:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 24.501545] postgres[1022]: [1022] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 24.503619] postgres[1022]: [1022] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker2 # [ 24.538786] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.540760] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 24.569498] niks3-server[1013]: 2026/09/20 13:26:16 OK 20241026095416_initial_model.sql (35.66ms) lb # [ 24.577114] niks3-server[1013]: 2026/09/20 13:26:16 OK 20251210153512_drop_unused_gin_index.sql (4.25ms) lb # [ 24.585721] niks3-server[1013]: 2026/09/20 13:26:16 OK 20251218171726_add_pins.sql (8.69ms) lb # [ 24.597313] niks3-server[1013]: 2026/09/20 13:26:16 OK 20260628120000_add_object_size_and_stats.sql (9.78ms) lb # [ 24.605059] niks3-server[1013]: 2026/09/20 13:26:16 OK 20260905000000_add_claims.sql (5.53ms) lb # [ 24.613217] niks3-server[1013]: 2026/09/20 13:26:16 OK 20260920000000_drop_claims.sql (7.94ms) worker1 # [ 24.627780] nix-grpc-daemon[846]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 lb # [ 24.614938] niks3-server[1013]: 2026/09/20 13:26:16 goose: successfully migrated database to version: 20260920000000 worker1 # [ 24.630620] nix-grpc-daemon[846]: ts=2026-09-20T13:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 24.624941] niks3-server[1013]: 2026/09/20 13:26:16 OK 1_commit_pending_closure.sql (11.89ms) lb # [ 24.628246] niks3-server[1013]: 2026/09/20 13:26:16 OK 2_object_stats_trigger.sql (1.76ms) lb # [ 24.629665] niks3-server[1013]: 2026/09/20 13:26:16 goose: up to current file version: 2 lb # [ 24.637134] niks3-server[1013]: 2026/09/20 13:26:16 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key worker2 # [ 24.739909] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.741867] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 24.729776] niks3-server[1013]: 2026/09/20 13:26:16 INFO Read proxy enabled — serving cache objects from S3 lb # [ 24.732108] niks3-server[1013]: 2026/09/20 13:26:16 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 24.737988] niks3-server[1013]: 2026/09/20 13:26:16 INFO systemd watchdog enabled interval=15s lb # [ 24.740291] systemd[1]: Started niks3 server. lb # [ 24.743272] niks3-server[1013]: 2026/09/20 13:26:16 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 24.745200] systemd[1]: Reached target Multi-User System. lb # [ 24.746948] systemd[1]: Startup finished in 1.014s (kernel) + 4.045s (initrd) + 19.687s (userspace) = 24.746s. lb # [ 24.755228] niks3-server[1013]: 2026/09/20 13:26:16 INFO lead: acquired remote=192.168.1.4:51892 worker2 # [ 24.784407] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_take_over worker1 # [ 24.832367] nix-grpc-daemon[846]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.834733] nix-grpc-daemon[846]: ts=2026-09-20T13:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.942679] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.944732] nix-grpc-daemon[786]: ts=2026-09-20T13:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.035840] nix-grpc-daemon[846]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.038419] nix-grpc-daemon[846]: ts=2026-09-20T13:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.145649] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.147679] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.239214] nix-grpc-daemon[846]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.242095] nix-grpc-daemon[846]: ts=2026-09-20T13:26:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.349086] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.351697] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.443057] nix-grpc-daemon[846]: ts=2026-09-20T13:26:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.466914] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:43258 worker2 # [ 25.469928] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: waiting for unit niks3.service, in 14.13 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 25.553415] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.575129] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 25.578254] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:43258 worker2 # [ 25.580966] nix-grpc-daemon[786]: ts=2026-09-20T13:26:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.05 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 25.684706] envoy[922]: conn peer=[::1]:32988 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=4 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker2 # [ 25.832357] systemd[1]: Starting scheduler-token.service... worker2 # [ 25.902385] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 25.904398] systemd[1]: Finished scheduler-token.service. worker2 # [ 25.906419] systemd[1]: scheduler-token.service: Consumed 25ms CPU time over 72ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.08 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.72 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 27.019221] nix-grpc-daemon[846]: ts=2026-09-20T13:26:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 27.026218] systemd[1]: Started Nix Daemon. worker1 # [ 27.249700] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 27.305253] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 1/5) worker1 # [ 27.357102] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 2/5) worker1 # [ 27.446356] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 391 ms (attempt 3/5) worker1 # [ 27.840845] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 295 ms (attempt 4/5) worker1 # [ 28.145389] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 28.190413] nix-grpc-daemon[786]: ts=2026-09-20T13:26:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 28.199963] systemd[1]: Started Nix Daemon. worker2 # [ 28.438598] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 28.476094] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 1/5) worker2 # [ 28.507460] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 2/5) worker2 # [ 28.546831] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 300 ms (attempt 3/5) worker2 # [ 28.850404] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 380 ms (attempt 4/5) worker2 # [ 29.237138] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 29.254956] nix-grpc-daemon[786]: ts=2026-09-20T13:26:21Z level=debug event=path_info_miss path=b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test error="error: path '/nix/store/b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 29.263772] nix-grpc-daemon[786]: ts=2026-09-20T13:26:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 29.272566] nix-grpc-daemon[786]: ts=2026-09-20T13:26:21Z level=debug event=path_info_miss path=b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test error="error: path '/nix/store/b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.07 seconds) client: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds) worker1 # [ 29.604121] nix-grpc-daemon[846]: ts=2026-09-20T13:26:21Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 29.606477] nix-grpc-daemon[846]: ts=2026-09-20T13:26:21Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:50624 worker1 # [ 29.616955] nix-grpc-daemon[846]: ts=2026-09-20T13:26:21Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:50624 worker1 # [ 29.633725] nix-grpc-daemon[846]: ts=2026-09-20T13:26:21Z level=debug event=path_info_miss path=b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test error="error: path '/nix/store/b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 29.650281] nix-grpc-daemon[786]: ts=2026-09-20T13:26:21Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:43270 worker2 # [ 29.655907] nix-grpc-daemon[786]: ts=2026-09-20T13:26:21Z level=debug event=path_info_miss path=b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test error="error: path '/nix/store/b3f8wnb0cc9m2wvhfvwcdmiwfsmpklab-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker1 # [ 29.899660] nix-grpc-daemon[846]: ts=2026-09-20T13:26:21Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 30.111615] nix-grpc-daemon[846]: ts=2026-09-20T13:26:21Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.44 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 worker2 # [ 30.360771] nix-grpc-daemon[786]: ts=2026-09-20T13:26:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43270 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 30.370981] nix-grpc-daemon[846]: ts=2026-09-20T13:26:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker2 # [ 30.427263] nix-grpc-daemon[786]: ts=2026-09-20T13:26:22Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 30.432349] nix-grpc-daemon[786]: ts=2026-09-20T13:26:22Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 30.473478] nix-grpc-daemon[846]: ts=2026-09-20T13:26:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 30.495661] nix-grpc-daemon[846]: ts=2026-09-20T13:26:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 client # copying 1 paths to 'lb:50051'... worker1 # [ 30.509472] nix-grpc-daemon[846]: ts=2026-09-20T13:26:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 30.536318] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 30.558064] nix-grpc-daemon[846]: ts=2026-09-20T13:26:22Z level=info event=niks3_push_started pid=916 worker1 # [ 30.844958] nix-grpc-daemon[916]: time=2026-09-20T13:26:22.381Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca="" worker1 # [ 31.060719] nix-daemon[906]: accepted connection from pid 929, user nix-grpc-daemon (trusted) worker1 # [ 31.078697] nix-daemon[906]: reaped child process 932, status = succeeded worker1 # [ 31.227276] nix-daemon[906]: accepted connection from pid 934, user nix-grpc-daemon (trusted) worker1 # [ 31.240695] nix-daemon[906]: reaped child process 937, status = succeeded lb # [ 31.239964] niks3-server[1013]: 2026/09/20 13:26:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 31.270123] nix-grpc-daemon[916]: time=2026-09-20T13:26:22.810Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 31.272414] nix-grpc-daemon[916]: time=2026-09-20T13:26:22.812Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 31.287299] niks3-server[1013]: 2026/09/20 13:26:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 31.301114] niks3-server[1013]: 2026/09/20 13:26:23 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 31.314069] niks3-server[1013]: 2026/09/20 13:26:23 INFO Signed narinfos id=1 count=1 worker1 # [ 31.328822] nix-grpc-daemon[916]: time=2026-09-20T13:26:22.868Z level=INFO msg="Uploading 1 narinfos" lb # [ 31.325124] niks3-server[1013]: 2026/09/20 13:26:23 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 31.330870] niks3-server[1013]: 2026/09/20 13:26:23 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 31.340594] niks3-server[1013]: 2026/09/20 13:26:23 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo lb # [ 31.352406] niks3-server[1013]: 2026/09/20 13:26:23 INFO Completed upload id=1 worker1 # [ 31.365238] nix-grpc-daemon[916]: time=2026-09-20T13:26:22.905Z level=INFO msg="Upload complete. (492ms)" worker1 # [ 31.368363] nix-grpc-daemon[846]: ts=2026-09-20T13:26:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 31.371722] nix-grpc-daemon[846]: ts=2026-09-20T13:26:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 31.380201] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 31.381752] nix-daemon[906]: reaped child process 914, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... worker1 # [ 31.387934] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> LOG-farm-a-t1 worker1 # [ 32.603543] nix-daemon[906]: reaped child process 941, status = succeeded worker1 # [ 32.750168] nix-daemon[906]: accepted connection from pid 957, user nix-grpc-daemon (trusted) worker1 # [ 32.763698] nix-daemon[906]: reaped child process 960, status = succeeded lb # [ 32.767588] niks3-server[1013]: 2026/09/20 13:26:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 32.790925] nix-grpc-daemon[916]: time=2026-09-20T13:26:24.330Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 32.792766] nix-grpc-daemon[916]: time=2026-09-20T13:26:24.332Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 32.804530] niks3-server[1013]: 2026/09/20 13:26:24 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 32.809730] niks3-server[1013]: 2026/09/20 13:26:24 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 32.814714] niks3-server[1013]: 2026/09/20 13:26:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 32.817937] niks3-server[1013]: 2026/09/20 13:26:24 INFO Signed narinfos id=2 count=1 worker1 # [ 32.831274] nix-grpc-daemon[916]: time=2026-09-20T13:26:24.370Z level=INFO msg="Uploading 1 narinfos" lb # [ 32.820935] niks3-server[1013]: 2026/09/20 13:26:24 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 32.830300] niks3-server[1013]: 2026/09/20 13:26:24 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 32.833738] niks3-server[1013]: 2026/09/20 13:26:24 INFO Completed upload id=2 worker1 # [ 32.846577] nix-grpc-daemon[916]: time=2026-09-20T13:26:24.386Z level=INFO msg="Upload complete. (249ms)" lb # [ 32.835556] niks3-server[1013]: 2026/09/20 13:26:24 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker1 # [ 32.850379] nix-grpc-daemon[846]: ts=2026-09-20T13:26:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 32.857091] nix-daemon[906]: reaped child process 939, status = succeeded worker2 # [ 32.873344] nix-grpc-daemon[786]: ts=2026-09-20T13:26:24Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 32.875096] nix-grpc-daemon[786]: ts=2026-09-20T13:26:24Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 32.906862] nix-grpc-daemon[846]: ts=2026-09-20T13:26:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 32.916085] nix-grpc-daemon[846]: ts=2026-09-20T13:26:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 32.941980] nix-grpc-daemon[916]: time=2026-09-20T13:26:24.481Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 32.947324] nix-grpc-daemon[846]: ts=2026-09-20T13:26:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 32.953074] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 33.119334] nix-daemon[906]: accepted connection from pid 964, user nix-grpc-daemon (trusted) worker1 # [ 33.139734] nix-daemon[906]: reaped child process 967, status = succeeded worker1 # [ 33.294344] nix-daemon[906]: accepted connection from pid 970, user nix-grpc-daemon (trusted) worker1 # [ 33.307177] nix-daemon[906]: reaped child process 973, status = succeeded lb # [ 33.308776] niks3-server[1013]: 2026/09/20 13:26:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 33.336359] nix-grpc-daemon[916]: time=2026-09-20T13:26:24.876Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 33.337884] nix-grpc-daemon[916]: time=2026-09-20T13:26:24.877Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 33.353452] niks3-server[1013]: 2026/09/20 13:26:25 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 33.366454] niks3-server[1013]: 2026/09/20 13:26:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 33.372361] niks3-server[1013]: 2026/09/20 13:26:25 INFO Signed narinfos id=3 count=1 worker1 # [ 33.387903] nix-grpc-daemon[916]: time=2026-09-20T13:26:24.927Z level=INFO msg="Uploading 1 narinfos" lb # [ 33.378354] niks3-server[1013]: 2026/09/20 13:26:25 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 33.390287] niks3-server[1013]: 2026/09/20 13:26:25 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 33.397760] niks3-server[1013]: 2026/09/20 13:26:25 INFO Completed upload id=3 worker1 # [ 33.410829] nix-grpc-daemon[916]: time=2026-09-20T13:26:24.950Z level=INFO msg="Upload complete. (450ms)" lb # [ 33.399884] niks3-server[1013]: 2026/09/20 13:26:25 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 33.415696] nix-grpc-daemon[846]: ts=2026-09-20T13:26:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 33.422537] nix-grpc-daemon[846]: ts=2026-09-20T13:26:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 33.432153] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 33.441800] nix-daemon[906]: reaped child process 962, status = succeeded client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker1 # [ 33.452589] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-t1 worker1 # [ 34.669214] nix-daemon[906]: reaped child process 977, status = succeeded worker1 # [ 34.817087] nix-daemon[906]: accepted connection from pid 992, user nix-grpc-daemon (trusted) worker1 # [ 34.829641] nix-daemon[906]: reaped child process 995, status = succeeded lb # [ 34.832941] niks3-server[1013]: 2026/09/20 13:26:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 34.862256] nix-grpc-daemon[916]: time=2026-09-20T13:26:26.401Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 34.864858] nix-grpc-daemon[916]: time=2026-09-20T13:26:26.403Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 34.878965] niks3-server[1013]: 2026/09/20 13:26:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 34.883075] niks3-server[1013]: 2026/09/20 13:26:26 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 34.886915] niks3-server[1013]: 2026/09/20 13:26:26 INFO Signed narinfos id=4 count=1 worker1 # [ 34.899643] nix-grpc-daemon[916]: time=2026-09-20T13:26:26.439Z level=INFO msg="Uploading 1 narinfos" lb # [ 34.891374] niks3-server[1013]: 2026/09/20 13:26:26 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 34.895072] niks3-server[1013]: 2026/09/20 13:26:26 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 34.897263] niks3-server[1013]: 2026/09/20 13:26:26 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 34.905556] niks3-server[1013]: 2026/09/20 13:26:26 INFO Completed upload id=4 worker1 # [ 34.918342] nix-grpc-daemon[916]: time=2026-09-20T13:26:26.458Z level=INFO msg="Upload complete. (259ms)" lb # [ 34.906847] niks3-server[1013]: 2026/09/20 13:26:26 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker1 # [ 34.922175] nix-grpc-daemon[846]: ts=2026-09-20T13:26:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker1 # [ 34.928416] nix-daemon[906]: reaped child process 975, status = succeeded worker2 # [ 34.940356] nix-grpc-daemon[786]: ts=2026-09-20T13:26:26Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 34.942303] nix-grpc-daemon[786]: ts=2026-09-20T13:26:26Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 34.975595] nix-grpc-daemon[846]: ts=2026-09-20T13:26:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 34.984689] nix-grpc-daemon[846]: ts=2026-09-20T13:26:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 34.994961] nix-grpc-daemon[916]: time=2026-09-20T13:26:26.534Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 35.002865] nix-grpc-daemon[846]: ts=2026-09-20T13:26:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 35.013185] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 35.193280] nix-daemon[906]: accepted connection from pid 999, user nix-grpc-daemon (trusted) worker1 # [ 35.208893] nix-daemon[906]: reaped child process 1002, status = succeeded worker1 # [ 35.357146] nix-daemon[906]: accepted connection from pid 1004, user nix-grpc-daemon (trusted) worker1 # [ 35.371668] nix-daemon[906]: reaped child process 1007, status = succeeded lb # [ 35.375574] niks3-server[1013]: 2026/09/20 13:26:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 35.393765] nix-grpc-daemon[916]: time=2026-09-20T13:26:26.933Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 35.395431] nix-grpc-daemon[916]: time=2026-09-20T13:26:26.935Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 35.394693] niks3-server[1013]: 2026/09/20 13:26:27 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 35.399791] niks3-server[1013]: 2026/09/20 13:26:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 35.402170] niks3-server[1013]: 2026/09/20 13:26:27 INFO Signed narinfos id=5 count=1 worker1 # [ 35.415117] nix-grpc-daemon[916]: time=2026-09-20T13:26:26.955Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.407929] niks3-server[1013]: 2026/09/20 13:26:27 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 35.412947] niks3-server[1013]: 2026/09/20 13:26:27 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 35.417537] niks3-server[1013]: 2026/09/20 13:26:27 INFO Completed upload id=5 worker1 # [ 35.431743] nix-grpc-daemon[916]: time=2026-09-20T13:26:26.971Z level=INFO msg="Upload complete. (404ms)" lb # [ 35.420265] niks3-server[1013]: 2026/09/20 13:26:27 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 35.435091] nix-grpc-daemon[846]: ts=2026-09-20T13:26:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 35.438532] nix-grpc-daemon[846]: ts=2026-09-20T13:26:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 35.449145] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 35.452446] nix-daemon[906]: reaped child process 997, status = succeeded client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 35.459408] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1 worker1 # [ 36.082595] nix-daemon[906]: reaped child process 1011, status = succeeded worker1 # [ 36.226587] nix-daemon[906]: accepted connection from pid 1026, user nix-grpc-daemon (trusted) worker1 # [ 36.246345] nix-daemon[906]: reaped child process 1029, status = succeeded lb # [ 36.242802] niks3-server[1013]: 2026/09/20 13:26:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 36.275114] nix-grpc-daemon[916]: time=2026-09-20T13:26:27.809Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 36.276932] nix-grpc-daemon[916]: time=2026-09-20T13:26:27.810Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 36.280154] niks3-server[1013]: 2026/09/20 13:26:28 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 36.286861] niks3-server[1013]: 2026/09/20 13:26:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 36.288819] niks3-server[1013]: 2026/09/20 13:26:28 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 36.293021] niks3-server[1013]: 2026/09/20 13:26:28 INFO Signed narinfos id=6 count=1 worker1 # [ 36.305813] nix-grpc-daemon[916]: time=2026-09-20T13:26:27.845Z level=INFO msg="Uploading 1 narinfos" lb # [ 36.298634] niks3-server[1013]: 2026/09/20 13:26:28 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 36.302888] niks3-server[1013]: 2026/09/20 13:26:28 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 36.307634] niks3-server[1013]: 2026/09/20 13:26:28 INFO Completed upload id=6 lb # [ 36.309739] niks3-server[1013]: 2026/09/20 13:26:28 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 36.322616] nix-grpc-daemon[916]: time=2026-09-20T13:26:27.861Z level=INFO msg="Upload complete. (252ms)" worker1 # [ 36.326434] nix-grpc-daemon[846]: ts=2026-09-20T13:26:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 36.339224] nix-daemon[906]: reaped child process 1009, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.22 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.78 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.31 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 worker1 # [ 37.697327] nix-grpc-daemon[846]: ts=2026-09-20T13:26:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50624 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # [ 37.719013] nix-grpc-daemon[846]: ts=2026-09-20T13:26:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 37.731688] nix-grpc-daemon[916]: time=2026-09-20T13:26:29.270Z level=INFO msg="All 2 paths already cached" worker2 # [ 37.757481] nix-grpc-daemon[786]: ts=2026-09-20T13:26:29Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.29 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.18 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb # [ 37.986547] envoy[922]: conn peer=[2001:db8:1::1]:42502 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2296 lb # [ 37.989747] envoy[922]: conn peer=[2001:db8:1::1]:42514 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=363 ms=66 lb # [ 37.992414] envoy[922]: conn peer=[2001:db8:1::1]:42520 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=12 lb # [ 37.996789] envoy[922]: conn peer=[2001:db8:1::1]:42530 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=13 lb # [ 38.000432] envoy[922]: conn peer=[2001:db8:1::1]:42532 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=3831 ms=6022 lb # [ 38.004348] envoy[922]: conn peer=[2001:db8:1::1]:58966 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=63 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.26 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2 worker1 # [ 38.487713] nix-grpc-daemon[846]: ts=2026-09-20T13:26:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50624 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker1 # [ 38.493532] nix-grpc-daemon[846]: ts=2026-09-20T13:26:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 38.501666] nix-grpc-daemon[916]: time=2026-09-20T13:26:30.041Z level=INFO msg="All 2 paths already cached" worker2 # [ 38.522541] nix-grpc-daemon[786]: ts=2026-09-20T13:26:30Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 38.524421] nix-grpc-daemon[786]: ts=2026-09-20T13:26:30Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 38.556379] nix-grpc-daemon[846]: ts=2026-09-20T13:26:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 38.567123] nix-grpc-daemon[846]: ts=2026-09-20T13:26:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 38.577046] nix-grpc-daemon[916]: time=2026-09-20T13:26:30.116Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 38.583471] nix-grpc-daemon[846]: ts=2026-09-20T13:26:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 38.590346] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 38.765646] nix-daemon[906]: accepted connection from pid 1047, user nix-grpc-daemon (trusted) worker1 # [ 38.780107] nix-daemon[906]: reaped child process 1050, status = succeeded worker1 # [ 38.948085] nix-daemon[906]: accepted connection from pid 1052, user nix-grpc-daemon (trusted) worker1 # [ 38.962202] nix-daemon[906]: reaped child process 1055, status = succeeded lb # [ 38.962792] niks3-server[1013]: 2026/09/20 13:26:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 38.988958] nix-grpc-daemon[916]: time=2026-09-20T13:26:30.528Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 38.990394] nix-grpc-daemon[916]: time=2026-09-20T13:26:30.528Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 38.996319] niks3-server[1013]: 2026/09/20 13:26:31 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 39.010294] niks3-server[1013]: 2026/09/20 13:26:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 39.027723] nix-grpc-daemon[916]: time=2026-09-20T13:26:30.567Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.016123] niks3-server[1013]: 2026/09/20 13:26:31 INFO Signed narinfos id=7 count=1 lb # [ 39.021168] niks3-server[1013]: 2026/09/20 13:26:31 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 39.031274] niks3-server[1013]: 2026/09/20 13:26:31 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 39.035871] niks3-server[1013]: 2026/09/20 13:26:31 INFO Completed upload id=7 worker1 # [ 39.048673] nix-grpc-daemon[916]: time=2026-09-20T13:26:30.588Z level=INFO msg="Upload complete. (451ms)" lb # [ 39.037662] niks3-server[1013]: 2026/09/20 13:26:31 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 39.054337] nix-grpc-daemon[846]: ts=2026-09-20T13:26:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 39.059616] nix-grpc-daemon[846]: ts=2026-09-20T13:26:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 39.070057] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 39.074357] nix-daemon[906]: reaped child process 1045, status = succeeded client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... worker1 # [ 39.079423] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> LOG-farm-top-t1b worker1 # [ 40.292791] nix-daemon[906]: reaped child process 1059, status = succeeded worker1 # [ 40.449629] nix-daemon[906]: accepted connection from pid 1075, user nix-grpc-daemon (trusted) worker1 # [ 40.464584] nix-daemon[906]: reaped child process 1078, status = succeeded lb # [ 40.464406] niks3-server[1013]: 2026/09/20 13:26:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.488893] nix-grpc-daemon[916]: time=2026-09-20T13:26:32.028Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 40.491761] nix-grpc-daemon[916]: time=2026-09-20T13:26:32.030Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 40.509870] niks3-server[1013]: 2026/09/20 13:26:32 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 40.516543] niks3-server[1013]: 2026/09/20 13:26:32 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 40.520058] niks3-server[1013]: 2026/09/20 13:26:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 40.522887] niks3-server[1013]: 2026/09/20 13:26:32 INFO Signed narinfos id=8 count=1 worker1 # [ 40.537321] nix-grpc-daemon[916]: time=2026-09-20T13:26:32.076Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.528082] niks3-server[1013]: 2026/09/20 13:26:32 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 40.533263] niks3-server[1013]: 2026/09/20 13:26:32 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 40.536814] niks3-server[1013]: 2026/09/20 13:26:32 INFO Completed upload id=8 lb # [ 40.538551] niks3-server[1013]: 2026/09/20 13:26:32 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 40.551057] nix-grpc-daemon[916]: time=2026-09-20T13:26:32.090Z level=INFO msg="Upload complete. (263ms)" worker1 # [ 40.556432] nix-grpc-daemon[846]: ts=2026-09-20T13:26:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 40.568307] nix-daemon[906]: reaped child process 1057, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.27 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.19 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.77 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup client # [ 40.978316] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 8efd75b801134a11babc4ed92b452ea3 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup worker2 # [ 41.184290] nix-grpc-daemon[786]: ts=2026-09-20T13:26:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43270 client # [ 41.163093] nix[888]: don't know how to build these paths: client # [ 41.163969] nix[888]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 41.196313] nix-grpc-daemon[786]: ts=2026-09-20T13:26:33Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 41.203732] nix-grpc-daemon[786]: ts=2026-09-20T13:26:33Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 41.208987] nix-grpc-daemon[786]: ts=2026-09-20T13:26:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 41.226210] nix-grpc-daemon[786]: ts=2026-09-20T13:26:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43270 client # [ 41.210133] nix[888]: copying 1 paths to 'lb:50051'... client # [ 41.211149] nix[888]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 41.238227] nix-grpc-daemon[786]: ts=2026-09-20T13:26:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 41.248876] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 41.272947] nix-grpc-daemon[786]: ts=2026-09-20T13:26:33Z level=info event=niks3_push_started pid=917 worker2 # [ 41.527321] nix-grpc-daemon[917]: time=2026-09-20T13:26:33.420Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca="" worker2 # [ 41.700199] nix-daemon[866]: accepted connection from pid 930, user nix-grpc-daemon (trusted) worker2 # [ 41.718878] nix-daemon[866]: reaped child process 933, status = succeeded worker2 # [ 41.883734] nix-daemon[866]: accepted connection from pid 935, user nix-grpc-daemon (trusted) worker2 # [ 41.899481] nix-daemon[866]: reaped child process 938, status = succeeded lb # [ 41.891695] niks3-server[1013]: 2026/09/20 13:26:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 41.921936] nix-grpc-daemon[917]: time=2026-09-20T13:26:33.819Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 41.924787] nix-grpc-daemon[917]: time=2026-09-20T13:26:33.821Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 41.923168] niks3-server[1013]: 2026/09/20 13:26:33 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 41.928840] niks3-server[1013]: 2026/09/20 13:26:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker2 # [ 41.954911] nix-grpc-daemon[917]: time=2026-09-20T13:26:33.851Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.931900] niks3-server[1013]: 2026/09/20 13:26:34 INFO Signed narinfos id=9 count=1 lb # [ 41.940203] niks3-server[1013]: 2026/09/20 13:26:34 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 41.944135] niks3-server[1013]: 2026/09/20 13:26:34 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 41.950517] niks3-server[1013]: 2026/09/20 13:26:34 INFO Completed upload id=9 worker2 # [ 41.973971] nix-grpc-daemon[917]: time=2026-09-20T13:26:33.871Z level=INFO msg="Upload complete. (434ms)" lb # [ 41.952294] niks3-server[1013]: 2026/09/20 13:26:34 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 41.976665] nix-grpc-daemon[786]: ts=2026-09-20T13:26:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 41.980863] nix-grpc-daemon[786]: ts=2026-09-20T13:26:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 41.988136] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 41.990913] nix-daemon[866]: reaped child process 915, status = succeeded client # [ 41.969482] nix[888]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... worker2 # [ 41.997340] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # [ 42.035663] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: b4adec24bdc94ae687fb6507881e9595 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.05 seconds) worker1 # [ 42.275339] nix-grpc-daemon[846]: ts=2026-09-20T13:26:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50624 client # [ 42.265532] nix[904]: don't know how to build these paths: client # [ 42.266915] nix[904]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 42.300030] nix-grpc-daemon[786]: ts=2026-09-20T13:26:34Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 42.305322] nix-grpc-daemon[786]: ts=2026-09-20T13:26:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 client # [ 42.281396] nix[904]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.04 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 45.619675] nix-daemon[866]: reaped child process 942, status = succeeded worker2 # [ 45.772205] nix-daemon[866]: accepted connection from pid 974, user nix-grpc-daemon (trusted) worker2 # [ 45.789993] nix-daemon[866]: reaped child process 977, status = succeeded lb # [ 45.776737] niks3-server[1013]: 2026/09/20 13:26:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.808118] nix-grpc-daemon[917]: time=2026-09-20T13:26:37.704Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 45.811674] nix-grpc-daemon[917]: time=2026-09-20T13:26:37.704Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 45.809066] niks3-server[1013]: 2026/09/20 13:26:37 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 45.816100] niks3-server[1013]: 2026/09/20 13:26:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 45.819772] niks3-server[1013]: 2026/09/20 13:26:37 INFO Signed narinfos id=10 count=1 worker2 # [ 45.843116] nix-grpc-daemon[917]: time=2026-09-20T13:26:37.740Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.820898] niks3-server[1013]: 2026/09/20 13:26:37 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 45.826505] niks3-server[1013]: 2026/09/20 13:26:37 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 45.832072] niks3-server[1013]: 2026/09/20 13:26:37 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 45.837639] niks3-server[1013]: 2026/09/20 13:26:37 INFO Completed upload id=10 worker2 # [ 45.861114] nix-grpc-daemon[917]: time=2026-09-20T13:26:37.758Z level=INFO msg="Upload complete. (249ms)" lb # [ 45.839151] niks3-server[1013]: 2026/09/20 13:26:37 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 45.865843] nix-grpc-daemon[786]: ts=2026-09-20T13:26:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 45.870268] nix-grpc-daemon[786]: ts=2026-09-20T13:26:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 45.877500] nix-daemon[866]: reaped child process 940, status = succeeded client # [ 45.867299] systemd[1]: dedup2.service: Deactivated successfully. client # [ 45.869324] systemd[1]: dedup2.service: Consumed 125ms CPU time over 3.831s wall clock time, 33.2M memory peak, 7.4K incoming IP traffic, 6.4K outgoing IP traffic. client # [ 45.911568] systemd[1]: dedup1.service: Deactivated successfully. client # [ 45.913476] systemd[1]: dedup1.service: Consumed 115ms CPU time over 4.935s wall clock time, 39.3M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.10 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.77 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 46.904802] systemd[1]: Started Nix Daemon. client # [ 47.103739] nix-daemon[947]: accepted connection from pid 944, user root (trusted) worker1 # [ 47.301829] nix-grpc-daemon[846]: ts=2026-09-20T13:26:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:50624 worker2 # [ 47.319577] nix-grpc-daemon[786]: ts=2026-09-20T13:26:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 47.331567] nix-grpc-daemon[786]: ts=2026-09-20T13:26:39Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 47.334135] nix-grpc-daemon[786]: ts=2026-09-20T13:26:39Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 47.365713] nix-grpc-daemon[846]: ts=2026-09-20T13:26:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 47.378675] nix-grpc-daemon[846]: ts=2026-09-20T13:26:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 47.393430] nix-grpc-daemon[846]: ts=2026-09-20T13:26:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 47.405628] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 47.582363] nix-daemon[906]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker1 # [ 47.598358] nix-daemon[906]: reaped child process 1107, status = succeeded worker1 # [ 47.750578] nix-daemon[906]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker1 # [ 47.761548] nix-daemon[906]: reaped child process 1112, status = succeeded lb # [ 47.765714] niks3-server[1013]: 2026/09/20 13:26:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 47.786193] nix-grpc-daemon[916]: time=2026-09-20T13:26:39.325Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 47.788236] nix-grpc-daemon[916]: time=2026-09-20T13:26:39.327Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 47.797974] niks3-server[1013]: 2026/09/20 13:26:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 47.818427] nix-grpc-daemon[916]: time=2026-09-20T13:26:39.358Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.806203] niks3-server[1013]: 2026/09/20 13:26:39 INFO Signed narinfos id=11 count=1 lb # [ 47.810278] niks3-server[1013]: 2026/09/20 13:26:39 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 47.818425] niks3-server[1013]: 2026/09/20 13:26:39 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 47.829778] niks3-server[1013]: 2026/09/20 13:26:39 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker1 # [ 47.849454] nix-grpc-daemon[916]: time=2026-09-20T13:26:39.389Z level=INFO msg="Upload complete. (427ms)" lb # [ 47.836883] niks3-server[1013]: 2026/09/20 13:26:39 INFO Completed upload id=11 worker1 # [ 47.852086] nix-grpc-daemon[846]: ts=2026-09-20T13:26:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 47.840345] niks3-server[1013]: 2026/09/20 13:26:39 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 47.858326] nix-grpc-daemon[846]: ts=2026-09-20T13:26:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 47.860372] nix-daemon[906]: reaped child process 1102, status = succeeded worker1 # [ 47.863329] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 47.869938] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) lb # [ 47.986877] envoy[922]: conn peer=[2001:db8:1::1]:58970 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4139 tx=1710 ms=2076 lb # [ 47.991278] envoy[922]: conn peer=[2001:db8:1::1]:58992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=3605 lb # [ 47.995209] envoy[922]: conn peer=[2001:db8:1::1]:58980 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2972 tx=1349 ms=4738 worker1 # [ 48.684296] nix-daemon[906]: reaped child process 1116, status = succeeded worker1 # [ 48.822343] nix-daemon[906]: accepted connection from pid 1131, user nix-grpc-daemon (trusted) worker1 # [ 48.835159] nix-daemon[906]: reaped child process 1134, status = succeeded lb # [ 48.833879] niks3-server[1013]: 2026/09/20 13:26:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.852904] nix-grpc-daemon[916]: time=2026-09-20T13:26:40.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 48.856029] nix-grpc-daemon[916]: time=2026-09-20T13:26:40.394Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 48.860883] niks3-server[1013]: 2026/09/20 13:26:40 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 48.863867] niks3-server[1013]: 2026/09/20 13:26:40 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 48.870088] niks3-server[1013]: 2026/09/20 13:26:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 48.873378] niks3-server[1013]: 2026/09/20 13:26:40 INFO Signed narinfos id=12 count=1 worker1 # [ 48.886355] nix-grpc-daemon[916]: time=2026-09-20T13:26:40.426Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.876119] niks3-server[1013]: 2026/09/20 13:26:40 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 48.881703] niks3-server[1013]: 2026/09/20 13:26:40 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 48.886282] niks3-server[1013]: 2026/09/20 13:26:40 INFO Completed upload id=12 worker1 # [ 48.898868] nix-grpc-daemon[916]: time=2026-09-20T13:26:40.438Z level=INFO msg="Upload complete. (222ms)" lb # [ 48.888061] niks3-server[1013]: 2026/09/20 13:26:40 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 48.901450] nix-grpc-daemon[846]: ts=2026-09-20T13:26:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=1 worker1 # [ 48.908330] nix-daemon[906]: reaped child process 1114, status = succeeded worker2 # [ 48.959413] nix-grpc-daemon[786]: ts=2026-09-20T13:26:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 48.972982] nix-grpc-daemon[786]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker1 # [ 48.993079] nix-grpc-daemon[846]: ts=2026-09-20T13:26:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 48.999219] nix-grpc-daemon[846]: ts=2026-09-20T13:26:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 49.200165] nix-grpc-daemon[786]: ts=2026-09-20T13:26:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43270 worker1 # [ 49.194607] nix-grpc-daemon[846]: ts=2026-09-20T13:26:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 49.199735] nix-grpc-daemon[916]: time=2026-09-20T13:26:40.739Z level=INFO msg="All 1 paths already cached" worker2 # [ 49.222435] nix-grpc-daemon[786]: ts=2026-09-20T13:26:41Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 49.224939] nix-grpc-daemon[786]: ts=2026-09-20T13:26:41Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 49.216096] nix-grpc-daemon[846]: ts=2026-09-20T13:26:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 49.222494] nix-grpc-daemon[846]: ts=2026-09-20T13:26:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 49.229476] nix-grpc-daemon[916]: time=2026-09-20T13:26:40.769Z level=INFO msg="All 1 paths already cached" worker1 # [ 49.232966] nix-grpc-daemon[846]: ts=2026-09-20T13:26:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 49.238091] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 49.376261] nix-daemon[906]: accepted connection from pid 1138, user nix-grpc-daemon (trusted) worker1 # [ 49.389528] nix-daemon[906]: reaped child process 1141, status = succeeded worker1 # [ 49.525643] nix-daemon[906]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker1 # [ 49.538340] nix-daemon[906]: reaped child process 1146, status = succeeded lb # [ 49.537200] niks3-server[1013]: 2026/09/20 13:26:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.555310] nix-grpc-daemon[916]: time=2026-09-20T13:26:41.094Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 49.556754] nix-grpc-daemon[916]: time=2026-09-20T13:26:41.094Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 49.553392] niks3-server[1013]: 2026/09/20 13:26:41 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 49.559752] niks3-server[1013]: 2026/09/20 13:26:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 49.563337] niks3-server[1013]: 2026/09/20 13:26:41 INFO Signed narinfos id=13 count=1 worker1 # [ 49.577960] nix-grpc-daemon[916]: time=2026-09-20T13:26:41.117Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.566330] niks3-server[1013]: 2026/09/20 13:26:41 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 49.575932] niks3-server[1013]: 2026/09/20 13:26:41 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 49.579694] niks3-server[1013]: 2026/09/20 13:26:41 INFO Completed upload id=13 worker1 # [ 49.592445] nix-grpc-daemon[916]: time=2026-09-20T13:26:41.132Z level=INFO msg="Upload complete. (349ms)" lb # [ 49.582322] niks3-server[1013]: 2026/09/20 13:26:41 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 49.594518] nix-grpc-daemon[846]: ts=2026-09-20T13:26:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 49.598049] nix-grpc-daemon[846]: ts=2026-09-20T13:26:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 49.605093] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 49.607369] nix-daemon[906]: reaped child process 1136, status = succeeded worker1 # [ 49.613568] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 50.827470] nix-daemon[906]: reaped child process 1150, status = succeeded worker1 # [ 50.946542] nix-daemon[906]: accepted connection from pid 1165, user nix-grpc-daemon (trusted) worker1 # [ 50.957585] nix-daemon[906]: reaped child process 1168, status = succeeded lb # [ 50.956370] niks3-server[1013]: 2026/09/20 13:26:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 50.974764] nix-grpc-daemon[916]: time=2026-09-20T13:26:42.514Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 50.976202] nix-grpc-daemon[916]: time=2026-09-20T13:26:42.516Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 50.978765] niks3-server[1013]: 2026/09/20 13:26:43 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 50.987708] niks3-server[1013]: 2026/09/20 13:26:43 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 50.991580] niks3-server[1013]: 2026/09/20 13:26:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 50.993915] niks3-server[1013]: 2026/09/20 13:26:43 INFO Signed narinfos id=14 count=1 worker1 # [ 51.008436] nix-grpc-daemon[916]: time=2026-09-20T13:26:42.548Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.000179] niks3-server[1013]: 2026/09/20 13:26:43 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 51.005078] niks3-server[1013]: 2026/09/20 13:26:43 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 51.010143] niks3-server[1013]: 2026/09/20 13:26:43 INFO Completed upload id=14 worker1 # [ 51.022872] nix-grpc-daemon[916]: time=2026-09-20T13:26:42.562Z level=INFO msg="Upload complete. (203ms)" worker1 # [ 51.026241] nix-grpc-daemon[846]: ts=2026-09-20T13:26:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=1 lb # [ 51.014027] niks3-server[1013]: 2026/09/20 13:26:43 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 51.032110] nix-daemon[906]: reaped child process 1148, status = succeeded worker2 # [ 51.042787] nix-grpc-daemon[786]: ts=2026-09-20T13:26:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 51.053154] nix-grpc-daemon[786]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker1 # [ 51.065792] nix-grpc-daemon[846]: ts=2026-09-20T13:26:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 51.067513] nix-grpc-daemon[846]: ts=2026-09-20T13:26:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 51.284502] nix-grpc-daemon[786]: ts=2026-09-20T13:26:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 51.292628] nix-grpc-daemon[786]: ts=2026-09-20T13:26:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 51.301220] nix-grpc-daemon[917]: time=2026-09-20T13:26:43.197Z level=INFO msg="All 2 paths already cached" worker1 # [ 51.307432] nix-grpc-daemon[846]: ts=2026-09-20T13:26:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker2 # [ 51.315993] nix-grpc-daemon[786]: ts=2026-09-20T13:26:43Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 51.320262] nix-grpc-daemon[786]: ts=2026-09-20T13:26:43Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 51.314468] nix-grpc-daemon[846]: ts=2026-09-20T13:26:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 51.320718] nix-grpc-daemon[916]: time=2026-09-20T13:26:42.860Z level=INFO msg="All 2 paths already cached" worker1 # [ 51.324575] nix-grpc-daemon[846]: ts=2026-09-20T13:26:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 51.329434] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 51.468672] nix-daemon[906]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker1 # [ 51.480912] nix-daemon[906]: reaped child process 1175, status = succeeded worker1 # [ 51.629878] nix-daemon[906]: accepted connection from pid 1177, user nix-grpc-daemon (trusted) worker1 # [ 51.642134] nix-daemon[906]: reaped child process 1180, status = succeeded lb # [ 51.645457] niks3-server[1013]: 2026/09/20 13:26:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.663903] nix-grpc-daemon[916]: time=2026-09-20T13:26:43.203Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 51.665292] nix-grpc-daemon[916]: time=2026-09-20T13:26:43.203Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 51.662040] niks3-server[1013]: 2026/09/20 13:26:43 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 51.667906] niks3-server[1013]: 2026/09/20 13:26:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 51.671611] niks3-server[1013]: 2026/09/20 13:26:43 INFO Signed narinfos id=15 count=1 worker1 # [ 51.686216] nix-grpc-daemon[916]: time=2026-09-20T13:26:43.225Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.673644] niks3-server[1013]: 2026/09/20 13:26:43 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 51.681550] niks3-server[1013]: 2026/09/20 13:26:43 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete worker1 # [ 51.698630] nix-grpc-daemon[916]: time=2026-09-20T13:26:43.238Z level=INFO msg="Upload complete. (364ms)" lb # [ 51.686070] niks3-server[1013]: 2026/09/20 13:26:43 INFO Completed upload id=15 worker1 # [ 51.700715] nix-grpc-daemon[846]: ts=2026-09-20T13:26:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 51.688753] niks3-server[1013]: 2026/09/20 13:26:43 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 51.704533] nix-grpc-daemon[846]: ts=2026-09-20T13:26:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 51.710870] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 51.713129] nix-daemon[906]: reaped child process 1170, status = succeeded worker1 # [ 51.718286] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 53.133700] nix-daemon[906]: reaped child process 1184, status = succeeded worker1 # [ 53.261304] nix-daemon[906]: accepted connection from pid 1199, user nix-grpc-daemon (trusted) worker1 # [ 53.273956] nix-daemon[906]: reaped child process 1202, status = succeeded lb # [ 53.272089] niks3-server[1013]: 2026/09/20 13:26:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.338187] nix-grpc-daemon[916]: time=2026-09-20T13:26:44.877Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 53.341065] nix-grpc-daemon[916]: time=2026-09-20T13:26:44.879Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 53.346839] niks3-server[1013]: 2026/09/20 13:26:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 53.348844] niks3-server[1013]: 2026/09/20 13:26:45 INFO Signed narinfos id=16 count=1 worker1 # [ 53.363920] nix-grpc-daemon[916]: time=2026-09-20T13:26:44.903Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.358456] niks3-server[1013]: 2026/09/20 13:26:45 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 53.406313] niks3-server[1013]: 2026/09/20 13:26:45 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 53.443695] niks3-server[1013]: 2026/09/20 13:26:45 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 53.464756] niks3-server[1013]: 2026/09/20 13:26:45 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 53.473461] niks3-server[1013]: 2026/09/20 13:26:45 INFO Completed upload id=16 worker1 # [ 53.486615] nix-grpc-daemon[916]: time=2026-09-20T13:26:45.026Z level=INFO msg="Upload complete. (360ms)" lb # [ 53.481778] niks3-server[1013]: 2026/09/20 13:26:45 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 53.492836] nix-grpc-daemon[846]: ts=2026-09-20T13:26:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=1 worker1 # [ 53.502314] nix-grpc-daemon[846]: ts=2026-09-20T13:26:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 53.512696] nix-daemon[906]: reaped child process 1182, status = succeeded worker2 # [ 53.527969] nix-grpc-daemon[786]: ts=2026-09-20T13:26:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 53.535494] nix-grpc-daemon[786]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 53.544774] nix-grpc-daemon[786]: ts=2026-09-20T13:26:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=0 paths=1 nar_bytes_out=232 client # [ 53.610954] nix-daemon[947]: reaped child process 949, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.93 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.01 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.40 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.16 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.22 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 54.660864] nix-daemon[947]: accepted connection from pid 1030, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker1 # [ 54.838364] nix-grpc-daemon[846]: ts=2026-09-20T13:26:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:50624 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 54.852823] nix-grpc-daemon[786]: ts=2026-09-20T13:26:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43270 client # copying 1 paths... client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'... worker2 # [ 54.865408] nix-grpc-daemon[786]: ts=2026-09-20T13:26:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 54.876330] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 55.056685] nix-daemon[866]: accepted connection from pid 1002, user nix-grpc-daemon (trusted) worker2 # [ 55.069698] nix-daemon[866]: reaped child process 1005, status = succeeded lb # [ 55.058201] niks3-server[1013]: 2026/09/20 13:26:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 55.114479] nix-grpc-daemon[917]: time=2026-09-20T13:26:47.011Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 55.116387] nix-grpc-daemon[917]: time=2026-09-20T13:26:47.013Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 55.103225] niks3-server[1013]: 2026/09/20 13:26:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 55.106320] niks3-server[1013]: 2026/09/20 13:26:47 INFO Signed narinfos id=17 count=1 worker2 # [ 55.129651] nix-grpc-daemon[917]: time=2026-09-20T13:26:47.026Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.108664] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 55.111811] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 55.115746] niks3-server[1013]: 2026/09/20 13:26:47 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 55.119641] niks3-server[1013]: 2026/09/20 13:26:47 INFO Completed upload id=17 worker2 # [ 55.144252] nix-grpc-daemon[917]: time=2026-09-20T13:26:47.041Z level=INFO msg="Upload complete. (257ms)" lb # [ 55.122485] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 55.147855] nix-grpc-daemon[786]: ts=2026-09-20T13:26:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 55.158191] nix-daemon[866]: reaped child process 1000, status = succeeded worker2 # [ 55.161425] nix-grpc-daemon[786]: ts=2026-09-20T13:26:47Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 55.163486] nix-grpc-daemon[786]: ts=2026-09-20T13:26:47Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 55.207358] nix-grpc-daemon[786]: ts=2026-09-20T13:26:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 55.215696] nix-grpc-daemon[786]: ts=2026-09-20T13:26:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43270 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 55.226788] nix-grpc-daemon[786]: ts=2026-09-20T13:26:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43270 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 55.230929] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 55.373061] nix-daemon[866]: accepted connection from pid 1011, user nix-grpc-daemon (trusted) worker2 # [ 55.386348] nix-daemon[866]: reaped child process 1014, status = succeeded worker2 # [ 55.509445] nix-daemon[866]: accepted connection from pid 1016, user nix-grpc-daemon (trusted) worker2 # [ 55.521344] nix-daemon[866]: reaped child process 1019, status = succeeded lb # [ 55.508854] niks3-server[1013]: 2026/09/20 13:26:47 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 55.517362] niks3-server[1013]: 2026/09/20 13:26:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 55.547729] nix-grpc-daemon[917]: time=2026-09-20T13:26:47.444Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 55.549944] nix-grpc-daemon[917]: time=2026-09-20T13:26:47.446Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker2 # [ 55.551515] nix-grpc-daemon[917]: time=2026-09-20T13:26:47.446Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 55.539706] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 55.542357] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 55.547839] niks3-server[1013]: 2026/09/20 13:26:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 55.550783] niks3-server[1013]: 2026/09/20 13:26:47 INFO Signed narinfos id=18 count=1 lb # [ 55.552093] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 55.554350] niks3-server[1013]: 2026/09/20 13:26:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 55.556489] niks3-server[1013]: 2026/09/20 13:26:47 INFO Signed narinfos id=19 count=2 worker2 # [ 55.580363] nix-grpc-daemon[917]: time=2026-09-20T13:26:47.477Z level=INFO msg="Uploading 3 narinfos" lb # [ 55.558314] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 55.570716] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 55.573072] niks3-server[1013]: 2026/09/20 13:26:47 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 55.576823] niks3-server[1013]: 2026/09/20 13:26:47 INFO Completed upload id=18 lb # [ 55.578873] niks3-server[1013]: 2026/09/20 13:26:47 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 55.580776] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 55.582875] niks3-server[1013]: 2026/09/20 13:26:47 INFO Completed upload id=19 worker2 # [ 55.606211] nix-grpc-daemon[917]: time=2026-09-20T13:26:47.503Z level=INFO msg="Upload complete. (366ms)" lb # [ 55.584571] niks3-server[1013]: 2026/09/20 13:26:47 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo worker2 # [ 55.608339] nix-grpc-daemon[786]: ts=2026-09-20T13:26:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 55.611589] nix-grpc-daemon[786]: ts=2026-09-20T13:26:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 55.617139] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 55.620293] nix-daemon[866]: reaped child process 1009, status = succeeded client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 55.625068] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 56.839524] nix-daemon[866]: reaped child process 1023, status = succeeded worker2 # [ 56.962936] nix-daemon[866]: accepted connection from pid 1038, user nix-grpc-daemon (trusted) worker2 # [ 56.974958] nix-daemon[866]: reaped child process 1041, status = succeeded lb # [ 56.965187] niks3-server[1013]: 2026/09/20 13:26:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 56.997255] nix-grpc-daemon[917]: time=2026-09-20T13:26:48.894Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 56.997091] niks3-server[1013]: 2026/09/20 13:26:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 56.999612] niks3-server[1013]: 2026/09/20 13:26:49 INFO Signed narinfos id=20 count=1 worker2 # [ 57.024236] nix-grpc-daemon[917]: time=2026-09-20T13:26:48.921Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.006384] niks3-server[1013]: 2026/09/20 13:26:49 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 57.017655] niks3-server[1013]: 2026/09/20 13:26:49 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 57.031941] niks3-server[1013]: 2026/09/20 13:26:49 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 57.041854] niks3-server[1013]: 2026/09/20 13:26:49 INFO Completed upload id=20 worker2 # [ 57.065255] nix-grpc-daemon[917]: time=2026-09-20T13:26:48.962Z level=INFO msg="Upload complete. (233ms)" worker2 # [ 57.068761] nix-grpc-daemon[786]: ts=2026-09-20T13:26:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=1 lb # [ 57.051266] niks3-server[1013]: 2026/09/20 13:26:49 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 57.076262] nix-daemon[866]: reaped child process 1021, status = succeeded client # copying 1 paths... worker1 # [ 57.102802] nix-grpc-daemon[846]: ts=2026-09-20T13:26:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 57.113089] nix-grpc-daemon[846]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 57.148422] nix-grpc-daemon[786]: ts=2026-09-20T13:26:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 57.150772] nix-grpc-daemon[786]: ts=2026-09-20T13:26:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=0 paths=1 nar_bytes_out=120 client # [ 57.213719] nix-daemon[947]: reaped child process 1033, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.71 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 57.352451] nix-daemon[947]: accepted connection from pid 1052, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker2 # [ 57.526881] nix-grpc-daemon[786]: ts=2026-09-20T13:26:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43270 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 57.531725] nix-grpc-daemon[786]: ts=2026-09-20T13:26:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 57.599954] nix-grpc-daemon[917]: time=2026-09-20T13:26:49.497Z level=INFO msg="All 1 paths already cached" worker2 # [ 57.614164] nix-grpc-daemon[786]: ts=2026-09-20T13:26:49Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 57.618760] nix-grpc-daemon[786]: ts=2026-09-20T13:26:49Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 57.615461] nix-grpc-daemon[846]: ts=2026-09-20T13:26:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 57.625471] nix-grpc-daemon[846]: ts=2026-09-20T13:26:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 57.636929] nix-grpc-daemon[846]: ts=2026-09-20T13:26:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 57.648337] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 57.657146] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5) worker1 # [ 57.667519] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 2/5) worker1 # [ 57.674970] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 3/5) worker1 # [ 57.690565] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 771 ms (attempt 4/5) lb # [ 57.986578] envoy[922]: conn peer=[2001:db8:1::1]:48852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3384 tx=1727 ms=1706 lb # [ 57.988255] envoy[922]: conn peer=[2001:db8:1::1]:48862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=15 lb # [ 57.989852] envoy[922]: conn peer=[2001:db8:1::1]:48866 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3837 tx=1945 ms=1883 lb # [ 57.991286] envoy[922]: conn peer=[2001:db8:1::1]:48876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=378 ms=8 lb # [ 57.992758] envoy[922]: conn peer=[2001:db8:1::1]:48878 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4328 tx=2080 ms=2309 lb # [ 57.994185] envoy[922]: conn peer=[2001:db8:1::1]:38652 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=69 lb # [ 57.995553] envoy[922]: conn peer=[2001:db8:1::1]:38674 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=50 lb # [ 57.996959] envoy[922]: conn peer=[2001:db8:1::1]:38668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4221 tx=1861 ms=2354 worker1 # [ 58.465773] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 58.471296] nix-grpc-daemon[846]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 58.675370] nix-daemon[906]: accepted connection from pid 1216, user nix-grpc-daemon (trusted) worker1 # [ 58.688782] nix-daemon[906]: reaped child process 1219, status = succeeded worker1 # [ 58.850660] nix-daemon[906]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker1 # [ 58.863366] nix-daemon[906]: reaped child process 1224, status = succeeded lb # [ 58.863437] niks3-server[1013]: 2026/09/20 13:26:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.161331] nix-grpc-daemon[916]: time=2026-09-20T13:26:50.699Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 59.164795] nix-grpc-daemon[916]: time=2026-09-20T13:26:50.700Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 59.168968] niks3-server[1013]: 2026/09/20 13:26:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 59.188734] nix-grpc-daemon[916]: time=2026-09-20T13:26:50.728Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.176156] niks3-server[1013]: 2026/09/20 13:26:51 INFO Signed narinfos id=21 count=1 lb # [ 59.182313] niks3-server[1013]: 2026/09/20 13:26:51 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 59.193919] niks3-server[1013]: 2026/09/20 13:26:51 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 59.201263] niks3-server[1013]: 2026/09/20 13:26:51 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 59.207249] niks3-server[1013]: 2026/09/20 13:26:51 INFO Completed upload id=21 worker1 # [ 59.220284] nix-grpc-daemon[916]: time=2026-09-20T13:26:50.760Z level=INFO msg="Upload complete. (729ms)" worker1 # [ 59.225086] nix-grpc-daemon[846]: ts=2026-09-20T13:26:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=1 paths=1 nar_bytes_in=560 lb # [ 59.215846] niks3-server[1013]: 2026/09/20 13:26:51 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 59.231673] nix-grpc-daemon[846]: ts=2026-09-20T13:26:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 59.242156] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) worker1 # [ 59.258854] nix-daemon[906]: reaped child process 1210, status = succeeded client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 59.265363] nix-daemon[906]: accepted connection from pid 846, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 60.493536] nix-daemon[906]: reaped child process 1228, status = succeeded worker1 # [ 60.635421] nix-daemon[906]: accepted connection from pid 1243, user nix-grpc-daemon (trusted) worker1 # [ 60.648151] nix-daemon[906]: reaped child process 1246, status = succeeded lb # [ 60.649369] niks3-server[1013]: 2026/09/20 13:26:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.670440] nix-grpc-daemon[916]: time=2026-09-20T13:26:52.210Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 60.680331] niks3-server[1013]: 2026/09/20 13:26:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 60.685137] niks3-server[1013]: 2026/09/20 13:26:52 INFO Signed narinfos id=22 count=1 worker1 # [ 60.700963] nix-grpc-daemon[916]: time=2026-09-20T13:26:52.240Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.694715] niks3-server[1013]: 2026/09/20 13:26:52 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 60.700380] niks3-server[1013]: 2026/09/20 13:26:52 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 60.712293] niks3-server[1013]: 2026/09/20 13:26:52 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 60.719254] niks3-server[1013]: 2026/09/20 13:26:52 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker1 # [ 60.735845] nix-grpc-daemon[916]: time=2026-09-20T13:26:52.275Z level=INFO msg="Upload complete. (256ms)" lb # [ 60.723227] niks3-server[1013]: 2026/09/20 13:26:52 INFO Completed upload id=22 worker1 # [ 60.738561] nix-grpc-daemon[846]: ts=2026-09-20T13:26:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=1 client # copying 1 paths... worker1 # [ 60.744408] nix-grpc-daemon[846]: ts=2026-09-20T13:26:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 60.747684] nix-daemon[906]: reaped child process 1226, status = succeeded client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 60.763594] nix-grpc-daemon[846]: ts=2026-09-20T13:26:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50624 worker1 # [ 60.765789] nix-grpc-daemon[846]: ts=2026-09-20T13:26:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50624 duration_s=0 paths=1 nar_bytes_out=120 client # [ 60.837503] nix-daemon[947]: reaped child process 1055, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.63 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 61.006104] nix-daemon[947]: accepted connection from pid 1073, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 61.197044] nix-grpc-daemon[786]: ts=2026-09-20T13:26:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43270 worker1 # [ 61.189344] nix-grpc-daemon[846]: ts=2026-09-20T13:26:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50624 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 61.508083] nix-grpc-daemon[916]: time=2026-09-20T13:26:53.047Z level=INFO msg="All 1 paths already cached" worker2 # [ 61.537588] nix-grpc-daemon[786]: ts=2026-09-20T13:26:53Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 61.544510] nix-grpc-daemon[786]: ts=2026-09-20T13:26:53Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 61.549625] nix-grpc-daemon[786]: ts=2026-09-20T13:26:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 61.562174] nix-grpc-daemon[786]: ts=2026-09-20T13:26:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 61.578145] nix-grpc-daemon[917]: time=2026-09-20T13:26:53.474Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 61.587792] nix-grpc-daemon[786]: ts=2026-09-20T13:26:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 61.596894] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 61.769744] nix-daemon[866]: accepted connection from pid 1049, user nix-grpc-daemon (trusted) worker2 # [ 61.785174] nix-daemon[866]: reaped child process 1052, status = succeeded worker2 # [ 61.915567] nix-daemon[866]: accepted connection from pid 1054, user nix-grpc-daemon (trusted) worker2 # [ 61.929033] nix-daemon[866]: reaped child process 1057, status = succeeded lb # [ 61.919517] niks3-server[1013]: 2026/09/20 13:26:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 61.947402] nix-grpc-daemon[917]: time=2026-09-20T13:26:53.844Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 61.948971] nix-grpc-daemon[917]: time=2026-09-20T13:26:53.846Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 61.937076] niks3-server[1013]: 2026/09/20 13:26:54 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 61.945530] niks3-server[1013]: 2026/09/20 13:26:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 61.951311] niks3-server[1013]: 2026/09/20 13:26:54 INFO Signed narinfos id=23 count=1 worker2 # [ 61.978454] nix-grpc-daemon[917]: time=2026-09-20T13:26:53.875Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.956090] niks3-server[1013]: 2026/09/20 13:26:54 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 61.966850] niks3-server[1013]: 2026/09/20 13:26:54 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 61.974900] niks3-server[1013]: 2026/09/20 13:26:54 INFO Completed upload id=23 worker2 # [ 61.998274] nix-grpc-daemon[917]: time=2026-09-20T13:26:53.895Z level=INFO msg="Upload complete. (386ms)" lb # [ 61.976835] niks3-server[1013]: 2026/09/20 13:26:54 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 62.000867] nix-grpc-daemon[786]: ts=2026-09-20T13:26:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=0 paths=1 nar_bytes_in=560 worker2 # [ 62.004297] nix-grpc-daemon[786]: ts=2026-09-20T13:26:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 62.011158] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 62.014695] nix-daemon[866]: reaped child process 1047, status = succeeded worker2 # [ 62.020273] nix-daemon[866]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 62.636952] nix-daemon[866]: reaped child process 1061, status = succeeded worker2 # [ 62.751234] nix-daemon[866]: accepted connection from pid 1076, user nix-grpc-daemon (trusted) worker2 # [ 62.764501] nix-daemon[866]: reaped child process 1079, status = succeeded lb # [ 62.753913] niks3-server[1013]: 2026/09/20 13:26:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 62.786292] nix-grpc-daemon[917]: time=2026-09-20T13:26:54.682Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 62.778057] niks3-server[1013]: 2026/09/20 13:26:54 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 62.786305] niks3-server[1013]: 2026/09/20 13:26:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 62.790353] niks3-server[1013]: 2026/09/20 13:26:54 INFO Signed narinfos id=24 count=1 worker2 # [ 62.816491] nix-grpc-daemon[917]: time=2026-09-20T13:26:54.713Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.800872] niks3-server[1013]: 2026/09/20 13:26:54 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 62.809714] niks3-server[1013]: 2026/09/20 13:26:54 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete worker2 # [ 62.839494] nix-grpc-daemon[917]: time=2026-09-20T13:26:54.736Z level=INFO msg="Upload complete. (213ms)" lb # [ 62.816179] niks3-server[1013]: 2026/09/20 13:26:54 INFO Completed upload id=24 lb # [ 62.819220] niks3-server[1013]: 2026/09/20 13:26:54 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 62.842917] nix-grpc-daemon[786]: ts=2026-09-20T13:26:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=0 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 62.850150] nix-daemon[866]: reaped child process 1059, status = succeeded client # copying 1 paths... worker2 # [ 62.887767] nix-grpc-daemon[786]: ts=2026-09-20T13:26:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43270 client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 62.905648] nix-grpc-daemon[786]: ts=2026-09-20T13:26:54Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43270 worker2 # [ 62.907249] nix-grpc-daemon[786]: ts=2026-09-20T13:26:54Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43270 duration_s=0 paths=1 nar_bytes_out=120 client # [ 62.968113] nix-daemon[947]: reaped child process 1076, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.13 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 9.27 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.34 seconds) client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.34 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.15 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds) worker2 # [ 64.078779] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 64.368905] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=signal_exit worker2 # [ 64.623857] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=scheduler_yield worker2 # [ 64.628612] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 64.603463] niks3-server[1013]: 2026/09/20 13:26:56 INFO lead: released remote=192.168.1.4:51892 worker1 # [ 64.625578] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 64.635730] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:43258 worker2 # [ 64.640753] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 64.642282] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:43258 worker2 # [ 64.644042] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=worker_gone addr=192.168.1.3:50051 lb # [ 64.752029] niks3-server[1013]: 2026/09/20 13:26:56 INFO lead: acquired remote=192.168.1.3:59718 worker1 # [ 64.765128] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_take_over worker2 # [ 64.829214] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 64.830938] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 64.825538] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 64.827151] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 65.031564] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 65.033373] nix-grpc-daemon[786]: ts=2026-09-20T13:26:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 65.027607] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 65.029450] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 65.234188] nix-grpc-daemon[786]: ts=2026-09-20T13:26:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 65.236268] nix-grpc-daemon[786]: ts=2026-09-20T13:26:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 65.229910] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 65.231731] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 65.437384] nix-grpc-daemon[786]: ts=2026-09-20T13:26:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 65.439797] nix-grpc-daemon[786]: ts=2026-09-20T13:26:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 65.432146] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 65.433818] nix-grpc-daemon[846]: ts=2026-09-20T13:26:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 65.628703] nix-grpc-daemon[786]: ts=2026-09-20T13:26:57Z level=info event=scheduler_restarting worker1 # [ 65.636352] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 65.639516] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 65.653681] nix-grpc-daemon[786]: ts=2026-09-20T13:26:57Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 65.666787] nix-daemon[866]: reaped child process 868, status = succeeded worker1 # [ 65.836510] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 65.838217] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 66.039121] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 66.042962] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 66.243167] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 66.244861] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 66.445291] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 66.455846] nix-grpc-daemon[846]: ts=2026-09-20T13:26:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54972 worker1 # [ 66.460745] nix-grpc-daemon[846]: ts=2026-09-20T13:26:58Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 66.479252] nix-grpc-daemon[786]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 66.481311] nix-grpc-daemon[786]: E0000 00:00:1789910818.375197 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 66.483603] nix-grpc-daemon[786]: E0000 00:00:1789910818.378391 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 66.758489] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 66.761431] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 66.762744] systemd[1]: nix-grpc-daemon.service: Consumed 1.462s CPU time over 48.647s wall clock time, 50.1M memory peak, 56.9K incoming IP traffic, 155.8K outgoing IP traffic. worker2 # [ 66.768461] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 66.770652] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 66.772536] systemd[1]: nix-grpc-daemon.socket: Consumed 310us CPU time over 56.227s wall clock time, 256K memory peak, 70.9K incoming IP traffic, 59.8K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 66.978937] nix-grpc-daemon[846]: ts=2026-09-20T13:26:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50624 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker1 # [ 66.981341] nix-grpc-daemon[846]: ts=2026-09-20T13:26:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:50624 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.17 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.01 seconds) worker2 # [ 67.057793] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 67.082410] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 67.290346] nix-grpc-daemon[846]: ts=2026-09-20T13:26:58Z level=info event=signal_exit worker1 # [ 67.561634] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_yield lb # [ 67.551497] niks3-server[1013]: 2026/09/20 13:26:59 INFO lead: released remote=192.168.1.3:59718 worker1 # [ 67.566977] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 67.571621] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54972 worker1 # [ 67.575188] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 67.756682] systemd[1]: Starting scheduler-token.service... worker1 # [ 67.768168] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 67.771859] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 67.831864] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 67.833808] systemd[1]: Finished scheduler-token.service. worker2 # [ 67.835299] systemd[1]: scheduler-token.service: Consumed 36ms CPU time over 77ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 67.839997] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 67.970252] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 67.985445] nix-grpc-daemon[1103]: ts=2026-09-20T13:26:59Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 67.974352] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 67.987502] nix-grpc-daemon[1103]: ts=2026-09-20T13:26:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 67.991562] nix-grpc-daemon[1103]: ts=2026-09-20T13:26:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 67.998444] nix-grpc-daemon[1103]: ts=2026-09-20T13:26:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 68.003148] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 67.984547] niks3-server[1013]: 2026/09/20 13:27:00 INFO lead: acquired remote=192.168.1.4:36300 worker2 # [ 68.008216] nix-grpc-daemon[1103]: ts=2026-09-20T13:26:59Z level=info event=scheduler_take_over lb # [ 67.987652] envoy[922]: conn peer=[2001:db8:1::1]:38688 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3731 tx=1817 ms=3298 lb # [ 67.989226] envoy[922]: conn peer=[2001:db8:1::1]:38704 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=53 lb # [ 67.992021] envoy[922]: conn peer=[2001:db8:1::1]:38710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3719 tx=1799 ms=1759 lb # [ 67.993541] envoy[922]: conn peer=[2001:db8:1::1]:36388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=49 lb # [ 67.994942] envoy[922]: conn peer=[2001:db8:1::4]:42892 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=33981 tx=1810 ms=47254 lb # [ 67.996470] envoy[922]: conn peer=[2001:db8:1::1]:36400 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=10 worker2 # [ 68.022642] nix-grpc-daemon[1103]: ts=2026-09-20T13:26:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 68.024308] nix-grpc-daemon[1103]: ts=2026-09-20T13:26:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 68.174962] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 68.176823] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 68.225191] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 68.226905] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 68.377720] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 68.381506] nix-grpc-daemon[846]: ts=2026-09-20T13:26:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 68.428380] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 68.432249] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 68.564588] nix-grpc-daemon[846]: ts=2026-09-20T13:27:00Z level=info event=scheduler_restarting worker1 # [ 68.595923] nix-grpc-daemon[846]: ts=2026-09-20T13:27:00Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 68.606796] nix-daemon[906]: reaped child process 908, status = succeeded worker2 # [ 68.633233] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 68.637207] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 68.715738] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 68.719641] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 68.722966] systemd[1]: nix-grpc-daemon.service: Consumed 2.506s CPU time over 50.735s wall clock time, 55.3M memory peak, 84.3K incoming IP traffic, 154.4K outgoing IP traffic. worker1 # [ 68.734578] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 68.737865] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 68.740502] systemd[1]: nix-grpc-daemon.socket: Consumed 352us CPU time over 58.843s wall clock time, 256K memory peak, 75.6K incoming IP traffic, 64.2K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 68.838181] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 68.842424] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, retrying worker2 # [ 69.043554] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 69.056139] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 69.059097] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:59094 worker2 # [ 69.063450] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:00Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 69.448898] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59110 worker2 # [ 69.454646] nix-daemon[866]: accepted connection from pid 1103, user nix-grpc-daemon (trusted) worker2 # [ 69.462852] nix-grpc-daemon[1103]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 1/5) worker2 # [ 69.514275] nix-grpc-daemon[1103]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 2/5) worker2 # [ 69.657860] nix-grpc-daemon[1103]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 3/5) worker2 # [ 69.825425] nix-grpc-daemon[1103]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 715 ms (attempt 4/5) worker2 # [ 70.541527] nix-grpc-daemon[1103]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... worker2 # [ 70.556741] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59110 client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 70.566678] nix-daemon[866]: accepted connection from pid 1103, user nix-grpc-daemon (trusted) worker2 # [ 70.577975] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:02Z level=info event=niks3_push_started pid=1159 worker2 # [ 70.733804] nix-grpc-daemon[1159]: time=2026-09-20T13:27:02.630Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca="" worker2 # [ 70.888153] nix-daemon[866]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 70.899919] nix-daemon[866]: reaped child process 1175, status = succeeded lb # [ 70.890597] niks3-server[1013]: 2026/09/20 13:27:02 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 70.895758] niks3-server[1013]: 2026/09/20 13:27:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 70.922669] nix-grpc-daemon[1159]: time=2026-09-20T13:27:02.819Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 70.924290] nix-grpc-daemon[1159]: time=2026-09-20T13:27:02.821Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" worker2 # [ 70.926201] nix-grpc-daemon[1159]: time=2026-09-20T13:27:02.823Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" lb # [ 70.934523] niks3-server[1013]: 2026/09/20 13:27:03 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 70.949873] niks3-server[1013]: 2026/09/20 13:27:03 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 70.953779] niks3-server[1013]: 2026/09/20 13:27:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 70.956699] niks3-server[1013]: 2026/09/20 13:27:03 INFO Signed narinfos id=26 count=2 lb # [ 70.959445] niks3-server[1013]: 2026/09/20 13:27:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 70.966390] niks3-server[1013]: 2026/09/20 13:27:03 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 70.974110] niks3-server[1013]: 2026/09/20 13:27:03 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 70.978071] niks3-server[1013]: 2026/09/20 13:27:03 INFO Signed narinfos id=25 count=1 worker2 # [ 71.003281] nix-grpc-daemon[1159]: time=2026-09-20T13:27:02.900Z level=INFO msg="Uploading 3 narinfos" lb # [ 71.005109] niks3-server[1013]: 2026/09/20 13:27:03 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 71.007153] niks3-server[1013]: 2026/09/20 13:27:03 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 71.013119] niks3-server[1013]: 2026/09/20 13:27:03 INFO Completed upload id=25 lb # [ 71.015251] niks3-server[1013]: 2026/09/20 13:27:03 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 71.017693] niks3-server[1013]: 2026/09/20 13:27:03 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 71.020696] niks3-server[1013]: 2026/09/20 13:27:03 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 71.023185] niks3-server[1013]: 2026/09/20 13:27:03 INFO Completed upload id=26 worker2 # [ 71.048500] nix-grpc-daemon[1159]: time=2026-09-20T13:27:02.945Z level=INFO msg="Upload complete. (310ms)" worker2 # [ 71.053842] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59110 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 71.066700] nix-daemon[866]: reaped child process 1157, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 2.28 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 71.160804] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 71.168905] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 71.337870] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 71.339696] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 71.343397] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 71.350795] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 71.352406] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 71.371120] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 71.384819] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:03Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:59094 worker2 # [ 71.386562] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.08 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 8.45 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 71.668947] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 72.003440] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:03Z level=info event=signal_exit worker2 # [ 72.013287] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:03Z level=info event=scheduler_yield lb # [ 71.992321] niks3-server[1013]: 2026/09/20 13:27:04 INFO lead: released remote=192.168.1.4:36300 worker2 # [ 72.017360] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:59094 worker1 # [ 72.005065] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:03Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 72.019358] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:03Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 72.020992] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:03Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 72.022295] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:59094 worker2 # [ 72.023636] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:03Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 72.205599] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 72.207492] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 72.220803] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 72.224605] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 72.408279] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 72.410046] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 72.422411] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 72.424052] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 72.611092] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 72.624726] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 72.626406] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 72.614950] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 72.815586] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 72.827712] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 72.819636] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 72.831767] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 73.019690] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=scheduler_restarting worker1 # [ 73.020424] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.024769] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 73.042885] nix-grpc-daemon[1103]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 73.046724] nix-grpc-daemon[1103]: E0000 00:00:1789910824.934519 1146 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 73.051804] nix-grpc-daemon[1103]: E0000 00:00:1789910824.934644 1146 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 73.056724] nix-grpc-daemon[1103]: ts=2026-09-20T13:27:04Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 73.064605] nix-daemon[866]: reaped child process 1152, status = succeeded worker1 # [ 73.225709] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.229622] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 73.430299] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.432033] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 73.632516] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.634252] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 73.835158] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.838860] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.024721] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 74.030495] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 74.032556] systemd[1]: nix-grpc-daemon.service: Consumed 307ms CPU time over 6.183s wall clock time, 30.6M memory peak, 20K incoming IP traffic, 31.6K outgoing IP traffic. worker2 # [ 74.041392] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 74.045374] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 74.048383] systemd[1]: nix-grpc-daemon.socket: Consumed 320us CPU time over 6.990s wall clock time, 256K memory peak, 18.1K incoming IP traffic, 12.9K outgoing IP traffic. worker1 # [ 74.039718] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.043961] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker1 # [ 74.244603] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.248375] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 74.450681] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.454162] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 74.650972] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.652752] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 74.853710] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.857537] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.058439] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.062660] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker1 # [ 75.263553] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.268127] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.470444] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.474372] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.671520] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.676185] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.876963] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.881357] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 76.081689] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.083596] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 76.286078] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.288604] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1 # [ 76.362715] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:07Z level=info event=scheduler_take_over lb # [ 76.349979] niks3-server[1013]: 2026/09/20 13:27:08 INFO lead: acquired remote=192.168.1.3:40512 worker1 # [ 76.487414] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.492114] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37528 worker1 # [ 76.494692] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2 worker1 # [ 77.570405] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 77.583926] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 77.600796] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 77.615122] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5) worker1 # [ 77.643994] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 2/5) worker1 # [ 77.792973] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 246 ms (attempt 3/5) lb # [ 77.989076] envoy[922]: conn peer=[2001:db8:1::3]:37542 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10331 tx=2333 ms=49226 lb # [ 77.993602] envoy[922]: conn peer=[2001:db8:1::1]:36416 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1165 tx=403 ms=2120 lb # [ 77.999307] envoy[922]: conn peer=[2001:db8:1::4]:56216 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=8603 tx=535 ms=5019 worker1 # [ 78.044839] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 666 ms (attempt 4/5) worker1 # [ 78.711957] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 78.738919] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:10Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 78.744555] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:10Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 78.784188] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 78.795257] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37544 client # copying 1 paths to 'lb:50051'... worker1 # [ 78.805643] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37544 client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 78.815902] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 79.065155] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:10Z level=info event=niks3_push_started pid=1346 worker1 # [ 79.295510] nix-grpc-daemon[1346]: time=2026-09-20T13:27:10.834Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca="" worker1 # [ 79.460207] nix-daemon[906]: accepted connection from pid 1359, user nix-grpc-daemon (trusted) worker1 # [ 79.473774] nix-daemon[906]: reaped child process 1362, status = succeeded worker1 # [ 79.647295] nix-daemon[906]: accepted connection from pid 1364, user nix-grpc-daemon (trusted) worker1 # [ 79.659853] nix-daemon[906]: reaped child process 1367, status = succeeded lb # [ 79.666576] niks3-server[1013]: 2026/09/20 13:27:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.695076] nix-grpc-daemon[1346]: time=2026-09-20T13:27:11.234Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 79.696567] nix-grpc-daemon[1346]: time=2026-09-20T13:27:11.234Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 79.707549] niks3-server[1013]: 2026/09/20 13:27:11 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 79.716398] niks3-server[1013]: 2026/09/20 13:27:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 79.721504] niks3-server[1013]: 2026/09/20 13:27:11 INFO Signed narinfos id=27 count=1 worker1 # [ 79.740107] nix-grpc-daemon[1346]: time=2026-09-20T13:27:11.279Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.731820] niks3-server[1013]: 2026/09/20 13:27:11 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 79.737155] niks3-server[1013]: 2026/09/20 13:27:11 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 79.743223] niks3-server[1013]: 2026/09/20 13:27:11 INFO Completed upload id=27 worker1 # [ 79.756102] nix-grpc-daemon[1346]: time=2026-09-20T13:27:11.296Z level=INFO msg="Upload complete. (456ms)" worker1 # [ 79.758649] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37544 duration_s=0 paths=1 nar_bytes_in=520 lb # [ 79.746964] niks3-server[1013]: 2026/09/20 13:27:11 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker1 # [ 79.762597] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 79.772053] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 79.774336] nix-daemon[906]: reaped child process 1344, status = succeeded client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... worker1 # [ 79.782585] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> LOG-farm-a-on-standby worker1 # [ 81.212905] nix-daemon[906]: reaped child process 1371, status = succeeded worker1 # [ 81.358235] nix-daemon[906]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker1 # [ 81.369743] nix-daemon[906]: reaped child process 1389, status = succeeded lb # [ 81.370145] niks3-server[1013]: 2026/09/20 13:27:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 81.537661] nix-grpc-daemon[1346]: time=2026-09-20T13:27:13.075Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 81.550243] nix-grpc-daemon[1346]: time=2026-09-20T13:27:13.076Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 81.561542] niks3-server[1013]: 2026/09/20 13:27:13 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 81.572431] niks3-server[1013]: 2026/09/20 13:27:13 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 81.582853] niks3-server[1013]: 2026/09/20 13:27:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 81.589827] niks3-server[1013]: 2026/09/20 13:27:13 INFO Signed narinfos id=28 count=1 worker1 # [ 81.603980] nix-grpc-daemon[1346]: time=2026-09-20T13:27:13.142Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.593234] niks3-server[1013]: 2026/09/20 13:27:13 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 81.602879] niks3-server[1013]: 2026/09/20 13:27:13 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 81.611113] niks3-server[1013]: 2026/09/20 13:27:13 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo lb # [ 81.614144] niks3-server[1013]: 2026/09/20 13:27:13 INFO Completed upload id=28 worker1 # [ 81.627133] nix-grpc-daemon[1346]: time=2026-09-20T13:27:13.166Z level=INFO msg="Upload complete. (435ms)" worker1 # [ 81.638508] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker1 # [ 81.655872] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:13Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 81.660561] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:13Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 81.670363] nix-daemon[906]: reaped child process 1369, status = succeeded worker1 # [ 81.699702] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 81.706600] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 81.712992] nix-grpc-daemon[1346]: time=2026-09-20T13:27:13.252Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 81.718366] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37544 client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 81.728210] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 81.900366] nix-daemon[906]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker1 # [ 81.915844] nix-daemon[906]: reaped child process 1398, status = succeeded worker1 # [ 82.066904] nix-daemon[906]: accepted connection from pid 1400, user nix-grpc-daemon (trusted) worker1 # [ 82.079292] nix-daemon[906]: reaped child process 1403, status = succeeded lb # [ 82.079305] niks3-server[1013]: 2026/09/20 13:27:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 82.097739] nix-grpc-daemon[1346]: time=2026-09-20T13:27:13.637Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 82.099500] nix-grpc-daemon[1346]: time=2026-09-20T13:27:13.637Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 82.096102] niks3-server[1013]: 2026/09/20 13:27:14 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 82.099691] niks3-server[1013]: 2026/09/20 13:27:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 82.102666] niks3-server[1013]: 2026/09/20 13:27:14 INFO Signed narinfos id=29 count=1 worker1 # [ 82.115417] nix-grpc-daemon[1346]: time=2026-09-20T13:27:13.655Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.106202] niks3-server[1013]: 2026/09/20 13:27:14 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 82.112601] niks3-server[1013]: 2026/09/20 13:27:14 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 82.116276] niks3-server[1013]: 2026/09/20 13:27:14 INFO Completed upload id=29 worker1 # [ 82.130594] nix-grpc-daemon[1346]: time=2026-09-20T13:27:13.670Z level=INFO msg="Upload complete. (396ms)" lb # [ 82.118409] niks3-server[1013]: 2026/09/20 13:27:14 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 82.132960] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37544 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 82.136261] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 82.141293] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 82.149144] nix-daemon[906]: reaped child process 1393, status = succeeded client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker1 # [ 82.153599] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 82.965479] nix-daemon[906]: reaped child process 1407, status = succeeded client # farm-b> LOG-farm-b-on-standby worker1 # [ 83.104684] nix-daemon[906]: accepted connection from pid 1422, user nix-grpc-daemon (trusted) worker1 # [ 83.116904] nix-daemon[906]: reaped child process 1425, status = succeeded lb # [ 83.118498] niks3-server[1013]: 2026/09/20 13:27:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 83.140768] nix-grpc-daemon[1346]: time=2026-09-20T13:27:14.679Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 83.142205] nix-grpc-daemon[1346]: time=2026-09-20T13:27:14.679Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 83.153660] niks3-server[1013]: 2026/09/20 13:27:15 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 83.162347] niks3-server[1013]: 2026/09/20 13:27:15 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 83.173074] niks3-server[1013]: 2026/09/20 13:27:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 83.178646] niks3-server[1013]: 2026/09/20 13:27:15 INFO Signed narinfos id=30 count=1 worker1 # [ 83.194526] nix-grpc-daemon[1346]: time=2026-09-20T13:27:14.734Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.183740] niks3-server[1013]: 2026/09/20 13:27:15 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 83.194766] niks3-server[1013]: 2026/09/20 13:27:15 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 83.198342] niks3-server[1013]: 2026/09/20 13:27:15 INFO Completed upload id=30 worker1 # [ 83.212381] nix-grpc-daemon[1346]: time=2026-09-20T13:27:14.752Z level=INFO msg="Upload complete. (253ms)" lb # [ 83.199817] niks3-server[1013]: 2026/09/20 13:27:15 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 83.215621] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 83.221593] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:14Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 83.223527] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:14Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 83.228399] nix-daemon[906]: reaped child process 1405, status = succeeded worker1 # [ 83.264726] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 83.273443] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 83.288627] nix-grpc-daemon[1346]: time=2026-09-20T13:27:14.828Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 83.293481] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 83.298288] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 83.423473] nix-daemon[906]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker1 # [ 83.435928] nix-daemon[906]: reaped child process 1434, status = succeeded worker1 # [ 83.568527] nix-daemon[906]: accepted connection from pid 1436, user nix-grpc-daemon (trusted) worker1 # [ 83.580681] nix-daemon[906]: reaped child process 1439, status = succeeded lb # [ 83.576317] niks3-server[1013]: 2026/09/20 13:27:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 83.807551] nix-grpc-daemon[1346]: time=2026-09-20T13:27:15.346Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 83.809300] nix-grpc-daemon[1346]: time=2026-09-20T13:27:15.347Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 83.815300] niks3-server[1013]: 2026/09/20 13:27:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 83.820324] niks3-server[1013]: 2026/09/20 13:27:15 INFO Signed narinfos id=31 count=1 worker1 # [ 83.836592] nix-grpc-daemon[1346]: time=2026-09-20T13:27:15.375Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.824533] niks3-server[1013]: 2026/09/20 13:27:15 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 83.837331] niks3-server[1013]: 2026/09/20 13:27:15 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 83.845362] niks3-server[1013]: 2026/09/20 13:27:15 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 83.850785] niks3-server[1013]: 2026/09/20 13:27:15 INFO Completed upload id=31 worker1 # [ 83.866770] nix-grpc-daemon[1346]: time=2026-09-20T13:27:15.406Z level=INFO msg="Upload complete. (562ms)" lb # [ 83.856094] niks3-server[1013]: 2026/09/20 13:27:15 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 83.872156] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37544 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 83.877888] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 83.891133] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 83.900772] nix-daemon[906]: reaped child process 1429, status = succeeded client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 83.911941] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-on-standby worker1 # [ 84.930203] nix-daemon[906]: reaped child process 1443, status = succeeded worker1 # [ 85.065832] nix-daemon[906]: accepted connection from pid 1458, user nix-grpc-daemon (trusted) worker1 # [ 85.077696] nix-daemon[906]: reaped child process 1461, status = succeeded lb # [ 85.075222] niks3-server[1013]: 2026/09/20 13:27:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 85.093353] nix-grpc-daemon[1346]: time=2026-09-20T13:27:16.633Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 85.094844] nix-grpc-daemon[1346]: time=2026-09-20T13:27:16.634Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 85.095903] niks3-server[1013]: 2026/09/20 13:27:17 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 85.098524] niks3-server[1013]: 2026/09/20 13:27:17 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 85.102642] niks3-server[1013]: 2026/09/20 13:27:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 85.104506] niks3-server[1013]: 2026/09/20 13:27:17 INFO Signed narinfos id=32 count=1 worker1 # [ 85.117209] nix-grpc-daemon[1346]: time=2026-09-20T13:27:16.656Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.108233] niks3-server[1013]: 2026/09/20 13:27:17 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 85.112061] niks3-server[1013]: 2026/09/20 13:27:17 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 85.115561] niks3-server[1013]: 2026/09/20 13:27:17 INFO Completed upload id=32 worker1 # [ 85.128188] nix-grpc-daemon[1346]: time=2026-09-20T13:27:16.668Z level=INFO msg="Upload complete. (203ms)" lb # [ 85.117054] niks3-server[1013]: 2026/09/20 13:27:17 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker1 # [ 85.131329] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker1 # [ 85.137861] nix-daemon[906]: reaped child process 1441, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 7.80 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.20 seconds) worker2 # [ 85.445226] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 85.449875] systemd[1]: Starting scheduler-token.service... worker2 # [ 85.515537] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 85.517405] systemd[1]: Finished scheduler-token.service. worker2 # [ 85.520878] systemd[1]: scheduler-token.service: Consumed 21ms CPU time over 67ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 85.524130] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 85.689482] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 85.692270] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 85.696133] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 85.703685] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 85.705298] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 85.724225] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.721841] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:17Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 85.723252] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:37528 worker1 # [ 85.724918] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.52 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs client # [ 86.003685] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 8f929c86a0b2495bb87665505e6652e8 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds) worker2 # [ 86.237170] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54762 worker2 # [ 86.250270] nix-daemon[866]: accepted connection from pid 1199, user nix-grpc-daemon (trusted) client # [ 86.238890] nix[1176]: don't know how to build these paths: client # [ 86.239966] nix[1176]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 86.263731] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:17Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 86.265554] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:17Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 86.307133] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 86.318506] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37544 client # [ 86.311440] nix[1176]: copying 1 paths to 'lb:50051'... worker1 # [ 86.327648] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37544 client # [ 86.312454] nix[1176]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 86.334135] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 86.464790] nix-daemon[906]: accepted connection from pid 1474, user nix-grpc-daemon (trusted) worker1 # [ 86.476820] nix-daemon[906]: reaped child process 1477, status = succeeded worker1 # [ 86.642795] nix-daemon[906]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) worker1 # [ 86.654553] nix-daemon[906]: reaped child process 1482, status = succeeded lb # [ 86.659679] niks3-server[1013]: 2026/09/20 13:27:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 86.678846] nix-grpc-daemon[1346]: time=2026-09-20T13:27:18.218Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 86.680687] nix-grpc-daemon[1346]: time=2026-09-20T13:27:18.220Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 86.676787] niks3-server[1013]: 2026/09/20 13:27:18 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 86.679890] niks3-server[1013]: 2026/09/20 13:27:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 86.681570] niks3-server[1013]: 2026/09/20 13:27:18 INFO Signed narinfos id=33 count=1 worker1 # [ 86.694642] nix-grpc-daemon[1346]: time=2026-09-20T13:27:18.234Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.685937] niks3-server[1013]: 2026/09/20 13:27:18 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 86.690307] niks3-server[1013]: 2026/09/20 13:27:18 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 86.693541] niks3-server[1013]: 2026/09/20 13:27:18 INFO Completed upload id=33 worker1 # [ 86.707502] nix-grpc-daemon[1346]: time=2026-09-20T13:27:18.247Z level=INFO msg="Upload complete. (368ms)" lb # [ 86.695491] niks3-server[1013]: 2026/09/20 13:27:18 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 86.709716] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37544 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 86.712675] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 worker1 # [ 86.719413] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 86.721432] nix-daemon[906]: reaped child process 1472, status = succeeded worker1 # [ 86.726106] nix-daemon[906]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) client # [ 86.709306] nix[1176]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb # [ 87.988217] envoy[922]: conn peer=[2001:db8:1::1]:34958 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9564 tx=3867 ms=7586 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 88.814031] systemd-journald[285]: Received client request to rotate journal, rotating. worker2 # [ 88.832563] systemd-journald[285]: Vacuuming done, freed 0B of archived journals from /var/log/journal/6bccd763220b4c6980ad21df1ed0c48f. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.05 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 88.725623] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) client: must succeed: sleep 5.0 worker1 # [ 89.360740] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:20Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.04 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 94.164788] nix-daemon[906]: reaped child process 1486, status = succeeded worker1 # [ 94.343171] nix-daemon[906]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker1 # [ 94.356978] nix-daemon[906]: reaped child process 1529, status = succeeded lb # [ 94.363515] niks3-server[1013]: 2026/09/20 13:27:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 94.385744] nix-grpc-daemon[1346]: time=2026-09-20T13:27:25.925Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 94.387474] nix-grpc-daemon[1346]: time=2026-09-20T13:27:25.927Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 94.405212] niks3-server[1013]: 2026/09/20 13:27:26 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 94.416440] niks3-server[1013]: 2026/09/20 13:27:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 94.425876] niks3-server[1013]: 2026/09/20 13:27:26 INFO Signed narinfos id=34 count=1 worker1 # [ 94.441663] nix-grpc-daemon[1346]: time=2026-09-20T13:27:25.981Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.438974] niks3-server[1013]: 2026/09/20 13:27:26 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 94.448972] niks3-server[1013]: 2026/09/20 13:27:26 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 94.456781] niks3-server[1013]: 2026/09/20 13:27:26 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo lb # [ 94.459453] niks3-server[1013]: 2026/09/20 13:27:26 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 94.462037] niks3-server[1013]: 2026/09/20 13:27:26 INFO Completed upload id=34 worker1 # [ 94.474841] nix-grpc-daemon[1346]: time=2026-09-20T13:27:26.014Z level=INFO msg="Upload complete. (334ms)" worker1 # [ 94.480055] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37544 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 94.485960] nix-daemon[906]: reaped child process 1484, status = succeeded client # [ 94.486340] systemd[1]: rs.service: Deactivated successfully. client # [ 94.488084] systemd[1]: rs.service: Consumed 110ms CPU time over 8.484s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic. worker1 # [ 95.364291] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:26Z level=info event=signal_exit lb # [ 95.572477] niks3-server[1013]: 2026/09/20 13:27:27 INFO lead: released remote=192.168.1.3:40512 worker1 # [ 95.585289] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_yield worker2 # [ 95.600138] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:27Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 95.592183] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 95.595344] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37528 worker1 # [ 95.598626] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 95.601555] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37528 worker1 # [ 95.604835] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=worker_gone addr=192.168.1.3:50051 lb # [ 95.690649] niks3-server[1013]: 2026/09/20 13:27:27 INFO lead: acquired remote=192.168.1.4:54058 worker2 # [ 95.714268] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:27Z level=info event=scheduler_take_over worker2 # [ 95.800223] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 95.791763] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.804117] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 95.795756] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.005319] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 95.996665] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.009295] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.000513] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.12 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker2 # [ 96.209947] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.212261] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker1 # [ 96.202322] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.205688] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 96.413600] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.402959] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.417265] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.407094] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.590114] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:28Z level=info event=scheduler_restarting worker2 # [ 96.619562] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.622840] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.620798] nix-daemon[906]: reaped child process 1337, status = succeeded worker1 # [ 96.623290] nix-grpc-daemon[1270]: ts=2026-09-20T13:27:28Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 96.819744] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.821555] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.022611] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.026589] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.227651] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.234919] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:29Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 97.236475] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:29Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42262 worker2 # [ 97.238105] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker1 # [ 97.471160] nix-grpc-daemon[1270]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 97.473130] nix-grpc-daemon[1270]: E0000 00:00:1789910849.010635 1313 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 97.476055] nix-grpc-daemon[1270]: E0000 00:00:1789910849.015966 1313 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 97.862571] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 97.866154] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 97.868314] systemd[1]: nix-grpc-daemon.service: Consumed 1.338s CPU time over 26.691s wall clock time, 33.5M memory peak, 51.4K incoming IP traffic, 101.9K outgoing IP traffic. worker1 # [ 97.884626] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 97.987970] envoy[922]: conn peer=[2001:db8:1::1]:52996 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1325 ms=8268 lb # [ 97.989715] envoy[922]: conn peer=[2001:db8:1::3]:38986 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6606 tx=1560 ms=25245 worker1 # [ 98.038499] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:29Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 98.040310] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 98.044058] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 98.051639] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:29Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 98.054888] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 98.067231] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.079975] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42262 worker2 # [ 98.084888] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.59 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid client # [ 98.572283] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 11430a5400824fe2a0f6a8df5e2cb2be client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds) worker2 # [ 98.784258] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54762 client # [ 98.763258] nix[1212]: don't know how to build these paths: client # [ 98.764409] nix[1212]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker2 # [ 98.798661] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:30Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 98.804000] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:30Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 98.842833] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54762 worker2 # [ 98.858303] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 1/5) worker2 # [ 98.885723] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 2/5) worker2 # [ 98.963518] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 138 ms (attempt 3/5) worker2 # [ 99.108361] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 426 ms (attempt 4/5) worker2 # [ 99.535128] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 99.550465] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54762 client # [ 99.533987] nix[1212]: copying 1 paths to 'lb:50051'... client # [ 99.538231] nix[1212]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker2 # [ 99.564616] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54762 worker2 # [ 99.575821] nix-daemon[866]: accepted connection from pid 1199, user nix-grpc-daemon (trusted) worker2 # [ 99.594272] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:31Z level=info event=niks3_push_started pid=1320 worker2 # [ 99.776252] nix-grpc-daemon[1320]: time=2026-09-20T13:27:31.671Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca="" worker2 # [ 99.929104] nix-daemon[866]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker2 # [ 99.941839] nix-daemon[866]: reaped child process 1340, status = succeeded worker2 # [ 100.091468] nix-daemon[866]: accepted connection from pid 1342, user nix-grpc-daemon (trusted) worker2 # [ 100.103759] nix-daemon[866]: reaped child process 1345, status = succeeded lb # [ 100.093275] niks3-server[1013]: 2026/09/20 13:27:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.122162] nix-grpc-daemon[1320]: time=2026-09-20T13:27:32.019Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 100.123701] nix-grpc-daemon[1320]: time=2026-09-20T13:27:32.020Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 100.113859] niks3-server[1013]: 2026/09/20 13:27:32 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 100.118819] niks3-server[1013]: 2026/09/20 13:27:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 100.122113] niks3-server[1013]: 2026/09/20 13:27:32 INFO Signed narinfos id=35 count=1 worker2 # [ 100.145527] nix-grpc-daemon[1320]: time=2026-09-20T13:27:32.042Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.125614] niks3-server[1013]: 2026/09/20 13:27:32 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 100.130521] niks3-server[1013]: 2026/09/20 13:27:32 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 100.134209] niks3-server[1013]: 2026/09/20 13:27:32 INFO Completed upload id=35 worker2 # [ 100.157674] nix-grpc-daemon[1320]: time=2026-09-20T13:27:32.054Z level=INFO msg="Upload complete. (379ms)" lb # [ 100.135974] niks3-server[1013]: 2026/09/20 13:27:32 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker2 # [ 100.159888] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54762 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 100.164103] nix-grpc-daemon[1199]: ts=2026-09-20T13:27:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54762 worker2 # [ 100.169548] nix-daemon[866]: accepted connection from pid 1199, user nix-grpc-daemon (trusted) worker2 # [ 100.171901] nix-daemon[866]: reaped child process 1318, status = succeeded worker2 # [ 100.176780] nix-daemon[866]: accepted connection from pid 1199, user nix-grpc-daemon (trusted) client # [ 100.150328] nix[1212]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 102.237259] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1199 (nix-grpc-daemon) on client request. worker2 # [ 102.240399] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 102.223380] niks3-server[1013]: 2026/09/20 13:27:34 INFO lead: released remote=192.168.1.4:54058 worker1 # [ 102.236151] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 102.221771] nix[1212]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again client # [ 102.226678] nix[1212]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 102.260325] systemd[1]: Starting scheduler-token.service... worker2 # [ 102.270688] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 102.272191] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 102.274186] systemd[1]: nix-grpc-daemon.service: Consumed 436ms CPU time over 16.742s wall clock time, 31.3M memory peak, 16.9K incoming IP traffic, 37K outgoing IP traffic. worker2 # [ 102.285067] nix-daemon[866]: reaped child process 1347, status = succeeded worker2 # [ 102.286960] nix-daemon[866]: reaped child process 1255, status = succeeded worker2 # [ 102.294685] nix-daemon[1349]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 102.301950] nix-daemon[866]: reaped child process 1349, status = failed with exit code 1 worker2 # [ 102.338217] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 102.340679] systemd[1]: Finished scheduler-token.service. worker2 # [ 102.341833] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 78ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 102.343630] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 102.349858] systemd[1]: Starting scheduler-token.service... worker2 # [ 102.395747] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 102.397382] systemd[1]: Finished scheduler-token.service. worker2 # [ 102.398511] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 47ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 102.403102] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 102.436774] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.531337] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 102.533886] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 102.537668] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 102.544846] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 102.550146] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 102.533038] niks3-server[1013]: 2026/09/20 13:27:34 INFO lead: acquired remote=192.168.1.4:41036 worker2 # [ 102.556433] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=scheduler_take_over worker1 # [ 102.545625] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.36 seconds) client: must succeed: sleep 5.0 worker2 # [ 102.563398] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.567531] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 102.569044] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42268 worker2 # [ 102.570725] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 102.746626] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.758655] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42268 worker2 # [ 102.763780] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 102.773469] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 102.778166] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 102.824953] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46472 worker2 # [ 102.833433] nix-daemon[866]: accepted connection from pid 1391, user nix-grpc-daemon (trusted) worker2 # [ 102.849286] nix-daemon[866]: accepted connection from pid 1391, user nix-grpc-daemon (trusted) client # [ 102.835601] nix[1212]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker2 # [ 102.863546] nix-daemon[866]: accepted connection from pid 1391, user nix-grpc-daemon (trusted) client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 107.882800] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:39Z level=info event=niks3_push_started pid=1470 worker2 # [ 107.904276] nix-daemon[866]: reaped child process 1446, status = succeeded lb # [ 107.987939] envoy[922]: conn peer=[2001:db8:1::4]:44526 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7821 tx=567 ms=16528 worker2 # [ 108.050505] nix-grpc-daemon[1470]: time=2026-09-20T13:27:39.946Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca="" worker2 # [ 108.189218] nix-daemon[866]: accepted connection from pid 1483, user nix-grpc-daemon (trusted) worker2 # [ 108.201938] nix-daemon[866]: reaped child process 1486, status = succeeded lb # [ 108.190248] niks3-server[1013]: 2026/09/20 13:27:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 108.219434] nix-grpc-daemon[1470]: time=2026-09-20T13:27:40.116Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 108.220953] nix-grpc-daemon[1470]: time=2026-09-20T13:27:40.118Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 108.216285] niks3-server[1013]: 2026/09/20 13:27:40 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 108.220395] niks3-server[1013]: 2026/09/20 13:27:40 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 108.223382] niks3-server[1013]: 2026/09/20 13:27:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 108.225099] niks3-server[1013]: 2026/09/20 13:27:40 INFO Signed narinfos id=36 count=1 worker2 # [ 108.249620] nix-grpc-daemon[1470]: time=2026-09-20T13:27:40.146Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.228434] niks3-server[1013]: 2026/09/20 13:27:40 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 108.233554] niks3-server[1013]: 2026/09/20 13:27:40 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 108.237071] niks3-server[1013]: 2026/09/20 13:27:40 INFO Completed upload id=36 worker2 # [ 108.260375] nix-grpc-daemon[1470]: time=2026-09-20T13:27:40.157Z level=INFO msg="Upload complete. (206ms)" worker2 # [ 108.264067] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46472 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 108.267562] nix-grpc-daemon[1470]: time=2026-09-20T13:27:40.163Z level=WARN msg="Failed to register uploaded object" key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 108.273725] nix-daemon[866]: reaped child process 1444, status = succeeded client # [ 108.278402] systemd[1]: mid.service: Deactivated successfully. client # [ 108.281979] systemd[1]: mid.service: Consumed 122ms CPU time over 9.708s wall clock time, 37.3M memory peak, 9.6K incoming IP traffic, 10.6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.35 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr client # [ 108.918261] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 72937129443043a287c97724cef34fef client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds) worker1 # [ 109.123435] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 109.134836] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) client # [ 109.130605] nix[1248]: don't know how to build these paths: client # [ 109.131480] nix[1248]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker2 # [ 109.170410] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:41Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker2 # [ 109.174646] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:41Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 109.202745] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 109.216462] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5) worker1 # [ 109.274329] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 2/5) worker1 # [ 109.339942] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 3/5) worker1 # [ 109.372566] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 382 ms (attempt 4/5) worker1 # [ 109.761780] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 109.780700] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 client # [ 109.775315] nix[1248]: copying 1 paths to 'lb:50051'... client # [ 109.778991] nix[1248]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker1 # [ 109.796297] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 109.807161] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 109.827566] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:41Z level=info event=niks3_push_started pid=1624 worker1 # [ 110.024591] nix-grpc-daemon[1624]: time=2026-09-20T13:27:41.564Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca="" worker1 # [ 110.187617] nix-daemon[906]: accepted connection from pid 1637, user nix-grpc-daemon (trusted) worker1 # [ 110.199501] nix-daemon[906]: reaped child process 1644, status = succeeded worker1 # [ 110.352793] nix-daemon[906]: accepted connection from pid 1646, user nix-grpc-daemon (trusted) worker1 # [ 110.364645] nix-daemon[906]: reaped child process 1649, status = succeeded lb # [ 110.365260] niks3-server[1013]: 2026/09/20 13:27:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.412940] nix-grpc-daemon[1624]: time=2026-09-20T13:27:41.951Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 110.414383] nix-grpc-daemon[1624]: time=2026-09-20T13:27:41.951Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 110.435683] niks3-server[1013]: 2026/09/20 13:27:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker1 # [ 110.454507] nix-grpc-daemon[1624]: time=2026-09-20T13:27:41.994Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.440987] niks3-server[1013]: 2026/09/20 13:27:42 INFO Signed narinfos id=37 count=1 lb # [ 110.446680] niks3-server[1013]: 2026/09/20 13:27:42 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 110.452714] niks3-server[1013]: 2026/09/20 13:27:42 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 110.460854] niks3-server[1013]: 2026/09/20 13:27:42 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 110.466714] niks3-server[1013]: 2026/09/20 13:27:42 INFO Completed upload id=37 worker1 # [ 110.479651] nix-grpc-daemon[1624]: time=2026-09-20T13:27:42.019Z level=INFO msg="Upload complete. (451ms)" lb # [ 110.469720] niks3-server[1013]: 2026/09/20 13:27:42 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker1 # [ 110.484942] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 110.491861] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 110.501474] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 110.513310] nix-daemon[906]: reaped child process 1622, status = succeeded worker1 # [ 110.517779] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) client # [ 110.501781] nix[1248]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 112.439883] systemd[1]: intr.service: Sent signal SIGINT to main process 1248 (nix) on client request. worker1 # [ 112.463435] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:44Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 112.448223] nix[1248]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 112.454779] nix[1248]: error: interrupted by the user client # [ 112.485940] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 112.487307] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 112.489071] systemd[1]: intr.service: Consumed 108ms CPU time over 3.567s wall clock time, 39.1M memory peak, 7.5K incoming IP traffic, 8.6K outgoing IP traffic. worker1 # [ 112.538240] nix-daemon[906]: reaped child process 1651, status = succeeded worker1 # [ 112.544279] nix-daemon[1653]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 112.547848] nix-daemon[906]: reaped child process 1653, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 4.79 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw client # [ 113.729145] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 108052f74e3046baaa7d7f0972756ad8 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds) client # [ 113.924618] nix[1269]: don't know how to build these paths: client # [ 113.925527] nix[1269]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker2 # [ 113.947997] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46472 worker2 # [ 113.961216] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:45Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 113.965723] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:45Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 114.009525] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46472 worker2 # [ 114.016338] nix-grpc-daemon[1391]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5) worker2 # [ 114.054076] nix-grpc-daemon[1391]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 120 ms (attempt 2/5) worker2 # [ 114.180381] nix-grpc-daemon[1391]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 178 ms (attempt 3/5) worker2 # [ 114.364860] nix-grpc-daemon[1391]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 628 ms (attempt 4/5) worker2 # [ 114.996336] nix-grpc-daemon[1391]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 115.010821] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46472 client # [ 114.993118] nix[1269]: copying 1 paths to 'lb:50051'... client # [ 114.993865] nix[1269]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker2 # [ 115.020540] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46472 worker2 # [ 115.024899] nix-daemon[866]: accepted connection from pid 1391, user nix-grpc-daemon (trusted) worker2 # [ 115.196554] nix-daemon[866]: accepted connection from pid 1529, user nix-grpc-daemon (trusted) worker2 # [ 115.211771] nix-daemon[866]: reaped child process 1532, status = succeeded worker2 # [ 115.385584] nix-daemon[866]: accepted connection from pid 1534, user nix-grpc-daemon (trusted) worker2 # [ 115.397934] nix-daemon[866]: reaped child process 1537, status = succeeded lb # [ 115.387579] niks3-server[1013]: 2026/09/20 13:27:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 115.416219] nix-grpc-daemon[1470]: time=2026-09-20T13:27:47.312Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 115.417607] nix-grpc-daemon[1470]: time=2026-09-20T13:27:47.312Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 115.403416] niks3-server[1013]: 2026/09/20 13:27:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 115.406176] niks3-server[1013]: 2026/09/20 13:27:47 INFO Signed narinfos id=38 count=1 worker2 # [ 115.429728] nix-grpc-daemon[1470]: time=2026-09-20T13:27:47.326Z level=INFO msg="Uploading 1 narinfos" lb # [ 115.411205] niks3-server[1013]: 2026/09/20 13:27:47 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 115.415065] niks3-server[1013]: 2026/09/20 13:27:47 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 115.420107] niks3-server[1013]: 2026/09/20 13:27:47 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 115.423897] niks3-server[1013]: 2026/09/20 13:27:47 INFO Completed upload id=38 worker2 # [ 115.448433] nix-grpc-daemon[1470]: time=2026-09-20T13:27:47.345Z level=INFO msg="Upload complete. (416ms)" lb # [ 115.426292] niks3-server[1013]: 2026/09/20 13:27:47 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker2 # [ 115.450456] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46472 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 115.453963] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46472 worker2 # [ 115.459946] nix-daemon[866]: accepted connection from pid 1391, user nix-grpc-daemon (trusted) worker2 # [ 115.462168] nix-daemon[866]: reaped child process 1527, status = succeeded worker2 # [ 115.467697] nix-daemon[866]: accepted connection from pid 1391, user nix-grpc-daemon (trusted) client # [ 115.440592] nix[1269]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done lb # [ 117.988615] envoy[922]: conn peer=[2001:db8:1::1]:60526 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3848 tx=1662 ms=9496 lb # [ 117.992549] envoy[922]: conn peer=[2001:db8:1::1]:56732 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=728 ms=3365 worker2 # [ 118.092996] nixos[1572]: switching to system configuration /nix/store/1s7hk7v6xhwd69k2r25jlpix4jrc15kf-nixos-system-worker2-test worker2 # [ 118.096397] systemd[1]: Stopped target Remote File Systems. worker2 # activating the configuration... worker2 # [ 118.098986] systemd[1]: Stopped target Local File Systems. worker2 # setting up /etc... worker2 # [ 118.746159] systemd[1]: Reload requested from client PID 1572 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 118.748096] systemd[1]: Reloading... worker2 # [ 119.419370] systemd[1]: Reloading finished in 670 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 119.474212] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 119.591351] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 119.593462] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 119.599296] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 119.601626] dbus-broker-launch[532]: Caught SIGHUP, trigger reload. worker2 # [ 119.605142] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 119.636570] dbus-broker-launch[532]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 119.640200] dbus-broker-launch[532]: NSS returned no entry for 'systemd-timesync' worker2 # [ 119.641324] dbus-broker-launch[532]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 119.644667] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 119.662330] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 119.665472] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 119.667314] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 119.675704] systemd[1]: Reached target Remote File Systems. worker2 # [ 119.679673] systemd[1]: Reached target Local File Systems. worker2 # [ 119.682109] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 119.687650] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 119.688457] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 119.689558] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 119.691461] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 119.692862] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 119.695562] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 120.091771] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 120.094404] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 120.097455] systemd[1]: Starting linger-users.service... worker2 # [ 120.138352] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 120.140796] systemd[1]: Finished linger-users.service. worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 120.396765] nixos[1572]: finished switching to system configuration /nix/store/1s7hk7v6xhwd69k2r25jlpix4jrc15kf-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.05 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2 worker2 # [ 120.557667] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:52Z level=info event=draining worker1 # [ 120.655632] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56640 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker1 # [ 120.661492] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker2 # [ 120.688802] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:52Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker2 # [ 120.691140] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:52Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 120.726575] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 120.738112] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 client # copying 1 paths to 'lb:50051'... worker1 # [ 120.748187] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker1 # [ 120.765916] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 120.934629] nix-daemon[906]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 120.946396] nix-daemon[906]: reaped child process 1710, status = succeeded worker1 # [ 121.116074] nix-daemon[906]: accepted connection from pid 1712, user nix-grpc-daemon (trusted) worker1 # [ 121.127588] nix-daemon[906]: reaped child process 1715, status = succeeded lb # [ 121.130443] niks3-server[1013]: 2026/09/20 13:27:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 121.147601] nix-grpc-daemon[1624]: time=2026-09-20T13:27:52.687Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 121.149126] nix-grpc-daemon[1624]: time=2026-09-20T13:27:52.689Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 121.147814] niks3-server[1013]: 2026/09/20 13:27:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 121.149260] niks3-server[1013]: 2026/09/20 13:27:53 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 121.151596] niks3-server[1013]: 2026/09/20 13:27:53 INFO Signed narinfos id=39 count=1 worker1 # [ 121.164369] nix-grpc-daemon[1624]: time=2026-09-20T13:27:52.704Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.154575] niks3-server[1013]: 2026/09/20 13:27:53 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 121.159105] niks3-server[1013]: 2026/09/20 13:27:53 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 121.164192] niks3-server[1013]: 2026/09/20 13:27:53 INFO Completed upload id=39 worker1 # [ 121.176949] nix-grpc-daemon[1624]: time=2026-09-20T13:27:52.716Z level=INFO msg="Upload complete. (397ms)" lb # [ 121.165883] niks3-server[1013]: 2026/09/20 13:27:53 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker1 # [ 121.178892] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 121.184407] nix-daemon[906]: reaped child process 1705, status = succeeded worker1 # [ 121.188885] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 121.193168] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 121.198327] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker1 # [ 122.210545] nix-daemon[906]: reaped child process 1719, status = succeeded client # farm-a> LOG-farm-a-during-drain worker1 # [ 122.360560] nix-daemon[906]: accepted connection from pid 1734, user nix-grpc-daemon (trusted) worker1 # [ 122.372129] nix-daemon[906]: reaped child process 1737, status = succeeded lb # [ 122.372445] niks3-server[1013]: 2026/09/20 13:27:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 122.393811] nix-grpc-daemon[1624]: time=2026-09-20T13:27:53.933Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 122.395294] nix-grpc-daemon[1624]: time=2026-09-20T13:27:53.935Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 122.407304] niks3-server[1013]: 2026/09/20 13:27:54 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 122.425862] niks3-server[1013]: 2026/09/20 13:27:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker1 # [ 122.443872] nix-grpc-daemon[1624]: time=2026-09-20T13:27:53.983Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.430739] niks3-server[1013]: 2026/09/20 13:27:54 INFO Signed narinfos id=40 count=1 lb # [ 122.436157] niks3-server[1013]: 2026/09/20 13:27:54 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 122.442831] niks3-server[1013]: 2026/09/20 13:27:54 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 122.450695] niks3-server[1013]: 2026/09/20 13:27:54 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 122.454083] niks3-server[1013]: 2026/09/20 13:27:54 INFO Completed upload id=40 worker1 # [ 122.466902] nix-grpc-daemon[1624]: time=2026-09-20T13:27:54.006Z level=INFO msg="Upload complete. (262ms)" lb # [ 122.456204] niks3-server[1013]: 2026/09/20 13:27:54 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker1 # [ 122.470334] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker1 # [ 122.476319] nix-daemon[906]: reaped child process 1717, status = succeeded worker2 # [ 122.487043] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:54Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 122.488795] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:54Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 122.518097] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 122.527778] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 122.536335] nix-grpc-daemon[1624]: time=2026-09-20T13:27:54.076Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 122.540508] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker1 # [ 122.549071] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 122.703426] nix-daemon[906]: accepted connection from pid 1741, user nix-grpc-daemon (trusted) worker1 # [ 122.715488] nix-daemon[906]: reaped child process 1744, status = succeeded worker1 # [ 122.878554] nix-daemon[906]: accepted connection from pid 1746, user nix-grpc-daemon (trusted) worker1 # [ 122.890237] nix-daemon[906]: reaped child process 1749, status = succeeded lb # [ 122.892652] niks3-server[1013]: 2026/09/20 13:27:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 122.910488] nix-grpc-daemon[1624]: time=2026-09-20T13:27:54.450Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 122.911921] nix-grpc-daemon[1624]: time=2026-09-20T13:27:54.450Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 122.905701] niks3-server[1013]: 2026/09/20 13:27:54 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 122.910877] niks3-server[1013]: 2026/09/20 13:27:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker1 # [ 122.927055] nix-grpc-daemon[1624]: time=2026-09-20T13:27:54.466Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.914365] niks3-server[1013]: 2026/09/20 13:27:54 INFO Signed narinfos id=41 count=1 lb # [ 122.917400] niks3-server[1013]: 2026/09/20 13:27:54 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 122.921878] niks3-server[1013]: 2026/09/20 13:27:54 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 122.926142] niks3-server[1013]: 2026/09/20 13:27:55 INFO Completed upload id=41 worker1 # [ 122.941022] nix-grpc-daemon[1624]: time=2026-09-20T13:27:54.480Z level=INFO msg="Upload complete. (386ms)" lb # [ 122.928859] niks3-server[1013]: 2026/09/20 13:27:55 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker1 # [ 122.942814] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 122.946149] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 122.950140] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 122.954745] nix-daemon[906]: reaped child process 1739, status = succeeded client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker1 # [ 122.959551] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 123.771877] nix-daemon[906]: reaped child process 1753, status = succeeded client # farm-b> LOG-farm-b-during-drain worker1 # [ 123.921726] nix-daemon[906]: accepted connection from pid 1768, user nix-grpc-daemon (trusted) worker1 # [ 123.933376] nix-daemon[906]: reaped child process 1771, status = succeeded lb # [ 123.937495] niks3-server[1013]: 2026/09/20 13:27:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 123.958527] nix-grpc-daemon[1624]: time=2026-09-20T13:27:55.498Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 123.960092] nix-grpc-daemon[1624]: time=2026-09-20T13:27:55.500Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 123.974850] niks3-server[1013]: 2026/09/20 13:27:56 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 123.982645] niks3-server[1013]: 2026/09/20 13:27:56 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 123.990171] niks3-server[1013]: 2026/09/20 13:27:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 123.994979] niks3-server[1013]: 2026/09/20 13:27:56 INFO Signed narinfos id=42 count=1 worker1 # [ 124.010764] nix-grpc-daemon[1624]: time=2026-09-20T13:27:55.550Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.005882] niks3-server[1013]: 2026/09/20 13:27:56 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 124.011455] niks3-server[1013]: 2026/09/20 13:27:56 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 124.017341] niks3-server[1013]: 2026/09/20 13:27:56 INFO Completed upload id=42 worker1 # [ 124.030456] nix-grpc-daemon[1624]: time=2026-09-20T13:27:55.570Z level=INFO msg="Upload complete. (264ms)" lb # [ 124.019685] niks3-server[1013]: 2026/09/20 13:27:56 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 124.050922] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:55Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 124.036613] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker2 # [ 124.052690] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:55Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 124.049635] nix-daemon[906]: reaped child process 1751, status = succeeded worker1 # [ 124.084314] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 124.092266] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 124.100204] nix-grpc-daemon[1624]: time=2026-09-20T13:27:55.640Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 124.105780] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker1 # [ 124.121484] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 124.256539] nix-daemon[906]: accepted connection from pid 1775, user nix-grpc-daemon (trusted) worker1 # [ 124.268368] nix-daemon[906]: reaped child process 1778, status = succeeded worker1 # [ 124.424680] nix-daemon[906]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker1 # [ 124.436528] nix-daemon[906]: reaped child process 1783, status = succeeded lb # [ 124.436849] niks3-server[1013]: 2026/09/20 13:27:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 124.458828] nix-grpc-daemon[1624]: time=2026-09-20T13:27:55.998Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 124.460177] nix-grpc-daemon[1624]: time=2026-09-20T13:27:55.998Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 124.464701] niks3-server[1013]: 2026/09/20 13:27:56 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 124.474412] niks3-server[1013]: 2026/09/20 13:27:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 124.479513] niks3-server[1013]: 2026/09/20 13:27:56 INFO Signed narinfos id=43 count=1 worker1 # [ 124.495244] nix-grpc-daemon[1624]: time=2026-09-20T13:27:56.035Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.486613] niks3-server[1013]: 2026/09/20 13:27:56 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 124.496348] niks3-server[1013]: 2026/09/20 13:27:56 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 124.502243] niks3-server[1013]: 2026/09/20 13:27:56 INFO Completed upload id=43 worker1 # [ 124.517163] nix-grpc-daemon[1624]: time=2026-09-20T13:27:56.057Z level=INFO msg="Upload complete. (390ms)" lb # [ 124.506224] niks3-server[1013]: 2026/09/20 13:27:56 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker1 # [ 124.520154] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 124.525389] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 124.534964] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 124.540658] nix-daemon[906]: reaped child process 1773, status = succeeded client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... worker1 # [ 124.543592] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> LOG-farm-top-during-drain worker1 # [ 125.755884] nix-daemon[906]: reaped child process 1787, status = succeeded worker1 # [ 125.889092] nix-daemon[906]: accepted connection from pid 1802, user nix-grpc-daemon (trusted) worker1 # [ 125.901197] nix-daemon[906]: reaped child process 1805, status = succeeded lb # [ 125.902760] niks3-server[1013]: 2026/09/20 13:27:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 125.923387] nix-grpc-daemon[1624]: time=2026-09-20T13:27:57.463Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 125.924984] nix-grpc-daemon[1624]: time=2026-09-20T13:27:57.464Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 125.933288] niks3-server[1013]: 2026/09/20 13:27:58 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 125.947642] niks3-server[1013]: 2026/09/20 13:27:58 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 125.958790] niks3-server[1013]: 2026/09/20 13:27:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 125.976320] nix-grpc-daemon[1624]: time=2026-09-20T13:27:57.516Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.963766] niks3-server[1013]: 2026/09/20 13:27:58 INFO Signed narinfos id=44 count=1 lb # [ 125.968189] niks3-server[1013]: 2026/09/20 13:27:58 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 125.977922] niks3-server[1013]: 2026/09/20 13:27:58 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 125.983576] niks3-server[1013]: 2026/09/20 13:27:58 INFO Completed upload id=44 lb # [ 125.985033] niks3-server[1013]: 2026/09/20 13:27:58 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker1 # [ 125.996534] nix-grpc-daemon[1624]: time=2026-09-20T13:27:57.536Z level=INFO msg="Upload complete. (245ms)" worker1 # [ 126.001769] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker1 # [ 126.014821] nix-daemon[906]: reaped child process 1785, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 5.61 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.20 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 126.505229] nix-daemon[866]: reaped child process 1541, status = succeeded worker2 # [ 126.653042] nix-daemon[866]: accepted connection from pid 1718, user nix-grpc-daemon (trusted) worker2 # [ 126.665528] nix-daemon[866]: reaped child process 1721, status = succeeded lb # [ 126.653121] niks3-server[1013]: 2026/09/20 13:27:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 126.684553] nix-grpc-daemon[1470]: time=2026-09-20T13:27:58.581Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 126.686096] nix-grpc-daemon[1470]: time=2026-09-20T13:27:58.583Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 126.685619] niks3-server[1013]: 2026/09/20 13:27:58 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 126.702069] niks3-server[1013]: 2026/09/20 13:27:58 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 126.708777] niks3-server[1013]: 2026/09/20 13:27:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign worker2 # [ 126.737599] nix-grpc-daemon[1470]: time=2026-09-20T13:27:58.634Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.714110] niks3-server[1013]: 2026/09/20 13:27:58 INFO Signed narinfos id=45 count=1 lb # [ 126.718823] niks3-server[1013]: 2026/09/20 13:27:58 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 126.729099] niks3-server[1013]: 2026/09/20 13:27:58 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 126.734184] niks3-server[1013]: 2026/09/20 13:27:58 INFO Completed upload id=45 worker2 # [ 126.759366] nix-grpc-daemon[1470]: time=2026-09-20T13:27:58.656Z level=INFO msg="Upload complete. (273ms)" lb # [ 126.737125] niks3-server[1013]: 2026/09/20 13:27:58 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker2 # [ 126.764112] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46472 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker2 # [ 126.771360] nix-daemon[866]: reaped child process 1539, status = succeeded client # [ 126.777188] systemd[1]: sw.service: Deactivated successfully. client # [ 126.780198] systemd[1]: sw.service: Consumed 113ms CPU time over 13.047s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.05 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 127.559163] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:59Z level=info event=signal_exit worker2 # [ 127.778506] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:59Z level=info event=scheduler_yield lb # [ 127.756804] niks3-server[1013]: 2026/09/20 13:27:59 INFO lead: released remote=192.168.1.4:41036 worker1 # [ 127.774659] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:59Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 127.785378] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42268 worker2 # [ 127.790756] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:59Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 127.793835] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:59Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 127.796755] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42268 worker2 # [ 127.800102] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:59Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 127.974476] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.978452] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 127.991238] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.995941] nix-grpc-daemon[1391]: ts=2026-09-20T13:27:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" lb # [ 127.989229] envoy[922]: conn peer=[2001:db8:1::1]:33176 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=3822 ms=5359 lb # [ 127.992963] envoy[922]: conn peer=[2001:db8:1::1]:33166 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1376 ms=12833 lb # [ 128.048366] niks3-server[1013]: 2026/09/20 13:28:00 INFO lead: acquired remote=192.168.1.3:59006 worker1 # [ 128.064718] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:59Z level=info event=scheduler_take_over worker1 # [ 128.179101] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.183273] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 128.197066] nix-grpc-daemon[1391]: ts=2026-09-20T13:28:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.200704] nix-grpc-daemon[1391]: ts=2026-09-20T13:28:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.383992] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.398602] nix-grpc-daemon[1391]: ts=2026-09-20T13:28:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.387972] nix-grpc-daemon[1536]: ts=2026-09-20T13:27:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 128.400581] nix-grpc-daemon[1391]: ts=2026-09-20T13:28:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 128.588320] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.590274] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 128.601180] nix-grpc-daemon[1391]: ts=2026-09-20T13:28:00Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2 # [ 128.603138] nix-grpc-daemon[1391]: ts=2026-09-20T13:28:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 128.778413] nix-grpc-daemon[1391]: ts=2026-09-20T13:28:00Z level=info event=scheduler_restarting worker2 # [ 128.791605] nix-daemon[866]: reaped child process 1442, status = succeeded worker1 # [ 128.791952] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.807220] nix-grpc-daemon[1391]: ts=2026-09-20T13:28:00Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 128.795928] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.996570] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.000422] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.104912] nix-grpc-daemon[1391]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 129.108456] nix-grpc-daemon[1391]: E0000 00:00:1789910881.001623 1434 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker2 # [ 129.113152] nix-grpc-daemon[1391]: E0000 00:00:1789910881.001894 1434 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 129.201346] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.205107] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.405944] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.409728] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 129.610472] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.614252] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 129.816241] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.819423] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 130.017122] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 130.028135] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:01Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40070 worker1 # [ 130.031699] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 130.592959] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 130.596597] systemd[1]: nix-grpc-daemon.service: Consumed 672ms CPU time over 28.324s wall clock time, 31M memory peak, 26K incoming IP traffic, 36.5K outgoing IP traffic. lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 131.582484] systemd[1]: Starting scheduler-token.service... worker2 # [ 131.672970] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 131.674951] systemd[1]: Finished scheduler-token.service. worker2 # [ 131.676124] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 92ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 131.681461] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 131.839515] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:03Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 131.841297] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 131.844657] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 131.851931] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 131.853566] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 131.868448] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 131.864804] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:03Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 131.868805] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:03Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40070 worker1 # [ 131.872584] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 5.38 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 19.24 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 133.156474] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 133.168240] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) worker1 # [ 133.173204] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 133.212118] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:04Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker1 # [ 133.214205] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:04Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 133.216081] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:04Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker1 # [ 133.217595] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:04Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 133.255948] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 133.264064] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 133.271317] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 133.276738] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 133.433921] nix-daemon[906]: accepted connection from pid 1814, user nix-grpc-daemon (trusted) worker1 # [ 133.445955] nix-daemon[906]: reaped child process 1817, status = succeeded worker1 # [ 133.604178] nix-daemon[906]: accepted connection from pid 1819, user nix-grpc-daemon (trusted) worker1 # [ 133.615797] nix-daemon[906]: reaped child process 1822, status = succeeded lb # [ 133.618489] niks3-server[1013]: 2026/09/20 13:28:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.641110] nix-grpc-daemon[1624]: time=2026-09-20T13:28:05.180Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 133.642429] nix-grpc-daemon[1624]: time=2026-09-20T13:28:05.180Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 133.647819] niks3-server[1013]: 2026/09/20 13:28:05 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 133.660733] niks3-server[1013]: 2026/09/20 13:28:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker1 # [ 133.681298] nix-grpc-daemon[1624]: time=2026-09-20T13:28:05.221Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.668291] niks3-server[1013]: 2026/09/20 13:28:05 INFO Signed narinfos id=46 count=1 lb # [ 133.686914] niks3-server[1013]: 2026/09/20 13:28:05 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 133.695217] niks3-server[1013]: 2026/09/20 13:28:05 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo lb # [ 133.698045] niks3-server[1013]: 2026/09/20 13:28:05 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 133.704284] niks3-server[1013]: 2026/09/20 13:28:05 INFO Completed upload id=46 worker1 # [ 133.718558] nix-grpc-daemon[1624]: time=2026-09-20T13:28:05.258Z level=INFO msg="Upload complete. (436ms)" worker1 # [ 133.723186] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 133.729314] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 133.741186] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 133.750284] nix-daemon[906]: reaped child process 1812, status = succeeded worker1 # [ 133.757152] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 134.383843] nix-daemon[906]: reaped child process 1826, status = succeeded worker1 # [ 134.521360] nix-daemon[906]: accepted connection from pid 1841, user nix-grpc-daemon (trusted) worker1 # [ 134.532334] nix-daemon[906]: reaped child process 1844, status = succeeded lb # [ 134.531617] niks3-server[1013]: 2026/09/20 13:28:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 134.552069] nix-grpc-daemon[1624]: time=2026-09-20T13:28:06.090Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 134.553436] nix-grpc-daemon[1624]: time=2026-09-20T13:28:06.091Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 134.560376] niks3-server[1013]: 2026/09/20 13:28:06 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 134.566775] niks3-server[1013]: 2026/09/20 13:28:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 134.570571] niks3-server[1013]: 2026/09/20 13:28:06 INFO Signed narinfos id=47 count=1 worker1 # [ 134.583239] nix-grpc-daemon[1624]: time=2026-09-20T13:28:06.123Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.572825] niks3-server[1013]: 2026/09/20 13:28:06 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 134.575727] niks3-server[1013]: 2026/09/20 13:28:06 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 134.582160] niks3-server[1013]: 2026/09/20 13:28:06 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete worker1 # [ 134.599034] nix-grpc-daemon[1624]: time=2026-09-20T13:28:06.138Z level=INFO msg="Upload complete. (233ms)" lb # [ 134.586565] niks3-server[1013]: 2026/09/20 13:28:06 INFO Completed upload id=47 lb # [ 134.589240] niks3-server[1013]: 2026/09/20 13:28:06 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 134.603345] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=1 worker1 # [ 134.606714] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:06Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 134.609522] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 134.613223] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:06Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 134.618345] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 134.620835] nix-daemon[906]: reaped child process 1824, status = succeeded worker1 # [ 134.624292] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 134.628850] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 134.789040] nix-daemon[906]: accepted connection from pid 1850, user nix-grpc-daemon (trusted) worker1 # [ 134.800960] nix-daemon[906]: reaped child process 1853, status = succeeded worker1 # [ 134.978117] nix-daemon[906]: accepted connection from pid 1855, user nix-grpc-daemon (trusted) worker1 # [ 134.992218] nix-daemon[906]: reaped child process 1858, status = succeeded lb # [ 134.997958] niks3-server[1013]: 2026/09/20 13:28:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.021982] nix-grpc-daemon[1624]: time=2026-09-20T13:28:06.561Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 135.023486] nix-grpc-daemon[1624]: time=2026-09-20T13:28:06.563Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 135.031291] niks3-server[1013]: 2026/09/20 13:28:07 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 135.040972] niks3-server[1013]: 2026/09/20 13:28:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 135.047063] niks3-server[1013]: 2026/09/20 13:28:07 INFO Signed narinfos id=48 count=1 worker1 # [ 135.063026] nix-grpc-daemon[1624]: time=2026-09-20T13:28:06.602Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.050791] niks3-server[1013]: 2026/09/20 13:28:07 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 135.063852] niks3-server[1013]: 2026/09/20 13:28:07 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete worker1 # [ 135.082974] nix-grpc-daemon[1624]: time=2026-09-20T13:28:06.622Z level=INFO msg="Upload complete. (449ms)" lb # [ 135.070511] niks3-server[1013]: 2026/09/20 13:28:07 INFO Completed upload id=48 lb # [ 135.073163] niks3-server[1013]: 2026/09/20 13:28:07 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 135.085327] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 135.093343] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 135.102053] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 135.105399] nix-daemon[906]: reaped child process 1848, status = succeeded worker1 # [ 135.110361] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 136.325789] nix-daemon[906]: reaped child process 1862, status = succeeded worker1 # [ 136.486811] nix-daemon[906]: accepted connection from pid 1877, user nix-grpc-daemon (trusted) worker1 # [ 136.497241] nix-daemon[906]: reaped child process 1880, status = succeeded lb # [ 136.503722] niks3-server[1013]: 2026/09/20 13:28:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 136.524755] nix-grpc-daemon[1624]: time=2026-09-20T13:28:08.064Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 136.527056] nix-grpc-daemon[1624]: time=2026-09-20T13:28:08.066Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 136.538148] niks3-server[1013]: 2026/09/20 13:28:08 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 136.553151] niks3-server[1013]: 2026/09/20 13:28:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 136.570572] nix-grpc-daemon[1624]: time=2026-09-20T13:28:08.110Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.558481] niks3-server[1013]: 2026/09/20 13:28:08 INFO Signed narinfos id=49 count=1 lb # [ 136.562448] niks3-server[1013]: 2026/09/20 13:28:08 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 136.573781] niks3-server[1013]: 2026/09/20 13:28:08 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 136.579452] niks3-server[1013]: 2026/09/20 13:28:08 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 136.588198] niks3-server[1013]: 2026/09/20 13:28:08 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo lb # [ 136.591227] niks3-server[1013]: 2026/09/20 13:28:08 INFO Completed upload id=49 worker1 # [ 136.604356] nix-grpc-daemon[1624]: time=2026-09-20T13:28:08.144Z level=INFO msg="Upload complete. (286ms)" worker1 # [ 136.614562] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=1 worker1 # [ 136.621988] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:08Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 136.627473] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:08Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 136.635783] nix-daemon[906]: reaped child process 1860, status = succeeded worker1 # [ 136.654933] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 136.665786] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 136.676331] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 136.686132] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 136.836335] nix-daemon[906]: accepted connection from pid 1886, user nix-grpc-daemon (trusted) worker1 # [ 136.848440] nix-daemon[906]: reaped child process 1889, status = succeeded worker1 # [ 137.005334] nix-daemon[906]: accepted connection from pid 1891, user nix-grpc-daemon (trusted) worker1 # [ 137.016788] nix-daemon[906]: reaped child process 1894, status = succeeded lb # [ 137.020348] niks3-server[1013]: 2026/09/20 13:28:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 137.040797] nix-grpc-daemon[1624]: time=2026-09-20T13:28:08.580Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 137.042651] nix-grpc-daemon[1624]: time=2026-09-20T13:28:08.582Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 137.047737] niks3-server[1013]: 2026/09/20 13:28:09 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 137.058748] niks3-server[1013]: 2026/09/20 13:28:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 137.076086] nix-grpc-daemon[1624]: time=2026-09-20T13:28:08.615Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.063138] niks3-server[1013]: 2026/09/20 13:28:09 INFO Signed narinfos id=50 count=1 lb # [ 137.074808] niks3-server[1013]: 2026/09/20 13:28:09 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 137.080489] niks3-server[1013]: 2026/09/20 13:28:09 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 137.086764] niks3-server[1013]: 2026/09/20 13:28:09 INFO Completed upload id=50 worker1 # [ 137.101692] nix-grpc-daemon[1624]: time=2026-09-20T13:28:08.641Z level=INFO msg="Upload complete. (406ms)" lb # [ 137.089972] niks3-server[1013]: 2026/09/20 13:28:09 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 137.103927] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 137.108837] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 137.119070] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 137.122838] nix-daemon[906]: reaped child process 1884, status = succeeded worker1 # [ 137.127764] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) lb # [ 137.988279] envoy[922]: conn peer=[2001:db8:1::4]:44358 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4876 tx=568 ms=26243 worker1 # [ 138.141646] nix-daemon[906]: reaped child process 1898, status = succeeded worker1 # [ 138.306283] nix-daemon[906]: accepted connection from pid 1913, user nix-grpc-daemon (trusted) worker1 # [ 138.318147] nix-daemon[906]: reaped child process 1916, status = succeeded lb # [ 138.322469] niks3-server[1013]: 2026/09/20 13:28:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.342959] nix-grpc-daemon[1624]: time=2026-09-20T13:28:09.882Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 138.345417] nix-grpc-daemon[1624]: time=2026-09-20T13:28:09.884Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 138.356789] niks3-server[1013]: 2026/09/20 13:28:10 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 138.363390] niks3-server[1013]: 2026/09/20 13:28:10 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 138.376559] niks3-server[1013]: 2026/09/20 13:28:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 138.394705] nix-grpc-daemon[1624]: time=2026-09-20T13:28:09.934Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.381434] niks3-server[1013]: 2026/09/20 13:28:10 INFO Signed narinfos id=51 count=1 lb # [ 138.386964] niks3-server[1013]: 2026/09/20 13:28:10 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 138.395685] niks3-server[1013]: 2026/09/20 13:28:10 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 138.400194] niks3-server[1013]: 2026/09/20 13:28:10 INFO Completed upload id=51 worker1 # [ 138.412795] nix-grpc-daemon[1624]: time=2026-09-20T13:28:09.952Z level=WARN msg="Failed to register uploaded object" key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 138.422622] nix-grpc-daemon[1624]: time=2026-09-20T13:28:09.958Z level=INFO msg="Upload complete. (283ms)" worker1 # [ 138.432265] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=1 worker1 # [ 138.436627] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:09Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 138.440578] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 138.444366] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:09Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 138.452429] nix-daemon[906]: reaped child process 1896, status = succeeded worker1 # [ 138.455199] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 138.463328] nix-grpc-daemon[1624]: time=2026-09-20T13:28:10.003Z level=INFO msg="All 1 paths already cached" worker1 # [ 138.467682] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 138.471441] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 138.630420] nix-daemon[906]: accepted connection from pid 1922, user nix-grpc-daemon (trusted) worker1 # [ 138.642199] nix-daemon[906]: reaped child process 1925, status = succeeded worker1 # [ 138.810503] nix-daemon[906]: accepted connection from pid 1927, user nix-grpc-daemon (trusted) worker1 # [ 138.822109] nix-daemon[906]: reaped child process 1930, status = succeeded lb # [ 138.827132] niks3-server[1013]: 2026/09/20 13:28:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.847281] nix-grpc-daemon[1624]: time=2026-09-20T13:28:10.387Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 138.848765] nix-grpc-daemon[1624]: time=2026-09-20T13:28:10.388Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 138.855453] niks3-server[1013]: 2026/09/20 13:28:10 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 138.867850] niks3-server[1013]: 2026/09/20 13:28:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 138.884786] nix-grpc-daemon[1624]: time=2026-09-20T13:28:10.424Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.872113] niks3-server[1013]: 2026/09/20 13:28:10 INFO Signed narinfos id=52 count=1 lb # [ 138.879980] niks3-server[1013]: 2026/09/20 13:28:10 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 138.888745] niks3-server[1013]: 2026/09/20 13:28:10 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete worker1 # [ 138.907208] nix-grpc-daemon[1624]: time=2026-09-20T13:28:10.447Z level=INFO msg="Upload complete. (429ms)" lb # [ 138.894454] niks3-server[1013]: 2026/09/20 13:28:10 INFO Completed upload id=52 worker1 # [ 138.909253] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 138.911933] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 lb # [ 138.899482] niks3-server[1013]: 2026/09/20 13:28:10 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 138.920366] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 138.924343] nix-daemon[906]: reaped child process 1920, status = succeeded worker1 # [ 138.929328] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 139.941421] nix-daemon[906]: reaped child process 1934, status = succeeded worker1 # [ 140.086591] nix-daemon[906]: accepted connection from pid 1949, user nix-grpc-daemon (trusted) worker1 # [ 140.097290] nix-daemon[906]: reaped child process 1952, status = succeeded lb # [ 140.100919] niks3-server[1013]: 2026/09/20 13:28:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 140.124098] nix-grpc-daemon[1624]: time=2026-09-20T13:28:11.663Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 140.125669] nix-grpc-daemon[1624]: time=2026-09-20T13:28:11.665Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 140.141693] niks3-server[1013]: 2026/09/20 13:28:12 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 140.150155] niks3-server[1013]: 2026/09/20 13:28:12 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 140.157282] niks3-server[1013]: 2026/09/20 13:28:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 140.173564] nix-grpc-daemon[1624]: time=2026-09-20T13:28:11.713Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.161094] niks3-server[1013]: 2026/09/20 13:28:12 INFO Signed narinfos id=53 count=1 lb # [ 140.165319] niks3-server[1013]: 2026/09/20 13:28:12 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 140.171323] niks3-server[1013]: 2026/09/20 13:28:12 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 140.174059] niks3-server[1013]: 2026/09/20 13:28:12 INFO Completed upload id=53 worker1 # [ 140.186813] nix-grpc-daemon[1624]: time=2026-09-20T13:28:11.726Z level=WARN msg="Failed to register uploaded object" key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 140.192539] nix-grpc-daemon[1624]: time=2026-09-20T13:28:11.731Z level=INFO msg="Upload complete. (254ms)" worker1 # [ 140.202456] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=1 worker1 # [ 140.206084] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:11Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 140.208101] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 140.209769] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:11Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 140.215382] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 140.217700] nix-daemon[906]: reaped child process 1932, status = succeeded worker1 # [ 140.221820] nix-grpc-daemon[1624]: time=2026-09-20T13:28:11.761Z level=INFO msg="All 1 paths already cached" worker1 # [ 140.225053] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 140.229724] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 140.382551] nix-daemon[906]: accepted connection from pid 1958, user nix-grpc-daemon (trusted) worker1 # [ 140.395438] nix-daemon[906]: reaped child process 1961, status = succeeded worker1 # [ 140.562540] nix-daemon[906]: accepted connection from pid 1963, user nix-grpc-daemon (trusted) worker1 # [ 140.574277] nix-daemon[906]: reaped child process 1966, status = succeeded lb # [ 140.578932] niks3-server[1013]: 2026/09/20 13:28:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 140.600993] nix-grpc-daemon[1624]: time=2026-09-20T13:28:12.140Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 140.602563] nix-grpc-daemon[1624]: time=2026-09-20T13:28:12.142Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 140.607949] niks3-server[1013]: 2026/09/20 13:28:12 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 140.620806] niks3-server[1013]: 2026/09/20 13:28:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 140.637340] nix-grpc-daemon[1624]: time=2026-09-20T13:28:12.177Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.624910] niks3-server[1013]: 2026/09/20 13:28:12 INFO Signed narinfos id=54 count=1 lb # [ 140.629104] niks3-server[1013]: 2026/09/20 13:28:12 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 140.639304] niks3-server[1013]: 2026/09/20 13:28:12 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 140.642893] niks3-server[1013]: 2026/09/20 13:28:12 INFO Completed upload id=54 worker1 # [ 140.655748] nix-grpc-daemon[1624]: time=2026-09-20T13:28:12.195Z level=INFO msg="Upload complete. (421ms)" lb # [ 140.645769] niks3-server[1013]: 2026/09/20 13:28:12 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 140.657947] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 140.662964] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 140.671294] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 140.675630] nix-daemon[906]: reaped child process 1956, status = succeeded worker1 # [ 140.680447] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 141.894261] nix-daemon[906]: reaped child process 1970, status = succeeded worker1 # [ 142.042536] nix-daemon[906]: accepted connection from pid 1985, user nix-grpc-daemon (trusted) worker1 # [ 142.055329] nix-daemon[906]: reaped child process 1988, status = succeeded lb # [ 142.059421] niks3-server[1013]: 2026/09/20 13:28:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 142.079926] nix-grpc-daemon[1624]: time=2026-09-20T13:28:13.619Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 142.081420] nix-grpc-daemon[1624]: time=2026-09-20T13:28:13.621Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 142.094791] niks3-server[1013]: 2026/09/20 13:28:14 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 142.104729] niks3-server[1013]: 2026/09/20 13:28:14 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 142.112846] niks3-server[1013]: 2026/09/20 13:28:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 142.118360] niks3-server[1013]: 2026/09/20 13:28:14 INFO Signed narinfos id=55 count=1 worker1 # [ 142.138499] nix-grpc-daemon[1624]: time=2026-09-20T13:28:13.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.137566] niks3-server[1013]: 2026/09/20 13:28:14 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 142.139160] niks3-server[1013]: 2026/09/20 13:28:14 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 142.141842] niks3-server[1013]: 2026/09/20 13:28:14 INFO Completed upload id=55 worker1 # [ 142.154938] nix-grpc-daemon[1624]: time=2026-09-20T13:28:13.694Z level=INFO msg="Upload complete. (267ms)" lb # [ 142.144070] niks3-server[1013]: 2026/09/20 13:28:14 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 142.165835] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=1 worker1 # [ 142.173678] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:13Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 142.178459] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 142.182210] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:13Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 142.192328] nix-daemon[906]: reaped child process 1968, status = succeeded worker1 # [ 142.206655] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 142.217574] nix-grpc-daemon[1624]: time=2026-09-20T13:28:13.757Z level=INFO msg="All 1 paths already cached" worker1 # [ 142.223713] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 142.230547] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 142.382340] nix-daemon[906]: accepted connection from pid 1994, user nix-grpc-daemon (trusted) worker1 # [ 142.395250] nix-daemon[906]: reaped child process 1997, status = succeeded worker1 # [ 142.560556] nix-daemon[906]: accepted connection from pid 1999, user nix-grpc-daemon (trusted) worker1 # [ 142.572710] nix-daemon[906]: reaped child process 2002, status = succeeded lb # [ 142.576350] niks3-server[1013]: 2026/09/20 13:28:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 142.597059] nix-grpc-daemon[1624]: time=2026-09-20T13:28:14.136Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 142.598510] nix-grpc-daemon[1624]: time=2026-09-20T13:28:14.136Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 142.601136] niks3-server[1013]: 2026/09/20 13:28:14 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 142.613218] niks3-server[1013]: 2026/09/20 13:28:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 142.619749] niks3-server[1013]: 2026/09/20 13:28:14 INFO Signed narinfos id=56 count=1 worker1 # [ 142.635831] nix-grpc-daemon[1624]: time=2026-09-20T13:28:14.175Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.624561] niks3-server[1013]: 2026/09/20 13:28:14 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 142.635065] niks3-server[1013]: 2026/09/20 13:28:14 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete worker1 # [ 142.654854] nix-grpc-daemon[1624]: time=2026-09-20T13:28:14.194Z level=INFO msg="Upload complete. (415ms)" lb # [ 142.642307] niks3-server[1013]: 2026/09/20 13:28:14 INFO Completed upload id=56 worker1 # [ 142.657340] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 142.647549] niks3-server[1013]: 2026/09/20 13:28:14 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 142.664762] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 142.673601] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 142.676389] nix-daemon[906]: reaped child process 1992, status = succeeded worker1 # [ 142.681663] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 144.306909] nix-daemon[906]: reaped child process 2006, status = succeeded worker1 # [ 144.470916] nix-daemon[906]: accepted connection from pid 2021, user nix-grpc-daemon (trusted) worker1 # [ 144.482653] nix-daemon[906]: reaped child process 2024, status = succeeded lb # [ 144.485805] niks3-server[1013]: 2026/09/20 13:28:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.504408] nix-grpc-daemon[1624]: time=2026-09-20T13:28:16.044Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 144.507159] nix-grpc-daemon[1624]: time=2026-09-20T13:28:16.045Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 144.505890] niks3-server[1013]: 2026/09/20 13:28:16 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 144.512880] niks3-server[1013]: 2026/09/20 13:28:16 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 144.519915] niks3-server[1013]: 2026/09/20 13:28:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 144.524616] niks3-server[1013]: 2026/09/20 13:28:16 INFO Signed narinfos id=57 count=1 worker1 # [ 144.538835] nix-grpc-daemon[1624]: time=2026-09-20T13:28:16.078Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.527810] niks3-server[1013]: 2026/09/20 13:28:16 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 144.532675] niks3-server[1013]: 2026/09/20 13:28:16 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 144.536086] niks3-server[1013]: 2026/09/20 13:28:16 INFO Completed upload id=57 worker1 # [ 144.548720] nix-grpc-daemon[1624]: time=2026-09-20T13:28:16.088Z level=INFO msg="Upload complete. (259ms)" lb # [ 144.537539] niks3-server[1013]: 2026/09/20 13:28:16 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 144.551144] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=1 worker1 # [ 144.555938] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:16Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 144.558784] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 144.561933] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:16Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 144.567690] nix-daemon[906]: reaped child process 2004, status = succeeded worker1 # [ 144.569445] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 144.575761] nix-grpc-daemon[1624]: time=2026-09-20T13:28:16.115Z level=INFO msg="All 2 paths already cached" worker1 # [ 144.579407] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 144.584529] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 144.740546] nix-daemon[906]: accepted connection from pid 2030, user nix-grpc-daemon (trusted) worker1 # [ 144.753698] nix-daemon[906]: reaped child process 2033, status = succeeded worker1 # [ 144.932692] nix-daemon[906]: accepted connection from pid 2035, user nix-grpc-daemon (trusted) worker1 # [ 144.946406] nix-daemon[906]: reaped child process 2038, status = succeeded lb # [ 144.948720] niks3-server[1013]: 2026/09/20 13:28:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.969383] nix-grpc-daemon[1624]: time=2026-09-20T13:28:16.509Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 144.970866] nix-grpc-daemon[1624]: time=2026-09-20T13:28:16.510Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 144.976828] niks3-server[1013]: 2026/09/20 13:28:17 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 144.987865] niks3-server[1013]: 2026/09/20 13:28:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 144.992930] niks3-server[1013]: 2026/09/20 13:28:17 INFO Signed narinfos id=58 count=1 worker1 # [ 145.008639] nix-grpc-daemon[1624]: time=2026-09-20T13:28:16.548Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.999405] niks3-server[1013]: 2026/09/20 13:28:17 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 145.011237] niks3-server[1013]: 2026/09/20 13:28:17 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 145.030720] nix-grpc-daemon[1624]: time=2026-09-20T13:28:16.570Z level=INFO msg="Upload complete. (441ms)" lb # [ 145.017971] niks3-server[1013]: 2026/09/20 13:28:17 INFO Completed upload id=58 worker1 # [ 145.032776] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 145.022069] niks3-server[1013]: 2026/09/20 13:28:17 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 145.038866] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 145.047733] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 145.050041] nix-daemon[906]: reaped child process 2028, status = succeeded worker1 # [ 145.055435] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 146.281805] nix-daemon[906]: reaped child process 2042, status = succeeded worker1 # [ 146.414246] nix-daemon[906]: accepted connection from pid 2057, user nix-grpc-daemon (trusted) worker1 # [ 146.426274] nix-daemon[906]: reaped child process 2060, status = succeeded lb # [ 146.429652] niks3-server[1013]: 2026/09/20 13:28:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.451203] nix-grpc-daemon[1624]: time=2026-09-20T13:28:17.990Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 146.452912] nix-grpc-daemon[1624]: time=2026-09-20T13:28:17.992Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 146.469284] niks3-server[1013]: 2026/09/20 13:28:18 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 146.476733] niks3-server[1013]: 2026/09/20 13:28:18 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 146.484066] niks3-server[1013]: 2026/09/20 13:28:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 146.487069] niks3-server[1013]: 2026/09/20 13:28:18 INFO Signed narinfos id=59 count=1 worker1 # [ 146.500026] nix-grpc-daemon[1624]: time=2026-09-20T13:28:18.039Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.490502] niks3-server[1013]: 2026/09/20 13:28:18 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 146.495247] niks3-server[1013]: 2026/09/20 13:28:18 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 146.498481] niks3-server[1013]: 2026/09/20 13:28:18 INFO Completed upload id=59 lb # [ 146.500179] niks3-server[1013]: 2026/09/20 13:28:18 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 146.512649] nix-grpc-daemon[1624]: time=2026-09-20T13:28:18.052Z level=INFO msg="Upload complete. (249ms)" worker1 # [ 146.518861] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=1 worker1 # [ 146.524215] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:18Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 146.532848] nix-daemon[906]: reaped child process 2040, status = succeeded worker1 # [ 146.561325] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 146.572931] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 146.585703] nix-grpc-daemon[1624]: time=2026-09-20T13:28:18.125Z level=INFO msg="All 2 paths already cached" worker1 # [ 146.593496] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 146.602366] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 146.759734] nix-daemon[906]: accepted connection from pid 2064, user nix-grpc-daemon (trusted) worker1 # [ 146.774984] nix-daemon[906]: reaped child process 2067, status = succeeded worker1 # [ 146.937433] nix-daemon[906]: accepted connection from pid 2069, user nix-grpc-daemon (trusted) worker1 # [ 146.952349] nix-daemon[906]: reaped child process 2072, status = succeeded lb # [ 146.954143] niks3-server[1013]: 2026/09/20 13:28:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.974382] nix-grpc-daemon[1624]: time=2026-09-20T13:28:18.514Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 146.975969] nix-grpc-daemon[1624]: time=2026-09-20T13:28:18.515Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 146.981590] niks3-server[1013]: 2026/09/20 13:28:19 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 146.993815] niks3-server[1013]: 2026/09/20 13:28:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker1 # [ 147.011512] nix-grpc-daemon[1624]: time=2026-09-20T13:28:18.551Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.999067] niks3-server[1013]: 2026/09/20 13:28:19 INFO Signed narinfos id=60 count=1 lb # [ 147.005521] niks3-server[1013]: 2026/09/20 13:28:19 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 147.014858] niks3-server[1013]: 2026/09/20 13:28:19 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 147.034538] nix-grpc-daemon[1624]: time=2026-09-20T13:28:18.574Z level=INFO msg="Upload complete. (420ms)" lb # [ 147.021968] niks3-server[1013]: 2026/09/20 13:28:19 INFO Completed upload id=60 worker1 # [ 147.036780] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 147.025785] niks3-server[1013]: 2026/09/20 13:28:19 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 147.042586] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 147.048655] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 147.051134] nix-daemon[906]: reaped child process 2062, status = succeeded worker1 # [ 147.056715] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 148.481508] nix-daemon[906]: reaped child process 2076, status = succeeded worker1 # [ 148.652831] nix-daemon[906]: accepted connection from pid 2091, user nix-grpc-daemon (trusted) worker1 # [ 148.665880] nix-daemon[906]: reaped child process 2094, status = succeeded lb # [ 148.668745] niks3-server[1013]: 2026/09/20 13:28:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.691029] nix-grpc-daemon[1624]: time=2026-09-20T13:28:20.230Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 148.692690] nix-grpc-daemon[1624]: time=2026-09-20T13:28:20.232Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 148.704137] niks3-server[1013]: 2026/09/20 13:28:20 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 148.710821] niks3-server[1013]: 2026/09/20 13:28:20 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 148.725127] niks3-server[1013]: 2026/09/20 13:28:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 148.742497] nix-grpc-daemon[1624]: time=2026-09-20T13:28:20.282Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.729448] niks3-server[1013]: 2026/09/20 13:28:20 INFO Signed narinfos id=61 count=1 lb # [ 148.738174] niks3-server[1013]: 2026/09/20 13:28:20 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 148.744927] niks3-server[1013]: 2026/09/20 13:28:20 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 148.750320] niks3-server[1013]: 2026/09/20 13:28:20 INFO Completed upload id=61 worker1 # [ 148.763048] nix-grpc-daemon[1624]: time=2026-09-20T13:28:20.302Z level=INFO msg="Upload complete. (297ms)" lb # [ 148.752960] niks3-server[1013]: 2026/09/20 13:28:20 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 148.772210] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=1 worker1 # [ 148.777634] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:20Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 148.788221] nix-daemon[906]: reaped child process 2074, status = succeeded worker1 # [ 148.813593] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 148.825389] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 148.837092] nix-grpc-daemon[1624]: time=2026-09-20T13:28:20.376Z level=INFO msg="All 2 paths already cached" worker1 # [ 148.843736] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 148.852456] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 149.032328] nix-daemon[906]: accepted connection from pid 2098, user nix-grpc-daemon (trusted) worker1 # [ 149.048086] nix-daemon[906]: reaped child process 2101, status = succeeded worker1 # [ 149.225256] nix-daemon[906]: accepted connection from pid 2103, user nix-grpc-daemon (trusted) worker1 # [ 149.240061] nix-daemon[906]: reaped child process 2106, status = succeeded lb # [ 149.242808] niks3-server[1013]: 2026/09/20 13:28:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.266304] nix-grpc-daemon[1624]: time=2026-09-20T13:28:20.806Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 149.268349] nix-grpc-daemon[1624]: time=2026-09-20T13:28:20.807Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 149.266132] niks3-server[1013]: 2026/09/20 13:28:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 149.267660] niks3-server[1013]: 2026/09/20 13:28:21 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 149.270196] niks3-server[1013]: 2026/09/20 13:28:21 INFO Signed narinfos id=62 count=1 worker1 # [ 149.283307] nix-grpc-daemon[1624]: time=2026-09-20T13:28:20.823Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.272380] niks3-server[1013]: 2026/09/20 13:28:21 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 149.277336] niks3-server[1013]: 2026/09/20 13:28:21 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 149.281221] niks3-server[1013]: 2026/09/20 13:28:21 INFO Completed upload id=62 worker1 # [ 149.293977] nix-grpc-daemon[1624]: time=2026-09-20T13:28:20.833Z level=INFO msg="Upload complete. (429ms)" lb # [ 149.282467] niks3-server[1013]: 2026/09/20 13:28:21 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 149.296239] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 149.299615] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 149.306592] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 149.309848] nix-daemon[906]: reaped child process 2096, status = succeeded worker1 # [ 149.315444] nix-daemon[906]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker1 # [ 150.733333] nix-daemon[906]: reaped child process 2110, status = succeeded worker1 # [ 150.879480] nix-daemon[906]: accepted connection from pid 2125, user nix-grpc-daemon (trusted) worker1 # [ 150.894670] nix-daemon[906]: reaped child process 2128, status = succeeded lb # [ 150.899584] niks3-server[1013]: 2026/09/20 13:28:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.922187] nix-grpc-daemon[1624]: time=2026-09-20T13:28:22.461Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 150.923789] nix-grpc-daemon[1624]: time=2026-09-20T13:28:22.463Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 150.939454] niks3-server[1013]: 2026/09/20 13:28:23 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 150.947850] niks3-server[1013]: 2026/09/20 13:28:23 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 150.951859] niks3-server[1013]: 2026/09/20 13:28:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 150.955833] niks3-server[1013]: 2026/09/20 13:28:23 INFO Signed narinfos id=63 count=1 worker1 # [ 150.971186] nix-grpc-daemon[1624]: time=2026-09-20T13:28:22.510Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.963246] niks3-server[1013]: 2026/09/20 13:28:23 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 150.967788] niks3-server[1013]: 2026/09/20 13:28:23 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 150.970219] niks3-server[1013]: 2026/09/20 13:28:23 INFO Completed upload id=63 worker1 # [ 150.983108] nix-grpc-daemon[1624]: time=2026-09-20T13:28:22.522Z level=INFO msg="Upload complete. (258ms)" lb # [ 150.972101] niks3-server[1013]: 2026/09/20 13:28:23 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 150.987077] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56640 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=1 worker1 # [ 150.995435] nix-daemon[906]: reaped child process 2108, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.12 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 151.153934] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 8aabb5b6b9eb46298d9dacc9ea6b943b client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 151.388789] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57892 client # [ 151.368039] nix[1349]: don't know how to build these paths: client # [ 151.369552] nix[1349]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 151.387349] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 151.399336] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:22Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 client # [ 151.383539] nix[1349]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 157.989444] envoy[922]: conn peer=[2001:db8:1::1]:33912 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27167 tx=10635 ms=17864 client # [ 181.384669] nix[1349]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu} client # [ 181.393513] nix[1349]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 181.426330] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 181.429752] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 181.434315] systemd[1]: gpu.service: Consumed 129ms CPU time over 30.279s wall clock time, 33.4M memory peak, 6.6K incoming IP traffic, 5.8K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.57 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 49.38 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1 # [ 183.084512] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:54Z level=info event=unhealthy reason=min_free worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.92 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 183.457482] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57892 worker1 # [ 183.450784] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56640 worker1 # [ 183.469358] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:55Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker1 # [ 183.473514] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:55Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 183.523745] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 183.535379] nix-grpc-daemon[1736]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5) worker2 # [ 183.593262] nix-grpc-daemon[1736]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 160 ms (attempt 2/5) worker2 # [ 183.759137] nix-grpc-daemon[1736]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 3/5) worker2 # [ 183.785556] nix-grpc-daemon[1736]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 596 ms (attempt 4/5) worker2 # [ 184.389244] nix-grpc-daemon[1736]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 184.404680] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57892 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 184.416656] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 184.428306] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) worker2 # [ 184.447125] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:56Z level=info event=niks3_push_started pid=1792 worker2 # [ 184.605552] nix-grpc-daemon[1792]: time=2026-09-20T13:28:56.501Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca="" worker2 # [ 184.753851] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted) worker2 # [ 184.767780] nix-daemon[866]: reaped child process 1808, status = succeeded worker2 # [ 184.928278] nix-daemon[866]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker2 # [ 184.942271] nix-daemon[866]: reaped child process 1813, status = succeeded lb # [ 184.932070] niks3-server[1013]: 2026/09/20 13:28:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 184.963074] nix-grpc-daemon[1792]: time=2026-09-20T13:28:56.859Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 184.964454] nix-grpc-daemon[1792]: time=2026-09-20T13:28:56.859Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 184.955655] niks3-server[1013]: 2026/09/20 13:28:57 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 184.962447] niks3-server[1013]: 2026/09/20 13:28:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 184.965737] niks3-server[1013]: 2026/09/20 13:28:57 INFO Signed narinfos id=64 count=1 worker2 # [ 184.988944] nix-grpc-daemon[1792]: time=2026-09-20T13:28:56.885Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.973071] niks3-server[1013]: 2026/09/20 13:28:57 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 184.976806] niks3-server[1013]: 2026/09/20 13:28:57 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 184.982228] niks3-server[1013]: 2026/09/20 13:28:57 INFO Completed upload id=64 worker2 # [ 185.005669] nix-grpc-daemon[1792]: time=2026-09-20T13:28:56.902Z level=INFO msg="Upload complete. (400ms)" worker2 # [ 185.009098] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57892 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 184.985923] niks3-server[1013]: 2026/09/20 13:28:57 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 185.012518] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 185.019210] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) worker2 # [ 185.021604] nix-daemon[866]: reaped child process 1790, status = succeeded worker2 # [ 185.026872] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> LOG-farm-a-drain worker2 # [ 186.055515] nix-daemon[866]: reaped child process 1817, status = succeeded worker2 # [ 186.208199] nix-daemon[866]: accepted connection from pid 1832, user nix-grpc-daemon (trusted) worker2 # [ 186.220529] nix-daemon[866]: reaped child process 1835, status = succeeded lb # [ 186.212603] niks3-server[1013]: 2026/09/20 13:28:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 186.246233] nix-grpc-daemon[1792]: time=2026-09-20T13:28:58.143Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 186.250632] nix-grpc-daemon[1792]: time=2026-09-20T13:28:58.144Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 186.250144] niks3-server[1013]: 2026/09/20 13:28:58 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 186.261265] niks3-server[1013]: 2026/09/20 13:28:58 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 186.272549] niks3-server[1013]: 2026/09/20 13:28:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 186.276440] niks3-server[1013]: 2026/09/20 13:28:58 INFO Signed narinfos id=65 count=1 worker2 # [ 186.302612] nix-grpc-daemon[1792]: time=2026-09-20T13:28:58.199Z level=INFO msg="Uploading 1 narinfos" lb # [ 186.281076] niks3-server[1013]: 2026/09/20 13:28:58 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 186.286491] niks3-server[1013]: 2026/09/20 13:28:58 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 186.290090] niks3-server[1013]: 2026/09/20 13:28:58 INFO Completed upload id=65 worker2 # [ 186.313786] nix-grpc-daemon[1792]: time=2026-09-20T13:28:58.210Z level=INFO msg="Upload complete. (279ms)" lb # [ 186.292821] niks3-server[1013]: 2026/09/20 13:28:58 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 186.318955] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57892 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=1 worker1 # [ 186.315890] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:57Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 186.331540] nix-daemon[866]: reaped child process 1815, status = succeeded worker1 # [ 186.319977] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:57Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 186.369744] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 186.380285] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 186.391643] nix-grpc-daemon[1792]: time=2026-09-20T13:28:58.288Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 186.399610] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 186.408320] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) worker2 # [ 186.560551] nix-daemon[866]: accepted connection from pid 1839, user nix-grpc-daemon (trusted) worker2 # [ 186.572995] nix-daemon[866]: reaped child process 1842, status = succeeded worker2 # [ 186.712151] nix-daemon[866]: accepted connection from pid 1844, user nix-grpc-daemon (trusted) worker2 # [ 186.724438] nix-daemon[866]: reaped child process 1847, status = succeeded lb # [ 186.712938] niks3-server[1013]: 2026/09/20 13:28:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 186.744221] nix-grpc-daemon[1792]: time=2026-09-20T13:28:58.641Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 186.745700] nix-grpc-daemon[1792]: time=2026-09-20T13:28:58.642Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 186.743747] niks3-server[1013]: 2026/09/20 13:28:58 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 186.752903] niks3-server[1013]: 2026/09/20 13:28:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 186.757558] niks3-server[1013]: 2026/09/20 13:28:58 INFO Signed narinfos id=66 count=1 worker2 # [ 186.783661] nix-grpc-daemon[1792]: time=2026-09-20T13:28:58.680Z level=INFO msg="Uploading 1 narinfos" lb # [ 186.763741] niks3-server[1013]: 2026/09/20 13:28:58 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 186.775386] niks3-server[1013]: 2026/09/20 13:28:58 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 186.781984] niks3-server[1013]: 2026/09/20 13:28:58 INFO Completed upload id=66 worker2 # [ 186.805312] nix-grpc-daemon[1792]: time=2026-09-20T13:28:58.702Z level=INFO msg="Upload complete. (384ms)" lb # [ 186.784368] niks3-server[1013]: 2026/09/20 13:28:58 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 186.808992] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57892 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 186.813837] nix-grpc-daemon[1736]: ts=2026-09-20T13:28:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 186.820842] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) worker2 # [ 186.826804] nix-daemon[866]: reaped child process 1837, status = succeeded client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker2 # [ 186.831085] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-drain lb # [ 187.991321] envoy[922]: conn peer=[2001:db8:1::1]:44782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=494 ms=30044 worker2 # [ 188.059800] nix-daemon[866]: reaped child process 1851, status = succeeded worker2 # [ 188.214478] nix-daemon[866]: accepted connection from pid 1866, user nix-grpc-daemon (trusted) worker2 # [ 188.225875] nix-daemon[866]: reaped child process 1869, status = succeeded lb # [ 188.217395] niks3-server[1013]: 2026/09/20 13:29:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 188.249090] nix-grpc-daemon[1792]: time=2026-09-20T13:29:00.146Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 188.250566] nix-grpc-daemon[1792]: time=2026-09-20T13:29:00.147Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 188.252974] niks3-server[1013]: 2026/09/20 13:29:00 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 188.259212] niks3-server[1013]: 2026/09/20 13:29:00 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 188.271535] niks3-server[1013]: 2026/09/20 13:29:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 188.277886] niks3-server[1013]: 2026/09/20 13:29:00 INFO Signed narinfos id=67 count=1 worker2 # [ 188.303941] nix-grpc-daemon[1792]: time=2026-09-20T13:29:00.200Z level=INFO msg="Uploading 1 narinfos" lb # [ 188.280722] niks3-server[1013]: 2026/09/20 13:29:00 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 188.292252] niks3-server[1013]: 2026/09/20 13:29:00 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 188.299041] niks3-server[1013]: 2026/09/20 13:29:00 INFO Completed upload id=67 lb # [ 188.300780] niks3-server[1013]: 2026/09/20 13:29:00 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 188.322622] nix-grpc-daemon[1792]: time=2026-09-20T13:29:00.219Z level=INFO msg="Upload complete. (283ms)" worker2 # [ 188.329339] nix-grpc-daemon[1736]: ts=2026-09-20T13:29:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57892 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=1 worker1 # [ 188.324955] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:59Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker1 # [ 188.329192] nix-grpc-daemon[1536]: ts=2026-09-20T13:28:59Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 188.343198] nix-daemon[866]: reaped child process 1849, status = succeeded worker2 # [ 188.379166] nix-grpc-daemon[1736]: ts=2026-09-20T13:29:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 188.391423] nix-grpc-daemon[1736]: ts=2026-09-20T13:29:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 188.403605] nix-grpc-daemon[1792]: time=2026-09-20T13:29:00.300Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 188.411577] nix-grpc-daemon[1736]: ts=2026-09-20T13:29:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 188.421166] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) worker2 # [ 188.576358] nix-daemon[866]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 188.589242] nix-daemon[866]: reaped child process 1876, status = succeeded worker2 # [ 188.738291] nix-daemon[866]: accepted connection from pid 1878, user nix-grpc-daemon (trusted) worker2 # [ 188.751167] nix-daemon[866]: reaped child process 1881, status = succeeded lb # [ 188.740990] niks3-server[1013]: 2026/09/20 13:29:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 188.771909] nix-grpc-daemon[1792]: time=2026-09-20T13:29:00.668Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 188.773290] nix-grpc-daemon[1792]: time=2026-09-20T13:29:00.668Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 188.767602] niks3-server[1013]: 2026/09/20 13:29:00 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 188.776397] niks3-server[1013]: 2026/09/20 13:29:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker2 # [ 188.804714] nix-grpc-daemon[1792]: time=2026-09-20T13:29:00.701Z level=INFO msg="Uploading 1 narinfos" lb # [ 188.781503] niks3-server[1013]: 2026/09/20 13:29:00 INFO Signed narinfos id=68 count=1 lb # [ 188.786648] niks3-server[1013]: 2026/09/20 13:29:00 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 188.798297] niks3-server[1013]: 2026/09/20 13:29:00 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete worker2 # [ 188.827737] nix-grpc-daemon[1792]: time=2026-09-20T13:29:00.724Z level=INFO msg="Upload complete. (394ms)" lb # [ 188.804344] niks3-server[1013]: 2026/09/20 13:29:00 INFO Completed upload id=68 worker2 # [ 188.829933] nix-grpc-daemon[1736]: ts=2026-09-20T13:29:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57892 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 188.807504] niks3-server[1013]: 2026/09/20 13:29:00 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 188.834801] nix-grpc-daemon[1736]: ts=2026-09-20T13:29:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57892 worker2 # [ 188.841279] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) worker2 # [ 188.846428] nix-daemon[866]: reaped child process 1871, status = succeeded client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... worker2 # [ 188.852162] nix-daemon[866]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> LOG-farm-top-drain worker2 # [ 189.479592] nix-daemon[866]: reaped child process 1885, status = succeeded worker2 # [ 189.629135] nix-daemon[866]: accepted connection from pid 1900, user nix-grpc-daemon (trusted) worker2 # [ 189.641254] nix-daemon[866]: reaped child process 1903, status = succeeded lb # [ 189.632924] niks3-server[1013]: 2026/09/20 13:29:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 189.664697] nix-grpc-daemon[1792]: time=2026-09-20T13:29:01.561Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 189.666206] nix-grpc-daemon[1792]: time=2026-09-20T13:29:01.563Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 189.668145] niks3-server[1013]: 2026/09/20 13:29:01 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 189.678943] niks3-server[1013]: 2026/09/20 13:29:01 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 189.687801] niks3-server[1013]: 2026/09/20 13:29:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 189.691773] niks3-server[1013]: 2026/09/20 13:29:01 INFO Signed narinfos id=69 count=1 worker2 # [ 189.718303] nix-grpc-daemon[1792]: time=2026-09-20T13:29:01.615Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.696483] niks3-server[1013]: 2026/09/20 13:29:01 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 189.705555] niks3-server[1013]: 2026/09/20 13:29:01 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 189.709046] niks3-server[1013]: 2026/09/20 13:29:01 INFO Completed upload id=69 lb # [ 189.710778] niks3-server[1013]: 2026/09/20 13:29:01 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 189.733865] nix-grpc-daemon[1792]: time=2026-09-20T13:29:01.630Z level=INFO msg="Upload complete. (274ms)" worker2 # [ 189.739645] nix-grpc-daemon[1736]: ts=2026-09-20T13:29:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57892 duration_s=0 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=1 worker2 # [ 189.752395] nix-daemon[866]: reaped child process 1883, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.50 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.18 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 191.088393] nix-grpc-daemon[1536]: ts=2026-09-20T13:29:02Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.94 seconds) (finished: run the VM test script, in 192.42 seconds) test script finished in 192.66s cleanup kill QemuMachine (pid 52) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 49) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 0.94 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh