tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 50) worker1 # Formatting '/build/vm-state-worker1/tmp.70XPRWOFLj', fmt=raw size=1073741824 client # Disk image does not exist, creating the virtualisation disk image... worker1 # mke2fs 1.47.4 (6-Mar-2025) client # Formatting '/build/vm-state-client/tmp.8oInvWY94u', fmt=raw size=1073741824 worker1 # Discarding device blocks: 0/262144 done client: QEMU running (pid 49) client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 52) client # Discarding device blocks: 0/262144 done worker1 # Filesystem UUID: e3cdf389-40e5-4787-9f82-90b620ab7000 client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Superblock backups stored on blocks: client # Filesystem UUID: b43e5ad4-3a5d-4dba-9231-114682aa5aac worker1 # 32768, 98304, 163840, 229376 client # Superblock backups stored on blocks: worker1 # client # 32768, 98304, 163840, 229376 worker1 # Allocating group tables: 0/8 done client # worker1 # Writing inode tables: 0/8 done client # Allocating group tables: 0/8 done worker1 # Creating journal (8192 blocks): done client # Writing inode tables: 0/8 done worker1 # Writing superblocks and filesystem accounting information: 0/8 done client # Creating journal (8192 blocks): done worker1 # client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Virtualisation disk image created. client # lb: QEMU running (pid 51) client # Virtualisation disk image created. lb # Disk image does not exist, creating the virtualisation disk image... worker2 # Formatting '/build/vm-state-worker2/tmp.9eiaDPplir', fmt=raw size=1073741824 lb # Formatting '/build/vm-state-lb/tmp.PaBz5gKktb', fmt=raw size=1073741824 worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done lb # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: 38641851-c8e9-424a-be26-c4cf0da97f81 lb # Filesystem UUID: e488cc7c-bb68-4c65-915e-0666e1454295 worker2 # Superblock backups stored on blocks: lb # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 lb # 32768, 98304, 163840, 229376 worker2 # lb # worker2 # Allocating group tables: 0/8 done lb # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done lb # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done lb # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/8 done worker2 # lb # worker2 # Virtualisation disk image created. lb # Virtualisation disk image created. (finished: start all VMs, in 0.20 seconds) client: waiting for unit network-addresses-eth1.service client: waiting for the VM to finish booting worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # client # client # worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker1 # worker1 # client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:08.0)... client # client # lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)... lb # lb # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker2 # worker2 # worker1 # Booting from ROM... client # Booting from ROM... lb # Booting from ROM... worker2 # Booting from ROM... worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/kn8lkkabvm6j2z1h4bz436yvy0sl8h8s-nixos-system-worker1-test/init regInfo=/nix/store/fi7n7rcxwmjd9xsqbdsf0axfx61p1yqr-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test/init regInfo=/nix/store/fn7g8nqplkbnzmdkpggk8d349iiq0ydb-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000001] kvm-clock: using sched offset of 480200280 cycles client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000004] tsc: Detected 2400.012 MHz processor worker1 # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.002730] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.002741] Using GB pages for direct mapping client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.002852] RAMDISK: [mem 0x5e367000-0x5ffcffff] lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j1nn9bbhrn5xz154akfhw453f8i07i4d-nixos-system-lb-test/init regInfo=/nix/store/hq8v7nws787a9kwd3h009z1n9dqal4fl-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.002860] ACPI: Early table checksum verification disabled client # [ 0.000000] Hypervisor detected: KVM worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.002862] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.002866] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] kvm-clock: using sched offset of 483561163 cycles worker1 # [ 0.002869] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.002876] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hhh9ld89fpwxsi59mykz4xra0di8j4h8-nixos-system-worker2-test/init regInfo=/nix/store/scs6ihx0jbj5aw1gbnl2wv8q1ggxqmhd-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.002878] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002880] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.002881] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000834] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.002734] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.002883] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002746] Using GB pages for direct mapping worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.002825] RAMDISK: [mem 0x5e366000-0x5ffcffff] worker1 # [ 0.002884] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.002832] ACPI: Early table checksum verification disabled worker1 # [ 0.002885] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] APIC: Static calls initialized client # [ 0.002835] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002887] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.002839] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002887] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.002842] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002888] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.002888] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.002857] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002859] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.002888] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.002889] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.000000] kvm-clock: using sched offset of 466731286 cycles client # [ 0.002860] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.003109] No NUMA configuration found client # [ 0.002862] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.003110] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000005] tsc: Detected 2400.012 MHz processor worker1 # [ 0.003112] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.002863] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005397] Zone ranges: worker2 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.005397] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002865] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.005399] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.005400] Normal empty client # [ 0.002866] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.005400] Device empty worker2 # [ 0.000000] kvm-clock: using sched offset of 480042970 cycles lb # [ 0.000834] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.002867] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.005401] Movable zone start for each node lb # [ 0.002722] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.005402] Early memory node ranges client # [ 0.002868] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.002734] Using GB pages for direct mapping worker1 # [ 0.005402] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.002818] RAMDISK: [mem 0x5e367000-0x5ffcffff] client # [ 0.002868] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.005403] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.002827] ACPI: Early table checksum verification disabled client # [ 0.002869] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.002830] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.005404] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002869] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.005423] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.002834] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.005689] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.002870] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.003094] No NUMA configuration found lb # [ 0.002838] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.032858] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.002750] Using GB pages for direct mapping worker1 # [ 0.033315] ACPI: PM-Timer IO Port: 0x608 client # [ 0.003094] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.002872] RAMDISK: [mem 0x5e367000-0x5ffcffff] lb # [ 0.002845] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.033326] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.003097] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.002880] ACPI: Early table checksum verification disabled lb # [ 0.002847] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.005730] Zone ranges: worker1 # [ 0.033353] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.002882] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.005731] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.002849] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.033355] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.002886] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005732] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker1 # [ 0.033357] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.002850] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005733] Normal empty client # [ 0.005734] Device empty worker2 # [ 0.002890] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.033358] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.005735] Movable zone start for each node lb # [ 0.002852] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005736] Early memory node ranges worker1 # [ 0.033359] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.002897] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002853] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005736] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.002899] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.033360] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.005737] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.002855] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.033362] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.002900] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005738] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.002856] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.033363] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.033366] TSC deadline timer available worker2 # [ 0.002902] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005757] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.002856] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.033370] CPU topo: Max. logical packages: 1 client # [ 0.006029] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.002903] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002857] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.033370] CPU topo: Max. logical dies: 1 client # [ 0.033293] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.033371] CPU topo: Max. dies per package: 1 lb # [ 0.002857] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.033744] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.002905] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.033374] CPU topo: Max. threads per core: 1 client # [ 0.033756] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.033375] CPU topo: Num. cores per package: 1 lb # [ 0.002858] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.002906] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.033375] CPU topo: Num. threads per package: 1 client # [ 0.033782] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.002858] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.002907] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.033375] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.003092] No NUMA configuration found client # [ 0.033785] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.002908] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.033393] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.003093] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.033787] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.002908] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.003095] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.033788] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.033423] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.005474] Zone ranges: worker2 # [ 0.002909] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.033789] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.033425] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.005475] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.002909] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.033426] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.033789] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.005476] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.005477] Normal empty worker2 # [ 0.002909] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.005478] Device empty client # [ 0.033792] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.033428] Booting paravirtualized kernel on KVM worker2 # [ 0.003131] No NUMA configuration found lb # [ 0.005479] Movable zone start for each node client # [ 0.033792] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.005480] Early memory node ranges worker1 # [ 0.033431] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.003132] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.033796] TSC deadline timer available client # [ 0.033800] CPU topo: Max. logical packages: 1 lb # [ 0.005480] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.003134] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.037866] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.033801] CPU topo: Max. logical dies: 1 worker2 # [ 0.005782] Zone ranges: lb # [ 0.005481] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.040387] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.033802] CPU topo: Max. dies per package: 1 worker2 # [ 0.005783] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.033805] CPU topo: Max. threads per core: 1 lb # [ 0.005482] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.040430] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.005784] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.033806] CPU topo: Num. cores per package: 1 worker2 # [ 0.005785] Normal empty lb # [ 0.005504] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.005786] Device empty client # [ 0.033806] CPU topo: Num. threads per package: 1 lb # [ 0.005784] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.005787] Movable zone start for each node client # [ 0.033806] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.005787] Early memory node ranges lb # [ 0.033914] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.034376] ACPI: PM-Timer IO Port: 0x608 client # [ 0.033823] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.005788] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.034388] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.005789] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.033859] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.040431] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/kn8lkkabvm6j2z1h4bz436yvy0sl8h8s-nixos-system-worker1-test/init regInfo=/nix/store/fi7n7rcxwmjd9xsqbdsf0axfx61p1yqr-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.034416] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.005790] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.033861] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.034419] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.005809] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.033862] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.040523] Unknown kernel command line parameters "regInfo=/nix/store/fi7n7rcxwmjd9xsqbdsf0axfx61p1yqr-closure-info/registration", will be passed to user space. lb # [ 0.034421] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.006078] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.040536] random: crng init done client # [ 0.033864] Booting paravirtualized kernel on KVM worker2 # [ 0.033274] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.034422] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.040537] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.033723] ACPI: PM-Timer IO Port: 0x608 client # [ 0.033866] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.034423] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.033734] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.042706] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.038306] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.034424] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.033758] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.043785] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.040503] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.034426] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.043816] Fallback order for Node 0: 0 worker2 # [ 0.033761] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.040547] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.034427] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.033763] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.043819] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.034431] TSC deadline timer available worker1 # [ 0.043820] Policy zone: DMA32 lb # [ 0.034435] CPU topo: Max. logical packages: 1 worker2 # [ 0.033764] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.034436] CPU topo: Max. logical dies: 1 worker1 # [ 0.046633] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.033765] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.034436] CPU topo: Max. dies per package: 1 worker1 # [ 0.049804] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.034440] CPU topo: Max. threads per core: 1 worker2 # [ 0.033766] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.053472] allocated 3145728 bytes of page_ext lb # [ 0.034440] CPU topo: Num. cores per package: 1 worker1 # [ 0.063463] ftrace: allocating 48731 entries in 192 pages worker2 # [ 0.033768] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.040549] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test/init regInfo=/nix/store/fn7g8nqplkbnzmdkpggk8d349iiq0ydb-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.034441] CPU topo: Num. threads per package: 1 worker1 # [ 0.063465] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.033769] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.064294] Dynamic Preempt: lazy worker2 # [ 0.033772] TSC deadline timer available lb # [ 0.034441] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.064474] rcu: Preemptible hierarchical RCU implementation. client # [ 0.040641] Unknown kernel command line parameters "regInfo=/nix/store/fn7g8nqplkbnzmdkpggk8d349iiq0ydb-closure-info/registration", will be passed to user space. worker2 # [ 0.033776] CPU topo: Max. logical packages: 1 lb # [ 0.034460] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.040654] random: crng init done worker2 # [ 0.033777] CPU topo: Max. logical dies: 1 worker1 # [ 0.064474] rcu: RCU event tracing is enabled. worker2 # [ 0.033777] CPU topo: Max. dies per package: 1 lb # [ 0.034493] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.064475] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.040655] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.033781] CPU topo: Max. threads per core: 1 worker1 # [ 0.064477] Trampoline variant of Tasks RCU enabled. lb # [ 0.034495] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.033782] CPU topo: Num. cores per package: 1 client # [ 0.042815] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.064477] Rude variant of Tasks RCU enabled. worker2 # [ 0.033782] CPU topo: Num. threads per package: 1 lb # [ 0.034496] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.064477] Tracing variant of Tasks RCU enabled. client # [ 0.043908] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.034498] Booting paravirtualized kernel on KVM worker2 # [ 0.033782] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.043938] Fallback order for Node 0: 0 worker1 # [ 0.064478] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.033799] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.043941] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.034501] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.064479] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.043942] Policy zone: DMA32 worker2 # [ 0.033828] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.038945] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.046749] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.064494] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.033829] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.041246] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.049856] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.033830] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.041290] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.064496] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.053217] allocated 3145728 bytes of page_ext client # [ 0.063176] ftrace: allocating 48731 entries in 192 pages worker2 # [ 0.033832] Booting paravirtualized kernel on KVM worker1 # [ 0.064496] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.063178] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.068806] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.064026] Dynamic Preempt: lazy worker2 # [ 0.033834] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.064186] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.069073] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.038293] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.064186] rcu: RCU event tracing is enabled. worker2 # [ 0.040485] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.069079] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.064187] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.041291] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j1nn9bbhrn5xz154akfhw453f8i07i4d-nixos-system-lb-test/init regInfo=/nix/store/hq8v7nws787a9kwd3h009z1n9dqal4fl-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.040527] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.064188] Trampoline variant of Tasks RCU enabled. client # [ 0.064189] Rude variant of Tasks RCU enabled. worker1 # [ 0.069179] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.064189] Tracing variant of Tasks RCU enabled. worker1 # [ 0.072731] Console: colour VGA+ 80x25 lb # [ 0.041388] Unknown kernel command line parameters "regInfo=/nix/store/hq8v7nws787a9kwd3h009z1n9dqal4fl-closure-info/registration", will be passed to user space. worker1 # [ 0.072734] printk: legacy console [tty0] enabled lb # [ 0.041400] random: crng init done client # [ 0.064190] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.102286] printk: legacy console [ttyS0] enabled lb # [ 0.041401] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes client # [ 0.064190] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.197433] ACPI: Core revision 20250807 lb # [ 0.043641] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.040528] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hhh9ld89fpwxsi59mykz4xra0di8j4h8-nixos-system-worker2-test/init regInfo=/nix/store/scs6ihx0jbj5aw1gbnl2wv8q1ggxqmhd-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.064205] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.198278] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.045048] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.045082] Fallback order for Node 0: 0 client # [ 0.064207] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.040619] Unknown kernel command line parameters "regInfo=/nix/store/scs6ihx0jbj5aw1gbnl2wv8q1ggxqmhd-closure-info/registration", will be passed to user space. worker1 # [ 0.199748] APIC: Switch to symmetric I/O mode setup lb # [ 0.045085] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.040632] random: crng init done client # [ 0.064208] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.200712] x2apic enabled lb # [ 0.045086] Policy zone: DMA32 client # [ 0.068670] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.040632] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.047695] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.201445] APIC: Switched APIC routing to: physical x2apic client # [ 0.068934] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.042801] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.051057] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.054541] allocated 3145728 bytes of page_ext worker2 # [ 0.043895] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.068940] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.064594] ftrace: allocating 48731 entries in 192 pages worker2 # [ 0.043925] Fallback order for Node 0: 0 worker1 # [ 0.203218] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.064596] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.043927] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.065474] Dynamic Preempt: lazy client # [ 0.069041] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.043928] Policy zone: DMA32 client # [ 0.072567] Console: colour VGA+ 80x25 lb # [ 0.065596] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.204168] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.072570] printk: legacy console [tty0] enabled worker2 # [ 0.046763] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.065597] rcu: RCU event tracing is enabled. client # [ 0.101945] printk: legacy console [ttyS0] enabled worker2 # [ 0.049840] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.065598] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.205782] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.198102] ACPI: Core revision 20250807 worker2 # [ 0.053204] allocated 3145728 bytes of page_ext lb # [ 0.065599] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.063148] ftrace: allocating 48731 entries in 192 pages lb # [ 0.065600] Rude variant of Tasks RCU enabled. worker1 # [ 0.206866] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.063150] ftrace: allocated 192 pages with 2 groups lb # [ 0.065600] Tracing variant of Tasks RCU enabled. worker2 # [ 0.064026] Dynamic Preempt: lazy client # [ 0.198958] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.207899] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.064162] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.065601] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.200434] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.064163] rcu: RCU event tracing is enabled. worker1 # [ 0.208779] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.065601] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.201352] x2apic enabled worker2 # [ 0.064164] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.065616] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.064165] Trampoline variant of Tasks RCU enabled. client # [ 0.202082] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.209783] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.064166] Rude variant of Tasks RCU enabled. lb # [ 0.065618] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.064166] Tracing variant of Tasks RCU enabled. worker1 # [ 0.210779] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.203851] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.064167] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.065619] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.070328] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.064167] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.211779] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.204807] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.212779] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.070613] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.064232] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.213779] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.070619] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.206404] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.064234] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.070731] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.208486] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.064235] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.074316] Console: colour VGA+ 80x25 worker2 # [ 0.068591] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.074319] printk: legacy console [tty0] enabled client # [ 0.209552] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.103628] printk: legacy console [ttyS0] enabled worker2 # [ 0.068873] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.210402] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.199576] ACPI: Core revision 20250807 worker1 # [ 0.214779] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.068878] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.216786] Spectre V2 : Enabling IBPB for BPF client # [ 0.211405] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.068983] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.200512] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.072529] Console: colour VGA+ 80x25 worker1 # [ 0.218290] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.072532] printk: legacy console [tty0] enabled lb # [ 0.202000] APIC: Switch to symmetric I/O mode setup client # [ 0.212401] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.218780] active return thunk: srso_alias_return_thunk worker2 # [ 0.101922] printk: legacy console [ttyS0] enabled lb # [ 0.202931] x2apic enabled client # [ 0.213401] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.197650] ACPI: Core revision 20250807 worker1 # [ 0.220405] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.203671] APIC: Switched APIC routing to: physical x2apic client # [ 0.214401] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.221642] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.198494] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.215401] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.222503] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.205457] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.200027] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.223498] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.200969] x2apic enabled lb # [ 0.206413] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.224508] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.201704] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.224779] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.208053] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.216401] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.203514] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.225779] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.209138] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.218408] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.227653] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.210186] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.204473] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.219402] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.228476] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.211051] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.220402] active return thunk: srso_alias_return_thunk worker1 # [ 0.229476] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.206115] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.221422] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.229779] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.212054] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.207199] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.230779] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.222401] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.208264] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.213051] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.223401] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.209113] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.214051] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.231779] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.224401] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.215050] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.225401] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.210116] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.216051] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.226401] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.211112] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.227401] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.212113] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.228402] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.213112] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.217050] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.230157] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.214112] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.219058] Spectre V2 : Enabling IBPB for BPF client # [ 0.231132] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.219773] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.232183] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.221050] active return thunk: srso_alias_return_thunk client # [ 0.233163] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.222071] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.215112] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.234173] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.217120] Spectre V2 : Enabling IBPB for BPF lb # [ 0.223050] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.224050] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.218113] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.225050] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.219113] active return thunk: srso_alias_return_thunk lb # [ 0.226050] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.220134] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.227050] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.222112] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.228050] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.223112] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.229050] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.224112] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.230050] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.225112] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.231050] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.226112] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.232050] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.233050] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.227112] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.228113] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.234050] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.229112] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.230112] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.231113] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.232112] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.233112] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.266251] Freeing SMP alternatives memory: 44K worker1 # [ 0.266782] pid_max: default: 32768 minimum: 301 worker1 # [ 0.267859] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.268893] landlock: Up and running. worker1 # [ 0.269499] Yama: becoming mindful. worker1 # [ 0.270000] LSM support for eBPF active worker1 # [ 0.270921] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.271819] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.274742] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.268020] Freeing SMP alternatives memory: 44K worker1 # [ 0.275331] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.268404] pid_max: default: 32768 minimum: 301 worker1 # [ 0.275784] ... version: 2 worker1 # [ 0.276479] ... bit width: 48 client # [ 0.269492] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.276782] ... generic counters: 6 client # [ 0.270506] landlock: Up and running. client # [ 0.271140] Yama: becoming mindful. worker1 # [ 0.277485] ... generic bitmap: 000000000000003f worker1 # [ 0.277793] ... fixed-purpose counters: 0 client # [ 0.272029] LSM support for eBPF active worker1 # [ 0.278497] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.272997] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.278782] ... value mask: 0000ffffffffffff worker1 # [ 0.279649] ... max period: 00007fffffffffff client # [ 0.273444] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.280441] ... global_ctrl mask: 000000000000003f worker1 # [ 0.280899] signal: max sigframe size: 3376 worker1 # [ 0.281724] rcu: Hierarchical SRCU implementation. client # [ 0.276706] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.282340] rcu: Max phase no-delay instances is 400. client # [ 0.277957] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.278410] ... version: 2 client # [ 0.279151] ... bit width: 48 lb # [ 0.269079] Freeing SMP alternatives memory: 44K client # [ 0.279403] ... generic counters: 6 lb # [ 0.269872] pid_max: default: 32768 minimum: 301 client # [ 0.280134] ... generic bitmap: 000000000000003f lb # [ 0.270704] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.280403] ... fixed-purpose counters: 0 worker1 # [ 0.287339] smp: Bringing up secondary CPUs ... lb # [ 0.271167] landlock: Up and running. client # [ 0.281144] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.272482] Yama: becoming mindful. worker1 # [ 0.287796] smp: Brought up 1 node, 1 CPU client # [ 0.281403] ... value mask: 0000ffffffffffff lb # [ 0.273264] LSM support for eBPF active worker1 # [ 0.288434] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.268127] Freeing SMP alternatives memory: 44K client # [ 0.282307] ... max period: 00007fffffffffff lb # [ 0.274062] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.268888] pid_max: default: 32768 minimum: 301 client # [ 0.283063] ... global_ctrl mask: 000000000000003f client # [ 0.283511] signal: max sigframe size: 3376 worker1 # [ 0.288935] Memory: 1454576K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) worker2 # [ 0.269207] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.275091] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.290001] devtmpfs: initialized client # [ 0.284256] rcu: Hierarchical SRCU implementation. worker2 # [ 0.270227] landlock: Up and running. worker2 # [ 0.271113] Yama: becoming mindful. worker1 # [ 0.290787] x86/mm: Memory block size: 128MB client # [ 0.285009] rcu: Max phase no-delay instances is 400. worker2 # [ 0.272297] LSM support for eBPF active lb # [ 0.277544] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.273053] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.292528] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.278622] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.274157] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.279056] ... version: 2 worker1 # [ 0.293662] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.279768] ... bit width: 48 worker1 # [ 0.294888] pinctrl core: initialized pinctrl subsystem lb # [ 0.280053] ... generic counters: 6 client # [ 0.289839] smp: Bringing up secondary CPUs ... lb # [ 0.280745] ... generic bitmap: 000000000000003f worker1 # [ 0.296049] PM: RTC time: 10:46:16, date: 2026-09-22 client # [ 0.290417] smp: Brought up 1 node, 1 CPU worker2 # [ 0.277002] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.281059] ... fixed-purpose counters: 0 client # [ 0.291090] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.281770] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.277663] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.282052] ... value mask: 0000ffffffffffff worker2 # [ 0.278117] ... version: 2 lb # [ 0.282933] ... max period: 00007fffffffffff worker2 # [ 0.278802] ... bit width: 48 client # [ 0.291620] Memory: 1454540K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved) worker1 # [ 0.299533] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.279115] ... generic counters: 6 lb # [ 0.283725] ... global_ctrl mask: 000000000000003f client # [ 0.292623] devtmpfs: initialized worker2 # [ 0.279792] ... generic bitmap: 000000000000003f lb # [ 0.284159] signal: max sigframe size: 3376 client # [ 0.293382] x86/mm: Memory block size: 128MB worker1 # [ 0.301246] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.280125] ... fixed-purpose counters: 0 lb # [ 0.284958] rcu: Hierarchical SRCU implementation. worker2 # [ 0.280809] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.285618] rcu: Max phase no-delay instances is 400. worker1 # [ 0.301804] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.281115] ... value mask: 0000ffffffffffff client # [ 0.295007] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.303063] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.282021] ... max period: 00007fffffffffff client # [ 0.295432] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.303796] audit: initializing netlink subsys (disabled) worker2 # [ 0.282799] ... global_ctrl mask: 000000000000003f client # [ 0.296486] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.283247] signal: max sigframe size: 3376 worker1 # [ 0.304935] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.284010] rcu: Hierarchical SRCU implementation. client # [ 0.297606] PM: RTC time: 10:46:16, date: 2026-09-22 worker1 # [ 0.304938] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.284676] rcu: Max phase no-delay instances is 400. lb # [ 0.290745] smp: Bringing up secondary CPUs ... worker1 # [ 0.305783] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.291066] smp: Brought up 1 node, 1 CPU worker1 # [ 0.306715] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.291731] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.307520] audit: type=2000 audit(1790073976.670:1): state=initialized audit_enabled=0 res=1 client # [ 0.301287] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.308784] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.292225] Memory: 1454580K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) worker1 # [ 0.308798] cpuidle: using governor menu client # [ 0.302607] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.293372] devtmpfs: initialized worker2 # [ 0.289670] smp: Bringing up secondary CPUs ... client # [ 0.303426] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.310775] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.290128] smp: Brought up 1 node, 1 CPU lb # [ 0.294143] x86/mm: Memory block size: 128MB worker2 # [ 0.290775] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.304682] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.312002] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.305413] audit: initializing netlink subsys (disabled) lb # [ 0.295955] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.312784] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.291319] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) worker1 # [ 0.313792] PCI: Using configuration type 1 for base access client # [ 0.306520] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.296898] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.292344] devtmpfs: initialized client # [ 0.306522] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.298139] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.293073] x86/mm: Memory block size: 128MB worker1 # [ 0.314886] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.307405] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.299227] PM: RTC time: 10:46:16, date: 2026-09-22 client # [ 0.308335] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.294709] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.309135] audit: type=2000 audit(1790073976.679:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.295141] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.310407] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.310420] cpuidle: using governor menu worker2 # [ 0.296205] pinctrl core: initialized pinctrl subsystem lb # [ 0.302958] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.297319] PM: RTC time: 10:46:16, date: 2026-09-22 client # [ 0.312671] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.304285] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.322071] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.305076] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.313626] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.322783] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.314406] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.306342] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.300929] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.315416] PCI: Using configuration type 1 for base access lb # [ 0.307064] audit: initializing netlink subsys (disabled) worker2 # [ 0.302335] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.308208] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.316498] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.308210] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.303135] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.309054] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.327783] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.304402] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.309990] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.328782] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.305125] audit: initializing netlink subsys (disabled) lb # [ 0.310788] audit: type=2000 audit(1790073976.692:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.306235] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.312055] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.321661] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.306237] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.312069] cpuidle: using governor menu client # [ 0.322405] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.307116] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.314248] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.308053] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.315349] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.308883] audit: type=2000 audit(1790073976.696:1): state=initialized audit_enabled=0 res=1 lb # [ 0.316056] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.310118] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.310133] cpuidle: using governor menu lb # [ 0.317065] PCI: Using configuration type 1 for base access client # [ 0.327405] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.337378] ACPI: Added _OSI(Module Device) worker1 # [ 0.337783] ACPI: Added _OSI(Processor Device) worker2 # [ 0.312337] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.328404] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.318131] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.338475] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.313348] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.314117] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.315127] PCI: Using configuration type 1 for base access worker2 # [ 0.316288] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.325252] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.345388] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.326054] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.338960] ACPI: Added _OSI(Module Device) client # [ 0.339406] ACPI: Added _OSI(Processor Device) worker1 # [ 0.348725] ACPI: Interpreter enabled client # [ 0.340153] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.349248] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.323361] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.331054] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.349782] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.324116] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.332053] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.350626] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.329116] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.330116] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.355782] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.356852] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.348424] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.342498] ACPI: Added _OSI(Module Device) client # [ 0.352834] ACPI: Interpreter enabled lb # [ 0.343054] ACPI: Added _OSI(Processor Device) client # [ 0.353427] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.343777] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.354141] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.338719] ACPI: Added _OSI(Module Device) worker2 # [ 0.339117] ACPI: Added _OSI(Processor Device) worker1 # [ 0.365437] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.339906] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.356457] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.357404] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.366265] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.366859] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.350626] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.360530] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.367904] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.369131] PCI host bridge to bus 0000:00 worker1 # [ 0.369787] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.346729] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.370782] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.354469] ACPI: Interpreter enabled lb # [ 0.355068] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.371782] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.355763] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.372781] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.350067] ACPI: Interpreter enabled worker1 # [ 0.373782] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.367958] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.350568] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.374782] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.351115] ACPI: Using IOAPIC for interrupt routing lb # [ 0.358103] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.368410] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.375783] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.359053] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.351948] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.369482] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.376709] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.370525] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.362110] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.378244] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.371769] PCI host bridge to bus 0000:00 client # [ 0.372408] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.373404] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.357116] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.358213] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.374404] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.375404] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.376404] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.377404] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.369218] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.378410] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.380845] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.370059] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.381794] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.379369] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.371130] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.382765] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.372175] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.380862] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.373391] PCI host bridge to bus 0000:00 worker2 # [ 0.366828] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.383990] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.374057] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.375054] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.385494] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.367746] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.376053] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.368208] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.377054] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.369240] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.388813] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.370461] PCI host bridge to bus 0000:00 lb # [ 0.378053] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.389708] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.371129] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.379053] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.390528] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.380058] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.372115] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.383466] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.390788] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.373115] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.384415] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.381012] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.374115] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.385345] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.392884] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.382506] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.375115] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.386533] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.376115] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.394814] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.377115] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.388104] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.395685] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.378094] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.396556] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.379554] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.391421] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.398302] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.392270] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.393170] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.393409] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.385137] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.386066] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.401008] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.395287] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.402435] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.387036] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.402804] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.388053] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.397412] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.404353] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.382179] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.398331] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.389775] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.383127] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.399114] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.384079] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.405813] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] client # [ 0.399965] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.406684] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.385362] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.393081] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.407521] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.393943] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.386903] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.394815] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.408327] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.402411] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.395179] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.403411] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.390123] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.404392] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.410812] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] lb # [ 0.396663] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.391025] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.411654] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.405760] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.391875] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.412557] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.399084] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.392121] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.414224] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.399956] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.407412] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] lb # [ 0.400755] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.408246] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.393881] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.409145] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.401636] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.416815] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.396142] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.417806] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.409973] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.397012] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.418723] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.397880] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.411439] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] lb # [ 0.405012] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.420188] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.412280] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.398679] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.405706] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.413127] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.406075] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.421811] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] client # [ 0.413966] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.422685] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.407618] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.423515] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.423788] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.402156] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.403122] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.410084] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] client # [ 0.416434] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.404055] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.425782] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.417411] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.410982] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.418340] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.405586] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.427794] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.411782] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.428740] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.419832] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.412595] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.407147] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] worker1 # [ 0.430168] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.421436] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] worker2 # [ 0.407975] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.422288] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.414824] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker2 # [ 0.409137] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.431820] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] client # [ 0.423134] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.415060] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.432657] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.423410] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.415993] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.410658] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.433482] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.417459] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.424949] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.412143] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker1 # [ 0.435153] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.413049] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.427417] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.413894] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.428382] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.436811] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] lb # [ 0.421089] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.415612] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.437631] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.421917] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.429764] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.438485] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.422754] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.418065] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.439367] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.431439] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] lb # [ 0.423683] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.418763] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.432282] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.440417] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.419137] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.433131] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.425084] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] worker1 # [ 0.441579] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.420722] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.425928] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.433973] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.443395] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker2 # [ 0.422122] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] lb # [ 0.426847] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.423015] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.435434] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] lb # [ 0.428059] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.436248] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.423858] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.437116] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.429655] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.424120] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.437995] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.431066] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.425693] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.432000] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.439026] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.426853] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.427138] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.433442] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.439613] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.441078] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker2 # [ 0.428674] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.443972] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.430154] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] lb # [ 0.436033] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] worker1 # [ 0.446395] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] lb # [ 0.436766] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.430995] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.447074] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.437077] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.432137] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.448376] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.438818] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.433693] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.449021] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.435144] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker1 # [ 0.450069] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.441061] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker2 # [ 0.435980] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.441889] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.451028] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.436841] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.442772] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.441624] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.452810] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker2 # [ 0.437874] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.453631] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.444312] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.444054] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker2 # [ 0.440168] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker1 # [ 0.454798] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.445674] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] client # [ 0.444628] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.441188] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.446277] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.456696] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.446019] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.442609] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] lb # [ 0.447733] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] client # [ 0.447000] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.447714] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.460353] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.460890] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.448649] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.461907] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.450456] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker1 # [ 0.462880] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.451278] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.463880] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.464877] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.452431] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.466005] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.454016] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.466903] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.467827] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.468773] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.443315] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.469514] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.448295] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.445668] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] client # [ 0.457369] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.469808] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.450676] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker1 # [ 0.470748] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.458224] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.446383] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.471503] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.459204] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.451312] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.471797] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.460224] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.447617] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.472736] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.452599] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.461220] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.448368] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.462216] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.474525] iommu: Default domain type: Translated lb # [ 0.453345] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.463217] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.449428] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.474789] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.454359] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.475950] ACPI: bus type USB registered client # [ 0.464430] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.450371] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.476662] usbcore: registered new interface driver usbfs client # [ 0.465446] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.455335] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.477422] usbcore: registered new interface driver hub client # [ 0.466410] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.451872] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker1 # [ 0.477792] usbcore: registered new device driver usb client # [ 0.467393] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.452121] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.457082] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] client # [ 0.468138] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.479489] NetLabel: Initializing lb # [ 0.458061] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.479783] NetLabel: domain hash size = 128 worker2 # [ 0.453409] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.468420] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.480466] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.469356] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.459351] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.454967] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.480817] NetLabel: unlabeled traffic allowed by default client # [ 0.470151] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.481696] PCI: Using ACPI for IRQ routing client # [ 0.470418] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.460663] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.472423] iommu: Default domain type: Translated worker2 # [ 0.458708] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.473232] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.474385] ACPI: bus type USB registered worker2 # [ 0.459231] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.464338] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.474950] usbcore: registered new interface driver usbfs worker2 # [ 0.460213] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.465160] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.475416] usbcore: registered new interface driver hub worker2 # [ 0.461219] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.476241] usbcore: registered new device driver usb lb # [ 0.466153] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.462216] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.467158] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.477898] NetLabel: Initializing worker2 # [ 0.463211] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.478405] NetLabel: domain hash size = 128 lb # [ 0.468161] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.464215] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.479127] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.469156] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.479442] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.465214] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.480304] PCI: Using ACPI for IRQ routing lb # [ 0.470189] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.466151] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.471165] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.467130] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.472096] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.468121] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.473069] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.469108] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.474066] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.470083] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.470911] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.475066] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.471890] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.476067] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.472130] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.477065] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.478067] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.474147] iommu: Default domain type: Translated lb # [ 0.479068] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.474975] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.476159] ACPI: bus type USB registered lb # [ 0.481469] iommu: Default domain type: Translated worker2 # [ 0.476942] usbcore: registered new interface driver usbfs lb # [ 0.482070] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.477835] usbcore: registered new interface driver hub lb # [ 0.483359] ACPI: bus type USB registered worker2 # [ 0.478126] usbcore: registered new device driver usb lb # [ 0.484129] usbcore: registered new interface driver usbfs worker2 # [ 0.479844] NetLabel: Initializing lb # [ 0.485236] usbcore: registered new interface driver hub worker2 # [ 0.480121] NetLabel: domain hash size = 128 lb # [ 0.486071] usbcore: registered new device driver usb worker2 # [ 0.480859] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.481164] NetLabel: unlabeled traffic allowed by default lb # [ 0.488017] NetLabel: Initializing worker2 # [ 0.482127] PCI: Using ACPI for IRQ routing lb # [ 0.488534] NetLabel: domain hash size = 128 lb # [ 0.489053] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.490059] NetLabel: unlabeled traffic allowed by default lb # [ 0.491026] PCI: Using ACPI for IRQ routing worker1 # [ 0.525545] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.525778] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.525778] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.525786] vgaarb: loaded worker1 # [ 0.526492] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.526783] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.530870] clocksource: Switched to clocksource kvm-clock client # [ 0.524872] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.525400] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.534390] VFS: Disk quotas dquot_6.6.0 client # [ 0.525400] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.535089] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.525408] vgaarb: loaded worker1 # [ 0.536362] pnp: PnP ACPI init client # [ 0.526106] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.537117] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.526405] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.538058] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.539562] pnp: PnP ACPI: found 6 devices client # [ 0.529489] clocksource: Switched to clocksource kvm-clock client # [ 0.532937] VFS: Disk quotas dquot_6.6.0 client # [ 0.533642] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.534957] pnp: PnP ACPI init client # [ 0.535749] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.547114] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.548564] clocksource: Switched to clocksource acpi_pm client # [ 0.536702] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.549579] NET: Registered PF_INET protocol family client # [ 0.538190] pnp: PnP ACPI: found 6 devices worker2 # [ 0.525712] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.550832] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.526111] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.526111] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.526119] vgaarb: loaded worker2 # [ 0.526871] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.527117] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.537110] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.538049] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.545765] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.547171] clocksource: Switched to clocksource acpi_pm lb # [ 0.538049] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.530209] clocksource: Switched to clocksource kvm-clock lb # [ 0.538063] vgaarb: loaded client # [ 0.548134] NET: Registered PF_INET protocol family lb # [ 0.538854] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.549282] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.539702] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.533650] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.534392] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.535755] pnp: PnP ACPI init lb # [ 0.543171] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.536560] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.537545] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.567246] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.539072] pnp: PnP ACPI: found 6 devices worker1 # [ 0.568825] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.547126] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.570168] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.547882] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.571528] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.549590] pnp: PnP ACPI init worker1 # [ 0.572836] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.550531] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.574007] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.551584] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.575311] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.553213] pnp: PnP ACPI: found 6 devices worker1 # [ 0.576436] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.546624] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.577638] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.548058] clocksource: Switched to clocksource acpi_pm client # [ 0.565788] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.578628] NET: Registered PF_XDP protocol family worker2 # [ 0.549024] NET: Registered PF_INET protocol family worker1 # [ 0.579486] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.567281] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.550191] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.580516] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.568565] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.581527] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.569863] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.582660] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.571091] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.583772] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.572183] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.560981] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.584873] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.562418] clocksource: Switched to clocksource acpi_pm client # [ 0.573364] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.586504] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.563424] NET: Registered PF_INET protocol family client # [ 0.574386] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.575595] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.564641] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.576554] NET: Registered PF_XDP protocol family worker1 # [ 0.588737] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.577335] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.578292] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.590792] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.579246] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.580289] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.592752] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.581324] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.594373] PCI: CLS 0 bytes, default 64 client # [ 0.582364] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.584089] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.595277] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.566800] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.597467] Trying to unpack rootfs image as initramfs... client # [ 0.586267] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.568360] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.569674] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.588639] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.571070] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.572364] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.590608] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.573510] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.592306] PCI: CLS 0 bytes, default 64 worker2 # [ 0.574818] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.582001] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.593226] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.575921] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.594886] Trying to unpack rootfs image as initramfs... worker2 # [ 0.577116] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.583553] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.578065] NET: Registered PF_XDP protocol family lb # [ 0.584927] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.578924] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.586307] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.579964] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.587621] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.580987] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.582117] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.588776] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.583257] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.590188] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.584372] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.591306] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.586059] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.592616] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.593665] NET: Registered PF_XDP protocol family lb # [ 0.594545] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.588312] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.595593] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.596646] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.590456] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.597768] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.592393] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.598974] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.600111] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.593987] PCI: CLS 0 bytes, default 64 lb # [ 0.601928] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.594901] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.596709] Trying to unpack rootfs image as initramfs... lb # [ 0.605247] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.607263] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.609243] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.610952] PCI: CLS 0 bytes, default 64 lb # [ 0.611863] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.613676] Trying to unpack rootfs image as initramfs... worker1 # [ 0.640233] Initialise system trusted keyrings worker1 # [ 0.643783] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.640876] Initialise system trusted keyrings client # [ 0.641814] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.663086] Key type asymmetric registered worker1 # [ 0.666725] Asymmetric key parser 'x509' registered worker2 # [ 0.637413] Initialise system trusted keyrings worker1 # [ 0.667636] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.640299] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.670954] io scheduler mq-deadline registered client # [ 0.661425] Key type asymmetric registered worker1 # [ 0.673740] io scheduler kyber registered worker1 # [ 0.676767] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.666521] Asymmetric key parser 'x509' registered worker1 # [ 0.678130] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.667328] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.669619] io scheduler mq-deadline registered client # [ 0.670342] io scheduler kyber registered worker1 # [ 0.683920] Linux agpgart interface v0.103 lb # [ 0.660942] Initialise system trusted keyrings worker1 # [ 0.684738] ACPI: bus type drm_connector registered client # [ 0.674007] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.675252] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.664510] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.688057] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.689107] usbserial: USB Serial support registered for generic worker2 # [ 0.661214] Key type asymmetric registered client # [ 0.679260] Linux agpgart interface v0.103 client # [ 0.680002] ACPI: bus type drm_connector registered worker1 # [ 0.692730] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.664268] Asymmetric key parser 'x509' registered worker1 # [ 0.692730] Please enable it if your BIOS has the CPPC option. client # [ 0.682944] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.665114] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.694928] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.683970] usbserial: USB Serial support registered for generic worker2 # [ 0.668376] io scheduler mq-deadline registered worker2 # [ 0.669122] io scheduler kyber registered worker1 # [ 0.698941] drop_monitor: Initializing network drop monitor service client # [ 0.687485] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.700133] NET: Registered PF_INET6 protocol family client # [ 0.687485] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.671778] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.689614] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.702874] Segment Routing with IPv6 worker2 # [ 0.673048] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.703531] In-situ OAM (IOAM) with IPv6 client # [ 0.692607] drop_monitor: Initializing network drop monitor service client # [ 0.693740] NET: Registered PF_INET6 protocol family lb # [ 0.683847] Key type asymmetric registered worker1 # [ 0.707141] IPI shorthand broadcast: enabled worker2 # [ 0.678668] Linux agpgart interface v0.103 client # [ 0.696942] Segment Routing with IPv6 worker2 # [ 0.679486] ACPI: bus type drm_connector registered client # [ 0.699507] In-situ OAM (IOAM) with IPv6 lb # [ 0.688488] Asymmetric key parser 'x509' registered client # [ 0.700512] IPI shorthand broadcast: enabled worker2 # [ 0.682702] usbcore: registered new interface driver usbserial_generic lb # [ 0.689417] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.683724] usbserial: USB Serial support registered for generic lb # [ 0.692658] io scheduler mq-deadline registered worker1 # [ 0.715443] sched_clock: Marking stable (582014651, 132699047)->(786201128, -71487430) lb # [ 0.693417] io scheduler kyber registered worker2 # [ 0.687270] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.687270] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.718943] registered taskstats version 1 worker2 # [ 0.689526] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.719939] Loading compiled-in X.509 certificates lb # [ 0.697109] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.708716] sched_clock: Marking stable (575013935, 133460903)->(783486112, -75011274) lb # [ 0.698509] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.692386] drop_monitor: Initializing network drop monitor service worker2 # [ 0.693558] NET: Registered PF_INET6 protocol family lb # [ 0.702137] Linux agpgart interface v0.103 client # [ 0.713726] registered taskstats version 1 lb # [ 0.702973] ACPI: bus type drm_connector registered worker2 # [ 0.696694] Segment Routing with IPv6 client # [ 0.714675] Loading compiled-in X.509 certificates worker2 # [ 0.699302] In-situ OAM (IOAM) with IPv6 lb # [ 0.705936] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.700344] IPI shorthand broadcast: enabled lb # [ 0.707025] usbserial: USB Serial support registered for generic lb # [ 0.710469] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.710469] Please enable it if your BIOS has the CPPC option. lb # [ 0.712772] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.738732] Demotion targets for Node 0: null worker2 # [ 0.708604] sched_clock: Marking stable (575014346, 133233044)->(784385798, -76138408) worker1 # [ 0.739629] Key type .fscrypt registered lb # [ 0.716667] drop_monitor: Initializing network drop monitor service lb # [ 0.717877] NET: Registered PF_INET6 protocol family worker1 # [ 0.741728] Key type fscrypt-provisioning registered worker2 # [ 0.712339] registered taskstats version 1 worker1 # [ 0.742654] ima: No TPM chip found, activating TPM-bypass! client # [ 0.731034] Demotion targets for Node 0: null worker2 # [ 0.713309] Loading compiled-in X.509 certificates worker1 # [ 0.743551] ima: Allocated hash algorithm: sha1 lb # [ 0.722576] Segment Routing with IPv6 worker1 # [ 0.745759] ima: No architecture policies found lb # [ 0.723278] In-situ OAM (IOAM) with IPv6 client # [ 0.734537] Key type .fscrypt registered client # [ 0.735181] Key type fscrypt-provisioning registered client # [ 0.736103] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.748735] PM: Magic number: 10:966:780 lb # [ 0.725870] IPI shorthand broadcast: enabled client # [ 0.738488] ima: Allocated hash algorithm: sha1 worker1 # [ 0.750507] RAS: Correctable Errors collector initialized. client # [ 0.739239] ima: No architecture policies found client # [ 0.741493] PM: Magic number: 10:966:780 client # [ 0.743070] RAS: Correctable Errors collector initialized. lb # [ 0.734208] sched_clock: Marking stable (600013733, 133430063)->(808611797, -75168001) worker1 # [ 0.760460] clk: Disabling unused clocks lb # [ 0.737669] registered taskstats version 1 lb # [ 0.738668] Loading compiled-in X.509 certificates worker1 # [ 0.762736] PM: genpd: Disabling unused power domains worker2 # [ 0.733262] Demotion targets for Node 0: null worker2 # [ 0.734122] Key type .fscrypt registered client # [ 0.752145] clk: Disabling unused clocks worker2 # [ 0.737260] Key type fscrypt-provisioning registered worker2 # [ 0.738217] ima: No TPM chip found, activating TPM-bypass! client # [ 0.756494] PM: genpd: Disabling unused power domains worker2 # [ 0.739159] ima: Allocated hash algorithm: sha1 worker2 # [ 0.739985] ima: No architecture policies found worker2 # [ 0.742259] PM: Magic number: 10:966:780 worker2 # [ 0.743869] RAS: Correctable Errors collector initialized. lb # [ 0.758460] Demotion targets for Node 0: null lb # [ 0.759420] Key type .fscrypt registered lb # [ 0.760194] Key type fscrypt-provisioning registered worker2 # [ 0.753900] clk: Disabling unused clocks lb # [ 0.761209] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.756260] PM: genpd: Disabling unused power domains lb # [ 0.763465] ima: Allocated hash algorithm: sha1 lb # [ 0.764322] ima: No architecture policies found lb # [ 0.768469] PM: Magic number: 10:966:780 lb # [ 0.772473] RAS: Correctable Errors collector initialized. lb # [ 0.781532] clk: Disabling unused clocks lb # [ 0.782287] PM: genpd: Disabling unused power domains client # [ 0.916586] Freeing initrd memory: 29096K client # [ 0.919679] Freeing unused decrypted memory: 2028K client # [ 0.922250] Freeing unused kernel image (initmem) memory: 3644K client # [ 0.923303] Write protecting the kernel read-only data: 32768k client # [ 0.925121] Freeing unused kernel image (text/rodata gap) memory: 1208K client # [ 0.926615] Freeing unused kernel image (rodata/data gap) memory: 752K worker1 # [ 0.941380] Freeing initrd memory: 29092K worker1 # [ 0.944963] Freeing unused decrypted memory: 2028K worker1 # [ 0.948054] Freeing unused kernel image (initmem) memory: 3644K worker1 # [ 0.949136] Write protecting the kernel read-only data: 32768k worker1 # [ 0.951172] Freeing unused kernel image (text/rodata gap) memory: 1208K worker1 # [ 0.952822] Freeing unused kernel image (rodata/data gap) memory: 752K worker2 # [ 0.925741] Freeing initrd memory: 29092K worker2 # [ 0.928856] Freeing unused decrypted memory: 2028K worker2 # [ 0.931516] Freeing unused kernel image (initmem) memory: 3644K worker2 # [ 0.932625] Write protecting the kernel read-only data: 32768k worker2 # [ 0.934531] Freeing unused kernel image (text/rodata gap) memory: 1208K worker2 # [ 0.936060] Freeing unused kernel image (rodata/data gap) memory: 752K lb # [ 0.957055] Freeing initrd memory: 29092K lb # [ 0.960567] Freeing unused decrypted memory: 2028K lb # [ 0.963564] Freeing unused kernel image (initmem) memory: 3644K lb # [ 0.964744] Write protecting the kernel read-only data: 32768k client # [ 0.977735] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.966941] Freeing unused kernel image (text/rodata gap) memory: 1208K client # [ 0.978802] Run /init as init process lb # [ 0.968560] Freeing unused kernel image (rodata/data gap) memory: 752K client # [ 0.988754] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.003949] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 1.005012] Run /init as init process worker1 # [ 1.016034] systemd[1]: Inserted module 'autofs4' client # [ 1.005034] fuse: init (API version 7.45) worker2 # [ 0.987047] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 0.988187] Run /init as init process client # [ 1.010823] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.013200] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 0.998086] systemd[1]: Inserted module 'autofs4' client # [ 1.016061] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.018249] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.033019] fuse: init (API version 7.45) worker1 # [ 1.038976] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.041815] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.014265] fuse: init (API version 7.45) lb # [ 1.020610] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.021781] Run /init as init process worker1 # [ 1.045091] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.047516] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.019989] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.022331] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.025206] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.032811] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.027443] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.046685] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.051598] fuse: init (API version 7.45) worker1 # [ 1.077228] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.058281] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.051948] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.060920] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.064130] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.066619] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.094325] systemd[1]: Successfully made /usr/ read-only. client # [ 1.383383] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.395284] systemd[1]: Detected virtualization kvm. client # [ 1.397419] systemd[1]: Detected architecture x86-64. client # [ 1.399606] systemd[1]: Running in initrd. client # [ 1.402249] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.413090] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.418129] systemd[1]: Detected virtualization kvm. client # [ 1.405142] systemd[1]: Hostname set to . worker1 # [ 1.418965] systemd[1]: Detected architecture x86-64. worker1 # [ 1.419865] systemd[1]: Running in initrd. worker1 # [ 1.421013] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.422255] systemd[1]: Hostname set to . worker2 # [ 1.387366] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.396556] systemd[1]: Detected virtualization kvm. worker2 # [ 1.398735] systemd[1]: Detected architecture x86-64. worker2 # [ 1.400938] systemd[1]: Running in initrd. worker2 # [ 1.403585] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.406594] systemd[1]: Hostname set to . lb # [ 1.430888] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.442701] systemd[1]: Detected virtualization kvm. lb # [ 1.444755] systemd[1]: Detected architecture x86-64. lb # [ 1.446836] systemd[1]: Running in initrd. lb # [ 1.449322] systemd[1]: Initializing machine ID from random generator. lb # [ 1.452175] systemd[1]: Hostname set to . client # [ 1.613164] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.627514] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.634131] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.653382] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.657868] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.659077] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.660561] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.661706] systemd[1]: Reached target Path Units. client # [ 1.662617] systemd[1]: Reached target Slice Units. client # [ 1.663540] systemd[1]: Reached target Swaps. client # [ 1.664333] systemd[1]: Reached target Timer Units. client # [ 1.665345] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.666666] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.667852] systemd[1]: Listening on Journal Sockets. client # [ 1.668896] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.680357] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.669915] systemd[1]: Listening on udev Kernel Socket. client # [ 1.670906] systemd[1]: Reached target Socket Units. client # [ 1.672806] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.685107] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.686292] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.687737] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.676547] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.688874] systemd[1]: Reached target Path Units. worker1 # [ 1.689692] systemd[1]: Reached target Slice Units. worker1 # [ 1.690594] systemd[1]: Reached target Swaps. worker1 # [ 1.691562] systemd[1]: Reached target Timer Units. worker1 # [ 1.692676] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.694012] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.695200] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.696214] systemd[1]: Listening on udev Control Socket. client # [ 1.684550] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.697261] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.698211] systemd[1]: Reached target Socket Units. worker1 # [ 1.700214] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.677933] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.705831] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.698660] systemd[1]: Starting Journal Service... worker1 # [ 1.713988] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.690159] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.711804] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.694551] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.695712] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.697153] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.698308] systemd[1]: Reached target Path Units. worker2 # [ 1.699181] systemd[1]: Reached target Slice Units. worker2 # [ 1.700099] systemd[1]: Reached target Swaps. worker2 # [ 1.700944] systemd[1]: Reached target Timer Units. worker1 # [ 1.730816] systemd[1]: Starting Journal Service... worker2 # [ 1.701918] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.703164] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.704385] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.705421] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.706523] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.707514] systemd[1]: Reached target Socket Units. worker2 # [ 1.709309] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.718573] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.713056] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.746224] systemd[1]: Starting Load Kernel Modules... client # [ 1.736451] netfs: FS-Cache loaded worker2 # [ 1.719927] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.741385] 9pnet: Installing 9P2000 support lb # [ 1.733962] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.737899] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.739141] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.751240] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.751440] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.740597] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.734325] systemd[1]: Starting Journal Service... lb # [ 1.741674] systemd[1]: Reached target Path Units. lb # [ 1.742578] systemd[1]: Reached target Slice Units. lb # [ 1.743497] systemd[1]: Reached target Swaps. worker1 # [ 1.767350] netfs: FS-Cache loaded lb # [ 1.744313] systemd[1]: Reached target Timer Units. lb # [ 1.745326] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.746664] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.747858] systemd[1]: Listening on Journal Sockets. lb # [ 1.748892] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.772466] 9pnet: Installing 9P2000 support lb # [ 1.749972] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.750960] systemd[1]: Reached target Socket Units. worker2 # [ 1.745338] systemd[1]: Starting Load Kernel Modules... lb # [ 1.752887] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.767594] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.758320] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.773174] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.785917] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.766636] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.781926] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.753324] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.796649] systemd-journald[67]: Collecting audit messages is disabled. client # [ 1.785435] systemd-journald[67]: Collecting audit messages is disabled. client # [ 1.787928] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.770906] netfs: FS-Cache loaded worker1 # [ 1.801061] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.781641] systemd[1]: Starting Journal Service... worker2 # [ 1.775640] 9pnet: Installing 9P2000 support worker1 # [ 1.807371] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.795850] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.800073] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.785318] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.816145] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.794529] systemd[1]: Starting Load Kernel Modules... client # [ 1.805191] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.821123] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.812706] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.815503] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.828072] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.798430] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.834158] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.805839] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.801537] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.838756] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.817774] netfs: FS-Cache loaded worker2 # [ 1.813639] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.822643] 9pnet: Installing 9P2000 support worker1 # [ 1.845789] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.817904] systemd-journald[67]: Collecting audit messages is disabled. worker1 # [ 1.848731] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.819469] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.824305] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.836587] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.830705] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.849614] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.835084] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.857735] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.842350] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.851756] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.845391] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.878243] systemd[1]: Finished Load Kernel Modules. lb # [ 1.856320] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.869571] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.884933] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.864880] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.877840] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.866883] systemd-journald[67]: Collecting audit messages is disabled. lb # [ 1.871895] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.895278] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.877829] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.874472] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.905376] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.882218] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.884722] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.899106] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.882143] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.891246] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.918167] systemd[1]: Started Journal Service. lb # [ 1.895524] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.908715] systemd[1]: Started Journal Service. worker1 # [ 1.784829] systemd-modules-load[68]: Inserted module 'dm_mod' worker1 # [ 1.788919] systemd-modules-load[68]: Inserted module 'virtio_balloon' client # [ 1.774774] systemd-modules-load[68]: Inserted module 'dm_mod' worker1 # [ 1.789963] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.777926] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.893369] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.780053] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.795961] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.901689] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.786854] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.792044] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.795071] systemd[1]: Reached target Local File Systems. client # [ 1.797940] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.811079] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.811993] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.812903] systemd[1]: Reached target Local File Systems. lb # [ 1.922522] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.816061] systemd[1]: Starting Create System Files and Directories... client # [ 1.805076] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.921325] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.931653] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.823067] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.936788] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.945520] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.805511] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 1.807369] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.941596] systemd[1]: Started Journal Service. worker2 # [ 1.810330] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.830129] systemd[1]: Finished Create System Files and Directories. lb # [ 1.954690] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.819150] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.849471] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.820191] systemd[1]: Reached target Local File Systems. worker2 # [ 1.823146] systemd[1]: Starting Create System Files and Directories... lb # [ 1.968558] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.831070] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.856285] systemd-udevd[84]: Using default interface naming scheme 'v261'. worker1 # [ 1.869273] systemd-udevd[83]: Using default interface naming scheme 'v261'. lb # [ 1.985077] systemd[1]: Started Journal Service. lb # [ 1.852609] systemd-modules-load[68]: Inserted module 'dm_mod' lb # [ 1.855381] systemd-modules-load[68]: Inserted module 'virtio_balloon' lb # [ 1.856404] systemd-modules-load[68]: Inserted module 'virtio_gpu' lb # [ 1.859358] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.855087] systemd[1]: Finished Create System Files and Directories. lb # [ 1.868117] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.869114] systemd[1]: Reached target Local File Systems. worker1 # [ 1.892851] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.881541] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.871254] systemd[1]: Starting Create System Files and Directories... lb # [ 1.878134] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.878769] systemd-udevd[83]: Using default interface naming scheme 'v261'. lb # [ 1.904959] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.906080] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.926103] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.927146] systemd[1]: Reached target System Initialization. client # [ 1.927951] systemd[1]: Reached target Basic System. worker1 # [ 1.947815] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.948774] systemd[1]: Reached target System Initialization. worker1 # [ 1.950239] systemd[1]: Reached target Basic System. lb # [ 1.927433] systemd-udevd[83]: Using default interface naming scheme 'v261'. lb # [ 1.953078] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.955081] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.955929] systemd[1]: Reached target System Initialization. worker2 # [ 1.956794] systemd[1]: Reached target Basic System. lb # [ 2.002226] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.003685] systemd[1]: Reached target System Initialization. lb # [ 2.004554] systemd[1]: Reached target Basic System. worker1 # [ 2.250397] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.244195] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.252869] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 2.272137] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 2.280510] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.271373] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.273438] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.274132] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.286178] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.294002] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.273895] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.305428] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.306161] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.307881] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.285967] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 2.313896] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.287179] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 2.316832] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.317958] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.320724] usb usb1: Product: EHCI Host Controller worker1 # [ 2.321452] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd client # [ 2.311277] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.323431] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.312121] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.325524] hub 1-0:1.0: USB hub found worker1 # [ 2.326409] hub 1-0:1.0: 6 ports detected client # [ 2.314578] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.307274] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.321593] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.335075] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.305031] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.306421] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.335921] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.323878] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.307084] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.325012] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.328578] usb usb1: Product: EHCI Host Controller client # [ 2.329247] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd client # [ 2.331164] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.314971] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.333589] hub 1-0:1.0: USB hub found worker2 # [ 2.315719] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.334185] hub 1-0:1.0: 6 ports detected worker2 # [ 2.317383] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.350551] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.351627] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 client # [ 2.341137] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.341915] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.325519] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.326390] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.327877] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.357588] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.330264] usb usb1: Product: EHCI Host Controller worker2 # [ 2.330933] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker2 # [ 2.333050] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.334324] hub 1-0:1.0: USB hub found worker2 # [ 2.335744] hub 1-0:1.0: 6 ports detected client # [ 2.354259] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.355373] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 worker1 # [ 2.369208] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.342342] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.349707] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.343088] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.363944] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.365086] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.358353] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.381948] usb usb2: Product: UHCI Host Controller lb # [ 2.359118] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.352935] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.382661] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.360955] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.385670] SCSI subsystem initialized worker2 # [ 2.356119] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 worker1 # [ 2.256763] systemd[1]: Starting Virtual Console Setup... client # [ 2.378175] SCSI subsystem initialized lb # [ 2.368625] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.369707] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.362748] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.370373] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.393730] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.371631] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.372723] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.384095] usb usb2: Product: UHCI Host Controller lb # [ 2.375453] usb usb1: Product: EHCI Host Controller lb # [ 2.376143] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd client # [ 2.254319] systemd[1]: Starting Virtual Console Setup... lb # [ 2.378453] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.372707] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.380550] hub 1-0:1.0: USB hub found lb # [ 2.381712] hub 1-0:1.0: 6 ports detected client # [ 2.393040] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.407442] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.380107] SCSI subsystem initialized worker1 # [ 2.410019] hub 2-0:1.0: USB hub found lb # [ 2.389057] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.389785] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.383682] usb usb2: Product: UHCI Host Controller client # [ 2.403175] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.415508] hub 2-0:1.0: 2 ports detected worker2 # [ 2.385964] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.404757] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.285837] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.287861] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.278939] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.397064] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.405225] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.295771] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.406324] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 worker2 # [ 2.400827] hub 2-0:1.0: USB hub found worker2 # [ 2.268470] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.301366] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.288248] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.272088] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.302915] systemd[1]: Finished Virtual Console Setup. client # [ 2.290278] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.414501] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.292614] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.409276] hub 2-0:1.0: 2 ports detected lb # [ 2.415640] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.296631] systemd[1]: Finished Virtual Console Setup. client # [ 2.433662] hub 2-0:1.0: USB hub found client # [ 2.434411] hub 2-0:1.0: 2 ports detected worker1 # [ 2.448123] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.448855] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.419722] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.432077] usb usb2: Product: UHCI Host Controller worker1 # [ 2.459580] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.461156] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 lb # [ 2.439727] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.451171] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.451947] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.466893] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.305303] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.337395] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.308215] systemd[1]: Finished Virtual Console Setup. client # [ 2.459503] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.339107] systemd[1]: Reached target Initrd Root Device. client # [ 2.460307] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker1 # [ 2.472560] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.316595] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.311840] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.344073] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.313730] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.465596] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.478724] usb usb3: Product: UHCI Host Controller lb # [ 2.322058] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.466758] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.479398] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.457466] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.481381] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.336253] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.452984] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.337829] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.453711] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.487045] hub 3-0:1.0: USB hub found client # [ 2.342067] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.489177] hub 3-0:1.0: 2 ports detected client # [ 2.477494] usb usb3: Product: UHCI Host Controller client # [ 2.478269] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.333285] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.335215] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.463748] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.470916] SCSI subsystem initialized client # [ 2.484503] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.497251] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.474519] hub 2-0:1.0: USB hub found worker2 # [ 2.468354] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker1 # [ 2.498748] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.489707] hub 3-0:1.0: USB hub found worker1 # [ 2.501841] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.479461] hub 2-0:1.0: 2 ports detected worker1 # [ 2.502617] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 worker2 # [ 2.473309] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.491671] hub 3-0:1.0: 2 ports detected worker2 # [ 2.474464] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.485056] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.498173] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.480740] usb usb3: Product: UHCI Host Controller worker1 # [ 2.510867] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.499543] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.482257] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.482974] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.380454] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.351178] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.352151] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.514775] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.358129] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.361773] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.356069] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.386407] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.507308] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.491553] hub 3-0:1.0: USB hub found client # [ 2.509123] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 worker1 # [ 2.521677] usb usb4: Product: UHCI Host Controller worker1 # [ 2.522539] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.377287] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.523490] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.525017] hub 4-0:1.0: USB hub found worker2 # [ 2.495378] hub 3-0:1.0: 2 ports detected worker1 # [ 2.527833] hub 4-0:1.0: 2 ports detected client # [ 2.382268] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.500292] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.518575] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.501006] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.519736] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.511122] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.534323] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.511919] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.535424] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.523541] usb usb4: Product: UHCI Host Controller client # [ 2.524286] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.525981] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.509345] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.527209] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.510119] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 client # [ 2.528922] hub 4-0:1.0: USB hub found client # [ 2.529599] hub 4-0:1.0: 2 ports detected worker2 # [ 2.513377] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.521525] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.522330] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker1 # [ 2.547847] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.393131] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.394154] systemd[1]: Reached target Initrd Root Device. client # [ 2.538499] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.520836] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.539350] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.523332] usb usb4: Product: UHCI Host Controller lb # [ 2.397068] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.524026] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.391971] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.532569] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.558259] scsi host0: ahci lb # [ 2.536531] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.397614] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.538493] usb usb3: Product: UHCI Host Controller worker1 # [ 2.562058] scsi host1: ahci worker2 # [ 2.532379] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.539186] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.562735] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.534324] hub 4-0:1.0: USB hub found client # [ 2.554550] scsi host0: ahci worker1 # [ 2.566814] scsi host2: ahci worker2 # [ 2.536859] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.544474] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.538047] hub 4-0:1.0: 2 ports detected client # [ 2.557182] scsi host1: ahci worker1 # [ 2.571121] scsi host3: ahci client # [ 2.559881] scsi host2: ahci worker1 # [ 2.573493] scsi host4: ahci lb # [ 2.550554] hub 3-0:1.0: USB hub found lb # [ 2.551981] hub 3-0:1.0: 2 ports detected worker1 # [ 2.575211] scsi host5: ahci client # [ 2.563776] scsi host3: ahci worker1 # [ 2.576438] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker1 # [ 2.577834] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker2 # [ 2.548765] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.549620] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.579056] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 client # [ 2.568526] scsi host4: ahci lb # [ 2.557626] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.580221] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 lb # [ 2.558351] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.581478] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker1 # [ 2.582653] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 client # [ 2.573095] scsi host5: ahci lb # [ 2.562537] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.563338] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 client # [ 2.574635] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 client # [ 2.578754] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 client # [ 2.579923] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.581713] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 lb # [ 2.571636] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.582879] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker2 # [ 2.566541] scsi host0: ahci client # [ 2.584039] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker2 # [ 2.567216] scsi host1: ahci lb # [ 2.440505] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.585202] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker2 # [ 2.569283] scsi host2: ahci lb # [ 2.576141] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.577361] usb usb4: Product: UHCI Host Controller worker2 # [ 2.572040] scsi host3: ahci lb # [ 2.447361] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.582039] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.577813] scsi host4: ahci worker2 # [ 2.578315] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.586503] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.581043] scsi host5: ahci lb # [ 2.587768] hub 4-0:1.0: USB hub found lb # [ 2.588730] hub 4-0:1.0: 2 ports detected worker2 # [ 2.581802] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 lb # [ 2.590633] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.585635] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker2 # [ 2.586909] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 lb # [ 2.593992] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.588062] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker2 # [ 2.589259] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker2 # [ 2.590394] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 lb # [ 2.603539] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.615301] scsi host0: ahci lb # [ 2.616036] scsi host1: ahci lb # [ 2.620242] scsi host2: ahci lb # [ 2.620740] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.624949] scsi host3: ahci lb # [ 2.630174] scsi host4: ahci lb # [ 2.634647] scsi host5: ahci lb # [ 2.635285] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 lb # [ 2.639686] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 lb # [ 2.642767] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 lb # [ 2.644019] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 lb # [ 2.645232] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 lb # [ 2.646404] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker1 # [ 2.691977] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.694847] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.698194] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.700061] usb 1-1: Manufacturer: QEMU worker1 # [ 2.701687] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.709885] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.712758] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.715880] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.729399] hid: raw HID events driver (C) Jiri Kosina client # [ 2.717685] usb 1-1: Manufacturer: QEMU client # [ 2.719305] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.708429] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.709571] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.710950] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.711645] usb 1-1: Manufacturer: QEMU worker2 # [ 2.712210] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.725975] hid: raw HID events driver (C) Jiri Kosina client # [ 2.748296] hid: raw HID events driver (C) Jiri Kosina client # [ 2.626867] systemd[1]: Mounting /sysroot... lb # [ 2.749772] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.752713] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.755927] usb 1-1: Product: QEMU USB Tablet lb # [ 2.757710] usb 1-1: Manufacturer: QEMU lb # [ 2.759323] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.665346] systemd[1]: Mounting /sysroot... lb # [ 2.787357] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.662936] systemd[1]: Mounting /sysroot... lb # [ 2.715546] systemd[1]: Mounting /sysroot... worker1 # [ 2.892620] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.897637] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.899951] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.902114] ata3.00: applying bridge limits worker1 # [ 2.904034] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.906284] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.908541] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.897340] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.911023] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.899610] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.913191] ata3.00: configured for UDMA/100 client # [ 2.902154] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.915595] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.904377] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.907016] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.909102] ata3.00: applying bridge limits client # [ 2.911021] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.913265] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.897194] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.915532] ata3.00: configured for UDMA/100 client # [ 2.918035] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.904347] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.905209] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.906080] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.906915] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.907785] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.908680] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.909749] ata3.00: applying bridge limits worker2 # [ 2.910468] ata3.00: configured for UDMA/100 worker2 # [ 2.911407] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.957621] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.982423] usbcore: registered new interface driver usbhid lb # [ 2.959948] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.962536] ata3.00: applying bridge limits lb # [ 2.964335] ata3.00: configured for UDMA/100 worker1 # [ 2.989711] usbhid: USB HID core driver lb # [ 2.966340] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.968680] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.970781] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.965487] usbcore: registered new interface driver usbhid lb # [ 2.973128] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.985260] usbcore: registered new interface driver usbhid lb # [ 2.975545] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.988478] usbhid: USB HID core driver worker2 # [ 2.971331] usbhid: USB HID core driver worker1 # [ 3.001316] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 2.978172] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 3.004990] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 3.011871] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 3.012390] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 2.994822] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 3.026417] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.996904] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 3.017538] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 3.002415] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 3.021757] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 3.040491] EXT4-fs (vda): mounted filesystem e3cdf389-40e5-4787-9f82-90b620ab7000 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.012529] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 3.030655] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.911372] systemd[1]: Mounted /sysroot. worker1 # [ 2.913156] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.016453] EXT4-fs (vda): mounted filesystem 38641851-c8e9-424a-be26-c4cf0da97f81 r/w with ordered data mode. Quota mode: none. client # [ 3.034705] EXT4-fs (vda): mounted filesystem b43e5ad4-3a5d-4dba-9231-114682aa5aac r/w with ordered data mode. Quota mode: none. worker1 # [ 2.914711] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.908694] systemd[1]: Mounted /sysroot. worker2 # [ 2.891655] systemd[1]: Mounted /sysroot. client # [ 2.909726] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.893068] systemd[1]: Reached target Initrd Root File System. client # [ 2.914069] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.897077] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 2.929198] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.044034] usbcore: registered new interface driver usbhid worker1 # [ 2.934851] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.936308] systemd[1]: Reloading... lb # [ 3.048849] usbhid: USB HID core driver client # [ 2.926738] systemd-sysroot-fstab-check[141]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.913409] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.932066] systemd[1]: Reload requested from client PID 141 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.933481] systemd[1]: Reloading... worker2 # [ 2.917926] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.921138] systemd[1]: Reloading... lb # [ 3.071075] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.076037] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 3.084706] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 3.094577] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.095527] EXT4-fs (vda): mounted filesystem e488cc7c-bb68-4c65-915e-0666e1454295 r/w with ordered data mode. Quota mode: none. lb # [ 2.966726] systemd[1]: Mounted /sysroot. lb # [ 2.970083] systemd[1]: Reached target Initrd Root File System. lb # [ 2.972648] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.987833] systemd-sysroot-fstab-check[141]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.014701] systemd[1]: Reloading finished in 80 ms. lb # [ 2.994065] systemd[1]: Reload requested from client PID 141 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.995532] systemd[1]: Reloading... worker1 # [ 3.023494] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... client # [ 3.014536] systemd[1]: Reloading finished in 83 ms. worker1 # [ 3.028191] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker1 # [ 3.031053] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.032443] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.003722] systemd[1]: Reloading finished in 83 ms. worker1 # [ 3.034144] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.023101] systemd-sysroot-fstab-check[141]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.036181] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 3.027218] systemd-sysroot-fstab-check[141]: Requesting swap.target/start/replace... worker2 # [ 3.011281] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... client # [ 3.030851] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.032258] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.015234] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... client # [ 3.034192] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.018822] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.035970] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 3.020146] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.022180] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.023809] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 3.077408] systemd[1]: Reloading finished in 83 ms. lb # [ 3.084819] systemd-sysroot-fstab-check[141]: Requesting initrd-fs.target/start/replace... lb # [ 3.087115] systemd-sysroot-fstab-check[141]: Requesting swap.target/start/replace... lb # [ 3.092632] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.094065] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.095110] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.097873] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 3.629216] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.635306] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.644283] systemd[1]: Mounting /sysroot/run... client # [ 3.652304] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.667191] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.674176] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.663981] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.683178] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.691319] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.664476] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.667140] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.669713] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.675076] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.705315] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.680140] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.701977] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.839913] 9p: Installing v9fs 9p2000 file system support client # [ 3.716472] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.720883] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.838336] 9p: Installing v9fs 9p2000 file system support client # [ 3.723076] systemd[1]: Mounted /sysroot/run. client # [ 3.723709] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.724433] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.709427] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.716962] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.711740] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.744860] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.715993] systemd[1]: Mounted /sysroot/run. client # [ 3.734058] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.735021] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.724163] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.736750] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.719464] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.882788] 9p: Installing v9fs 9p2000 file system support worker2 # [ 3.720481] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.751654] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.724442] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.732318] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.759558] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.762269] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.763239] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.764236] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.734136] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.735620] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.743186] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.755681] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.756745] systemd[1]: Reached target Initrd File Systems. client # [ 3.758920] systemd[1]: Starting Find NixOS closure... client # [ 3.762130] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.775432] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.776882] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.779104] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.757337] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.778948] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.785986] systemd[1]: Finished Find NixOS closure. worker1 # [ 3.799050] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.787423] systemd[1]: Reached target Initrd Default Target. worker1 # [ 3.800990] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.802065] systemd[1]: Starting Find NixOS closure... client # [ 3.789193] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.804528] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.790084] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.802135] systemd[1]: Stopped target Initrd Default Target. client # [ 3.804050] systemd[1]: Stopped target Basic System. client # [ 3.804772] systemd[1]: Stopped target Initrd Root Device. client # [ 3.805529] systemd[1]: Stopped target Path Units. client # [ 3.806399] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.807363] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.929938] 9p: Installing v9fs 9p2000 file system support client # [ 3.808363] systemd[1]: Stopped target Slice Units. client # [ 3.809316] systemd[1]: Stopped target Socket Units. worker1 # [ 3.822882] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.811128] systemd[1]: Stopped target System Initialization. lb # [ 3.800484] systemd[1]: Mounted /sysroot/run. client # [ 3.811911] systemd[1]: Stopped target Swaps. client # [ 3.812560] systemd[1]: Stopped target Timer Units. client # [ 3.813392] systemd[1]: dbus.socket: Deactivated successfully. client # [ 3.814253] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.815117] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.816287] systemd[1]: Stopped Find NixOS closure. lb # [ 3.806642] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.817094] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 3.830896] systemd[1]: Finished Find NixOS closure. lb # [ 3.807928] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.818973] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.832094] systemd[1]: Reached target Initrd Default Target. client # [ 3.820164] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 3.833745] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.821389] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.810855] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.822395] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.824230] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.813740] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.825151] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.826497] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.828119] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.829101] systemd[1]: Stopped Create System Files and Directories. client # [ 3.830074] systemd[1]: Stopped target Local File Systems. client # [ 3.830806] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.833122] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.846511] systemd[1]: Stopped target Initrd Default Target. client # [ 3.834101] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.847786] systemd[1]: Stopped target Basic System. client # [ 3.835145] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.824326] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.848694] systemd[1]: Stopped target Initrd Root Device. client # [ 3.836317] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.825772] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.850115] systemd[1]: Stopped target Path Units. client # [ 3.838115] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.850821] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.851917] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 3.852933] systemd[1]: Stopped target Slice Units. worker1 # [ 3.853808] systemd[1]: Stopped target Socket Units. worker1 # [ 3.854805] systemd[1]: Stopped target System Initialization. worker1 # [ 3.855816] systemd[1]: Stopped target Swaps. client # [ 3.843635] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.856768] systemd[1]: Stopped target Timer Units. worker1 # [ 3.857807] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 3.859133] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.860025] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.847939] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.861035] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.862137] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 3.863848] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.865213] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 3.866410] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.867411] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 3.868567] systemd[1]: Stopped Load Kernel Modules. client # [ 3.855613] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.857537] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.870359] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.871582] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.859131] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.860429] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.873130] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.874103] systemd[1]: Stopped Create System Files and Directories. client # [ 3.861900] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.875073] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.875910] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 3.863816] systemd[1]: Closed udev Control Socket. worker1 # [ 3.877128] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 3.865066] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.878375] systemd[1]: Stopped Coldplug All udev Devices. client # [ 3.865803] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.866828] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.868132] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.869200] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.882509] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 3.870456] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.883527] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 3.871392] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.884479] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.890591] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.894080] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.899615] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.886914] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.889263] systemd[1]: Finished Cleanup udev Database. client # [ 3.889977] systemd[1]: Reached target Switch Root. worker1 # [ 3.903094] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.891347] systemd[1]: Starting NixOS Activation... worker1 # [ 3.904197] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.905240] systemd[1]: Closed udev Control Socket. worker1 # [ 3.907437] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.909165] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.910191] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.911088] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.912302] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.913265] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.915136] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.915961] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.917049] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.933412] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.935180] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.935909] systemd[1]: Reached target Switch Root. worker1 # [ 3.937480] systemd[1]: Starting NixOS Activation... client # [ 4.022551] initrd-nixos-activation-start[196]: booting system configuration /nix/store/qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test client # [ 4.071743] initrd-nixos-activation-start[196]: running activation script... worker1 # [ 4.089781] initrd-nixos-activation-start[195]: booting system configuration /nix/store/kn8lkkabvm6j2z1h4bz436yvy0sl8h8s-nixos-system-worker1-test worker1 # [ 4.137970] initrd-nixos-activation-start[195]: running activation script... client # [ 4.412927] initrd-nixos-activation-start[219]: setting up /etc... worker1 # [ 4.441550] initrd-nixos-activation-start[218]: setting up /etc... worker1 # [ 4.634953] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.636534] systemd[1]: Finished NixOS Activation. worker1 # [ 4.638531] systemd[1]: Starting Switch Root... client # [ 4.634520] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.636847] systemd[1]: Finished NixOS Activation. client # [ 4.637886] systemd[1]: Starting Switch Root... worker1 # [ 4.651606] systemd[1]: Switching root. client # [ 4.649903] systemd[1]: Switching root. worker2 # [ 4.663792] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.687292] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.688537] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.690929] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.694134] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.716881] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.711116] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.712914] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.721527] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.722605] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.724336] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.737136] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.738287] systemd[1]: Stopped target Basic System. worker2 # [ 4.740118] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.740877] systemd[1]: Stopped target Path Units. worker2 # [ 4.741543] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.742528] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.743749] systemd[1]: Stopped target Slice Units. worker2 # [ 4.744457] systemd[1]: Stopped target Socket Units. worker2 # [ 4.745160] systemd[1]: Stopped target System Initialization. worker2 # [ 4.746185] systemd[1]: Stopped target Swaps. worker2 # [ 4.746993] systemd[1]: Stopped target Timer Units. worker2 # [ 4.748048] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.749144] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.749949] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.751123] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.914132] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.752099] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 4.754068] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.755107] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.756161] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.757115] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.763447] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.759114] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.765895] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.760050] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.761228] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.762477] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.763605] systemd[1]: Stopped Create System Files and Directories. lb # [ 4.770143] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.764884] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.765709] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.915651] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.767103] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.773953] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.769118] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.770970] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.773097] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.774081] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.781157] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.785124] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.789156] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.791195] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.798915] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.792907] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.794480] systemd[1]: Closed udev Control Socket. lb # [ 4.800574] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.796107] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.797136] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.798149] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.800108] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.801162] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.802085] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.808943] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.803056] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.810416] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.804285] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.805607] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.812134] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.825153] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.826512] systemd[1]: Stopped target Basic System. worker2 # [ 4.820249] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.827407] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.821627] systemd[1]: Finished Cleanup udev Database. lb # [ 4.828343] systemd[1]: Stopped target Path Units. lb # [ 4.829171] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.822937] systemd[1]: Reached target Switch Root. lb # [ 4.831108] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.824915] systemd[1]: Starting NixOS Activation... lb # [ 4.832160] systemd[1]: Stopped target Slice Units. lb # [ 4.832881] systemd[1]: Stopped target Socket Units. lb # [ 4.833802] systemd[1]: Stopped target System Initialization. lb # [ 4.834650] systemd[1]: Stopped target Swaps. lb # [ 4.835290] systemd[1]: Stopped target Timer Units. lb # [ 4.836288] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.837346] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.838569] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.839843] systemd[1]: Stopped Find NixOS closure. lb # [ 4.841122] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 4.843163] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.844136] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.846218] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.847214] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.848368] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.849413] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.850625] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.851920] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.853133] systemd[1]: Stopped Create System Files and Directories. lb # [ 4.855288] systemd[1]: Stopped target Local File Systems. lb # [ 4.856269] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.857433] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.858585] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.859939] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.861503] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.863127] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.871810] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.874135] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.881269] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.039831] NET: Registered PF_VSOCK protocol family lb # [ 4.884669] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.885850] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.886888] systemd[1]: Closed udev Control Socket. lb # [ 4.889060] systemd[1]: Starting Cleanup udev Database... lb # [ 4.889860] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.890912] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.891798] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.893114] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.894094] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.896110] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.897086] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.898437] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.913818] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.059633] NET: Registered PF_VSOCK protocol family lb # [ 4.916085] systemd[1]: Finished Cleanup udev Database. lb # [ 4.916885] systemd[1]: Reached target Switch Root. lb # [ 4.918707] systemd[1]: Starting NixOS Activation... worker2 # [ 4.978108] initrd-nixos-activation-start[193]: booting system configuration /nix/store/hhh9ld89fpwxsi59mykz4xra0di8j4h8-nixos-system-worker2-test worker2 # [ 5.040370] initrd-nixos-activation-start[193]: running activation script... lb # [ 5.074149] initrd-nixos-activation-start[195]: booting system configuration /nix/store/j1nn9bbhrn5xz154akfhw453f8i07i4d-nixos-system-lb-test lb # [ 5.145497] initrd-nixos-activation-start[195]: running activation script... worker1 # [ 5.419758] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.429470] systemd[1]: Detected virtualization kvm. worker1 # [ 5.431343] systemd[1]: Detected architecture x86-64. worker1 # [ 5.433270] systemd[1]: Detected first boot. worker1 # [ 5.440442] systemd[1]: Initializing machine ID from random generator. client # [ 5.437890] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.447607] systemd[1]: Detected virtualization kvm. client # [ 5.449511] systemd[1]: Detected architecture x86-64. client # [ 5.451338] systemd[1]: Detected first boot. client # [ 5.456651] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.410601] initrd-nixos-activation-start[216]: setting up /etc... lb # [ 5.537654] initrd-nixos-activation-start[218]: setting up /etc... worker1 # [ 5.695087] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.708122] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.810525] systemd[1]: Applying preset policy. worker2 # [ 5.653831] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.656127] systemd[1]: Finished NixOS Activation. worker2 # [ 5.657250] systemd[1]: Starting Switch Root... client # [ 5.816428] systemd[1]: Applying preset policy. worker2 # [ 5.671096] systemd[1]: Switching root. lb # [ 5.793744] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.796168] systemd[1]: Finished NixOS Activation. lb # [ 5.797323] systemd[1]: Starting Switch Root... lb # [ 5.810276] systemd[1]: Switching root. worker2 # [ 5.939029] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). lb # [ 6.074278] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.093966] NET: Registered PF_VSOCK protocol family client # [ 6.154329] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 6.200586] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.232179] NET: Registered PF_VSOCK protocol family client # [ 6.497906] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.499206] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.501871] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 6.476454] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.503870] systemd[1]: Created slice Slice /system/getty. worker2 # [ 6.486076] systemd[1]: Detected virtualization kvm. client # [ 6.505206] systemd[1]: Created slice User and Session Slice. client # [ 6.506107] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 6.487869] systemd[1]: Detected architecture x86-64. client # [ 6.507347] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 6.489774] systemd[1]: Detected first boot. client # [ 6.508499] systemd[1]: Expecting device /dev/hvc0... client # [ 6.509174] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.509942] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.510777] systemd[1]: Stopped target initrd-fs.target. client # [ 6.511573] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.512412] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.513248] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.514131] systemd[1]: Reached target Path Units. client # [ 6.514832] systemd[1]: Reached target Remote File Systems. worker2 # [ 6.496269] systemd[1]: Initializing machine ID from random generator. client # [ 6.515644] systemd[1]: Reached target Slice Units. client # [ 6.516334] systemd[1]: Reached target Swaps. client # [ 6.530214] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.533337] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.535642] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.538102] systemd[1]: Listening on Factory Reset Management. client # [ 6.539101] systemd[1]: Listening on Hostname Service Socket. client # [ 6.542236] systemd[1]: Starting Journal Log Access Socket... client # [ 6.543686] systemd[1]: Listening on Journal Audit Socket. client # [ 6.546216] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.547701] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.549110] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.550473] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.557063] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.558088] systemd[1]: Listening on udev Control Socket. client # [ 6.558990] systemd[1]: Listening on udev Varlink Socket. client # [ 6.562284] systemd[1]: Mounting Huge Pages File System... client # [ 6.564900] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.570855] systemd[1]: Mounting Kernel Debug File System... client # [ 6.576426] systemd[1]: Mounting Kernel Trace File System... client # [ 6.582129] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.584262] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 6.603664] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 6.605098] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.594361] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 6.607885] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.595781] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.609983] systemd[1]: Created slice Slice /system/getty. client # [ 6.598140] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.611355] systemd[1]: Created slice User and Session Slice. worker1 # [ 6.612262] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.613468] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.614613] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.615380] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.603294] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.616146] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.616949] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.617703] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.618499] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 6.619359] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.620246] systemd[1]: Reached target Path Units. client # [ 6.608855] systemd[1]: Mounting FUSE Control File System... worker1 # [ 6.620947] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.621740] systemd[1]: Reached target Slice Units. worker1 # [ 6.622464] systemd[1]: Reached target Swaps. client # [ 6.614735] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.609477] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.625236] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 6.613603] systemd[1]: Detected virtualization kvm. lb # [ 6.615389] systemd[1]: Detected architecture x86-64. worker1 # [ 6.640114] systemd[1]: Listening on Process Core Dump Socket. lb # [ 6.617309] systemd[1]: Detected first boot. worker1 # [ 6.642486] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 6.644883] systemd[1]: Listening on Factory Reset Management. worker1 # [ 6.645820] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.623828] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.649326] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.651141] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 6.654142] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 6.655223] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.656625] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.657969] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.646846] systemd[1]: Starting Journal Service... worker2 # [ 6.632440] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.665076] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.666102] systemd[1]: Listening on udev Control Socket. worker1 # [ 6.667009] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.670655] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.673791] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.665058] systemd[1]: Starting Load Kernel Modules... worker1 # [ 6.680396] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 6.686593] systemd[1]: Mounting Kernel Trace File System... client # [ 6.679227] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 6.694507] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.685913] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 6.698116] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 6.694304] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.708340] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 6.709430] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.711158] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.719799] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.720537] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.723048] systemd-journald[289]: Collecting audit messages is enabled. worker1 # [ 6.751870] systemd[1]: Mounting FUSE Control File System... worker1 # [ 6.753076] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.742942] systemd[1]: Listening on Journal Log Access Socket. client # [ 6.751064] systemd[1]: Mounted Huge Pages File System. client # [ 6.755042] systemd[1]: Mounted POSIX Message Queue File System. client # [ 6.756048] loop: module loaded client # [ 6.760640] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 6.775555] systemd[1]: Starting Journal Service... client # [ 6.764877] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 6.751473] systemd[1]: Applying preset policy. client # [ 6.634610] systemd[1]: Queued start job for default target Multi-User System.[ 6.769396] systemd[1]: Started Journal Service. worker1 # [ 6.782109] systemd[1]: Starting Load Kernel Modules... client # client # [ 6.772261] EXT4-fs (vda): re-mounted b43e5ad4-3a5d-4dba-9231-114682aa5aac. client # [ 6.640226] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 6.642538] systemd-modules-load[290]: Inserted module 'loop' worker1 # [ 6.791173] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.649216] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.652120] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.653284] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 6.799157] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.655099] systemd[1]: Mounted FUSE Control File System. worker1 # [ 6.801117] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.657367] systemd[1]: Finished Load Kernel Modules. client # [ 6.661396] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.808539] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 6.814633] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 6.816735] systemd[1]: Mounted Huge Pages File System. worker1 # [ 6.817619] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 6.821084] systemd[1]: Mounted Kernel Debug File System. client # [ 6.677063] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.823418] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.825894] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.828182] systemd[1]: Mounted FUSE Control File System. client # [ 6.685069] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.688759] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.689712] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.837810] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 6.844089] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.700082] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.845751] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.705316] systemd-oomd[292]: No swap; memory pressure usage will be degraded worker1 # [ 6.851613] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.713615] systemd[1]: Starting Apply Kernel Variables... client # [ 6.731073] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.732297] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.733481] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.883103] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.872553] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.896715] EXT4-fs (vda): re-mounted e3cdf389-40e5-4787-9f82-90b620ab7000. worker1 # [ 6.904568] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.906277] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.908430] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.900182] systemd-journald[289]: Received client request to flush runtime journal. worker1 # [ 6.917767] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.918586] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.935030] systemd-journald[288]: Collecting audit messages is enabled. worker1 # [ 6.954987] loop: module loaded worker1 # [ 6.967281] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.971387] systemd[1]: Starting Firewall... worker1 # [ 6.976044] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 6.997107] systemd[1]: Started Journal Service. worker1 # [ 6.866934] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 6.871331] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.983802] systemd[1]: Applying preset policy. worker1 # [ 6.881108] systemd-modules-load[289]: Inserted module 'loop' worker1 # [ 6.884765] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 6.890184] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.880917] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 6.894339] systemd[1]: Reached target First Boot Complete. client # [ 6.882393] systemd[1]: Finished Load/Save OS Random Seed. client # [ 6.885139] systemd[1]: Reached target First Boot Complete. client # [ 6.885890] systemd[1]: Finished Apply Kernel Variables. client # [ 6.886651] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.887612] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 6.892129] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.914169] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 6.919858] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.937888] systemd-oomd[290]: No swap; memory pressure usage will be degraded worker1 # [ 6.955633] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.949730] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.951167] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.096746] systemd-journald[288]: Received client request to flush runtime journal. client # [ 6.956381] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 6.991833] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.026357] systemd-udevd[319]: Using default interface naming scheme 'v261'. worker2 # [ 7.171032] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.107945] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.114418] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.115351] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.116277] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.117292] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.120575] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 7.169098] systemd-udevd[320]: Using default interface naming scheme 'v261'. client # [ 7.206988] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.348921] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.260327] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.253675] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.271304] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.301064] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.302069] (udev-worker)[323]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.306906] (udev-worker)[324]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.308269] (udev-worker)[323]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.368740] systemd[1]: Mounting /run/wrappers... client # [ 7.399196] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 7.400940] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.402295] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.404513] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.407670] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.409148] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.411751] systemd[1]: Mounted /run/wrappers. client # [ 7.413110] systemd[1]: Reached target Local File Systems. client # [ 7.416672] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 7.420126] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.432993] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.426150] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 7.427137] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.432366] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 7.444457] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.476045] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.617318] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.618687] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.621316] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.623372] systemd[1]: Created slice Slice /system/getty. worker1 # [ 7.521529] systemd[1]: Mounted /run/wrappers. worker2 # [ 7.624724] systemd[1]: Created slice User and Session Slice. worker1 # [ 7.522391] systemd[1]: Reached target Local File Systems. worker2 # [ 7.625612] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.626787] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.627854] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 7.525064] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.628564] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 7.629336] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.630149] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.630912] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.631690] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 7.529092] systemd[1]: Starting register-nix-paths.service... worker2 # [ 7.632540] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.633475] systemd[1]: Reached target Path Units. client # [ 7.518302] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.634285] systemd[1]: Reached target Remote File Systems. worker1 # [ 7.533198] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.535707] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.657175] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 7.526131] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 7.538903] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.635076] systemd[1]: Reached target Slice Units. worker2 # [ 7.647160] systemd[1]: Reached target Swaps. worker1 # [ 7.545496] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.546649] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 7.650163] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.653583] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.656129] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.658728] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.659637] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.663111] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.664663] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.667590] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.668983] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.670450] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.689522] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.671773] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.679884] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.680900] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.681785] systemd[1]: Listening on udev Varlink Socket. client # [ 7.568086] systemd[1]: Finished Create System Files and Directories. worker2 # [ 7.685644] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.688868] systemd[1]: Mounting POSIX Message Queue File System... client # [ 7.577068] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 7.695940] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.701778] systemd[1]: Mounting Kernel Trace File System... client # [ 7.585841] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.706168] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.710378] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 7.721309] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 7.722167] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.723951] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.623150] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.725881] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.627311] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.738030] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 7.739357] systemd[1]: Stopped initrd-switch-root.service. lb # [ 7.742206] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 7.744317] systemd[1]: Created slice Slice /system/getty. lb # [ 7.745735] systemd[1]: Created slice User and Session Slice. lb # [ 7.746638] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.740600] systemd[1]: Mounting FUSE Control File System... lb # [ 7.747824] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 7.748918] systemd[1]: Expecting device /dev/hvc0... lb # [ 7.749626] systemd[1]: Expecting device /dev/ttyS0... lb # [ 7.750340] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.742534] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.751217] systemd[1]: Stopped target initrd-fs.target. lb # [ 7.751995] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 7.752762] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 7.753621] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 7.754520] systemd[1]: Reached target Path Units. lb # [ 7.755232] systemd[1]: Reached target Remote File Systems. lb # [ 7.756036] systemd[1]: Reached target Slice Units. lb # [ 7.756730] systemd[1]: Reached target Swaps. worker1 # [ 7.659547] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 7.771693] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 7.775482] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.771524] systemd[1]: Starting Journal Service... lb # [ 7.778385] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 7.657145] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 7.781237] systemd[1]: Listening on Factory Reset Management. lb # [ 7.782178] systemd[1]: Listening on Hostname Service Socket. lb # [ 7.786138] systemd[1]: Starting Journal Log Access Socket... lb # [ 7.787785] systemd[1]: Listening on Journal Audit Socket. lb # [ 7.790850] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.785138] systemd[1]: Starting Load Kernel Modules... lb # [ 7.792242] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 7.793723] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.795052] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.795895] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 7.804097] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 7.805165] systemd[1]: Listening on udev Control Socket. lb # [ 7.806144] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 7.697180] systemd[1]: Finished Create System Files and Directories. lb # [ 7.810242] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.803846] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.702293] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 7.805775] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.813490] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.705941] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 7.694858] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 7.811518] systemd[1]: Starting Coldplug All udev Devices... lb # [ 7.820497] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.816610] systemd[1]: Listening on Journal Log Access Socket. client # [ 7.701512] systemd[1]: Starting Update is Completed... worker2 # [ 7.819566] systemd[1]: Mounted Huge Pages File System. lb # [ 7.826329] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.821411] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.823394] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.824882] systemd[1]: Mounted Kernel Trace File System. lb # [ 7.832756] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.827150] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 7.836553] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 7.831134] systemd[1]: Mounted FUSE Control File System. worker2 # [ 7.836383] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.846985] systemd[1]: Starting Load Kernel Module configfs... lb # [ 7.848109] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 7.849601] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.851394] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.858194] systemd[1]: Mounting FUSE Control File System... lb # [ 7.860583] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.750945] systemd[1]: Finished Update is Completed. worker2 # [ 7.871142] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 7.872982] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 7.774760] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.878510] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 7.778917] (udev-worker)[355]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.782847] (udev-worker)[356]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 7.786361] (udev-worker)[356]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.901889] systemd[1]: Starting Journal Service... worker2 # [ 7.908698] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.920244] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.914487] EXT4-fs (vda): re-mounted 38641851-c8e9-424a-be26-c4cf0da97f81. worker2 # [ 7.924141] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.925774] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 7.927748] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.935571] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.930650] systemd-journald[286]: Collecting audit messages is enabled. worker2 # [ 7.935276] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 7.936081] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.948707] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.943823] loop: module loaded lb # [ 7.955681] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.951835] systemd[1]: Finished Load Kernel Modules. worker1 # [ 7.849638] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.853336] systemd[1]: Starting Update is Completed... worker2 # [ 7.957909] systemd[1]: Starting Firewall... worker2 # [ 7.963122] systemd[1]: Starting Apply Kernel Variables... lb # [ 7.976705] systemd[1]: Starting Coldplug All udev Devices... client # [ 7.727519] ACPI: button: Power Button [PWRF] client # [ 7.794783] mousedev: PS/2 mouse device common for all mice lb # [ 7.991885] systemd-journald[288]: Collecting audit messages is enabled. worker2 # [ 7.986500] systemd[1]: Started Journal Service. worker2 # [ 7.857158] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 7.860117] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 7.899242] rtc_cmos 00:04: RTC can wake from S4 lb # [ 8.007021] systemd[1]: Listening on Journal Log Access Socket. client # [ 7.930629] rtc_cmos 00:04: registered as rtc0 client # [ 7.930708] rtc_cmos 00:04: setting system clock to 2026-09-22T10:46:24 UTC (1790073984) worker2 # [ 7.868485] systemd-modules-load[287]: Inserted module 'loop' lb # [ 8.010034] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.873373] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.013211] systemd[1]: Mounted POSIX Message Queue File System. client # [ 7.930785] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 7.980299] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.980396] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.020893] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.026089] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.917177] systemd[1]: Finished Update is Completed. lb # [ 7.900344] systemd[1]: Queued start job for default target Multi-User System.[ 8.034791] systemd[1]: Finished Create List of Static Device Nodes. lb # lb # [ 7.902672] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.039991] loop: module loaded lb # [ 8.041833] systemd[1]: Started Journal Service. lb # [ 7.910813] systemd-modules-load[289]: Inserted module 'loop' worker2 # [ 7.904839] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 8.047501] EXT4-fs (vda): re-mounted e488cc7c-bb68-4c65-915e-0666e1454295. worker2 # [ 7.908268] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 7.917316] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 7.994192] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 lb # [ 7.922467] systemd[1]: Finished Load Kernel Module configfs. lb # [ 7.923428] systemd[1]: Mounted FUSE Control File System. lb # [ 7.925101] systemd[1]: Finished Load Kernel Modules. worker2 # [ 7.920526] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 7.922209] systemd[1]: Reached target First Boot Complete. lb # [ 7.929217] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 7.999601] Console: switching to colour dummy device 80x25 client # [ 8.012808] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 8.088239] [drm] Found bochs VGA, ID 0xb0c5. client # [ 8.088242] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.947081] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 7.943268] systemd-oomd[288]: No swap; memory pressure usage will be degraded lb # [ 7.954886] systemd[1]: Mounting Kernel Configuration File System... lb # [ 7.961062] systemd[1]: Starting Firewall... client # [ 7.973981] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 8.090656] systemd-journald[286]: Received client request to flush runtime journal. client # [ 7.976077] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.966903] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 7.968101] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.122855] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 7.978136] systemd-oomd[290]: No swap; memory pressure usage will be degraded lb # [ 7.984078] systemd[1]: Starting Load/Save OS Random Seed... client # [ 8.137400] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 8.143805] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 7.999800] systemd[1]: Starting Apply Kernel Variables... client # [ 8.145206] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.018622] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.021592] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.044711] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 8.022787] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 8.047226] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.049534] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.052299] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.054685] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 8.056730] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.059240] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.197259] systemd-journald[288]: Received client request to flush runtime journal. client # [ 8.221767] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.095950] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.100600] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 8.103268] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.105193] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 8.106165] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 8.108153] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 8.129143] systemd[1]: Starting Virtual Console Setup... client # [ 8.222021] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 8.242630] Console: switching to colour frame buffer device 160x50 client # [ 8.300330] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 8.154162] systemd-udevd[319]: Using default interface naming scheme 'v261'. client # [ 8.179829] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.182454] systemd[1]: Stopped Virtual Console Setup. client # [ 8.188592] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.208500] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.210613] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 8.218980] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 8.221579] systemd[1]: Reached target First Boot Complete. lb # [ 8.225167] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.227274] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.229404] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 8.230356] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 8.231613] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.265745] systemd[1]: Finished Firewall. worker1 # [ 8.407359] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 8.249279] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 8.414440] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.415503] ppdev: user-space parallel port driver worker2 # [ 8.282358] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 8.290567] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 8.293073] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 8.299185] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 8.480749] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.367194] systemd[1]: Finished Coldplug All udev Devices. client # [ 8.517522] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.436056] ACPI: button: Power Button [PWRF] worker1 # [ 8.440761] mousedev: PS/2 mouse device common for all mice worker1 # [ 8.496332] rtc_cmos 00:04: RTC can wake from S4 worker1 # [ 8.510160] rtc_cmos 00:04: registered as rtc0 worker1 # [ 8.510250] rtc_cmos 00:04: setting system clock to 2026-09-22T10:46:25 UTC (1790073985) client # [ 8.408841] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.397812] systemd-udevd[330]: Using default interface naming scheme 'v261'. worker1 # [ 8.510345] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 8.411057] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.525252] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.525370] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 8.541172] Console: switching to colour dummy device 80x25 worker2 # [ 8.405801] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 8.425108] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.545549] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 worker1 # [ 8.571070] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.597646] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 8.597648] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 8.605522] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 8.616199] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 8.476459] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 8.648924] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.649625] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker2 # [ 8.487508] systemd[1]: Mounting /run/wrappers... lb # [ 8.505284] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 8.528079] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 8.529568] systemd[1]: Mounted /run/wrappers. worker2 # [ 8.530668] systemd[1]: Reached target Local File Systems. worker2 # [ 8.532839] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 8.538158] systemd[1]: Starting register-nix-paths.service... client # [ 8.690583] kvm_amd: TSC scaling supported client # [ 8.691014] kvm_amd: Nested Virtualization enabled client # [ 8.691886] kvm_amd: Nested Paging enabled client # [ 8.692345] kvm_amd: LBR virtualization supported client # [ 8.693157] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 8.542228] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 8.694039] kvm_amd: Virtual GIF supported client # [ 8.694756] kvm_amd: Virtual NMI enabled worker2 # [ 8.544120] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.548082] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 8.553467] systemd[1]: Starting Create System Files and Directories... client # [ 8.590600] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.711049] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 8.739758] EDAC MC: Ver: 3.0.0 worker1 # [ 8.711322] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 8.729389] Console: switching to colour frame buffer device 160x50 lb # [ 8.611577] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.641266] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.629362] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 8.633692] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 8.807233] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 8.643510] (udev-worker)[358]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 8.661097] systemd[1]: Mounted /run/wrappers. lb # [ 8.662133] systemd[1]: Reached target Local File Systems. worker2 # [ 8.657572] (udev-worker)[355]: Network interface NamePolicy= disabled on kernel command line. lb # [ 8.666519] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 8.660213] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. lb # [ 8.671248] systemd[1]: Starting register-nix-paths.service... lb # [ 8.677313] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 8.678228] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.709956] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.711480] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.688081] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 8.718312] systemd[1]: Starting Virtual Console Setup... lb # [ 8.702237] systemd[1]: Starting Create System Files and Directories... worker2 # [ 8.701176] systemd[1]: Finished Create System Files and Directories. lb # [ 8.707968] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 8.707203] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 8.710497] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 8.918402] ppdev: user-space parallel port driver client # [ 8.785936] systemd-vconsole-setup[423]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 8.789614] systemd[1]: Finished Virtual Console Setup. client # [ 8.791792] systemd[1]: Reached target System Initialization. lb # [ 8.781601] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 8.792857] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.794232] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.795283] systemd[1]: Reached target Timer Units. client # [ 8.797167] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.798142] systemd[1]: Listening on Nix Daemon Socket. client # [ 8.798903] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 8.800067] systemd[1]: Reached target Socket Units. lb # [ 8.788888] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.800754] systemd[1]: Reached target Basic System. worker2 # [ 8.785513] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 8.803789] systemd[1]: Started backdoor.service. client # [ 8.805475] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.811077] systemd[1]: Starting nftables firewall... client # [ 8.816921] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.825452] systemd[1]: Starting Post-Boot Actions... client # [ 8.833547] systemd[1]: Started Reset console on configuration changes. client # [ 8.853208] systemd[1]: Starting resolvconf update... lb # [ 8.851218] systemd[1]: Finished Create System Files and Directories. worker2 # [ 8.845307] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 8.849264] systemd[1]: Starting Update is Completed... worker1 # [ 9.020873] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.870408] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 8.876112] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.040324] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # connecting to host... client # [ 8.901839] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 8.917294] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.918688] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.895712] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 8.908260] systemd[1]: Finished Post-Boot Actions. worker1 # [ 8.925994] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.904061] systemd[1]: Finished Update is Completed. client # [ 8.932573] nsncd[431]: Sep 22 10:46:25.632 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.934616] systemd[1]: Started Name Service Cache Daemon (nsncd). client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 8.940278] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 8.945845] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.947912] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.928639] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 8.960098] systemd[1]: Starting User Login Management... worker2 # [ 8.931028] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.975996] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client: connected to guest root shell worker2 # [ 8.933913] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client: (connecting took 9.67 seconds) worker2 # [ 8.935384] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client: (finished: waiting for the VM to finish booting, in 9.67 seconds) worker2 # [ 8.938140] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.940405] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.942506] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.029230] systemd[1]: Finished register-nix-paths.service. worker1 # [ 9.169417] kvm_amd: TSC scaling supported worker1 # [ 9.169954] kvm_amd: Nested Virtualization enabled worker1 # [ 9.170468] kvm_amd: Nested Paging enabled worker1 # [ 9.171136] kvm_amd: LBR virtualization supported worker1 # [ 9.171897] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 9.172429] kvm_amd: Virtual GIF supported worker1 # [ 9.173019] kvm_amd: Virtual NMI enabled lb # [ 9.023084] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 9.033431] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.041708] systemd[1]: Starting Update is Completed... worker1 # [ 9.214910] EDAC MC: Ver: 3.0.0 client # [ 9.069317] dbus-broker-launch[442]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 9.059458] (udev-worker)[362]: Network interface NamePolicy= disabled on kernel command line. lb # [ 9.071439] (udev-worker)[368]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 9.075173] (udev-worker)[368]: Network interface NamePolicy= disabled on kernel command line. client # [ 9.091132] systemd-logind[462]: New seat seat0. client # [ 9.095218] dbus-broker-launch[442]: NSS returned no entry for 'systemd-timesync' client # [ 9.098726] dbus-broker-launch[442]: Invalid user-name in /nix/store/8rd26vjfizqw5mjnswk36af94npr87nm-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 9.104594] systemd-logind[462]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 9.106180] systemd-logind[462]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 9.108170] systemd-logind[462]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 9.112851] systemd[1]: Finished Update is Completed. client # [ 9.135463] systemd[1]: Started User Login Management. client # [ 9.138064] systemd[1]: Started D-Bus System Message Bus. client # [ 9.150363] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 9.151362] systemd[1]: Stopping Host and Network Name Lookups... client # [ 9.152174] systemd[1]: Stopped target User and Group Name Lookups. client # [ 9.152944] systemd[1]: Stopping User and Group Name Lookups... client # [ 9.165083] systemd[1]: Starting linger-users.service... client # [ 9.165832] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.286064] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 9.175083] systemd[1]: nscd.service: Deactivated successfully. client # [ 9.180384] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 9.299525] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 9.185605] dbus-broker-launch[442]: Ready client # [ 9.206553] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.210815] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.213495] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.247603] systemd[1]: linger-users.service: Deactivated successfully. client # [ 9.250108] systemd[1]: Finished linger-users.service. worker2 # [ 9.234821] systemd[1]: Finished Firewall. client # [ 9.255911] systemd[1]: Finished resolvconf update. client # [ 9.262328] systemd[1]: Starting DHCP Client... client # [ 9.269520] nsncd[527]: Sep 22 10:46:25.971 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.272692] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 9.274610] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.275947] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.344496] systemd-vconsole-setup[522]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.348274] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.349444] systemd[1]: Reached target System Initialization. worker1 # [ 9.351075] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 9.353073] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 9.354050] systemd[1]: Reached target Timer Units. worker1 # [ 9.354751] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 9.355733] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 9.358522] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 9.334812] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 9.359868] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 9.336836] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 9.362066] systemd[1]: Reached target Socket Units. worker1 # [ 9.362841] systemd[1]: Reached target Basic System. lb # [ 9.338331] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.365896] systemd[1]: Started backdoor.service. lb # [ 9.341328] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 9.368340] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 9.344122] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 9.346830] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.372300] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 9.348549] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.377500] systemd[1]: Starting Post-Boot Actions... worker2 # [ 9.362435] ACPI: button: Power Button [PWRF] worker1 # [ 9.384840] systemd[1]: Started Reset console on configuration changes. worker2 # [ 9.371367] mousedev: PS/2 mouse device common for all mice worker2 # [ 9.431612] rtc_cmos 00:04: RTC can wake from S4 worker2 # [ 9.455625] rtc_cmos 00:04: registered as rtc0 worker2 # [ 9.455694] rtc_cmos 00:04: setting system clock to 2026-09-22T10:46:26 UTC (1790073986) worker1 # [ 9.389078] systemd[1]: Starting resolvconf update... client # [ 9.379584] dhcpcd[557]: dhcpcd-10.3.2 starting worker1 # [ 9.398229] systemd[1]: Starting D-Bus System Message Bus... client # [ 9.387333] dhcpcd[566]: dev: loaded udev lb # [ 9.382132] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 9.385968] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.537683] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 9.455774] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 9.466070] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 9.466150] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 9.472902] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 9.477514] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 client # [ 9.436281] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 9.486832] Console: switching to colour dummy device 80x25 worker2 # [ 9.563370] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 9.563372] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 9.461459] systemd[1]: Finished Post-Boot Actions. worker2 # [ 9.571147] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 9.578302] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 9.578968] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker2 # [ 9.581869] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # connecting to host... worker1 # [ 9.503812] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.504687] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.627363] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 9.508836] nsncd[530]: Sep 22 10:46:26.621 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 9.510988] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.513178] systemd[1]: Starting User Login Management... worker1 # [ 9.517251] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 9.507496] systemd[1]: Finished nftables firewall. client # [ 9.509596] systemd[1]: Reached target Preparation for Network. lb # [ 9.634335] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 9.513560] systemd[1]: Starting Address configuration of eth1... client # [ 9.518069] systemd[1]: Starting Extra networking commands.... lb # [ 9.645132] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 9.662837] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.663821] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 9.668028] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.669477] cfg80211: failed to load regulatory.db lb # [ 9.542324] systemd[1]: Finished Firewall. worker1 # [ 9.575587] dbus-broker-launch[534]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 9.593537] dbus-broker-launch[534]: NSS returned no entry for 'systemd-timesync' worker1 # [ 9.595377] dbus-broker-launch[534]: Invalid user-name in /nix/store/r6c36z2ah39ibj29dsamba7qp92g9jbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 9.683395] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 9.728978] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.613059] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 9.613947] systemd[1]: Stopping Host and Network Name Lookups... client # [ 9.735829] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.603261] dhcpcd[566]: eth0: waiting for carrier worker1 # [ 9.616691] systemd[1]: Stopped target User and Group Name Lookups. client # [ 9.604233] dhcpcd[566]: eth0: carrier acquired worker1 # [ 9.618463] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 9.620083] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 9.623778] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 9.625458] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 9.613455] network-addresses-eth1-start[578]: adding address 192.168.1.1/24... done client # [ 9.616189] dhcpcd[566]: DUID 00:01:00:01:32:45:19:02:52:54:00:12:34:56 client # [ 9.617272] dhcpcd[566]: eth0: IAID 00:12:34:56 client # [ 9.618091] dhcpcd[566]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 9.632796] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.607762] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.636336] systemd-logind[555]: New seat seat0. client # [ 9.626488] network-addresses-eth1-start[578]: adding address 2001:db8:1::1/64... done worker1 # [ 9.644708] systemd-logind[555]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 9.683634] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 9.648243] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 9.649969] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 9.639529] systemd[1]: Finished Address configuration of eth1. worker1 # [ 9.651355] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 9.653884] systemd[1]: Started User Login Management. worker1 # [ 9.657651] systemd[1]: Starting linger-users.service... worker2 # [ 9.710370] Console: switching to colour frame buffer device 160x50 worker2 # [ 9.770143] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 9.658953] systemd[1]: Finished register-nix-paths.service. lb # [ 9.660714] systemd[1]: Reached target System Initialization. lb # [ 9.662066] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 9.664443] systemd[1]: Started niks3 garbage collection timer. lb # [ 9.665320] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 9.666319] systemd[1]: Reached target Timer Units. lb # [ 9.668176] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 9.663888] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 9.666309] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.675153] systemd[1]: Listening on niks3 server socket. lb # [ 9.675964] systemd[1]: Listening on Nix Daemon Socket. lb # [ 9.676766] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 9.677892] systemd[1]: Reached target Socket Units. worker2 # [ 9.672594] systemd[1]: Starting Virtual Console Setup... lb # [ 9.678690] systemd[1]: Reached target Basic System. worker1 # [ 9.705571] dbus-broker-launch[534]: Ready lb # [ 9.685212] systemd[1]: Started backdoor.service. lb # [ 9.691295] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 9.718905] nsncd[600]: Sep 22 10:46:26.840 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.698038] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.723215] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.724272] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 9.725534] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.730266] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 9.731764] systemd[1]: Finished linger-users.service. lb # [ 9.713955] systemd[1]: Starting Post-Boot Actions... worker1 # [ 9.740456] systemd[1]: Finished resolvconf update. worker1 # [ 9.742402] systemd[1]: Reached target Preparation for Network. lb # [ 9.721161] systemd[1]: Started Reset console on configuration changes. worker1 # [ 9.746127] systemd[1]: Starting DHCP Client... worker1 # [ 9.749130] systemd[1]: Starting Address configuration of eth1... lb # [ 9.684505] ACPI: button: Power Button [PWRF] worker1 # [ 9.753070] systemd[1]: Starting Extra networking commands.... lb # [ 9.712429] mousedev: PS/2 mouse device common for all mice lb # [ 9.740912] systemd[1]: Starting resolvconf update... lb # [ 9.777144] rtc_cmos 00:04: RTC can wake from S4 lb # [ 9.790176] rtc_cmos 00:04: registered as rtc0 lb # [ 9.790240] rtc_cmos 00:04: setting system clock to 2026-09-22T10:46:26 UTC (1790073986) lb # [ 9.760625] systemd[1]: Started rustfs.service. lb # [ 9.786311] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 9.919865] ppdev: user-space parallel port driver worker2 # [ 9.922359] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # connecting to host... worker2 # [ 9.943971] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 9.827916] systemd[1]: Finished Post-Boot Actions. worker1 # [ 9.856186] network-addresses-eth1-start[630]: adding address 192.168.1.3/24... done lb # [ 9.834194] nsncd[523]: Sep 22 10:46:26.674 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 9.872583] network-addresses-eth1-start[630]: adding address 2001:db8:1::3/64... done lb # [ 9.849815] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 9.851501] systemd[1]: Finished register-nix-paths.service. lb # [ 9.790330] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 9.805376] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 worker1 # [ 9.894918] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.866480] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 9.869172] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.877650] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.880820] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 9.875596] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.917817] dhcpcd[637]: dhcpcd-10.3.2 starting lb # [ 9.896769] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 9.927382] dhcpcd[691]: dev: loaded udev worker1 # [ 9.936250] systemd[1]: Finished Extra networking commands.. worker1 # [ 9.938349] systemd[1]: Reached target Network. worker1 # [ 9.941469] systemd[1]: Starting Permit User Sessions... lb # [ 9.920858] systemd[1]: Starting User Login Management... lb # [ 9.928993] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 10.087988] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 10.088460] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.827861] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 9.827954] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 9.978133] systemd[1]: Finished Permit User Sessions. worker1 # [ 9.984776] systemd[1]: Started Getty on tty1. worker2 # [ 10.089718] kvm_amd: TSC scaling supported worker2 # [ 10.090165] kvm_amd: Nested Virtualization enabled worker1 # [ 9.987181] systemd[1]: Reached target Login Prompts. worker2 # [ 10.090874] kvm_amd: Nested Paging enabled worker2 # [ 10.091478] kvm_amd: LBR virtualization supported worker2 # [ 10.091972] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 10.092645] kvm_amd: Virtual GIF supported worker2 # [ 10.093160] kvm_amd: Virtual NMI enabled worker1 # [ 9.995714] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.841439] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 9.862652] Console: switching to colour dummy device 80x25 worker2 # [ 10.133275] EDAC MC: Ver: 3.0.0 worker1 # [ 10.183788] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 10.213527] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 10.214294] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 10.217439] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 10.176499] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 10.218340] cfg80211: failed to load regulatory.db lb # [ 10.176653] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 10.268538] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 10.137219] dhcpcd[691]: eth0: waiting for carrier worker1 # [ 10.138507] dhcpcd[691]: eth0: carrier acquired lb # [ 10.118470] dbus-broker-launch[552]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 10.147270] dhcpcd[691]: DUID 00:01:00:01:32:45:19:03:52:54:00:12:34:56 worker1 # [ 10.148338] dhcpcd[691]: eth0: IAID 00:12:34:56 worker1 # [ 10.149056] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 10.273853] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 10.274288] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 10.143336] dbus-broker-launch[552]: NSS returned no entry for 'systemd-timesync' lb # [ 10.144762] dbus-broker-launch[552]: Invalid user-name in /nix/store/4f05js9lzfgnghkwcx7gl7iad82krcww-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 10.153470] systemd-logind[554]: New seat seat0. lb # [ 10.161976] systemd[1]: Started User Login Management. lb # [ 10.166235] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 10.167301] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 10.169155] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 10.170427] systemd[1]: Stopping User and Group Name Lookups... lb # [ 10.179191] systemd[1]: Starting linger-users.service... lb # [ 10.180985] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 10.320179] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 10.191104] systemd[1]: nscd.service: Deactivated successfully. lb # [ 10.198239] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 10.344364] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 10.362503] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 10.363827] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 10.236405] systemd-vconsole-setup[522]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 10.239973] systemd[1]: Finished Virtual Console Setup. worker2 # [ 10.241427] systemd[1]: Reached target System Initialization. worker2 # [ 10.242494] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.243878] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.245230] systemd[1]: Reached target Timer Units. worker2 # [ 10.246141] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 10.247828] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 10.250432] systemd[1]: Listening on Nix worker-protocol over gRPC. client: (finished: waiting for unit network-addresses-eth1.service, in 10.93 seconds) worker2 # [ 10.251508] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } worker2 # [ 10.252640] systemd[1]: Reached target Socket Units. worker2 # [ 10.254132] systemd[1]: Reached target Basic System. worker2 # [ 10.256375] systemd[1]: Started backdoor.service. worker2 # [ 10.259634] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 10.263079] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.268195] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.271912] systemd[1]: Started Reset console on configuration changes. lb # [ 10.281614] systemd[1]: Started D-Bus System Message Bus. lb # [ 10.285424] dbus-broker-launch[552]: Ready worker2 # [ 10.279525] systemd[1]: Starting resolvconf update... client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.292229] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.286967] systemd[1]: Starting D-Bus System Message Bus... lb # [ 10.309657] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 10.320689] systemd[1]: Finished linger-users.service. worker2 # [ 10.352390] systemd[1]: Finished Post-Boot Actions. lb # [ 10.494836] Console: switching to colour frame buffer device 160x50 worker2 # connecting to host... lb # [ 10.389119] systemd[1]: Finished resolvconf update. lb # [ 10.392937] systemd[1]: Reached target Preparation for Network. worker2 # [ 10.389685] nsncd[529]: Sep 22 10:46:27.563 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.393458] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 10.533380] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 10.395644] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 10.397295] systemd[1]: Reached target User and Group Name Lookups. lb # [ 10.404127] nsncd[614]: Sep 22 10:46:27.241 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.399320] systemd[1]: Starting User Login Management... worker2 # [ 10.403835] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 10.439692] systemd[1]: Starting DHCP Client... lb # [ 10.446307] systemd[1]: Starting Address configuration of eth1... worker2 # [ 10.450810] dbus-broker-launch[533]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 10.458652] systemd[1]: Starting Extra networking commands.... lb # [ 10.465082] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.467170] dbus-broker-launch[533]: NSS returned no entry for 'systemd-timesync' worker2 # [ 10.468262] dbus-broker-launch[533]: Invalid user-name in /nix/store/r6c36z2ah39ibj29dsamba7qp92g9jbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 10.486454] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 10.487695] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 10.494275] systemd-logind[554]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 10.490158] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 10.491353] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 10.492910] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 10.494414] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 10.495862] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 10.505515] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.513271] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 10.516211] systemd-logind[554]: New seat seat0. worker2 # [ 10.523213] systemd-logind[554]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 10.525178] systemd-logind[554]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 10.526963] systemd-logind[554]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 10.529893] systemd[1]: Started User Login Management. worker2 # [ 10.534815] systemd[1]: Starting linger-users.service... lb # [ 10.564498] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 10.570714] systemd[1]: Reached target User and Group Name Lookups. lb # [ 10.581185] systemd[1]: Starting Virtual Console Setup... worker2 # [ 10.575856] dbus-broker-launch[533]: Ready worker2 # [ 10.586223] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.588744] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 10.590872] nsncd[600]: Sep 22 10:46:27.765 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.593477] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.602183] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 10.604049] systemd[1]: Finished linger-users.service. worker2 # [ 10.611142] systemd[1]: Finished resolvconf update. lb # [ 10.617636] systemd-logind[554]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 10.612374] systemd[1]: Reached target Preparation for Network. worker2 # [ 10.617254] systemd[1]: Starting DHCP Client... worker2 # [ 10.619391] systemd[1]: Starting Address configuration of eth1... worker2 # [ 10.623150] systemd[1]: Starting Extra networking commands.... lb # [ 10.646086] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 10.652904] systemd[1]: Stopped Virtual Console Setup. lb # [ 10.655336] network-addresses-eth1-start[642]: adding address 192.168.1.2/24... done client # [ 10.668871] systemd[1]: Finished Extra networking commands.. client # [ 10.670880] systemd[1]: Reached target Network. client # [ 10.674447] systemd[1]: Starting Permit User Sessions... lb # [ 10.672691] systemd[1]: Starting Virtual Console Setup... worker1 # [ 10.703683] dhcpcd[691]: eth0: soliciting a DHCP lease lb # [ 10.686180] network-addresses-eth1-start[642]: adding address 2001:db8:1::2/64... done client # [ 10.701635] systemd[1]: Finished Permit User Sessions. worker1 # [ 10.851187] NET: Registered PF_PACKET protocol family client # [ 10.705773] systemd[1]: Started Getty on tty1. client # [ 10.707195] systemd[1]: Reached target Login Prompts. worker1 # [ 10.722528] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 10.725175] dhcpcd[691]: eth0: probing address 10.0.2.15/24 worker2 # [ 10.719240] network-addresses-eth1-start[629]: adding address 192.168.1.4/24... done lb # [ 10.726837] systemd[1]: Finished Address configuration of eth1. client # [ 10.738583] dhcpcd[566]: eth0: soliciting a DHCP lease worker2 # [ 10.735079] network-addresses-eth1-start[629]: adding address 2001:db8:1::4/64... done client # [ 10.887923] NET: Registered PF_PACKET protocol family client # [ 10.759900] dhcpcd[566]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 10.762178] dhcpcd[566]: eth0: probing address 10.0.2.15/24 worker2 # [ 10.756281] systemd[1]: Finished Address configuration of eth1. lb # [ 10.910729] ppdev: user-space parallel port driver worker2 # [ 10.785667] dhcpcd[637]: dhcpcd-10.3.2 starting worker2 # [ 10.794229] dhcpcd[692]: dev: loaded udev worker2 # [ 10.799902] systemd[1]: Finished Extra networking commands.. worker2 # [ 10.801589] systemd[1]: Reached target Network. worker2 # [ 10.805742] systemd[1]: Starting Permit User Sessions... worker2 # [ 10.954279] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 10.954795] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 10.840481] systemd[1]: Finished Extra networking commands.. worker2 # [ 10.835516] systemd[1]: Finished Permit User Sessions. lb # [ 10.845639] systemd[1]: Reached target Network. worker2 # [ 10.839518] systemd[1]: Started Getty on tty1. worker2 # [ 10.840835] systemd[1]: Reached target Login Prompts. lb # [ 10.861145] systemd[1]: Starting PostgreSQL Server... worker2 # [ 10.856567] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 10.874501] systemd[1]: Starting Permit User Sessions... lb # [ 10.906677] systemd-logind[554]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 11.043140] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 11.054336] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 11.070386] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 11.071099] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 11.074250] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 11.075110] cfg80211: failed to load regulatory.db lb # [ 10.972493] dhcpcd[695]: dhcpcd-10.3.2 starting lb # [ 10.989574] dhcpcd[726]: dev: loaded udev worker2 # [ 11.120013] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 10.987761] dhcpcd[692]: eth0: waiting for carrier worker2 # [ 10.988699] dhcpcd[692]: eth0: carrier acquired lb # [ 10.997638] systemd[1]: Finished Permit User Sessions. worker2 # [ 10.995691] dhcpcd[692]: DUID 00:01:00:01:32:45:19:04:52:54:00:12:34:56 worker2 # [ 10.996608] dhcpcd[692]: eth0: IAID 00:12:34:56 worker2 # [ 10.997283] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 11.015306] systemd[1]: Started Getty on tty1. lb # [ 11.016039] systemd[1]: Reached target Login Prompts. lb # [ 11.172296] 8021q: 802.1Q VLAN Support v1.8 lb # [ 11.173120] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 11.178818] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 11.164649] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 11.189056] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 11.193094] systemd[1]: Stopped Virtual Console Setup. lb # [ 11.210268] systemd[1]: Starting Virtual Console Setup... lb # [ 11.438257] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 11.507292] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 11.508251] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 11.511512] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 11.512444] cfg80211: failed to load regulatory.db lb # [ 11.396275] postgresql-pre-start[735]: The files belonging to this database system will be owned by user "postgres". lb # [ 11.398525] postgresql-pre-start[735]: This user must also own the server process. lb # [ 11.409566] postgresql-pre-start[735]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 11.410771] postgresql-pre-start[735]: The default database encoding has accordingly been set to "UTF8". lb # [ 11.412158] postgresql-pre-start[735]: The default text search configuration will be set to "english". lb # [ 11.414280] postgresql-pre-start[735]: Data page checksums are enabled. lb # [ 11.416298] postgresql-pre-start[735]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 11.417936] postgresql-pre-start[735]: creating subdirectories ... ok lb # [ 11.420113] postgresql-pre-start[735]: selecting dynamic shared memory implementation ... posix lb # [ 11.603096] kvm_amd: TSC scaling supported lb # [ 11.603996] kvm_amd: Nested Virtualization enabled worker1 # [ 11.495479] dhcpcd[691]: eth0: soliciting an IPv6 router worker1 # [ 11.498556] dhcpcd[691]: eth0: Router Advertisement from fe80::2 worker1 # [ 11.500652] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 11.612865] kvm_amd: Nested Paging enabled lb # [ 11.613354] kvm_amd: LBR virtualization supported worker1 # [ 11.502831] dhcpcd[691]: eth0: adding route to fec0::/64 worker1 # [ 11.504696] dhcpcd[691]: eth0: adding default route via fe80::2 lb # [ 11.622532] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 11.623181] kvm_amd: Virtual GIF supported lb # [ 11.625988] kvm_amd: Virtual NMI enabled lb # [ 11.632131] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 11.501785] dhcpcd[726]: eth0: waiting for carrier lb # [ 11.503443] dhcpcd[726]: eth0: carrier acquired lb # [ 11.525169] dhcpcd[726]: DUID 00:01:00:01:32:45:19:04:52:54:00:12:34:56 lb # [ 11.527432] dhcpcd[726]: eth0: IAID 00:12:34:56 lb # [ 11.528859] dhcpcd[726]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 11.719287] EDAC MC: Ver: 3.0.0 lb # [ 11.612080] postgresql-pre-start[735]: selecting default "max_connections" ... 100 lb: (finished: waiting for unit network-addresses-eth1.service, in 1.37 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.07 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 11.735529] systemd-vconsole-setup[739]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 11.741370] systemd[1]: Finished Virtual Console Setup. lb # [ 11.754110] postgresql-pre-start[735]: selecting default "shared_buffers" ... 128MB worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit niks3.service client # [ 12.237727] dhcpcd[566]: eth0: soliciting an IPv6 router client # [ 12.240551] dhcpcd[566]: eth0: Router Advertisement from fe80::2 client # [ 12.242538] dhcpcd[566]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 12.244692] dhcpcd[566]: eth0: adding route to fec0::/64 client # [ 12.246588] dhcpcd[566]: eth0: adding default route via fe80::2 worker2 # [ 12.365826] dhcpcd[692]: eth0: soliciting a DHCP lease worker2 # [ 12.522778] NET: Registered PF_PACKET protocol family worker2 # [ 12.395970] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 12.400346] dhcpcd[692]: eth0: probing address 10.0.2.15/24 lb # [ 12.911330] dhcpcd[726]: eth0: soliciting an IPv6 router lb # [ 12.912628] dhcpcd[726]: eth0: Router Advertisement from fe80::2 lb # [ 12.913605] dhcpcd[726]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 12.914557] dhcpcd[726]: eth0: adding route to fec0::/64 lb # [ 12.915332] dhcpcd[726]: eth0: adding default route via fe80::2 worker2 # [ 12.923566] dhcpcd[692]: eth0: soliciting an IPv6 router worker2 # [ 12.926452] dhcpcd[692]: eth0: Router Advertisement from fe80::2 worker2 # [ 12.928560] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 12.930728] dhcpcd[692]: eth0: adding route to fec0::/64 worker2 # [ 12.932582] dhcpcd[692]: eth0: adding default route via fe80::2 lb # [ 13.026871] dhcpcd[726]: eth0: soliciting a DHCP lease lb # [ 13.178367] NET: Registered PF_PACKET protocol family lb # [ 13.052903] dhcpcd[726]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 13.055250] dhcpcd[726]: eth0: probing address 10.0.2.15/24 lb # [ 13.369607] postgresql-pre-start[735]: selecting default time zone ... UTC lb # [ 13.374624] postgresql-pre-start[735]: creating configuration files ... ok lb # [ 13.610619] postgresql-pre-start[735]: running bootstrap script ... ok lb # [ 14.156147] postgresql-pre-start[735]: performing post-bootstrap initialization ... ok lb # [ 14.299138] postgresql-pre-start[735]: syncing data to disk ... ok lb # [ 14.300094] postgresql-pre-start[735]: initdb: warning: enabling "trust" authentication for local connections lb # [ 14.301228] postgresql-pre-start[735]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 14.303109] postgresql-pre-start[735]: Success. You can now start the database server using: lb # [ 14.304166] postgresql-pre-start[735]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 14.410766] postgres[814]: [814] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 14.415479] postgres[814]: [814] LOG: listening on IPv6 address "::1", port 5432 lb # [ 14.416527] postgres[814]: [814] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 14.420818] postgres[814]: [814] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 14.433526] postgres[823]: [823] LOG: database system was shut down at 2026-09-22 10:46:30 GMT lb # [ 14.439549] postgres[814]: [814] LOG: database system is ready to accept connections lb # [ 14.444033] systemd[1]: Started PostgreSQL Server. lb # [ 14.450988] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 14.657390] postgresql-setup-start[839]: CREATE DATABASE lb # [ 14.698455] postgresql-setup-start[845]: CREATE ROLE lb # [ 14.716898] postgresql-setup-start[847]: ALTER DATABASE lb # [ 14.721801] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 14.723397] systemd[1]: Reached target PostgreSQL. worker1 # [ 15.349897] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 15.350897] dhcpcd[691]: eth0: adding route to 10.0.2.0/24 worker1 # [ 15.351621] dhcpcd[691]: eth0: adding default route via 10.0.2.2 worker1 # [ 15.439674] systemd[1]: Started DHCP Client. worker1 # [ 15.441959] systemd[1]: Reached target Multi-User System. worker1 # [ 15.442829] systemd[1]: Startup finished in 875ms (kernel) + 3.975s (initrd) + 10.589s (userspace) = 15.441s. client # [ 16.662182] dhcpcd[566]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 16.664842] dhcpcd[566]: eth0: adding route to 10.0.2.0/24 client # [ 16.666918] dhcpcd[566]: eth0: adding default route via 10.0.2.2 client # [ 16.752285] systemd[1]: Started DHCP Client. client # [ 16.753942] systemd[1]: Reached target Multi-User System. client # [ 16.755256] systemd[1]: Startup finished in 848ms (kernel) + 4.023s (initrd) + 11.882s (userspace) = 16.754s. worker2 # [ 17.402386] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 17.403536] dhcpcd[692]: eth0: adding route to 10.0.2.0/24 worker2 # [ 17.404375] dhcpcd[692]: eth0: adding default route via 10.0.2.2 lb # [ 17.418765] dhcpcd[726]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 17.419715] dhcpcd[726]: eth0: adding route to 10.0.2.0/24 lb # [ 17.420419] dhcpcd[726]: eth0: adding default route via 10.0.2.2 worker2 # [ 17.485620] systemd[1]: Started DHCP Client. worker2 # [ 17.487594] systemd[1]: Reached target Multi-User System. worker2 # [ 17.488509] systemd[1]: Startup finished in 858ms (kernel) + 5.044s (initrd) + 11.585s (userspace) = 17.487s. lb # [ 17.513712] systemd[1]: Started DHCP Client. lb # [ 17.515868] systemd[1]: Reached target Network is Online. lb # [ 17.520147] systemd[1]: Started Envoy reverse proxy. lb # [ 17.523586] systemd[1]: Started mock-oidc.service. lb # [ 17.699854] mock-oidc-server[933]: Mock OIDC Server running lb # [ 17.704390] mock-oidc-server[933]: OIDC Address: 192.168.1.2:8080 lb # [ 17.705399] mock-oidc-server[933]: Issue Address: 0.0.0.0:8081 lb # [ 17.706280] mock-oidc-server[933]: Issuer: http://192.168.1.2:8080/oidc lb # [ 17.707264] mock-oidc-server[933]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 17.708438] mock-oidc-server[933]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 17.709757] mock-oidc-server[933]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 18.198366] envoy[932]: [2026-09-22 10:46:35.040][932][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 18.200404] envoy[932]: [2026-09-22 10:46:35.043][932][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 18.202101] envoy[932]: [2026-09-22 10:46:35.043][932][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 18.204574] envoy[932]: [2026-09-22 10:46:35.043][932][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 18.206554] envoy[932]: [2026-09-22 10:46:35.043][932][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 18.209322] envoy[932]: [2026-09-22 10:46:35.043][932][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 18.212106] envoy[932]: [2026-09-22 10:46:35.043][932][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 18.213823] envoy[932]: [2026-09-22 10:46:35.044][932][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 18.217618] envoy[932]: [2026-09-22 10:46:35.044][932][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 18.219632] envoy[932]: [2026-09-22 10:46:35.044][932][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 18.221325] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 18.223228] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 18.227614] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 18.230234] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 18.232137] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 18.234660] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 18.236617] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 18.238317] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 18.240208] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 18.243264] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 18.244972] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 18.249195] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 18.263387] envoy[932]: [2026-09-22 10:46:35.045][932][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 18.266383] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 18.269170] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 18.271539] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 18.273990] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 18.275622] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 18.277866] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 18.281084] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 18.282954] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 18.285881] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 18.290078] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 18.292188] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.294212] envoy[932]: [2026-09-22 10:46:35.047][932][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 18.296907] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 18.299652] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 18.301502] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 18.307371] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 18.310093] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 18.312505] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 18.314290] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 18.318165] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 18.320070] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 18.324760] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 18.326504] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 18.328117] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 18.330479] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 18.333410] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 18.334862] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 18.337039] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 18.343192] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 18.355267] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 18.357395] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 18.359283] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 18.369113] envoy[932]: [2026-09-22 10:46:35.049][932][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 18.374685] envoy[932]: [2026-09-22 10:46:35.055][932][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 18.376956] envoy[932]: [2026-09-22 10:46:35.055][932][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.379262] envoy[932]: [2026-09-22 10:46:35.055][932][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 18.381362] envoy[932]: [2026-09-22 10:46:35.055][932][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 18.384353] envoy[932]: [2026-09-22 10:46:35.055][932][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 18.386147] envoy[932]: [2026-09-22 10:46:35.055][932][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 18.388564] envoy[932]: [2026-09-22 10:46:35.056][932][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 18.390089] envoy[932]: [2026-09-22 10:46:35.056][932][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 18.391796] envoy[932]: [2026-09-22 10:46:35.056][932][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 18.398682] envoy[932]: [2026-09-22 10:46:35.056][932][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 18.400517] envoy[932]: [2026-09-22 10:46:35.075][932][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 18.402191] envoy[932]: [2026-09-22 10:46:35.075][932][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 18.407404] envoy[932]: [2026-09-22 10:46:35.075][932][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 18.411890] envoy[932]: [2026-09-22 10:46:35.075][932][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 18.414072] envoy[932]: [2026-09-22 10:46:35.075][932][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 18.415987] envoy[932]: [2026-09-22 10:46:35.075][932][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 18.417696] envoy[932]: [2026-09-22 10:46:35.075][932][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 18.419121] envoy[932]: [2026-09-22 10:46:35.075][932][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 18.421077] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 18.422472] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 18.424103] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 18.428144] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 18.429762] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 18.432279] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 18.434848] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 18.436642] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 18.461813] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 18.464453] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 18.466246] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 18.468107] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 18.470253] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 18.472515] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 18.474180] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 18.476311] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 18.478602] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 18.480606] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 18.482356] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 18.484210] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.486832] envoy[932]: [2026-09-22 10:46:35.077][932][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 18.489102] envoy[932]: [2026-09-22 10:46:35.079][932][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.491693] envoy[932]: [2026-09-22 10:46:35.079][932][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 18.494738] envoy[932]: [2026-09-22 10:46:35.079][932][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 18.497176] envoy[932]: [2026-09-22 10:46:35.079][932][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 18.499582] envoy[932]: [2026-09-22 10:46:35.079][932][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 18.501089] envoy[932]: [2026-09-22 10:46:35.079][932][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 18.504190] envoy[932]: [2026-09-22 10:46:35.081][932][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 18.510209] envoy[932]: [2026-09-22 10:46:35.081][932][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 18.512334] envoy[932]: [2026-09-22 10:46:35.081][932][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 18.514529] envoy[932]: [2026-09-22 10:46:35.081][932][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 18.519686] envoy[932]: [2026-09-22 10:46:35.081][932][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 18.521503] envoy[932]: [2026-09-22 10:46:35.257][932][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 18.522839] envoy[932]: [2026-09-22 10:46:35.329][932][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 18.535519] envoy[932]: [2026-09-22 10:46:35.329][932][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 18.537226] envoy[932]: [2026-09-22 10:46:35.329][932][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 18.544811] envoy[932]: [2026-09-22 10:46:35.329][932][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 18.591371] envoy[932]: [2026-09-22 10:46:35.434][932][info][main] [source/server/server.cc:968] runtime: {} lb # [ 18.599220] envoy[932]: [2026-09-22 10:46:35.442][932][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 18.601531] envoy[932]: [2026-09-22 10:46:35.444][932][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 18.604121] envoy[932]: [2026-09-22 10:46:35.447][932][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 18.607153] envoy[932]: [2026-09-22 10:46:35.450][932][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 18.608920] envoy[932]: [2026-09-22 10:46:35.451][932][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 18.610461] envoy[932]: [2026-09-22 10:46:35.452][932][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 18.668636] envoy[932]: [2026-09-22 10:46:35.511][932][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 18.697329] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 18.665440] systemd[1]: Reached target Network is Online. worker2 # [ 18.672787] systemd[1]: Starting scheduler-token.service... lb # [ 18.690225] envoy[932]: [2026-09-22 10:46:35.533][932][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 18.692605] envoy[932]: [2026-09-22 10:46:35.535][932][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 18.695500] envoy[932]: [2026-09-22 10:46:35.535][932][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 18.774690] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 18.775657] systemd[1]: Finished scheduler-token.service. worker2 # [ 18.776653] systemd[1]: scheduler-token.service: Consumed 33ms CPU time over 101ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 18.781773] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 18.876765] nix-grpc-daemon[784]: ts=2026-09-22T10:46:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 18.887210] nix-grpc-daemon[784]: ts=2026-09-22T10:46:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 18.890726] nix-grpc-daemon[784]: ts=2026-09-22T10:46:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 18.918342] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 18.919719] nix-grpc-daemon[784]: E0000 00:00:1790073996.039728 784 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 18.932760] nix-grpc-daemon[784]: E0000 00:00:1790073996.055104 784 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 18.936215] nix-grpc-daemon[784]: ts=2026-09-22T10:46:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 18.939227] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 18.965634] nix-grpc-daemon[784]: E0000 00:00:1790073996.087943 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 18.950571] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 18.959717] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 18.991064] nix-grpc-daemon[784]: E0000 00:00:1790073996.113298 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 18.994053] nix-grpc-daemon[784]: E0000 00:00:1790073996.116403 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 18.965548] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 18.974921] envoy[932]: [2026-09-22 10:46:35.817][932][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 18.979100] envoy[932]: [2026-09-22 10:46:35.817][932][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 19.007978] nix-grpc-daemon[784]: E0000 00:00:1790073996.130290 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 18.983264] envoy[932]: [2026-09-22 10:46:35.817][932][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 19.016852] nix-grpc-daemon[784]: ts=2026-09-22T10:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 18.993220] envoy[932]: [2026-09-22 10:46:35.836][932][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 18.998499] nix-grpc-daemon[786]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 18.999918] nix-grpc-daemon[786]: E0000 00:00:1790073996.174673 786 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 19.014922] nix-grpc-daemon[786]: E0000 00:00:1790073996.192334 786 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 19.018436] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 19.021507] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 19.066351] nix-grpc-daemon[786]: E0000 00:00:1790073996.242997 825 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 19.080675] nix-grpc-daemon[786]: E0000 00:00:1790073996.258079 825 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 19.085062] nix-grpc-daemon[786]: E0000 00:00:1790073996.261178 825 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 19.096919] nix-grpc-daemon[786]: E0000 00:00:1790073996.274297 825 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 19.121608] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.134111] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.218266] nix-grpc-daemon[784]: ts=2026-09-22T10:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 19.335885] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.337631] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.538291] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.542207] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.618643] nix-grpc-daemon[784]: ts=2026-09-22T10:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 19.743319] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.747074] nix-grpc-daemon[786]: ts=2026-09-22T10:46:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.948215] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.952607] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.152522] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.154344] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.355079] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.356740] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.423451] nix-grpc-daemon[784]: ts=2026-09-22T10:46:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.427576] nix-grpc-daemon[784]: ts=2026-09-22T10:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.557400] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.559123] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.628774] nix-grpc-daemon[784]: ts=2026-09-22T10:46:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.632882] nix-grpc-daemon[784]: ts=2026-09-22T10:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.760288] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.763994] nix-grpc-daemon[786]: ts=2026-09-22T10:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.833389] nix-grpc-daemon[784]: ts=2026-09-22T10:46:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.835203] nix-grpc-daemon[784]: ts=2026-09-22T10:46:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.966682] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.969998] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.036092] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.039786] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.167280] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.171109] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.237412] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.239242] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.372313] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.376672] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.441775] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.444920] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.577672] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.581960] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.642555] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.646393] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.782861] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.787184] nix-grpc-daemon[786]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.847326] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.851249] nix-grpc-daemon[784]: ts=2026-09-22T10:46:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.989367] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.993268] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.052251] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.055827] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.190538] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.194340] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.256867] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.260818] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.395363] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.399659] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.462723] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.466469] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.600646] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.604462] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.667467] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.671624] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.805760] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.810126] nix-grpc-daemon[786]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.872810] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.876681] nix-grpc-daemon[784]: ts=2026-09-22T10:46:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.012280] nix-grpc-daemon[786]: ts=2026-09-22T10:46:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.015549] nix-grpc-daemon[786]: ts=2026-09-22T10:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.074665] nix-grpc-daemon[784]: ts=2026-09-22T10:46:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.078593] nix-grpc-daemon[784]: ts=2026-09-22T10:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.213199] nix-grpc-daemon[786]: ts=2026-09-22T10:46:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.216995] nix-grpc-daemon[786]: ts=2026-09-22T10:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.279816] nix-grpc-daemon[784]: ts=2026-09-22T10:46:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.283727] nix-grpc-daemon[784]: ts=2026-09-22T10:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.418307] nix-grpc-daemon[786]: ts=2026-09-22T10:46:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.421990] nix-grpc-daemon[786]: ts=2026-09-22T10:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.482370] nix-grpc-daemon[784]: ts=2026-09-22T10:46:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.485946] nix-grpc-daemon[784]: ts=2026-09-22T10:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.622528] nix-grpc-daemon[786]: ts=2026-09-22T10:46:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.626180] nix-grpc-daemon[786]: ts=2026-09-22T10:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.686959] nix-grpc-daemon[784]: ts=2026-09-22T10:46:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.690886] nix-grpc-daemon[784]: ts=2026-09-22T10:46:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.826551] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.829217] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.891872] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.895928] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.031300] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.034881] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.096792] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.099426] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.232380] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.236840] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.300055] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.302083] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.437782] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.441611] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.504745] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.507943] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.642680] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.646552] nix-grpc-daemon[786]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.705101] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.707076] nix-grpc-daemon[784]: ts=2026-09-22T10:46:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.847457] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.851509] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.907771] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.909677] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.053188] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.057062] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.110775] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.114752] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.257904] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.261879] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.315835] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.319891] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.463182] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.467087] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.521958] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.524603] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.667697] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.669471] nix-grpc-daemon[786]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.723076] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.727498] nix-grpc-daemon[784]: ts=2026-09-22T10:46:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.870216] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.871924] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.928407] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.932453] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.074329] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.077604] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.133308] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.138654] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.275293] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.279133] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.337965] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.340236] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.480232] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.484098] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.541322] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.543060] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.685507] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.689328] nix-grpc-daemon[786]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.743669] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.745644] nix-grpc-daemon[784]: ts=2026-09-22T10:46:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.890327] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.894160] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.946636] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.950550] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.095525] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.099233] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.151504] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.155462] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.300239] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.304130] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.356127] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.358281] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.505124] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.508881] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.559506] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.561289] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.709865] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.713664] nix-grpc-daemon[786]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.762028] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.763964] nix-grpc-daemon[784]: ts=2026-09-22T10:46:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.914896] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.918721] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.964898] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.968869] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.120882] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.123941] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.169905] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.174009] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.321997] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.325879] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.374859] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.378730] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.526983] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.530763] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.578504] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.581619] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.731942] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.735686] nix-grpc-daemon[786]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.779170] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.783220] nix-grpc-daemon[784]: ts=2026-09-22T10:46:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.936806] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.940557] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.985181] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.989088] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.083753] rustfs-bucket-start[1043]: mb s3://farm lb # [ 29.089879] systemd[1]: Finished rustfs-bucket.service. lb # [ 29.096400] systemd[1]: Starting niks3 server... worker2 # [ 29.142731] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.145841] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.186411] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.190395] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.328640] postgres[1059]: [1059] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 29.329867] postgres[1059]: [1059] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker2 # [ 29.343868] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.347658] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.387903] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.389772] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.376137] niks3-server[1053]: 2026/09/22 10:46:46 OK 20241026095416_initial_model.sql (25.98ms) lb # [ 29.380177] niks3-server[1053]: 2026/09/22 10:46:46 OK 20251210153512_drop_unused_gin_index.sql (5.53ms) lb # [ 29.386972] niks3-server[1053]: 2026/09/22 10:46:46 OK 20251218171726_add_pins.sql (6.75ms) lb # [ 29.393483] niks3-server[1053]: 2026/09/22 10:46:46 OK 20260628120000_add_object_size_and_stats.sql (6.24ms) lb # [ 29.397986] niks3-server[1053]: 2026/09/22 10:46:46 OK 20260905000000_add_claims.sql (4.7ms) lb # [ 29.403119] niks3-server[1053]: 2026/09/22 10:46:46 OK 20260920000000_drop_claims.sql (5.09ms) lb # [ 29.404511] niks3-server[1053]: 2026/09/22 10:46:46 goose: successfully migrated database to version: 20260920000000 lb # [ 29.410517] niks3-server[1053]: 2026/09/22 10:46:46 OK 1_commit_pending_closure.sql (6.01ms) lb # [ 29.413225] niks3-server[1053]: 2026/09/22 10:46:46 OK 2_object_stats_trigger.sql (2.72ms) lb # [ 29.414489] niks3-server[1053]: 2026/09/22 10:46:46 goose: up to current file version: 2 lb # [ 29.421075] niks3-server[1053]: 2026/09/22 10:46:46 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key lb # [ 29.499759] niks3-server[1053]: 2026/09/22 10:46:46 INFO Read proxy enabled — serving cache objects from S3 lb # [ 29.501716] niks3-server[1053]: 2026/09/22 10:46:46 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 29.505176] niks3-server[1053]: 2026/09/22 10:46:46 INFO systemd watchdog enabled interval=15s lb # [ 29.506416] systemd[1]: Started niks3 server. lb # [ 29.507040] systemd[1]: Reached target Multi-User System. lb # [ 29.509927] systemd[1]: Startup finished in 892ms (kernel) + 5.145s (initrd) + 23.471s (userspace) = 29.509s. lb # [ 29.511652] niks3-server[1053]: 2026/09/22 10:46:46 INFO Starting HTTP server address=0.0.0.0:5751 worker2 # [ 29.548917] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.552779] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.592372] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.595509] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.754436] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.758401] nix-grpc-daemon[786]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.792548] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.796544] nix-grpc-daemon[784]: ts=2026-09-22T10:46:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.959587] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.963741] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.997418] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.001207] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.166311] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.169825] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.202163] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.206144] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.367631] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.371592] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.407217] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.411166] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 18.54 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds) lb: waiting for unit envoy.service worker2 # [ 30.572878] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.577142] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.613672] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.616795] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit envoy.service, in 0.06 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 30.666869] envoy[932]: conn peer=[::1]:54960 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds) worker2 # [ 30.778386] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.813933] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.783294] nix-grpc-daemon[786]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.817782] nix-grpc-daemon[784]: ts=2026-09-22T10:46:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.807201] systemd[1]: Starting scheduler-token.service... worker2 # [ 30.877965] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 30.879808] systemd[1]: Finished scheduler-token.service. worker2 # [ 30.881319] systemd[1]: scheduler-token.service: Consumed 21ms CPU time over 74ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 31.015234] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.985169] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.017038] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.988622] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 31.216327] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.218750] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.187769] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.191941] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.419172] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.421045] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.393442] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.397732] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.622087] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.623792] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.595786] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.600276] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.824433] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.826325] nix-grpc-daemon[784]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.802134] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.805779] nix-grpc-daemon[786]: ts=2026-09-22T10:46:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.026728] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 32.028554] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.003326] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.005222] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 32.229792] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.233749] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.208269] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.211484] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.434682] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.438701] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.409580] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.413826] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.639590] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.641464] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.615349] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.619571] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.842620] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.846610] nix-grpc-daemon[784]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.817539] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.821616] nix-grpc-daemon[786]: ts=2026-09-22T10:46:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.047630] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.019755] nix-grpc-daemon[786]: ts=2026-09-22T10:46:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.051511] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.023410] nix-grpc-daemon[786]: ts=2026-09-22T10:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 33.249516] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.253615] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.226194] nix-grpc-daemon[786]: ts=2026-09-22T10:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.229304] nix-grpc-daemon[786]: ts=2026-09-22T10:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.454597] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.426197] nix-grpc-daemon[786]: ts=2026-09-22T10:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.427923] nix-grpc-daemon[786]: ts=2026-09-22T10:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.458642] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.628172] nix-grpc-daemon[786]: ts=2026-09-22T10:46:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.660981] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.632241] nix-grpc-daemon[786]: ts=2026-09-22T10:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.664230] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.861574] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.833508] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.865631] nix-grpc-daemon[784]: ts=2026-09-22T10:46:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.837263] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.065973] nix-grpc-daemon[784]: ts=2026-09-22T10:46:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.067824] nix-grpc-daemon[784]: ts=2026-09-22T10:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.038710] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.042912] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 34.269073] nix-grpc-daemon[784]: ts=2026-09-22T10:46:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.273308] nix-grpc-daemon[784]: ts=2026-09-22T10:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.245483] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.248684] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.474266] nix-grpc-daemon[784]: ts=2026-09-22T10:46:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.446752] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.478618] nix-grpc-daemon[784]: ts=2026-09-22T10:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.449954] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.648338] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.680890] nix-grpc-daemon[784]: ts=2026-09-22T10:46:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.652377] nix-grpc-daemon[786]: ts=2026-09-22T10:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.684262] nix-grpc-daemon[784]: ts=2026-09-22T10:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.881416] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.853695] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.885414] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.857624] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.055760] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.086260] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.059727] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.090386] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 35.291391] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.261829] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.295305] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.265743] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.496294] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.467178] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.500403] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.470939] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.669817] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.703462] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.673807] nix-grpc-daemon[786]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.706482] nix-grpc-daemon[784]: ts=2026-09-22T10:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.902767] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.872323] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.906662] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.876361] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.074451] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.108083] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.078418] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.111576] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 36.279872] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.309341] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.281681] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.314119] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2 # [ 36.482981] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.484885] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.515103] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.519411] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.686252] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.721227] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.690224] nix-grpc-daemon[786]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.722828] nix-grpc-daemon[784]: ts=2026-09-22T10:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.921605] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.891522] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.923587] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.895758] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.124257] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.126142] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.096094] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.099432] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 37.327061] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.331136] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.302222] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.305469] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 37.531934] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.503490] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.536266] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.507554] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.705495] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.707414] nix-grpc-daemon[786]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.738520] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.741601] nix-grpc-daemon[784]: ts=2026-09-22T10:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.908872] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.939475] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.943458] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.913162] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.141496] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.113931] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.145536] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.117816] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.346599] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.319921] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.350721] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.321489] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2 # [ 38.521283] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.551650] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.525269] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.555838] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.726067] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.727832] nix-grpc-daemon[786]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.758100] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.761322] nix-grpc-daemon[784]: ts=2026-09-22T10:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.958641] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.928908] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.960679] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.930883] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.161226] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.162920] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.132162] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.136240] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.363488] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.365275] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.338642] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.341777] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb # [ 39.521673] niks3-server[1053]: 2026/09/22 10:46:56 INFO lead: acquired remote=192.168.1.4:55114 worker2 # [ 39.515396] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_take_over worker1 # [ 39.566568] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.539332] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.570902] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.543682] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.771938] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.744352] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.774134] nix-grpc-daemon[784]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.746152] nix-grpc-daemon[786]: ts=2026-09-22T10:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.974872] nix-grpc-daemon[784]: ts=2026-09-22T10:46:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.976972] nix-grpc-daemon[784]: ts=2026-09-22T10:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.947213] nix-grpc-daemon[786]: ts=2026-09-22T10:46:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.950412] nix-grpc-daemon[786]: ts=2026-09-22T10:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.177681] nix-grpc-daemon[784]: ts=2026-09-22T10:46:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.148494] nix-grpc-daemon[786]: ts=2026-09-22T10:46:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.158756] nix-grpc-daemon[786]: ts=2026-09-22T10:46:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34944 worker2 # [ 40.163671] nix-grpc-daemon[786]: ts=2026-09-22T10:46:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 40.181177] nix-grpc-daemon[786]: ts=2026-09-22T10:46:57Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 40.185398] nix-grpc-daemon[786]: ts=2026-09-22T10:46:57Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:34944 worker2 # [ 40.189329] nix-grpc-daemon[786]: ts=2026-09-22T10:46:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.12 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 41.336217] nix-grpc-daemon[786]: ts=2026-09-22T10:46:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 41.346788] systemd[1]: Started Nix Daemon. worker2 # [ 41.555266] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 41.579810] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker2 # [ 41.668115] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 187 ms (attempt 2/5) worker2 # [ 41.860515] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 243 ms (attempt 3/5) worker2 # [ 42.109443] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 208 ms (attempt 4/5) worker2 # [ 42.323723] nix-grpc-daemon[786]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 42.327742] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 42.363664] nix-grpc-daemon[786]: ts=2026-09-22T10:46:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 42.375108] nix-grpc-daemon[786]: ts=2026-09-22T10:46:59Z level=debug event=path_info_miss path=qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test error="error: path '/nix/store/qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 42.380351] nix-grpc-daemon[786]: ts=2026-09-22T10:46:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 42.386067] nix-grpc-daemon[786]: ts=2026-09-22T10:46:59Z level=debug event=path_info_miss path=qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test error="error: path '/nix/store/qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds) client: must succeed: install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds) worker1 # [ 42.766890] nix-grpc-daemon[784]: ts=2026-09-22T10:46:59Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 42.772206] nix-grpc-daemon[784]: ts=2026-09-22T10:46:59Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:35784 worker1 # [ 42.784723] systemd[1]: Started Nix Daemon. worker1 # [ 42.975728] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 42.998494] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5) worker1 # [ 43.098293] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 194 ms (attempt 2/5) worker1 # [ 43.292454] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 275 ms (attempt 3/5) worker1 # [ 43.570745] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 682 ms (attempt 4/5) worker1 # [ 44.262287] nix-grpc-daemon[784]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 44.265958] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 44.258728] nix-grpc-daemon[786]: ts=2026-09-22T10:47:01Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:34952 worker1 # [ 44.304560] nix-grpc-daemon[784]: ts=2026-09-22T10:47:01Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:35784 worker2 # [ 44.269507] nix-grpc-daemon[786]: ts=2026-09-22T10:47:01Z level=debug event=path_info_miss path=qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test error="error: path '/nix/store/qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 44.315649] nix-grpc-daemon[784]: ts=2026-09-22T10:47:01Z level=debug event=path_info_miss path=qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test error="error: path '/nix/store/qa4bpmmrzxnmnwz5m9pc3b9s796ifdak-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds) worker1 # [ 44.572816] nix-grpc-daemon[784]: ts=2026-09-22T10:47:01Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 44.772989] nix-grpc-daemon[784]: ts=2026-09-22T10:47:01Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.69 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 44.999958] nix-grpc-daemon[784]: ts=2026-09-22T10:47:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 45.009860] nix-grpc-daemon[784]: ts=2026-09-22T10:47:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 worker2 # [ 45.015094] nix-grpc-daemon[786]: ts=2026-09-22T10:47:02Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 45.020682] nix-grpc-daemon[786]: ts=2026-09-22T10:47:02Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 45.103638] nix-grpc-daemon[784]: ts=2026-09-22T10:47:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 45.120154] nix-grpc-daemon[784]: ts=2026-09-22T10:47:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 client # copying 1 paths to 'lb:50051'... worker1 # [ 45.129787] nix-grpc-daemon[784]: ts=2026-09-22T10:47:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 45.155920] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 45.174139] nix-grpc-daemon[784]: ts=2026-09-22T10:47:02Z level=info event=niks3_push_started pid=864 worker1 # [ 45.467824] nix-grpc-daemon[864]: time=2026-09-22T10:47:02.586Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 45.651315] nix-daemon[852]: accepted connection from pid 876, user nix-grpc-daemon (trusted) worker1 # [ 45.668158] nix-daemon[852]: reaped child process 879, status = succeeded worker1 # [ 45.796373] nix-daemon[852]: accepted connection from pid 882, user nix-grpc-daemon (trusted) worker1 # [ 45.810565] nix-daemon[852]: reaped child process 885, status = succeeded lb # [ 45.794501] niks3-server[1053]: 2026/09/22 10:47:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.831641] nix-grpc-daemon[864]: time=2026-09-22T10:47:02.953Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 45.834294] nix-grpc-daemon[864]: time=2026-09-22T10:47:02.956Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 45.850762] niks3-server[1053]: 2026/09/22 10:47:02 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 45.852594] niks3-server[1053]: 2026/09/22 10:47:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 45.861245] niks3-server[1053]: 2026/09/22 10:47:02 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 45.869613] niks3-server[1053]: 2026/09/22 10:47:02 INFO Signed narinfos id=1 count=1 worker1 # [ 45.895521] nix-grpc-daemon[864]: time=2026-09-22T10:47:03.017Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.884806] niks3-server[1053]: 2026/09/22 10:47:02 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 45.891369] niks3-server[1053]: 2026/09/22 10:47:02 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo lb # [ 45.902190] niks3-server[1053]: 2026/09/22 10:47:02 INFO Completed upload id=1 worker1 # [ 45.926608] nix-grpc-daemon[864]: time=2026-09-22T10:47:03.048Z level=INFO msg="Upload complete. (432ms)" worker1 # [ 45.932905] nix-grpc-daemon[784]: ts=2026-09-22T10:47:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 45.939592] nix-grpc-daemon[784]: ts=2026-09-22T10:47:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 45.951264] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 45.960213] nix-daemon[852]: reaped child process 862, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... worker1 # [ 45.965801] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 46.782599] nix-daemon[852]: reaped child process 889, status = succeeded worker1 # [ 46.906238] nix-daemon[852]: accepted connection from pid 905, user nix-grpc-daemon (trusted) worker1 # [ 46.920720] nix-daemon[852]: reaped child process 908, status = succeeded lb # [ 46.906873] niks3-server[1053]: 2026/09/22 10:47:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 46.978384] nix-grpc-daemon[864]: time=2026-09-22T10:47:04.100Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 46.981082] nix-grpc-daemon[864]: time=2026-09-22T10:47:04.103Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 46.994632] niks3-server[1053]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 47.003727] niks3-server[1053]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 47.009113] niks3-server[1053]: 2026/09/22 10:47:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 47.018401] niks3-server[1053]: 2026/09/22 10:47:03 INFO Signed narinfos id=2 count=1 worker1 # [ 47.044137] nix-grpc-daemon[864]: time=2026-09-22T10:47:04.164Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.022173] niks3-server[1053]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 47.032488] niks3-server[1053]: 2026/09/22 10:47:03 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 47.037813] niks3-server[1053]: 2026/09/22 10:47:03 INFO Completed upload id=2 lb # [ 47.040208] niks3-server[1053]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker1 # [ 47.061959] nix-grpc-daemon[864]: time=2026-09-22T10:47:04.184Z level=INFO msg="Upload complete. (287ms)" worker1 # [ 47.069848] nix-grpc-daemon[784]: ts=2026-09-22T10:47:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 47.085827] nix-daemon[852]: reaped child process 887, status = succeeded worker2 # [ 47.054545] nix-grpc-daemon[786]: ts=2026-09-22T10:47:04Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 47.058508] nix-grpc-daemon[786]: ts=2026-09-22T10:47:04Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 47.130245] nix-grpc-daemon[784]: ts=2026-09-22T10:47:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 47.143624] nix-grpc-daemon[784]: ts=2026-09-22T10:47:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 47.159108] nix-grpc-daemon[864]: time=2026-09-22T10:47:04.280Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 47.167868] nix-grpc-daemon[784]: ts=2026-09-22T10:47:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 47.184464] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 47.364378] nix-daemon[852]: accepted connection from pid 912, user nix-grpc-daemon (trusted) worker1 # [ 47.380670] nix-daemon[852]: reaped child process 915, status = succeeded worker1 # [ 47.531744] nix-daemon[852]: accepted connection from pid 917, user nix-grpc-daemon (trusted) worker1 # [ 47.546876] nix-daemon[852]: reaped child process 920, status = succeeded lb # [ 47.536534] niks3-server[1053]: 2026/09/22 10:47:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 47.573099] nix-grpc-daemon[864]: time=2026-09-22T10:47:04.695Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 47.574765] nix-grpc-daemon[864]: time=2026-09-22T10:47:04.697Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 47.577456] niks3-server[1053]: 2026/09/22 10:47:04 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 47.585266] niks3-server[1053]: 2026/09/22 10:47:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 47.590496] niks3-server[1053]: 2026/09/22 10:47:04 INFO Signed narinfos id=3 count=1 worker1 # [ 47.617923] nix-grpc-daemon[864]: time=2026-09-22T10:47:04.739Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.605806] niks3-server[1053]: 2026/09/22 10:47:04 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 47.608753] niks3-server[1053]: 2026/09/22 10:47:04 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 47.616198] niks3-server[1053]: 2026/09/22 10:47:04 INFO Completed upload id=3 worker1 # [ 47.640544] nix-grpc-daemon[864]: time=2026-09-22T10:47:04.762Z level=INFO msg="Upload complete. (439ms)" lb # [ 47.619304] niks3-server[1053]: 2026/09/22 10:47:04 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 47.645298] nix-grpc-daemon[784]: ts=2026-09-22T10:47:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 47.651355] nix-grpc-daemon[784]: ts=2026-09-22T10:47:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 47.659528] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... worker1 # [ 47.674086] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 47.675542] nix-daemon[852]: reaped child process 910, status = succeeded client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 48.679248] envoy[932]: conn peer=[2001:db8:1::1]:56630 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=364 ms=1101 lb # [ 48.680970] envoy[932]: conn peer=[2001:db8:1::1]:56634 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=365 ms=1578 lb # [ 48.682821] envoy[932]: conn peer=[2001:db8:1::1]:37998 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=7 lb # [ 48.684481] envoy[932]: conn peer=[2001:db8:1::1]:38002 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=8 client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 48.970617] nix-grpc-daemon[784]: E0000 00:00:1790074026.090591 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 48.999134] nix-grpc-daemon[784]: E0000 00:00:1790074026.118731 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 49.002278] nix-grpc-daemon[784]: E0000 00:00:1790074026.119832 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 49.021664] nix-grpc-daemon[784]: E0000 00:00:1790074026.143248 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. client # farm-b> LOG-farm-b-t1 worker1 # [ 49.294624] nix-daemon[852]: reaped child process 924, status = succeeded worker1 # [ 49.414285] nix-daemon[852]: accepted connection from pid 940, user nix-grpc-daemon (trusted) worker1 # [ 49.428256] nix-daemon[852]: reaped child process 943, status = succeeded lb # [ 49.415563] niks3-server[1053]: 2026/09/22 10:47:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.447497] nix-grpc-daemon[864]: time=2026-09-22T10:47:06.569Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 49.449802] nix-grpc-daemon[864]: time=2026-09-22T10:47:06.571Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 49.443039] niks3-server[1053]: 2026/09/22 10:47:06 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 49.449442] niks3-server[1053]: 2026/09/22 10:47:06 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 49.454315] niks3-server[1053]: 2026/09/22 10:47:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 49.456468] niks3-server[1053]: 2026/09/22 10:47:06 INFO Signed narinfos id=4 count=1 worker1 # [ 49.480550] nix-grpc-daemon[864]: time=2026-09-22T10:47:06.602Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.459601] niks3-server[1053]: 2026/09/22 10:47:06 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 49.464055] niks3-server[1053]: 2026/09/22 10:47:06 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete worker1 # [ 49.492621] nix-grpc-daemon[864]: time=2026-09-22T10:47:06.614Z level=INFO msg="Upload complete. (210ms)" lb # [ 49.469121] niks3-server[1053]: 2026/09/22 10:47:06 INFO Completed upload id=4 lb # [ 49.470779] niks3-server[1053]: 2026/09/22 10:47:06 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker1 # [ 49.495422] nix-grpc-daemon[784]: ts=2026-09-22T10:47:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker1 # [ 49.502883] nix-daemon[852]: reaped child process 922, status = succeeded worker2 # [ 49.475481] nix-grpc-daemon[786]: ts=2026-09-22T10:47:06Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 49.479535] nix-grpc-daemon[786]: ts=2026-09-22T10:47:06Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 49.551673] nix-grpc-daemon[784]: ts=2026-09-22T10:47:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 49.564502] nix-grpc-daemon[784]: ts=2026-09-22T10:47:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 49.579564] nix-grpc-daemon[864]: time=2026-09-22T10:47:06.701Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 49.590062] nix-grpc-daemon[784]: ts=2026-09-22T10:47:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 49.598728] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 49.775264] nix-daemon[852]: accepted connection from pid 947, user nix-grpc-daemon (trusted) worker1 # [ 49.790321] nix-daemon[852]: reaped child process 950, status = succeeded worker1 # [ 49.941906] nix-daemon[852]: accepted connection from pid 952, user nix-grpc-daemon (trusted) worker1 # [ 49.957700] nix-daemon[852]: reaped child process 955, status = succeeded lb # [ 49.942497] niks3-server[1053]: 2026/09/22 10:47:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.971565] nix-grpc-daemon[864]: time=2026-09-22T10:47:07.093Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 49.973134] nix-grpc-daemon[864]: time=2026-09-22T10:47:07.093Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 49.957921] niks3-server[1053]: 2026/09/22 10:47:06 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 49.963078] niks3-server[1053]: 2026/09/22 10:47:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 49.966860] niks3-server[1053]: 2026/09/22 10:47:06 INFO Signed narinfos id=5 count=1 worker1 # [ 49.990685] nix-grpc-daemon[864]: time=2026-09-22T10:47:07.112Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.970633] niks3-server[1053]: 2026/09/22 10:47:06 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 49.976069] niks3-server[1053]: 2026/09/22 10:47:06 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 49.984176] niks3-server[1053]: 2026/09/22 10:47:06 INFO Completed upload id=5 worker1 # [ 50.008327] nix-grpc-daemon[864]: time=2026-09-22T10:47:07.130Z level=INFO msg="Upload complete. (396ms)" lb # [ 49.985848] niks3-server[1053]: 2026/09/22 10:47:06 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 50.011642] nix-grpc-daemon[784]: ts=2026-09-22T10:47:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 50.015810] nix-grpc-daemon[784]: ts=2026-09-22T10:47:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 50.023081] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 50.029139] nix-daemon[852]: reaped child process 945, status = succeeded worker1 # [ 50.033325] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 51.066297] nix-daemon[852]: reaped child process 959, status = succeeded worker1 # [ 51.194472] nix-daemon[852]: accepted connection from pid 975, user nix-grpc-daemon (trusted) worker1 # [ 51.210701] nix-daemon[852]: reaped child process 978, status = succeeded lb # [ 51.197183] niks3-server[1053]: 2026/09/22 10:47:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.232496] nix-grpc-daemon[864]: time=2026-09-22T10:47:08.354Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 51.236380] nix-grpc-daemon[864]: time=2026-09-22T10:47:08.356Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 51.228184] niks3-server[1053]: 2026/09/22 10:47:08 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 51.234743] niks3-server[1053]: 2026/09/22 10:47:08 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 51.238734] niks3-server[1053]: 2026/09/22 10:47:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 51.241240] niks3-server[1053]: 2026/09/22 10:47:08 INFO Signed narinfos id=6 count=1 worker1 # [ 51.267148] nix-grpc-daemon[864]: time=2026-09-22T10:47:08.389Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.247877] niks3-server[1053]: 2026/09/22 10:47:08 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 51.256335] niks3-server[1053]: 2026/09/22 10:47:08 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 51.260205] niks3-server[1053]: 2026/09/22 10:47:08 INFO Completed upload id=6 worker1 # [ 51.284328] nix-grpc-daemon[864]: time=2026-09-22T10:47:08.406Z level=INFO msg="Upload complete. (241ms)" lb # [ 51.262421] niks3-server[1053]: 2026/09/22 10:47:08 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 51.288493] nix-grpc-daemon[784]: ts=2026-09-22T10:47:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 51.296357] nix-daemon[852]: reaped child process 957, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.53 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.07 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 worker2 # [ 52.506790] nix-grpc-daemon[786]: ts=2026-09-22T10:47:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34952 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 52.514615] nix-grpc-daemon[786]: ts=2026-09-22T10:47:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 52.538719] nix-grpc-daemon[786]: ts=2026-09-22T10:47:09Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.26 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.14 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 53.283884] nix-grpc-daemon[786]: ts=2026-09-22T10:47:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34952 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker1 # [ 53.322666] nix-grpc-daemon[784]: ts=2026-09-22T10:47:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 53.332525] nix-grpc-daemon[864]: time=2026-09-22T10:47:10.454Z level=INFO msg="All 2 paths already cached" worker2 # [ 53.314269] nix-grpc-daemon[786]: ts=2026-09-22T10:47:10Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 53.316286] nix-grpc-daemon[786]: ts=2026-09-22T10:47:10Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 53.389472] nix-grpc-daemon[784]: ts=2026-09-22T10:47:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 53.403321] nix-grpc-daemon[784]: ts=2026-09-22T10:47:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 53.417203] nix-grpc-daemon[864]: time=2026-09-22T10:47:10.539Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 53.426680] nix-grpc-daemon[784]: ts=2026-09-22T10:47:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 53.439553] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 53.622796] nix-daemon[852]: accepted connection from pid 995, user nix-grpc-daemon (trusted) worker1 # [ 53.637399] nix-daemon[852]: reaped child process 998, status = succeeded worker1 # [ 53.779791] nix-daemon[852]: accepted connection from pid 1000, user nix-grpc-daemon (trusted) worker1 # [ 53.794603] nix-daemon[852]: reaped child process 1003, status = succeeded lb # [ 53.782615] niks3-server[1053]: 2026/09/22 10:47:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.815382] nix-grpc-daemon[864]: time=2026-09-22T10:47:10.937Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 53.817568] nix-grpc-daemon[864]: time=2026-09-22T10:47:10.939Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 53.810996] niks3-server[1053]: 2026/09/22 10:47:10 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 53.822970] niks3-server[1053]: 2026/09/22 10:47:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 53.852459] nix-grpc-daemon[864]: time=2026-09-22T10:47:10.974Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.828783] niks3-server[1053]: 2026/09/22 10:47:10 INFO Signed narinfos id=7 count=1 lb # [ 53.834538] niks3-server[1053]: 2026/09/22 10:47:10 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 53.845516] niks3-server[1053]: 2026/09/22 10:47:10 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 53.850594] niks3-server[1053]: 2026/09/22 10:47:10 INFO Completed upload id=7 worker1 # [ 53.877558] nix-grpc-daemon[864]: time=2026-09-22T10:47:10.999Z level=INFO msg="Upload complete. (424ms)" lb # [ 53.856075] niks3-server[1053]: 2026/09/22 10:47:10 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 53.880573] nix-grpc-daemon[784]: ts=2026-09-22T10:47:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 53.885432] nix-grpc-daemon[784]: ts=2026-09-22T10:47:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 53.894340] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 53.899872] nix-daemon[852]: reaped child process 993, status = succeeded client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... worker1 # [ 53.906559] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 54.519443] nix-daemon[852]: reaped child process 1007, status = succeeded worker1 # [ 54.669627] nix-daemon[852]: accepted connection from pid 1023, user nix-grpc-daemon (trusted) worker1 # [ 54.685089] nix-daemon[852]: reaped child process 1026, status = succeeded lb # [ 54.674258] niks3-server[1053]: 2026/09/22 10:47:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.707628] nix-grpc-daemon[864]: time=2026-09-22T10:47:11.829Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 54.710295] nix-grpc-daemon[864]: time=2026-09-22T10:47:11.831Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 54.714704] niks3-server[1053]: 2026/09/22 10:47:11 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 54.722801] niks3-server[1053]: 2026/09/22 10:47:11 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 54.735170] niks3-server[1053]: 2026/09/22 10:47:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 54.740768] niks3-server[1053]: 2026/09/22 10:47:11 INFO Signed narinfos id=8 count=1 worker1 # [ 54.768041] nix-grpc-daemon[864]: time=2026-09-22T10:47:11.890Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.747568] niks3-server[1053]: 2026/09/22 10:47:11 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 54.758913] niks3-server[1053]: 2026/09/22 10:47:11 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 54.764340] niks3-server[1053]: 2026/09/22 10:47:11 INFO Completed upload id=8 worker1 # [ 54.789773] nix-grpc-daemon[864]: time=2026-09-22T10:47:11.912Z level=INFO msg="Upload complete. (278ms)" lb # [ 54.766463] niks3-server[1053]: 2026/09/22 10:47:11 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 54.792801] nix-grpc-daemon[784]: ts=2026-09-22T10:47:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 54.800453] nix-daemon[852]: reaped child process 1005, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.71 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.12 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&ca-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ca.pem' /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # [ 55.321689] nix-grpc-daemon[784]: ts=2026-09-22T10:47:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:36420 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # [ 55.365546] nix-grpc-daemon[784]: ts=2026-09-22T10:47:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:36420 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&ca-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ca.pem' /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&ca-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ca.pem' /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # [ 55.493551] nix-grpc-daemon[786]: ts=2026-09-22T10:47:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:53510 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a client # /nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # [ 55.537324] nix-grpc-daemon[786]: ts=2026-09-22T10:47:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:53510 worker2 # [ 55.542970] nix-grpc-daemon[786]: copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... worker2 # [ 55.560794] nix-grpc-daemon[786]: copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... worker2 # [ 55.569680] nix-grpc-daemon[786]: copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&ca-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ca.pem' /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds) client: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/887" client # removing stale temporary roots file "/nix/var/nix/temproots/866" client # removing stale temporary roots file "/nix/var/nix/temproots/818" client # removing stale temporary roots file "/nix/var/nix/temproots/854" client # removing stale temporary roots file "/nix/var/nix/temproots/833" client # removing stale temporary roots file "/nix/var/nix/temproots/874" client # deleting specified paths... client # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker2 # [ 56.000612] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34952 worker1 # [ 56.034619] nix-grpc-daemon[784]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 56.042243] nix-grpc-daemon[784]: copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... worker1 # [ 56.063171] nix-grpc-daemon[864]: time=2026-09-22T10:47:13.184Z level=INFO msg="All 1 paths already cached" worker1 # [ 56.069951] nix-grpc-daemon[784]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:35784 worker2 # [ 56.046210] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34952 client # copying 1 paths... worker1 # [ 56.087753] nix-grpc-daemon[784]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:35784 client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'grpc://lb:50051'... worker2 # [ 56.072600] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 56.076642] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=0 paths=1 nar_bytes_out=232 client: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.55 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 1.07 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup client # [ 56.215551] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 73072807f88946daa331a42e32085deb client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup worker1 # [ 56.410894] nix-grpc-daemon[784]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35784 client # [ 56.402303] nix[937]: don't know how to build these paths: client # [ 56.403185] nix[937]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 56.393743] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 56.396608] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 56.438945] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 56.453107] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 client # [ 56.479321] nix[937]: copying 1 paths to 'lb:50051'... worker2 # [ 56.462622] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 client # [ 56.482141] nix[937]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 56.473657] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 56.485637] nix-grpc-daemon[786]: ts=2026-09-22T10:47:13Z level=info event=niks3_push_started pid=927 worker2 # [ 56.728149] nix-grpc-daemon[927]: time=2026-09-22T10:47:13.902Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 56.903803] nix-daemon[873]: accepted connection from pid 939, user nix-grpc-daemon (trusted) worker2 # [ 56.919702] nix-daemon[873]: reaped child process 942, status = succeeded worker2 # [ 57.069266] nix-daemon[873]: accepted connection from pid 945, user nix-grpc-daemon (trusted) worker2 # [ 57.080418] nix-daemon[873]: reaped child process 948, status = succeeded lb # [ 57.100593] niks3-server[1053]: 2026/09/22 10:47:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 57.116899] nix-grpc-daemon[927]: time=2026-09-22T10:47:14.294Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 57.119686] nix-grpc-daemon[927]: time=2026-09-22T10:47:14.297Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 57.170566] niks3-server[1053]: 2026/09/22 10:47:14 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 57.175636] niks3-server[1053]: 2026/09/22 10:47:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker2 # [ 57.174080] nix-grpc-daemon[927]: time=2026-09-22T10:47:14.351Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.180298] niks3-server[1053]: 2026/09/22 10:47:14 INFO Signed narinfos id=9 count=1 lb # [ 57.189976] niks3-server[1053]: 2026/09/22 10:47:14 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 57.196111] niks3-server[1053]: 2026/09/22 10:47:14 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 57.202491] niks3-server[1053]: 2026/09/22 10:47:14 INFO Completed upload id=9 worker2 # [ 57.195983] nix-grpc-daemon[927]: time=2026-09-22T10:47:14.373Z level=INFO msg="Upload complete. (441ms)" lb # [ 57.203668] niks3-server[1053]: 2026/09/22 10:47:14 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 57.198917] nix-grpc-daemon[786]: ts=2026-09-22T10:47:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 57.202219] nix-grpc-daemon[786]: ts=2026-09-22T10:47:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 57.208069] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 57.214979] nix-daemon[873]: reaped child process 925, status = succeeded client # [ 57.234838] nix[937]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... worker2 # [ 57.218497] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # [ 57.270812] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 29d60e79a0534818a87299d9afa8b847 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.06 seconds) worker1 # [ 57.510850] nix-grpc-daemon[784]: ts=2026-09-22T10:47:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35784 client # [ 57.505428] nix[953]: don't know how to build these paths: client # [ 57.506280] nix[953]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 57.501726] nix-grpc-daemon[786]: ts=2026-09-22T10:47:14Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 57.508841] nix-grpc-daemon[786]: ts=2026-09-22T10:47:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 client # [ 57.531452] nix[953]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 lb # [ 58.679575] envoy[932]: conn peer=[2001:db8:1::1]:38014 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=4393 ms=6333 lb # [ 58.681151] envoy[932]: conn peer=[2001:db8:1::1]:38020 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=48 lb # [ 58.682583] envoy[932]: conn peer=[2001:db8:1::1]:34788 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4182 tx=1895 ms=1491 lb # [ 58.683966] envoy[932]: conn peer=[2001:db8:1::1]:34790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=969 tx=2139 ms=133 lb # [ 58.685351] envoy[932]: conn peer=[2001:db8:1::1]:34800 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=409 ms=62 client: (finished: must succeed: sleep 2, in 2.03 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 60.634500] nix-daemon[873]: reaped child process 952, status = succeeded worker2 # [ 60.778214] nix-daemon[873]: accepted connection from pid 984, user nix-grpc-daemon (trusted) worker2 # [ 60.790714] nix-daemon[873]: reaped child process 987, status = succeeded lb # [ 60.813177] niks3-server[1053]: 2026/09/22 10:47:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.955837] nix-grpc-daemon[927]: time=2026-09-22T10:47:18.132Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 60.957805] nix-grpc-daemon[927]: time=2026-09-22T10:47:18.132Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 60.986036] niks3-server[1053]: 2026/09/22 10:47:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 60.989030] niks3-server[1053]: 2026/09/22 10:47:17 INFO Signed narinfos id=10 count=1 worker2 # [ 60.982781] nix-grpc-daemon[927]: time=2026-09-22T10:47:18.159Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.994593] niks3-server[1053]: 2026/09/22 10:47:17 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 61.000986] niks3-server[1053]: 2026/09/22 10:47:17 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 61.008931] niks3-server[1053]: 2026/09/22 10:47:17 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 61.026075] niks3-server[1053]: 2026/09/22 10:47:17 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 61.039325] niks3-server[1053]: 2026/09/22 10:47:17 INFO Completed upload id=10 worker2 # [ 61.033370] nix-grpc-daemon[927]: time=2026-09-22T10:47:18.210Z level=INFO msg="Upload complete. (403ms)" lb # [ 61.050101] niks3-server[1053]: 2026/09/22 10:47:17 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 61.043315] nix-grpc-daemon[786]: ts=2026-09-22T10:47:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 61.051226] nix-grpc-daemon[786]: ts=2026-09-22T10:47:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 61.063782] nix-daemon[873]: reaped child process 950, status = succeeded client # [ 61.109613] systemd[1]: dedup1.service: Deactivated successfully. client # [ 61.114171] systemd[1]: dedup1.service: Consumed 122ms CPU time over 4.896s wall clock time, 41.5M memory peak, 7.2K incoming IP traffic, 8.5K outgoing IP traffic. client # [ 61.119763] systemd[1]: dedup2.service: Deactivated successfully. client # [ 61.122877] systemd[1]: dedup2.service: Consumed 141ms CPU time over 3.851s wall clock time, 35.2M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.10 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.82 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share client # [ 62.045966] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 15afaff7918143b082044079448cf4c5 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share, in 0.07 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share client # [ 62.243717] nix[993]: don't know how to build these paths: client # [ 62.244546] nix[993]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 62.225796] nix-grpc-daemon[786]: ts=2026-09-22T10:47:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 62.236539] nix-grpc-daemon[786]: ts=2026-09-22T10:47:19Z level=debug event=want client=6 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 62.240797] nix-grpc-daemon[786]: ts=2026-09-22T10:47:19Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 62.310323] nix-grpc-daemon[784]: ts=2026-09-22T10:47:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 62.317599] nix-grpc-daemon[784]: ts=2026-09-22T10:47:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 client # [ 62.310197] nix[993]: copying 1 paths to 'lb:50051'... client # [ 62.310943] nix[993]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker1 # [ 62.323385] nix-grpc-daemon[784]: ts=2026-09-22T10:47:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 62.328493] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 62.483046] nix-daemon[852]: accepted connection from pid 1052, user nix-grpc-daemon (trusted) worker1 # [ 62.497265] nix-daemon[852]: reaped child process 1055, status = succeeded worker1 # [ 62.636602] nix-daemon[852]: accepted connection from pid 1057, user nix-grpc-daemon (trusted) worker1 # [ 62.650426] nix-daemon[852]: reaped child process 1060, status = succeeded lb # [ 62.637562] niks3-server[1053]: 2026/09/22 10:47:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 62.666886] nix-grpc-daemon[864]: time=2026-09-22T10:47:19.788Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 62.668201] nix-grpc-daemon[864]: time=2026-09-22T10:47:19.788Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 62.653178] niks3-server[1053]: 2026/09/22 10:47:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 62.679751] nix-grpc-daemon[864]: time=2026-09-22T10:47:19.801Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.656192] niks3-server[1053]: 2026/09/22 10:47:19 INFO Signed narinfos id=11 count=1 lb # [ 62.658504] niks3-server[1053]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 62.661807] niks3-server[1053]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 62.665900] niks3-server[1053]: 2026/09/22 10:47:19 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 62.669059] niks3-server[1053]: 2026/09/22 10:47:19 INFO Completed upload id=11 worker1 # [ 62.692976] nix-grpc-daemon[864]: time=2026-09-22T10:47:19.815Z level=INFO msg="Upload complete. (357ms)" worker1 # [ 62.695194] nix-grpc-daemon[784]: ts=2026-09-22T10:47:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 62.672362] niks3-server[1053]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker1 # [ 62.698807] nix-grpc-daemon[784]: ts=2026-09-22T10:47:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 62.706189] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 62.708436] nix-daemon[852]: reaped child process 1050, status = succeeded worker1 # [ 62.713500] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # [ 62.700413] nix[993]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 63.120670] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 4a3508a9ac7b4ed3ae59268306b2bcff client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag share, in 1.08 seconds) client # [ 63.342363] nix[1009]: don't know how to build these paths: client # [ 63.343265] nix[1009]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 63.323358] nix-grpc-daemon[786]: ts=2026-09-22T10:47:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 63.334420] nix-grpc-daemon[786]: ts=2026-09-22T10:47:20Z level=debug event=want client=7 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 63.368818] nix-grpc-daemon[784]: ts=2026-09-22T10:47:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 client # [ 63.361969] nix[1009]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 66.410713] systemd[1]: share1.service: Sent signal SIGINT to main process 993 (nix) on client request. client # [ 66.417878] nix[993]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 66.423351] nix[993]: [mutex.cc : 2506] RAW: thread should hold at least a read lock on Mutex 0x7ce4d4dfccb8 client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 66.446468] systemd-coredump[1024]: Process 993 (nix) of user 0 terminated abnormally with signal 6/ABRT, processing... client # [ 66.464097] systemd[1]: Created slice Slice /system/systemd-coredump. client # [ 66.469512] systemd[1]: Started Process Core Dump (PID 1024/UID 0). client # [ 68.291043] systemd-coredump[1029]: Cannot store coredump of 993 (nix): No space left on device client # [ 68.384109] systemd-coredump[1029]: Process 993 (nix) of user 0 terminated abnormally without generating a coredump. client # [ 68.398816] systemd[1]: systemd-coredump@0-1-1024_1025-0.service: Deactivated successfully. client # [ 68.405359] systemd[1]: systemd-coredump@0-1-1024_1025-0.service: Consumed 1.556s CPU time over 1.923s wall clock time, 969M memory peak, 931M written to disk. client # [ 68.417578] systemd[1]: share1.service: Main process exited, code=dumped, status=6/ABRT client # [ 68.418973] systemd[1]: share1.service: Failed with result 'core-dump'. client # [ 68.420792] systemd[1]: share1.service: Consumed 265ms CPU time over 6.371s wall clock time, 43.5M memory peak, 4K written to disk, 6.2K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 2.15 seconds) lb # [ 68.679503] envoy[932]: conn peer=[2001:db8:1::1]:34810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3011 tx=1563 ms=4675 lb # [ 68.683257] envoy[932]: conn peer=[2001:db8:1::1]:34826 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1197 ms=3582 lb # [ 68.686754] envoy[932]: conn peer=[2001:db8:1::1]:34834 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2982 tx=787 ms=6158 client: waiting for success: ! systemctl is-active share2 worker1 # [ 68.934335] nix-daemon[852]: reaped child process 1064, status = succeeded worker1 # [ 69.086325] nix-daemon[852]: accepted connection from pid 1098, user nix-grpc-daemon (trusted) worker1 # [ 69.100953] nix-daemon[852]: reaped child process 1101, status = succeeded lb # [ 69.091864] niks3-server[1053]: 2026/09/22 10:47:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.124220] nix-grpc-daemon[864]: time=2026-09-22T10:47:26.246Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 69.127067] nix-grpc-daemon[864]: time=2026-09-22T10:47:26.248Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 69.132219] niks3-server[1053]: 2026/09/22 10:47:25 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 69.139633] niks3-server[1053]: 2026/09/22 10:47:25 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 69.153744] niks3-server[1053]: 2026/09/22 10:47:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 69.161413] niks3-server[1053]: 2026/09/22 10:47:26 INFO Signed narinfos id=12 count=1 worker1 # [ 69.188473] nix-grpc-daemon[864]: time=2026-09-22T10:47:26.310Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.164383] niks3-server[1053]: 2026/09/22 10:47:26 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 69.174680] niks3-server[1053]: 2026/09/22 10:47:26 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 69.178450] niks3-server[1053]: 2026/09/22 10:47:26 INFO Completed upload id=12 worker1 # [ 69.202465] nix-grpc-daemon[864]: time=2026-09-22T10:47:26.324Z level=INFO msg="Upload complete. (276ms)" lb # [ 69.181125] niks3-server[1053]: 2026/09/22 10:47:26 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker1 # [ 69.207645] nix-grpc-daemon[784]: ts=2026-09-22T10:47:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=6 outputs=1 worker1 # [ 69.213530] nix-grpc-daemon[784]: ts=2026-09-22T10:47:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=6 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=6 outputs=1 worker1 # [ 69.226212] nix-daemon[852]: reaped child process 1062, status = succeeded client # [ 69.277164] systemd[1]: share2.service: Deactivated successfully. client # [ 69.281335] systemd[1]: share2.service: Consumed 123ms CPU time over 6.159s wall clock time, 35.4M memory peak, 4K written to disk, 6.1K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.11 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.04 seconds) (finished: subtest: the first client leaving does not fail the second, in 7.98 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 70.133221] systemd[1]: Started Nix Daemon. client # [ 70.284779] nix-daemon[1070]: accepted connection from pid 1067, user root (trusted) worker1 # [ 70.484526] nix-grpc-daemon[784]: ts=2026-09-22T10:47:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:35784 worker2 # [ 70.458670] nix-grpc-daemon[786]: ts=2026-09-22T10:47:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 70.475124] nix-grpc-daemon[786]: ts=2026-09-22T10:47:27Z level=debug event=want client=8 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 70.480644] nix-grpc-daemon[786]: ts=2026-09-22T10:47:27Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 70.520195] nix-grpc-daemon[786]: ts=2026-09-22T10:47:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 70.533837] nix-grpc-daemon[786]: ts=2026-09-22T10:47:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 70.545970] nix-grpc-daemon[786]: ts=2026-09-22T10:47:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 70.558582] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 70.761154] nix-daemon[873]: accepted connection from pid 1022, user nix-grpc-daemon (trusted) worker2 # [ 70.776443] nix-daemon[873]: reaped child process 1025, status = succeeded worker2 # [ 70.937102] nix-daemon[873]: accepted connection from pid 1027, user nix-grpc-daemon (trusted) worker2 # [ 70.952223] nix-daemon[873]: reaped child process 1030, status = succeeded lb # [ 70.975711] niks3-server[1053]: 2026/09/22 10:47:27 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 70.979968] nix-grpc-daemon[927]: time=2026-09-22T10:47:28.157Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 70.982172] nix-grpc-daemon[927]: time=2026-09-22T10:47:28.158Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 71.009158] niks3-server[1053]: 2026/09/22 10:47:27 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 71.018560] niks3-server[1053]: 2026/09/22 10:47:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker2 # [ 71.017652] nix-grpc-daemon[927]: time=2026-09-22T10:47:28.194Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.023828] niks3-server[1053]: 2026/09/22 10:47:27 INFO Signed narinfos id=13 count=1 lb # [ 71.030320] niks3-server[1053]: 2026/09/22 10:47:27 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 71.039660] niks3-server[1053]: 2026/09/22 10:47:27 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete worker2 # [ 71.039628] nix-grpc-daemon[927]: time=2026-09-22T10:47:28.217Z level=INFO msg="Upload complete. (468ms)" lb # [ 71.046537] niks3-server[1053]: 2026/09/22 10:47:27 INFO Completed upload id=13 worker2 # [ 71.042401] nix-grpc-daemon[786]: ts=2026-09-22T10:47:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 71.051386] niks3-server[1053]: 2026/09/22 10:47:27 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker2 # [ 71.047945] nix-grpc-daemon[786]: ts=2026-09-22T10:47:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 71.058066] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 71.064162] nix-daemon[873]: reaped child process 1020, status = succeeded worker2 # [ 71.068529] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 71.894917] nix-daemon[873]: reaped child process 1034, status = succeeded worker2 # [ 72.052971] nix-daemon[873]: accepted connection from pid 1050, user nix-grpc-daemon (trusted) worker2 # [ 72.065907] nix-daemon[873]: reaped child process 1053, status = succeeded lb # [ 72.088859] niks3-server[1053]: 2026/09/22 10:47:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 72.090560] nix-grpc-daemon[927]: time=2026-09-22T10:47:29.267Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 72.092884] nix-grpc-daemon[927]: time=2026-09-22T10:47:29.269Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 72.117298] niks3-server[1053]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 72.133144] niks3-server[1053]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 72.144880] niks3-server[1053]: 2026/09/22 10:47:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 72.149418] niks3-server[1053]: 2026/09/22 10:47:28 INFO Signed narinfos id=14 count=1 worker2 # [ 72.146292] nix-grpc-daemon[927]: time=2026-09-22T10:47:29.323Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.154320] niks3-server[1053]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 72.164932] niks3-server[1053]: 2026/09/22 10:47:29 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 72.172334] niks3-server[1053]: 2026/09/22 10:47:29 INFO Completed upload id=14 worker2 # [ 72.166298] nix-grpc-daemon[927]: time=2026-09-22T10:47:29.343Z level=INFO msg="Upload complete. (290ms)" lb # [ 72.174643] niks3-server[1053]: 2026/09/22 10:47:29 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker2 # [ 72.172980] nix-grpc-daemon[786]: ts=2026-09-22T10:47:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=7 outputs=1 worker1 # [ 72.208856] nix-grpc-daemon[784]: ts=2026-09-22T10:47:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:35784 worker2 # [ 72.187281] nix-daemon[873]: reaped child process 1032, status = succeeded worker1 # [ 72.217756] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker1 # [ 72.240373] nix-grpc-daemon[784]: ts=2026-09-22T10:47:29Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 72.246094] nix-grpc-daemon[784]: ts=2026-09-22T10:47:29Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 72.489687] nix-grpc-daemon[786]: ts=2026-09-22T10:47:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 72.492228] nix-grpc-daemon[786]: ts=2026-09-22T10:47:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 72.498255] nix-grpc-daemon[927]: time=2026-09-22T10:47:29.675Z level=INFO msg="All 1 paths already cached" worker2 # [ 72.508834] nix-grpc-daemon[786]: ts=2026-09-22T10:47:29Z level=debug event=want client=9 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 72.510811] nix-grpc-daemon[786]: ts=2026-09-22T10:47:29Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 72.513772] nix-grpc-daemon[786]: ts=2026-09-22T10:47:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 72.521562] nix-grpc-daemon[786]: ts=2026-09-22T10:47:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 72.530445] nix-grpc-daemon[927]: time=2026-09-22T10:47:29.707Z level=INFO msg="All 1 paths already cached" worker2 # [ 72.534870] nix-grpc-daemon[786]: ts=2026-09-22T10:47:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 72.538483] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 72.683737] nix-daemon[873]: accepted connection from pid 1059, user nix-grpc-daemon (trusted) worker2 # [ 72.697189] nix-daemon[873]: reaped child process 1062, status = succeeded worker2 # [ 72.846698] nix-daemon[873]: accepted connection from pid 1064, user nix-grpc-daemon (trusted) worker2 # [ 72.859451] nix-daemon[873]: reaped child process 1067, status = succeeded lb # [ 72.880822] niks3-server[1053]: 2026/09/22 10:47:29 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 72.879918] nix-grpc-daemon[927]: time=2026-09-22T10:47:30.057Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 72.881277] nix-grpc-daemon[927]: time=2026-09-22T10:47:30.057Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 72.905883] niks3-server[1053]: 2026/09/22 10:47:29 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 72.915138] niks3-server[1053]: 2026/09/22 10:47:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 72.921236] niks3-server[1053]: 2026/09/22 10:47:29 INFO Signed narinfos id=15 count=1 worker2 # [ 72.918608] nix-grpc-daemon[927]: time=2026-09-22T10:47:30.095Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.926947] niks3-server[1053]: 2026/09/22 10:47:29 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 72.937712] niks3-server[1053]: 2026/09/22 10:47:29 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete worker2 # [ 72.935975] nix-grpc-daemon[927]: time=2026-09-22T10:47:30.113Z level=INFO msg="Upload complete. (390ms)" lb # [ 72.942780] niks3-server[1053]: 2026/09/22 10:47:29 INFO Completed upload id=15 worker2 # [ 72.937954] nix-grpc-daemon[786]: ts=2026-09-22T10:47:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 72.947560] niks3-server[1053]: 2026/09/22 10:47:29 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker2 # [ 72.944446] nix-grpc-daemon[786]: ts=2026-09-22T10:47:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 72.948628] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 72.950974] nix-daemon[873]: reaped child process 1057, status = succeeded worker2 # [ 72.956384] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 73.778503] nix-daemon[873]: reaped child process 1071, status = succeeded worker2 # [ 73.934670] nix-daemon[873]: accepted connection from pid 1087, user nix-grpc-daemon (trusted) worker2 # [ 73.945378] nix-daemon[873]: reaped child process 1090, status = succeeded lb # [ 73.969397] niks3-server[1053]: 2026/09/22 10:47:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 73.969897] nix-grpc-daemon[927]: time=2026-09-22T10:47:31.147Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 73.971725] nix-grpc-daemon[927]: time=2026-09-22T10:47:31.148Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 73.998320] niks3-server[1053]: 2026/09/22 10:47:30 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 74.011927] niks3-server[1053]: 2026/09/22 10:47:30 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 74.022860] niks3-server[1053]: 2026/09/22 10:47:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker2 # [ 74.020234] nix-grpc-daemon[927]: time=2026-09-22T10:47:31.197Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.026730] niks3-server[1053]: 2026/09/22 10:47:30 INFO Signed narinfos id=16 count=1 lb # [ 74.033147] niks3-server[1053]: 2026/09/22 10:47:30 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 74.044127] niks3-server[1053]: 2026/09/22 10:47:30 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 74.048945] niks3-server[1053]: 2026/09/22 10:47:30 INFO Completed upload id=16 lb # [ 74.051250] niks3-server[1053]: 2026/09/22 10:47:30 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker2 # [ 74.043858] nix-grpc-daemon[927]: time=2026-09-22T10:47:31.220Z level=INFO msg="Upload complete. (277ms)" worker2 # [ 74.049685] nix-grpc-daemon[786]: ts=2026-09-22T10:47:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=8 outputs=1 worker2 # [ 74.062404] nix-daemon[873]: reaped child process 1069, status = succeeded worker2 # [ 74.094341] nix-grpc-daemon[786]: ts=2026-09-22T10:47:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 74.112129] nix-grpc-daemon[786]: ts=2026-09-22T10:47:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 74.116581] nix-grpc-daemon[786]: ts=2026-09-22T10:47:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 74.412046] nix-grpc-daemon[784]: ts=2026-09-22T10:47:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 74.415302] nix-grpc-daemon[784]: ts=2026-09-22T10:47:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 74.421481] nix-grpc-daemon[864]: time=2026-09-22T10:47:31.543Z level=INFO msg="All 1 paths already cached" worker2 # [ 74.403334] nix-grpc-daemon[786]: ts=2026-09-22T10:47:31Z level=debug event=want client=10 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 74.408298] nix-grpc-daemon[786]: ts=2026-09-22T10:47:31Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 74.413244] nix-grpc-daemon[786]: ts=2026-09-22T10:47:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 74.421782] nix-grpc-daemon[786]: ts=2026-09-22T10:47:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 74.431160] nix-grpc-daemon[927]: time=2026-09-22T10:47:31.608Z level=INFO msg="All 2 paths already cached" worker2 # [ 74.437609] nix-grpc-daemon[786]: ts=2026-09-22T10:47:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 74.447157] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 74.604586] nix-daemon[873]: accepted connection from pid 1096, user nix-grpc-daemon (trusted) worker2 # [ 74.617503] nix-daemon[873]: reaped child process 1099, status = succeeded worker2 # [ 74.767534] nix-daemon[873]: accepted connection from pid 1101, user nix-grpc-daemon (trusted) worker2 # [ 74.780430] nix-daemon[873]: reaped child process 1104, status = succeeded lb # [ 74.800189] niks3-server[1053]: 2026/09/22 10:47:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 74.802550] nix-grpc-daemon[927]: time=2026-09-22T10:47:31.979Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 74.803964] nix-grpc-daemon[927]: time=2026-09-22T10:47:31.979Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 74.823542] niks3-server[1053]: 2026/09/22 10:47:31 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 74.835873] niks3-server[1053]: 2026/09/22 10:47:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 74.842447] niks3-server[1053]: 2026/09/22 10:47:31 INFO Signed narinfos id=17 count=1 worker2 # [ 74.839299] nix-grpc-daemon[927]: time=2026-09-22T10:47:32.016Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.847145] niks3-server[1053]: 2026/09/22 10:47:31 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 74.858304] niks3-server[1053]: 2026/09/22 10:47:31 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete worker2 # [ 74.857931] nix-grpc-daemon[927]: time=2026-09-22T10:47:32.035Z level=INFO msg="Upload complete. (399ms)" lb # [ 74.864312] niks3-server[1053]: 2026/09/22 10:47:31 INFO Completed upload id=17 worker2 # [ 74.859948] nix-grpc-daemon[786]: ts=2026-09-22T10:47:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 74.868947] niks3-server[1053]: 2026/09/22 10:47:31 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker2 # [ 74.866070] nix-daemon[873]: reaped child process 1094, status = succeeded worker2 # [ 74.867761] nix-grpc-daemon[786]: ts=2026-09-22T10:47:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 74.871572] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 74.876992] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 76.100547] nix-daemon[873]: reaped child process 1108, status = succeeded worker2 # [ 76.227286] nix-daemon[873]: accepted connection from pid 1124, user nix-grpc-daemon (trusted) worker2 # [ 76.239334] nix-daemon[873]: reaped child process 1127, status = succeeded lb # [ 76.256965] niks3-server[1053]: 2026/09/22 10:47:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 76.259986] nix-grpc-daemon[927]: time=2026-09-22T10:47:33.437Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 76.261547] nix-grpc-daemon[927]: time=2026-09-22T10:47:33.438Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 76.297145] niks3-server[1053]: 2026/09/22 10:47:33 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 76.302230] niks3-server[1053]: 2026/09/22 10:47:33 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 76.316473] niks3-server[1053]: 2026/09/22 10:47:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 76.322467] niks3-server[1053]: 2026/09/22 10:47:33 INFO Signed narinfos id=18 count=1 worker2 # [ 76.318727] nix-grpc-daemon[927]: time=2026-09-22T10:47:33.495Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.326551] niks3-server[1053]: 2026/09/22 10:47:33 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 76.336796] niks3-server[1053]: 2026/09/22 10:47:33 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 76.342784] niks3-server[1053]: 2026/09/22 10:47:33 INFO Completed upload id=18 worker2 # [ 76.336319] nix-grpc-daemon[927]: time=2026-09-22T10:47:33.513Z level=INFO msg="Upload complete. (250ms)" lb # [ 76.345361] niks3-server[1053]: 2026/09/22 10:47:33 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker2 # [ 76.343720] nix-grpc-daemon[786]: ts=2026-09-22T10:47:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=9 outputs=1 worker2 # [ 76.350806] nix-grpc-daemon[786]: ts=2026-09-22T10:47:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 76.360270] nix-grpc-daemon[786]: ts=2026-09-22T10:47:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 76.363274] nix-grpc-daemon[786]: ts=2026-09-22T10:47:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 76.368513] nix-daemon[873]: reaped child process 1106, status = succeeded client # [ 76.469487] nix-daemon[1070]: reaped child process 1072, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.50 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.58 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.36 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.16 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.19 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 77.456262] nix-daemon[1070]: accepted connection from pid 1152, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 77.623105] nix-grpc-daemon[786]: ts=2026-09-22T10:47:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34952 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 77.659332] nix-grpc-daemon[784]: ts=2026-09-22T10:47:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 77.813338] nix-daemon[852]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker1 # [ 77.824806] nix-daemon[852]: reaped child process 1112, status = succeeded lb # [ 77.811655] niks3-server[1053]: 2026/09/22 10:47:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 77.843549] nix-grpc-daemon[864]: time=2026-09-22T10:47:34.965Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 77.844919] nix-grpc-daemon[864]: time=2026-09-22T10:47:34.965Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 77.835602] niks3-server[1053]: 2026/09/22 10:47:34 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 77.846893] niks3-server[1053]: 2026/09/22 10:47:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign worker1 # [ 77.875355] nix-grpc-daemon[864]: time=2026-09-22T10:47:34.997Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.851459] niks3-server[1053]: 2026/09/22 10:47:34 INFO Signed narinfos id=19 count=1 lb # [ 77.862090] niks3-server[1053]: 2026/09/22 10:47:34 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete worker1 # [ 77.894282] nix-grpc-daemon[864]: time=2026-09-22T10:47:35.016Z level=INFO msg="Upload complete. (236ms)" lb # [ 77.870890] niks3-server[1053]: 2026/09/22 10:47:34 INFO Completed upload id=19 lb # [ 77.874450] niks3-server[1053]: 2026/09/22 10:47:34 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 77.878460] niks3-server[1053]: 2026/09/22 10:47:34 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 77.881312] nix-grpc-daemon[786]: ts=2026-09-22T10:47:35Z level=debug event=want client=11 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 77.883394] nix-grpc-daemon[786]: ts=2026-09-22T10:47:35Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 77.955414] nix-grpc-daemon[784]: ts=2026-09-22T10:47:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 77.967794] nix-grpc-daemon[784]: ts=2026-09-22T10:47:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 77.983578] nix-grpc-daemon[784]: ts=2026-09-22T10:47:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 77.993343] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 78.164968] nix-daemon[852]: accepted connection from pid 1116, user nix-grpc-daemon (trusted) worker1 # [ 78.178261] nix-daemon[852]: reaped child process 1119, status = succeeded worker1 # [ 78.342323] nix-daemon[852]: accepted connection from pid 1121, user nix-grpc-daemon (trusted) worker1 # [ 78.355146] nix-daemon[852]: reaped child process 1124, status = succeeded lb # [ 78.346740] niks3-server[1053]: 2026/09/22 10:47:35 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 78.358708] niks3-server[1053]: 2026/09/22 10:47:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.390801] nix-grpc-daemon[864]: time=2026-09-22T10:47:35.512Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 78.392232] nix-grpc-daemon[864]: time=2026-09-22T10:47:35.512Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker1 # [ 78.393809] nix-grpc-daemon[864]: time=2026-09-22T10:47:35.512Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 78.387404] niks3-server[1053]: 2026/09/22 10:47:35 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 78.398907] niks3-server[1053]: 2026/09/22 10:47:35 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 78.414764] niks3-server[1053]: 2026/09/22 10:47:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 78.418885] niks3-server[1053]: 2026/09/22 10:47:35 INFO Signed narinfos id=20 count=1 lb # [ 78.423309] niks3-server[1053]: 2026/09/22 10:47:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 78.426352] niks3-server[1053]: 2026/09/22 10:47:35 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 78.428826] niks3-server[1053]: 2026/09/22 10:47:35 INFO Signed narinfos id=21 count=2 lb # [ 78.430650] niks3-server[1053]: 2026/09/22 10:47:35 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls worker1 # [ 78.453831] nix-grpc-daemon[864]: time=2026-09-22T10:47:35.575Z level=INFO msg="Uploading 3 narinfos" lb # [ 78.441068] niks3-server[1053]: 2026/09/22 10:47:35 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 78.446591] niks3-server[1053]: 2026/09/22 10:47:35 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 78.448044] niks3-server[1053]: 2026/09/22 10:47:35 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 78.450994] niks3-server[1053]: 2026/09/22 10:47:35 INFO Completed upload id=20 lb # [ 78.452777] niks3-server[1053]: 2026/09/22 10:47:35 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 78.455651] niks3-server[1053]: 2026/09/22 10:47:35 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 78.458637] niks3-server[1053]: 2026/09/22 10:47:35 INFO Completed upload id=21 worker1 # [ 78.482709] nix-grpc-daemon[864]: time=2026-09-22T10:47:35.605Z level=INFO msg="Upload complete. (475ms)" worker1 # [ 78.487771] nix-grpc-daemon[784]: ts=2026-09-22T10:47:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=2 nar_bytes_in=976 worker1 # [ 78.493359] nix-grpc-daemon[784]: ts=2026-09-22T10:47:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 78.505175] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 78.517870] nix-daemon[852]: reaped child process 1114, status = succeeded client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... worker1 # [ 78.523556] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 78.680968] envoy[932]: conn peer=[2001:db8:1::1]:59666 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1453 tx=1197 ms=5908 lb # [ 78.684590] envoy[932]: conn peer=[2001:db8:1::1]:59684 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=57 lb # [ 78.687933] envoy[932]: conn peer=[2001:db8:1::1]:59680 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3397 tx=1939 ms=1816 lb # [ 78.691423] envoy[932]: conn peer=[2001:db8:1::1]:59700 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3866 tx=2154 ms=1678 lb # [ 78.694885] envoy[932]: conn peer=[2001:db8:1::1]:40372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=55 lb # [ 78.698420] envoy[932]: conn peer=[2001:db8:1::1]:40388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2389 ms=2026 lb # [ 78.701809] envoy[932]: conn peer=[2001:db8:1::1]:40402 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=48 client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 79.546226] nix-daemon[852]: reaped child process 1128, status = succeeded worker1 # [ 79.700581] nix-daemon[852]: accepted connection from pid 1144, user nix-grpc-daemon (trusted) worker1 # [ 79.712075] nix-daemon[852]: reaped child process 1147, status = succeeded lb # [ 79.699354] niks3-server[1053]: 2026/09/22 10:47:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.730176] nix-grpc-daemon[864]: time=2026-09-22T10:47:36.852Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 79.727238] niks3-server[1053]: 2026/09/22 10:47:36 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 79.736583] niks3-server[1053]: 2026/09/22 10:47:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 79.741694] niks3-server[1053]: 2026/09/22 10:47:36 INFO Signed narinfos id=22 count=1 worker1 # [ 79.768450] nix-grpc-daemon[864]: time=2026-09-22T10:47:36.890Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.747861] niks3-server[1053]: 2026/09/22 10:47:36 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 79.759556] niks3-server[1053]: 2026/09/22 10:47:36 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete worker1 # [ 79.791155] nix-grpc-daemon[864]: time=2026-09-22T10:47:36.913Z level=INFO msg="Upload complete. (258ms)" lb # [ 79.767293] niks3-server[1053]: 2026/09/22 10:47:36 INFO Completed upload id=22 lb # [ 79.769452] niks3-server[1053]: 2026/09/22 10:47:36 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker1 # [ 79.793941] nix-grpc-daemon[784]: ts=2026-09-22T10:47:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=10 outputs=1 worker1 # [ 79.801614] nix-daemon[852]: reaped child process 1126, status = succeeded client # copying 1 paths... worker2 # [ 79.816144] nix-grpc-daemon[786]: ts=2026-09-22T10:47:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 79.824887] nix-grpc-daemon[786]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 79.877051] nix-grpc-daemon[784]: ts=2026-09-22T10:47:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 79.880573] nix-grpc-daemon[784]: ts=2026-09-22T10:47:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=1 nar_bytes_out=120 client # [ 79.969569] nix-daemon[1070]: reaped child process 1155, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.69 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 80.156048] nix-daemon[1070]: accepted connection from pid 1174, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker2 # [ 80.322081] nix-grpc-daemon[786]: ts=2026-09-22T10:47:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 80.324299] nix-grpc-daemon[786]: ts=2026-09-22T10:47:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 80.341488] nix-grpc-daemon[786]: ts=2026-09-22T10:47:37Z level=debug event=want client=12 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 80.343822] nix-grpc-daemon[786]: ts=2026-09-22T10:47:37Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 80.385802] nix-grpc-daemon[786]: ts=2026-09-22T10:47:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 80.393921] nix-grpc-daemon[786]: ts=2026-09-22T10:47:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 client # copying 1 paths to 'lb:50051'... worker2 # [ 80.406591] nix-grpc-daemon[786]: ts=2026-09-22T10:47:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 80.414443] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 80.422537] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5) worker2 # [ 80.428061] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 2/5) worker2 # [ 80.560726] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 366 ms (attempt 3/5) worker2 # [ 80.930421] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 314 ms (attempt 4/5) worker2 # [ 81.250681] nix-grpc-daemon[786]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 81.254394] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 81.259935] nix-grpc-daemon[786]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 81.443527] nix-daemon[873]: accepted connection from pid 1144, user nix-grpc-daemon (trusted) worker2 # [ 81.455373] nix-daemon[873]: reaped child process 1147, status = succeeded worker2 # [ 81.597062] nix-daemon[873]: accepted connection from pid 1149, user nix-grpc-daemon (trusted) worker2 # [ 81.609255] nix-daemon[873]: reaped child process 1152, status = succeeded lb # [ 81.628440] niks3-server[1053]: 2026/09/22 10:47:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.633476] nix-grpc-daemon[927]: time=2026-09-22T10:47:38.810Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 81.634949] nix-grpc-daemon[927]: time=2026-09-22T10:47:38.810Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 81.658089] niks3-server[1053]: 2026/09/22 10:47:38 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 81.670086] niks3-server[1053]: 2026/09/22 10:47:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker2 # [ 81.668703] nix-grpc-daemon[927]: time=2026-09-22T10:47:38.846Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.675080] niks3-server[1053]: 2026/09/22 10:47:38 INFO Signed narinfos id=23 count=1 lb # [ 81.681991] niks3-server[1053]: 2026/09/22 10:47:38 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 81.692091] niks3-server[1053]: 2026/09/22 10:47:38 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker2 # [ 81.691687] nix-grpc-daemon[927]: time=2026-09-22T10:47:38.869Z level=INFO msg="Upload complete. (413ms)" lb # [ 81.698128] niks3-server[1053]: 2026/09/22 10:47:38 INFO Completed upload id=23 worker2 # [ 81.694228] nix-grpc-daemon[786]: ts=2026-09-22T10:47:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=1 paths=1 nar_bytes_in=560 lb # [ 81.700366] niks3-server[1053]: 2026/09/22 10:47:38 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker2 # [ 81.698429] nix-grpc-daemon[786]: ts=2026-09-22T10:47:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 81.704505] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) worker2 # [ 81.707194] nix-daemon[873]: reaped child process 1137, status = succeeded worker2 # [ 81.710804] nix-grpc-daemon[786]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... worker2 # [ 81.719704] nix-daemon[873]: accepted connection from pid 786, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 83.334947] nix-daemon[873]: reaped child process 1157, status = succeeded worker2 # [ 83.444084] nix-daemon[873]: accepted connection from pid 1173, user nix-grpc-daemon (trusted) worker2 # [ 83.454949] nix-daemon[873]: reaped child process 1176, status = succeeded lb # [ 83.470231] niks3-server[1053]: 2026/09/22 10:47:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 83.471190] nix-grpc-daemon[927]: time=2026-09-22T10:47:40.648Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 83.488844] niks3-server[1053]: 2026/09/22 10:47:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 83.485131] nix-grpc-daemon[927]: time=2026-09-22T10:47:40.662Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.491790] niks3-server[1053]: 2026/09/22 10:47:40 INFO Signed narinfos id=24 count=1 lb # [ 83.494447] niks3-server[1053]: 2026/09/22 10:47:40 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 83.496839] niks3-server[1053]: 2026/09/22 10:47:40 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 83.501055] niks3-server[1053]: 2026/09/22 10:47:40 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 83.504194] niks3-server[1053]: 2026/09/22 10:47:40 INFO Completed upload id=24 worker2 # [ 83.497855] nix-grpc-daemon[927]: time=2026-09-22T10:47:40.675Z level=INFO msg="Upload complete. (170ms)" lb # [ 83.506508] niks3-server[1053]: 2026/09/22 10:47:40 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker2 # [ 83.500554] nix-grpc-daemon[786]: ts=2026-09-22T10:47:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=11 outputs=1 client # copying 1 paths... worker2 # [ 83.508962] nix-daemon[873]: reaped child process 1154, status = succeeded worker1 # [ 83.537550] nix-grpc-daemon[784]: ts=2026-09-22T10:47:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 83.546641] nix-grpc-daemon[784]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 83.537448] nix-grpc-daemon[786]: ts=2026-09-22T10:47:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 83.539388] nix-grpc-daemon[786]: ts=2026-09-22T10:47:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34952 duration_s=0 paths=1 nar_bytes_out=120 client # [ 83.645629] nix-daemon[1070]: reaped child process 1177, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.67 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 83.799074] nix-daemon[1070]: accepted connection from pid 1196, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker1 # [ 84.005588] nix-grpc-daemon[784]: ts=2026-09-22T10:47:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:35784 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 83.978263] nix-grpc-daemon[786]: ts=2026-09-22T10:47:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 83.987355] nix-grpc-daemon[927]: time=2026-09-22T10:47:41.164Z level=INFO msg="All 1 paths already cached" worker2 # [ 84.001165] nix-grpc-daemon[786]: ts=2026-09-22T10:47:41Z level=debug event=want client=13 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker1 # [ 84.037843] nix-grpc-daemon[784]: ts=2026-09-22T10:47:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker2 # [ 84.005885] nix-grpc-daemon[786]: ts=2026-09-22T10:47:41Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 84.046262] nix-grpc-daemon[784]: ts=2026-09-22T10:47:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 84.055705] nix-grpc-daemon[864]: time=2026-09-22T10:47:41.177Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 84.063144] nix-grpc-daemon[784]: ts=2026-09-22T10:47:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 84.074390] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 84.258298] nix-daemon[852]: accepted connection from pid 1152, user nix-grpc-daemon (trusted) worker1 # [ 84.273277] nix-daemon[852]: reaped child process 1155, status = succeeded worker1 # [ 84.407239] nix-daemon[852]: accepted connection from pid 1157, user nix-grpc-daemon (trusted) worker1 # [ 84.421063] nix-daemon[852]: reaped child process 1160, status = succeeded lb # [ 84.408821] niks3-server[1053]: 2026/09/22 10:47:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 84.441427] nix-grpc-daemon[864]: time=2026-09-22T10:47:41.563Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 84.443279] nix-grpc-daemon[864]: time=2026-09-22T10:47:41.565Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 84.442155] niks3-server[1053]: 2026/09/22 10:47:41 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 84.450696] niks3-server[1053]: 2026/09/22 10:47:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 84.457272] niks3-server[1053]: 2026/09/22 10:47:41 INFO Signed narinfos id=25 count=1 worker1 # [ 84.484280] nix-grpc-daemon[864]: time=2026-09-22T10:47:41.606Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.460712] niks3-server[1053]: 2026/09/22 10:47:41 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 84.474686] niks3-server[1053]: 2026/09/22 10:47:41 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete worker1 # [ 84.505255] nix-grpc-daemon[864]: time=2026-09-22T10:47:41.627Z level=INFO msg="Upload complete. (418ms)" lb # [ 84.481225] niks3-server[1053]: 2026/09/22 10:47:41 INFO Completed upload id=25 worker1 # [ 84.507717] nix-grpc-daemon[784]: ts=2026-09-22T10:47:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 84.485102] niks3-server[1053]: 2026/09/22 10:47:41 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker1 # [ 84.513688] nix-grpc-daemon[784]: ts=2026-09-22T10:47:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 84.522915] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 84.526723] nix-daemon[852]: reaped child process 1150, status = succeeded worker1 # [ 84.531324] nix-daemon[852]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 85.746303] nix-daemon[852]: reaped child process 1164, status = succeeded worker1 # [ 85.868881] nix-daemon[852]: accepted connection from pid 1180, user nix-grpc-daemon (trusted) worker1 # [ 85.883936] nix-daemon[852]: reaped child process 1183, status = succeeded lb # [ 85.868930] niks3-server[1053]: 2026/09/22 10:47:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 85.898353] nix-grpc-daemon[864]: time=2026-09-22T10:47:43.019Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 85.886199] niks3-server[1053]: 2026/09/22 10:47:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 85.888227] niks3-server[1053]: 2026/09/22 10:47:42 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 85.890165] niks3-server[1053]: 2026/09/22 10:47:42 INFO Signed narinfos id=26 count=1 worker1 # [ 85.915401] nix-grpc-daemon[864]: time=2026-09-22T10:47:43.037Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.893927] niks3-server[1053]: 2026/09/22 10:47:42 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 85.898054] niks3-server[1053]: 2026/09/22 10:47:42 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 85.901333] niks3-server[1053]: 2026/09/22 10:47:42 INFO Completed upload id=26 worker1 # [ 85.925251] nix-grpc-daemon[864]: time=2026-09-22T10:47:43.047Z level=INFO msg="Upload complete. (187ms)" lb # [ 85.904638] niks3-server[1053]: 2026/09/22 10:47:42 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker1 # [ 85.927994] nix-grpc-daemon[784]: ts=2026-09-22T10:47:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=12 outputs=1 worker1 # [ 85.935187] nix-daemon[852]: reaped child process 1162, status = succeeded client # copying 1 paths... worker2 # [ 85.946116] nix-grpc-daemon[786]: ts=2026-09-22T10:47:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34952 worker2 # [ 85.957519] nix-grpc-daemon[786]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 86.015321] nix-grpc-daemon[784]: ts=2026-09-22T10:47:43Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 86.019833] nix-grpc-daemon[784]: ts=2026-09-22T10:47:43Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35784 duration_s=0 paths=1 nar_bytes_out=120 client # [ 86.053946] nix-daemon[1070]: reaped child process 1199, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.42 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 9.51 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.39 seconds) client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.34 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.16 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.16 seconds) worker2 # [ 87.145597] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 88.049542] nix-grpc-daemon[786]: ts=2026-09-22T10:47:45Z level=info event=signal_exit lb # [ 88.334832] niks3-server[1053]: 2026/09/22 10:47:45 INFO lead: released remote=192.168.1.4:55114 lb # [ 88.680586] envoy[932]: conn peer=[2001:db8:1::1]:40410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3868 tx=2083 ms=2275 lb # [ 88.684545] envoy[932]: conn peer=[2001:db8:1::1]:40418 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=50 lb # [ 88.688478] envoy[932]: conn peer=[2001:db8:1::1]:40432 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3755 tx=2122 ms=3265 lb # [ 88.692211] envoy[932]: conn peer=[2001:db8:1::1]:48374 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=48 lb # [ 88.695602] envoy[932]: conn peer=[2001:db8:1::1]:48388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3743 tx=2121 ms=2020 lb # [ 88.699301] envoy[932]: conn peer=[2001:db8:1::1]:48398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=9 worker1 # [ 89.360213] nix-grpc-daemon[784]: ts=2026-09-22T10:47:46Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 89.333893] nix-grpc-daemon[786]: ts=2026-09-22T10:47:46Z level=info event=scheduler_restarting worker2 # [ 89.337513] nix-grpc-daemon[786]: ts=2026-09-22T10:47:46Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 89.341233] nix-grpc-daemon[786]: ts=2026-09-22T10:47:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34944 worker2 # [ 89.344544] nix-grpc-daemon[786]: ts=2026-09-22T10:47:46Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 89.347689] nix-grpc-daemon[786]: ts=2026-09-22T10:47:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34944 worker2 # [ 89.351385] nix-grpc-daemon[786]: ts=2026-09-22T10:47:46Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 89.413896] nix-daemon[873]: reaped child process 875, status = succeeded lb # [ 89.523650] niks3-server[1053]: 2026/09/22 10:47:46 INFO lead: acquired remote=192.168.1.3:43624 worker1 # [ 89.547904] nix-grpc-daemon[784]: ts=2026-09-22T10:47:46Z level=info event=scheduler_take_over worker1 # [ 89.560595] nix-grpc-daemon[784]: ts=2026-09-22T10:47:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.564408] nix-grpc-daemon[784]: ts=2026-09-22T10:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.538281] nix-grpc-daemon[786]: ts=2026-09-22T10:47:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 89.765185] nix-grpc-daemon[784]: ts=2026-09-22T10:47:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.767206] nix-grpc-daemon[784]: ts=2026-09-22T10:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.967597] nix-grpc-daemon[784]: ts=2026-09-22T10:47:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.969535] nix-grpc-daemon[784]: ts=2026-09-22T10:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.026306] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 90.029247] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 90.030267] systemd[1]: nix-grpc-daemon.service: Consumed 2.022s CPU time over 1min 11.243s wall clock time, 57.1M memory peak, 77.4K incoming IP traffic, 244.9K outgoing IP traffic. worker2 # [ 90.034798] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 90.036550] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 90.038122] systemd[1]: nix-grpc-daemon.socket: Consumed 278us CPU time over 1min 19.790s wall clock time, 256K memory peak, 94.2K incoming IP traffic, 83K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.04 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 90.170077] nix-grpc-daemon[784]: ts=2026-09-22T10:47:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.180951] nix-grpc-daemon[784]: ts=2026-09-22T10:47:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34372 worker1 # [ 90.185962] nix-grpc-daemon[784]: ts=2026-09-22T10:47:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 90.299481] nix-grpc-daemon[784]: ts=2026-09-22T10:47:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35784 worker1 # [ 90.301759] nix-grpc-daemon[784]: ts=2026-09-22T10:47:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:35784 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.21 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds) worker2 # [ 90.377459] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 90.442516] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 90.966653] nix-grpc-daemon[784]: ts=2026-09-22T10:47:48Z level=info event=signal_exit worker2 # [ 91.192933] systemd[1]: Starting scheduler-token.service... lb # [ 91.227643] niks3-server[1053]: 2026/09/22 10:47:48 INFO lead: released remote=192.168.1.3:43624 worker2 # [ 91.248200] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 91.249418] systemd[1]: Finished scheduler-token.service. worker2 # [ 91.250868] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 55ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 91.256747] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 91.398713] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 91.401184] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 91.404314] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 91.410068] nix-grpc-daemon[1203]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 91.412171] nix-grpc-daemon[1203]: E0000 00:00:1790074068.587056 1203 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 91.417069] nix-grpc-daemon[1203]: E0000 00:00:1790074068.592149 1203 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 91.421161] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 91.422762] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 91.430335] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:48Z level=info event=scheduler_take_over lb # [ 91.436714] niks3-server[1053]: 2026/09/22 10:47:48 INFO lead: acquired remote=192.168.1.4:51434 worker2 # [ 91.433067] nix-grpc-daemon[1203]: E0000 00:00:1790074068.609664 1243 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 91.444411] nix-grpc-daemon[1203]: E0000 00:00:1790074068.621751 1243 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 91.449131] nix-grpc-daemon[1203]: E0000 00:00:1790074068.624064 1243 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 91.458466] nix-grpc-daemon[1203]: E0000 00:00:1790074068.635865 1243 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 91.466247] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.467715] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.668698] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.670528] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.871451] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.873382] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.074261] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.076165] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.254050] nix-grpc-daemon[784]: ts=2026-09-22T10:47:49Z level=info event=scheduler_restarting worker1 # [ 92.255716] nix-grpc-daemon[784]: ts=2026-09-22T10:47:49Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 92.257213] nix-grpc-daemon[784]: ts=2026-09-22T10:47:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34372 worker1 # [ 92.258543] nix-grpc-daemon[784]: ts=2026-09-22T10:47:49Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 92.273385] nix-daemon[852]: reaped child process 854, status = succeeded worker2 # [ 92.277171] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.279600] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.463777] nix-grpc-daemon[784]: ts=2026-09-22T10:47:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 92.480910] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.487977] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 92.489473] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:33048 worker2 # [ 92.491155] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:49Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 93.121126] nix-grpc-daemon[784]: E0000 00:00:1790074070.243285 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 93.123247] nix-grpc-daemon[784]: E0000 00:00:1790074070.243395 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 93.995228] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 93.996532] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 93.998404] systemd[1]: nix-grpc-daemon.service: Consumed 2.676s CPU time over 1min 15.299s wall clock time, 62.1M memory peak, 92.6K incoming IP traffic, 175.6K outgoing IP traffic. worker1 # [ 94.003211] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 94.005282] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 94.006123] systemd[1]: nix-grpc-daemon.socket: Consumed 330us CPU time over 1min 24.651s wall clock time, 256K memory peak, 92.1K incoming IP traffic, 81.4K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.04 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 94.236509] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 94.247771] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 94.260411] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5) worker2 # [ 94.285092] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 2/5) worker2 # [ 94.300135] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 3/5) worker2 # [ 94.369573] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 340 ms (attempt 4/5) worker2 # [ 94.710517] nix-grpc-daemon[1203]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 94.711902] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 94.725729] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42466 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 94.732192] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 94.743109] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:51Z level=info event=niks3_push_started pid=1263 worker2 # [ 94.872413] nix-grpc-daemon[1263]: time=2026-09-22T10:47:52.049Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 95.003374] nix-daemon[873]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker2 # [ 95.019687] nix-daemon[873]: reaped child process 1279, status = succeeded lb # [ 95.038640] niks3-server[1053]: 2026/09/22 10:47:51 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 95.048186] niks3-server[1053]: 2026/09/22 10:47:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.048366] nix-grpc-daemon[1263]: time=2026-09-22T10:47:52.225Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 95.049998] nix-grpc-daemon[1263]: time=2026-09-22T10:47:52.227Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 95.051885] nix-grpc-daemon[1263]: time=2026-09-22T10:47:52.229Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 95.077958] niks3-server[1053]: 2026/09/22 10:47:51 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 95.088595] niks3-server[1053]: 2026/09/22 10:47:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 95.090438] niks3-server[1053]: 2026/09/22 10:47:51 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 95.098265] niks3-server[1053]: 2026/09/22 10:47:51 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 95.104882] niks3-server[1053]: 2026/09/22 10:47:51 INFO Signed narinfos id=28 count=2 lb # [ 95.106963] niks3-server[1053]: 2026/09/22 10:47:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 95.109122] niks3-server[1053]: 2026/09/22 10:47:51 INFO Signed narinfos id=27 count=1 worker2 # [ 95.102883] nix-grpc-daemon[1263]: time=2026-09-22T10:47:52.280Z level=INFO msg="Uploading 3 narinfos" lb # [ 95.114531] niks3-server[1053]: 2026/09/22 10:47:51 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 95.130674] niks3-server[1053]: 2026/09/22 10:47:51 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 95.133441] niks3-server[1053]: 2026/09/22 10:47:51 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 95.136679] niks3-server[1053]: 2026/09/22 10:47:51 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 95.138943] niks3-server[1053]: 2026/09/22 10:47:51 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 95.140618] niks3-server[1053]: 2026/09/22 10:47:51 INFO Completed upload id=27 lb # [ 95.142285] niks3-server[1053]: 2026/09/22 10:47:51 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 95.144883] niks3-server[1053]: 2026/09/22 10:47:51 INFO Completed upload id=28 worker2 # [ 95.139709] nix-grpc-daemon[1263]: time=2026-09-22T10:47:52.317Z level=INFO msg="Upload complete. (263ms)" worker2 # [ 95.142357] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42466 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 95.149658] nix-daemon[873]: reaped child process 1261, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.14 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.01 seconds) worker1 # [ 95.250220] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 95.254995] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 95.378941] nix-grpc-daemon[1206]: ts=2026-09-22T10:47:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 95.382369] nix-grpc-daemon[1206]: ts=2026-09-22T10:47:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 95.384516] nix-grpc-daemon[1206]: ts=2026-09-22T10:47:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 95.390084] nix-grpc-daemon[1206]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 95.391471] nix-grpc-daemon[1206]: E0000 00:00:1790074072.511641 1206 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 95.398276] nix-grpc-daemon[1206]: E0000 00:00:1790074072.516870 1206 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 95.402610] nix-grpc-daemon[1206]: ts=2026-09-22T10:47:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 95.404823] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 95.408671] nix-grpc-daemon[1206]: E0000 00:00:1790074072.531028 1247 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 95.423088] nix-grpc-daemon[1206]: E0000 00:00:1790074072.544313 1247 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 95.426228] nix-grpc-daemon[1206]: E0000 00:00:1790074072.544499 1247 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 95.436258] nix-grpc-daemon[1206]: E0000 00:00:1790074072.558563 1247 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 95.443431] nix-grpc-daemon[1206]: ts=2026-09-22T10:47:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.414982] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:33048 worker2 # [ 95.417303] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.09 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.42 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb # [ 96.572363] niks3-server[1053]: 2026/09/22 10:47:53 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 96.576231] systemd[1]: Stopping niks3 server... worker1 # [ 96.601099] nix-grpc-daemon[1206]: ts=2026-09-22T10:47:53Z level=info event=scheduler_lock_lost status=200 lb # [ 96.579542] niks3-server[1053]: 2026/09/22 10:47:53 INFO lead: released remote=192.168.1.4:51434 worker2 # [ 96.576827] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:53Z level=info event=scheduler_lock_lost status=200 lb # [ 96.597612] systemd[1]: niks3.service: Deactivated successfully. lb # [ 96.599857] systemd[1]: Stopped niks3 server. lb # [ 96.601268] systemd[1]: niks3.service: Consumed 599ms CPU time over 1min 7.500s wall clock time, 21.1M memory peak, 80.4K incoming IP traffic, 113.5K outgoing IP traffic. lb # [ 96.610541] systemd[1]: Starting niks3 server... lb # [ 96.681485] niks3-server[1196]: 2026/09/22 10:47:53 goose: no migrations to run. current version: 20260920000000 lb # [ 96.687959] niks3-server[1196]: 2026/09/22 10:47:53 OK 1_commit_pending_closure.sql (4.79ms) lb # [ 96.691567] niks3-server[1196]: 2026/09/22 10:47:53 OK 2_object_stats_trigger.sql (1.77ms) lb # [ 96.692662] niks3-server[1196]: 2026/09/22 10:47:53 goose: up to current file version: 2 lb # [ 96.694224] niks3-server[1196]: 2026/09/22 10:47:53 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key lb # [ 96.706047] niks3-server[1196]: 2026/09/22 10:47:53 INFO Read proxy enabled — serving cache objects from S3 lb # [ 96.707709] niks3-server[1196]: 2026/09/22 10:47:53 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 96.709123] niks3-server[1196]: 2026/09/22 10:47:53 INFO systemd watchdog enabled interval=15s lb # [ 96.711168] systemd[1]: Started niks3 server. lb # [ 96.711892] niks3-server[1196]: 2026/09/22 10:47:53 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 97.184153] nix-grpc-daemon[1206]: ts=2026-09-22T10:47:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 97.192663] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker1 # [ 97.202154] nix-grpc-daemon[1206]: ts=2026-09-22T10:47:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 97.210301] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5) worker1 # [ 97.239082] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 124 ms (attempt 2/5) worker1 # [ 97.366449] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 3/5) worker1 # [ 97.375613] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 432 ms (attempt 4/5) lb # [ 97.589256] niks3-server[1196]: 2026/09/22 10:47:54 INFO lead: acquired remote=192.168.1.4:58020 worker1 # [ 97.811203] nix-grpc-daemon[1206]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 97.813691] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 97.808685] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:54Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker2 # [ 97.810649] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:54Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 97.850950] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 97.858782] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42466 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 97.865353] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 97.870655] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 98.018170] nix-daemon[873]: accepted connection from pid 1298, user nix-grpc-daemon (trusted) worker2 # [ 98.034295] nix-daemon[873]: reaped child process 1301, status = succeeded worker2 # [ 98.173638] nix-daemon[873]: accepted connection from pid 1303, user nix-grpc-daemon (trusted) worker2 # [ 98.186756] nix-daemon[873]: reaped child process 1306, status = succeeded lb # [ 98.203197] niks3-server[1196]: 2026/09/22 10:47:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.203060] nix-grpc-daemon[1263]: time=2026-09-22T10:47:55.380Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 98.205442] nix-grpc-daemon[1263]: time=2026-09-22T10:47:55.382Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 98.226199] niks3-server[1196]: 2026/09/22 10:47:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 98.230564] niks3-server[1196]: 2026/09/22 10:47:55 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 98.241783] niks3-server[1196]: 2026/09/22 10:47:55 INFO Signed narinfos id=29 count=1 worker2 # [ 98.237096] nix-grpc-daemon[1263]: time=2026-09-22T10:47:55.414Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.252101] niks3-server[1196]: 2026/09/22 10:47:55 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 98.255529] niks3-server[1196]: 2026/09/22 10:47:55 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 98.259632] niks3-server[1196]: 2026/09/22 10:47:55 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo lb # [ 98.264039] niks3-server[1196]: 2026/09/22 10:47:55 INFO Completed upload id=29 worker2 # [ 98.257623] nix-grpc-daemon[1263]: time=2026-09-22T10:47:55.435Z level=INFO msg="Upload complete. (381ms)" worker2 # [ 98.259616] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42466 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 98.263228] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 98.270073] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 98.275912] nix-daemon[873]: reaped child process 1296, status = succeeded client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker2 # [ 98.280720] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) lb # [ 98.680858] envoy[932]: conn peer=[2001:db8:1::4]:52736 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=87143 tx=4032 ms=70425 lb # [ 98.683136] envoy[932]: conn peer=[2001:db8:1::1]:48412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=11 lb # [ 98.684856] envoy[932]: conn peer=[2001:db8:1::3]:48528 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=22107 tx=4175 ms=72631 lb # [ 98.686692] envoy[932]: conn peer=[2001:db8:1::1]:40220 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=282 ms=918 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 99.094361] nix-daemon[873]: reaped child process 1310, status = succeeded worker2 # [ 99.220874] nix-daemon[873]: accepted connection from pid 1326, user nix-grpc-daemon (trusted) worker2 # [ 99.232666] nix-daemon[873]: reaped child process 1329, status = succeeded lb # [ 99.249984] niks3-server[1196]: 2026/09/22 10:47:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 99.250097] nix-grpc-daemon[1263]: time=2026-09-22T10:47:56.427Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 99.253085] nix-grpc-daemon[1263]: time=2026-09-22T10:47:56.429Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 99.274110] niks3-server[1196]: 2026/09/22 10:47:56 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 99.276763] niks3-server[1196]: 2026/09/22 10:47:56 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 99.281058] niks3-server[1196]: 2026/09/22 10:47:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 99.283219] niks3-server[1196]: 2026/09/22 10:47:56 INFO Signed narinfos id=30 count=1 worker2 # [ 99.278490] nix-grpc-daemon[1263]: time=2026-09-22T10:47:56.455Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.287830] niks3-server[1196]: 2026/09/22 10:47:56 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 99.292530] niks3-server[1196]: 2026/09/22 10:47:56 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 99.295302] niks3-server[1196]: 2026/09/22 10:47:56 INFO Completed upload id=30 worker2 # [ 99.288987] nix-grpc-daemon[1263]: time=2026-09-22T10:47:56.466Z level=INFO msg="Upload complete. (200ms)" lb # [ 99.298102] niks3-server[1196]: 2026/09/22 10:47:56 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker2 # [ 99.292987] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42466 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker2 # [ 99.299466] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:56Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 99.301637] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:56Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 99.307087] nix-daemon[873]: reaped child process 1308, status = succeeded worker2 # [ 99.342142] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 99.349477] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 99.355731] nix-grpc-daemon[1263]: time=2026-09-22T10:47:56.533Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 99.360235] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 99.365678] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 99.502300] nix-daemon[873]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker2 # [ 99.515964] nix-daemon[873]: reaped child process 1338, status = succeeded worker2 # [ 99.649563] nix-daemon[873]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 99.661924] nix-daemon[873]: reaped child process 1343, status = succeeded lb # [ 99.677892] niks3-server[1196]: 2026/09/22 10:47:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 99.676387] nix-grpc-daemon[1263]: time=2026-09-22T10:47:56.853Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 99.677750] nix-grpc-daemon[1263]: time=2026-09-22T10:47:56.853Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 99.691773] niks3-server[1196]: 2026/09/22 10:47:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 99.694219] niks3-server[1196]: 2026/09/22 10:47:56 INFO Signed narinfos id=31 count=1 worker2 # [ 99.689290] nix-grpc-daemon[1263]: time=2026-09-22T10:47:56.866Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.695855] niks3-server[1196]: 2026/09/22 10:47:56 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 99.699943] niks3-server[1196]: 2026/09/22 10:47:56 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 99.704286] niks3-server[1196]: 2026/09/22 10:47:56 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 99.707052] niks3-server[1196]: 2026/09/22 10:47:56 INFO Completed upload id=31 worker2 # [ 99.702151] nix-grpc-daemon[1263]: time=2026-09-22T10:47:56.879Z level=INFO msg="Upload complete. (331ms)" lb # [ 99.709057] niks3-server[1196]: 2026/09/22 10:47:56 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker2 # [ 99.704371] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42466 duration_s=0 paths=1 nar_bytes_in=656 worker2 # [ 99.706778] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 99.713078] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 99.720336] nix-daemon[873]: reaped child process 1333, status = succeeded client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker2 # [ 99.723646] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 101.137747] nix-daemon[873]: reaped child process 1347, status = succeeded worker2 # [ 101.262564] nix-daemon[873]: accepted connection from pid 1363, user nix-grpc-daemon (trusted) worker2 # [ 101.275641] nix-daemon[873]: reaped child process 1366, status = succeeded lb # [ 101.295331] niks3-server[1196]: 2026/09/22 10:47:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.298575] nix-grpc-daemon[1263]: time=2026-09-22T10:47:58.475Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 101.300181] nix-grpc-daemon[1263]: time=2026-09-22T10:47:58.477Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 101.336947] niks3-server[1196]: 2026/09/22 10:47:58 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 101.345224] niks3-server[1196]: 2026/09/22 10:47:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker2 # [ 101.344460] nix-grpc-daemon[1263]: time=2026-09-22T10:47:58.521Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.351157] niks3-server[1196]: 2026/09/22 10:47:58 INFO Signed narinfos id=32 count=1 lb # [ 101.355969] niks3-server[1196]: 2026/09/22 10:47:58 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 101.362053] niks3-server[1196]: 2026/09/22 10:47:58 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 101.366926] niks3-server[1196]: 2026/09/22 10:47:58 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 101.372390] niks3-server[1196]: 2026/09/22 10:47:58 INFO Completed upload id=32 worker2 # [ 101.366028] nix-grpc-daemon[1263]: time=2026-09-22T10:47:58.543Z level=INFO msg="Upload complete. (235ms)" lb # [ 101.374401] niks3-server[1196]: 2026/09/22 10:47:58 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 101.368704] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42466 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker2 # [ 101.375405] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:58Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 101.377417] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:58Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 101.381643] nix-daemon[873]: reaped child process 1345, status = succeeded worker2 # [ 101.419456] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 101.430337] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 101.440985] nix-grpc-daemon[1263]: time=2026-09-22T10:47:58.618Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 101.448438] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 101.453342] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 101.584799] nix-daemon[873]: accepted connection from pid 1372, user nix-grpc-daemon (trusted) worker2 # [ 101.597307] nix-daemon[873]: reaped child process 1375, status = succeeded worker2 # [ 101.744618] nix-daemon[873]: accepted connection from pid 1377, user nix-grpc-daemon (trusted) worker2 # [ 101.757946] nix-daemon[873]: reaped child process 1380, status = succeeded lb # [ 101.778328] niks3-server[1196]: 2026/09/22 10:47:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.794136] nix-grpc-daemon[1263]: time=2026-09-22T10:47:58.971Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 101.795765] nix-grpc-daemon[1263]: time=2026-09-22T10:47:58.971Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 101.820079] niks3-server[1196]: 2026/09/22 10:47:58 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 101.828594] niks3-server[1196]: 2026/09/22 10:47:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker2 # [ 101.826332] nix-grpc-daemon[1263]: time=2026-09-22T10:47:59.003Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.832628] niks3-server[1196]: 2026/09/22 10:47:58 INFO Signed narinfos id=33 count=1 lb # [ 101.839254] niks3-server[1196]: 2026/09/22 10:47:58 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 101.844412] niks3-server[1196]: 2026/09/22 10:47:58 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 101.848524] niks3-server[1196]: 2026/09/22 10:47:58 INFO Completed upload id=33 worker2 # [ 101.841982] nix-grpc-daemon[1263]: time=2026-09-22T10:47:59.019Z level=INFO msg="Upload complete. (383ms)" worker2 # [ 101.844054] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42466 duration_s=0 paths=1 nar_bytes_in=784 lb # [ 101.851230] niks3-server[1196]: 2026/09/22 10:47:58 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 101.847776] nix-grpc-daemon[1203]: ts=2026-09-22T10:47:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42466 worker2 # [ 101.853535] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 101.856599] nix-daemon[873]: reaped child process 1370, status = succeeded client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 101.862592] nix-daemon[873]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 102.676201] nix-daemon[873]: reaped child process 1384, status = succeeded worker2 # [ 102.800822] nix-daemon[873]: accepted connection from pid 1400, user nix-grpc-daemon (trusted) worker2 # [ 102.812354] nix-daemon[873]: reaped child process 1403, status = succeeded lb # [ 102.834783] niks3-server[1196]: 2026/09/22 10:47:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 102.836758] nix-grpc-daemon[1263]: time=2026-09-22T10:48:00.013Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 102.839057] nix-grpc-daemon[1263]: time=2026-09-22T10:48:00.015Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 102.867290] niks3-server[1196]: 2026/09/22 10:47:59 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 102.878636] niks3-server[1196]: 2026/09/22 10:47:59 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 102.889368] niks3-server[1196]: 2026/09/22 10:47:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker2 # [ 102.889922] nix-grpc-daemon[1263]: time=2026-09-22T10:48:00.067Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.896702] niks3-server[1196]: 2026/09/22 10:47:59 INFO Signed narinfos id=34 count=1 lb # [ 102.901472] niks3-server[1196]: 2026/09/22 10:47:59 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 102.911405] niks3-server[1196]: 2026/09/22 10:47:59 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 102.914459] niks3-server[1196]: 2026/09/22 10:47:59 INFO Completed upload id=34 worker2 # [ 102.908349] nix-grpc-daemon[1263]: time=2026-09-22T10:48:00.085Z level=INFO msg="Upload complete. (240ms)" lb # [ 102.916209] niks3-server[1196]: 2026/09/22 10:47:59 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 102.913827] nix-grpc-daemon[1203]: ts=2026-09-22T10:48:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42466 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 102.926091] nix-daemon[873]: reaped child process 1382, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart >&2, in 5.98 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart outPath, in 0.16 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.63 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 103.314427] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 103.424410] nix-grpc-daemon[1203]: ts=2026-09-22T10:48:00Z level=info event=signal_exit lb # [ 103.796136] niks3-server[1196]: 2026/09/22 10:48:00 INFO lead: released remote=192.168.1.4:58020 worker2 # [ 104.789315] nix-grpc-daemon[1203]: ts=2026-09-22T10:48:01Z level=info event=scheduler_restarting worker2 # [ 104.792168] nix-grpc-daemon[1203]: ts=2026-09-22T10:48:01Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 104.820865] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:01Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 104.793408] nix-grpc-daemon[1203]: ts=2026-09-22T10:48:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:33048 worker2 # [ 104.794855] nix-grpc-daemon[1203]: ts=2026-09-22T10:48:01Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 104.796106] nix-grpc-daemon[1203]: ts=2026-09-22T10:48:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:33048 worker2 # [ 104.797441] nix-grpc-daemon[1203]: ts=2026-09-22T10:48:01Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 104.805061] nix-daemon[873]: reaped child process 1255, status = succeeded worker1 # [ 105.020542] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.022516] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.000869] nix-grpc-daemon[1203]: ts=2026-09-22T10:48:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 105.223378] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.227372] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.427940] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.432098] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.454824] nix-grpc-daemon[1203]: E0000 00:00:1790074082.632189 1248 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 105.457127] nix-grpc-daemon[1203]: E0000 00:00:1790074082.634563 1248 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 105.632504] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.634504] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.836529] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.840333] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.040860] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.044820] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.245730] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.250594] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.450742] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.452700] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.653412] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.656382] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.859240] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.862482] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.866756] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 106.869727] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 106.874678] systemd[1]: nix-grpc-daemon.service: Consumed 1.053s CPU time over 15.608s wall clock time, 35.2M memory peak, 45.7K incoming IP traffic, 83.5K outgoing IP traffic. worker2 # [ 106.884410] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 106.888348] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 106.891138] systemd[1]: nix-grpc-daemon.socket: Consumed 351us CPU time over 16.514s wall clock time, 256K memory peak, 37.1K incoming IP traffic, 27.7K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker1 # [ 107.059218] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.060908] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.262684] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.266732] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.467548] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.471518] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.608944] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_take_over lb # [ 107.585655] niks3-server[1196]: 2026/09/22 10:48:04 INFO lead: acquired remote=192.168.1.3:45212 worker1 # [ 107.672482] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.676417] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.877512] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.879174] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 108.079586] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.082900] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:05Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42840 worker1 # [ 108.084359] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # [ 108.680662] envoy[932]: conn peer=[2001:db8:1::1]:40226 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9653 tx=4434 ms=5779 lb # [ 108.682249] envoy[932]: conn peer=[2001:db8:1::4]:35502 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5880 tx=648 ms=13528 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2 worker1 # [ 109.313610] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49644 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 109.322202] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 109.345877] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:06Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 109.350786] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:06Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 109.394399] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 109.404883] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49644 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 109.410650] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 109.416327] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 109.425981] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:06Z level=info event=niks3_push_started pid=1285 worker1 # [ 109.600229] nix-grpc-daemon[1285]: time=2026-09-22T10:48:06.722Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 109.748097] nix-daemon[852]: accepted connection from pid 1298, user nix-grpc-daemon (trusted) worker1 # [ 109.759859] nix-daemon[852]: reaped child process 1301, status = succeeded worker1 # [ 109.915361] nix-daemon[852]: accepted connection from pid 1303, user nix-grpc-daemon (trusted) worker1 # [ 109.927960] nix-daemon[852]: reaped child process 1306, status = succeeded lb # [ 109.918789] niks3-server[1196]: 2026/09/22 10:48:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 109.950555] nix-grpc-daemon[1285]: time=2026-09-22T10:48:07.072Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 109.953629] nix-grpc-daemon[1285]: time=2026-09-22T10:48:07.074Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 109.951596] niks3-server[1196]: 2026/09/22 10:48:06 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 109.962118] niks3-server[1196]: 2026/09/22 10:48:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign worker1 # [ 109.992335] nix-grpc-daemon[1285]: time=2026-09-22T10:48:07.114Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.968076] niks3-server[1196]: 2026/09/22 10:48:06 INFO Signed narinfos id=35 count=1 lb # [ 109.980892] niks3-server[1196]: 2026/09/22 10:48:06 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 109.985912] niks3-server[1196]: 2026/09/22 10:48:06 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 109.996622] niks3-server[1196]: 2026/09/22 10:48:06 INFO Completed upload id=35 worker1 # [ 110.020601] nix-grpc-daemon[1285]: time=2026-09-22T10:48:07.142Z level=INFO msg="Upload complete. (416ms)" lb # [ 109.998077] niks3-server[1196]: 2026/09/22 10:48:06 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker1 # [ 110.022802] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49644 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 110.026965] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 110.033232] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 110.037072] nix-daemon[852]: reaped child process 1283, status = succeeded client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker1 # [ 110.041645] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 110.869780] nix-daemon[852]: reaped child process 1310, status = succeeded worker1 # [ 110.994927] nix-daemon[852]: accepted connection from pid 1326, user nix-grpc-daemon (trusted) worker1 # [ 111.006786] nix-daemon[852]: reaped child process 1329, status = succeeded lb # [ 110.997149] niks3-server[1196]: 2026/09/22 10:48:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.028699] nix-grpc-daemon[1285]: time=2026-09-22T10:48:08.150Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 111.031066] nix-grpc-daemon[1285]: time=2026-09-22T10:48:08.152Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 111.036478] niks3-server[1196]: 2026/09/22 10:48:07 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 111.045881] niks3-server[1196]: 2026/09/22 10:48:07 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 111.053777] niks3-server[1196]: 2026/09/22 10:48:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 111.060709] niks3-server[1196]: 2026/09/22 10:48:07 INFO Signed narinfos id=36 count=1 worker1 # [ 111.085247] nix-grpc-daemon[1285]: time=2026-09-22T10:48:08.206Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.067642] niks3-server[1196]: 2026/09/22 10:48:07 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 111.076425] niks3-server[1196]: 2026/09/22 10:48:07 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 111.080570] niks3-server[1196]: 2026/09/22 10:48:07 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo lb # [ 111.083510] niks3-server[1196]: 2026/09/22 10:48:07 INFO Completed upload id=36 worker1 # [ 111.107477] nix-grpc-daemon[1285]: time=2026-09-22T10:48:08.229Z level=INFO msg="Upload complete. (259ms)" worker1 # [ 111.111187] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker1 # [ 111.123548] nix-daemon[852]: reaped child process 1308, status = succeeded worker1 # [ 111.124819] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:08Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 111.126596] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:08Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 111.168328] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 111.181082] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 111.194557] nix-grpc-daemon[1285]: time=2026-09-22T10:48:08.316Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 111.203253] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 111.211539] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 111.373669] nix-daemon[852]: accepted connection from pid 1335, user nix-grpc-daemon (trusted) worker1 # [ 111.386682] nix-daemon[852]: reaped child process 1338, status = succeeded worker1 # [ 111.547211] nix-daemon[852]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker1 # [ 111.560102] nix-daemon[852]: reaped child process 1343, status = succeeded lb # [ 111.549368] niks3-server[1196]: 2026/09/22 10:48:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.581553] nix-grpc-daemon[1285]: time=2026-09-22T10:48:08.703Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 111.584151] nix-grpc-daemon[1285]: time=2026-09-22T10:48:08.705Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 111.577512] niks3-server[1196]: 2026/09/22 10:48:08 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 111.589221] niks3-server[1196]: 2026/09/22 10:48:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker1 # [ 111.620731] nix-grpc-daemon[1285]: time=2026-09-22T10:48:08.742Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.596524] niks3-server[1196]: 2026/09/22 10:48:08 INFO Signed narinfos id=37 count=1 lb # [ 111.601266] niks3-server[1196]: 2026/09/22 10:48:08 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 111.613384] niks3-server[1196]: 2026/09/22 10:48:08 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete worker1 # [ 111.643562] nix-grpc-daemon[1285]: time=2026-09-22T10:48:08.765Z level=INFO msg="Upload complete. (419ms)" lb # [ 111.619548] niks3-server[1196]: 2026/09/22 10:48:08 INFO Completed upload id=37 worker1 # [ 111.645881] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49644 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 111.623118] niks3-server[1196]: 2026/09/22 10:48:08 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 111.651130] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 111.660567] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 111.664076] nix-daemon[852]: reaped child process 1333, status = succeeded client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... worker1 # [ 111.668106] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 113.297690] nix-daemon[852]: reaped child process 1347, status = succeeded worker1 # [ 113.441097] nix-daemon[852]: accepted connection from pid 1363, user nix-grpc-daemon (trusted) worker1 # [ 113.453098] nix-daemon[852]: reaped child process 1366, status = succeeded lb # [ 113.443571] niks3-server[1196]: 2026/09/22 10:48:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 113.477427] nix-grpc-daemon[1285]: time=2026-09-22T10:48:10.599Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 113.479686] nix-grpc-daemon[1285]: time=2026-09-22T10:48:10.601Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 113.479857] niks3-server[1196]: 2026/09/22 10:48:10 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 113.484830] niks3-server[1196]: 2026/09/22 10:48:10 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 113.496188] niks3-server[1196]: 2026/09/22 10:48:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 113.500232] niks3-server[1196]: 2026/09/22 10:48:10 INFO Signed narinfos id=38 count=1 worker1 # [ 113.527169] nix-grpc-daemon[1285]: time=2026-09-22T10:48:10.649Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.511664] niks3-server[1196]: 2026/09/22 10:48:10 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 113.516695] niks3-server[1196]: 2026/09/22 10:48:10 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 113.522366] niks3-server[1196]: 2026/09/22 10:48:10 INFO Completed upload id=38 worker1 # [ 113.546427] nix-grpc-daemon[1285]: time=2026-09-22T10:48:10.668Z level=INFO msg="Upload complete. (269ms)" lb # [ 113.525725] niks3-server[1196]: 2026/09/22 10:48:10 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 113.557705] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 113.564554] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:10Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 113.569222] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:10Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 113.578172] nix-daemon[852]: reaped child process 1345, status = succeeded worker1 # [ 113.608374] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 113.621049] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 113.639939] nix-grpc-daemon[1285]: time=2026-09-22T10:48:10.762Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 113.648571] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 113.657351] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 113.810098] nix-daemon[852]: accepted connection from pid 1372, user nix-grpc-daemon (trusted) worker1 # [ 113.823288] nix-daemon[852]: reaped child process 1375, status = succeeded worker1 # [ 113.978388] nix-daemon[852]: accepted connection from pid 1377, user nix-grpc-daemon (trusted) worker1 # [ 113.991262] nix-daemon[852]: reaped child process 1380, status = succeeded lb # [ 113.981295] niks3-server[1196]: 2026/09/22 10:48:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 114.013052] nix-grpc-daemon[1285]: time=2026-09-22T10:48:11.135Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 114.014777] nix-grpc-daemon[1285]: time=2026-09-22T10:48:11.136Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 114.015149] niks3-server[1196]: 2026/09/22 10:48:10 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 114.020331] niks3-server[1196]: 2026/09/22 10:48:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 114.025473] niks3-server[1196]: 2026/09/22 10:48:10 INFO Signed narinfos id=39 count=1 worker1 # [ 114.053654] nix-grpc-daemon[1285]: time=2026-09-22T10:48:11.175Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.037299] niks3-server[1196]: 2026/09/22 10:48:10 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 114.044794] niks3-server[1196]: 2026/09/22 10:48:10 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 114.058792] niks3-server[1196]: 2026/09/22 10:48:10 INFO Completed upload id=39 worker1 # [ 114.082873] nix-grpc-daemon[1285]: time=2026-09-22T10:48:11.204Z level=INFO msg="Upload complete. (412ms)" worker1 # [ 114.087748] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49644 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 114.093293] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 lb # [ 114.071177] niks3-server[1196]: 2026/09/22 10:48:10 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 114.102305] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 114.109860] nix-daemon[852]: reaped child process 1370, status = succeeded worker1 # [ 114.113828] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 115.528772] nix-daemon[852]: reaped child process 1384, status = succeeded worker1 # [ 115.637645] nix-daemon[852]: accepted connection from pid 1400, user nix-grpc-daemon (trusted) worker1 # [ 115.649719] nix-daemon[852]: reaped child process 1403, status = succeeded lb # [ 115.639063] niks3-server[1196]: 2026/09/22 10:48:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 115.675493] nix-grpc-daemon[1285]: time=2026-09-22T10:48:12.797Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 115.678054] nix-grpc-daemon[1285]: time=2026-09-22T10:48:12.799Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 115.679751] niks3-server[1196]: 2026/09/22 10:48:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 115.683870] niks3-server[1196]: 2026/09/22 10:48:12 INFO Signed narinfos id=40 count=1 worker1 # [ 115.707610] nix-grpc-daemon[1285]: time=2026-09-22T10:48:12.829Z level=INFO msg="Uploading 1 narinfos" lb # [ 115.684950] niks3-server[1196]: 2026/09/22 10:48:12 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 115.689801] niks3-server[1196]: 2026/09/22 10:48:12 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 115.697782] niks3-server[1196]: 2026/09/22 10:48:12 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 115.703291] niks3-server[1196]: 2026/09/22 10:48:12 INFO Completed upload id=40 worker1 # [ 115.727255] nix-grpc-daemon[1285]: time=2026-09-22T10:48:12.849Z level=INFO msg="Upload complete. (206ms)" worker1 # [ 115.729972] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 lb # [ 115.707276] niks3-server[1196]: 2026/09/22 10:48:12 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo lb # [ 115.710756] niks3-server[1196]: 2026/09/22 10:48:12 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 115.738431] nix-daemon[852]: reaped child process 1382, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 6.67 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.19 seconds) worker2 # [ 115.989621] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 115.995762] systemd[1]: Starting scheduler-token.service... worker2 # [ 116.061459] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 116.063068] systemd[1]: Finished scheduler-token.service. worker2 # [ 116.064513] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 67ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 116.069647] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 116.215342] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:13Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 116.217823] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 116.221526] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 116.228068] nix-grpc-daemon[1424]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 116.229386] nix-grpc-daemon[1424]: E0000 00:00:1790074093.404965 1424 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 116.234942] nix-grpc-daemon[1424]: E0000 00:00:1790074093.410082 1424 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 116.238886] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 116.241350] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 116.248090] nix-grpc-daemon[1424]: E0000 00:00:1790074093.423155 1465 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 116.258075] nix-grpc-daemon[1424]: E0000 00:00:1790074093.435529 1465 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 116.262053] nix-grpc-daemon[1424]: E0000 00:00:1790074093.437766 1465 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 116.272050] nix-grpc-daemon[1424]: E0000 00:00:1790074093.449480 1465 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 116.280139] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 116.314873] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:13Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 116.316493] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:13Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42840 worker1 # [ 116.318090] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.40 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs client # [ 116.555254] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 47f44b0b391c4520af9e211bac0a7dd3 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds) worker1 # [ 116.777399] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49644 client # [ 116.771157] nix[1322]: don't know how to build these paths: client # [ 116.772260] nix[1322]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 116.791164] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:13Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 116.796398] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:13Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 116.834959] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 116.843662] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49644 client # [ 116.836334] nix[1322]: copying 1 paths to 'lb:50051'... worker1 # [ 116.849479] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49644 client # [ 116.839238] nix[1322]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 116.858941] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 117.004604] nix-daemon[852]: accepted connection from pid 1416, user nix-grpc-daemon (trusted) worker1 # [ 117.017495] nix-daemon[852]: reaped child process 1419, status = succeeded worker1 # [ 117.181062] nix-daemon[852]: accepted connection from pid 1421, user nix-grpc-daemon (trusted) worker1 # [ 117.194383] nix-daemon[852]: reaped child process 1424, status = succeeded lb # [ 117.182891] niks3-server[1196]: 2026/09/22 10:48:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 117.217043] nix-grpc-daemon[1285]: time=2026-09-22T10:48:14.339Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 117.218601] nix-grpc-daemon[1285]: time=2026-09-22T10:48:14.340Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 117.214437] niks3-server[1196]: 2026/09/22 10:48:14 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 117.224993] niks3-server[1196]: 2026/09/22 10:48:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 117.232094] niks3-server[1196]: 2026/09/22 10:48:14 INFO Signed narinfos id=41 count=1 worker1 # [ 117.259181] nix-grpc-daemon[1285]: time=2026-09-22T10:48:14.381Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.237104] niks3-server[1196]: 2026/09/22 10:48:14 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 117.248298] niks3-server[1196]: 2026/09/22 10:48:14 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 117.254686] niks3-server[1196]: 2026/09/22 10:48:14 INFO Completed upload id=41 worker1 # [ 117.278670] nix-grpc-daemon[1285]: time=2026-09-22T10:48:14.400Z level=INFO msg="Upload complete. (413ms)" lb # [ 117.258269] niks3-server[1196]: 2026/09/22 10:48:14 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 117.282779] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49644 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 117.288142] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 worker1 # [ 117.297260] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 117.300438] nix-daemon[852]: reaped child process 1414, status = succeeded client # [ 117.291777] nix[1322]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... worker1 # [ 117.305093] nix-daemon[852]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) lb # [ 118.681157] envoy[932]: conn peer=[2001:db8:1::1]:59852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9577 tx=4392 ms=6431 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 119.265416] systemd-journald[286]: Received client request to rotate journal, rotating. worker2 # [ 119.276765] systemd-journald[286]: Vacuuming done, freed 0B of archived journals from /var/log/journal/22889ca121274cfa846369b3932ca906. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 119.220905] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) client: must succeed: sleep 5.0 worker1 # [ 119.406044] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:16Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 124.526781] nix-daemon[852]: reaped child process 1428, status = succeeded worker1 # [ 124.654026] nix-daemon[852]: accepted connection from pid 1469, user nix-grpc-daemon (trusted) worker1 # [ 124.666297] nix-daemon[852]: reaped child process 1472, status = succeeded lb # [ 124.655572] niks3-server[1196]: 2026/09/22 10:48:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 124.684275] nix-grpc-daemon[1285]: time=2026-09-22T10:48:21.806Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 124.687252] nix-grpc-daemon[1285]: time=2026-09-22T10:48:21.808Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 124.678743] niks3-server[1196]: 2026/09/22 10:48:21 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 124.681823] niks3-server[1196]: 2026/09/22 10:48:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 124.684327] niks3-server[1196]: 2026/09/22 10:48:21 INFO Signed narinfos id=42 count=1 worker1 # [ 124.708587] nix-grpc-daemon[1285]: time=2026-09-22T10:48:21.830Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.687779] niks3-server[1196]: 2026/09/22 10:48:21 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 124.690583] niks3-server[1196]: 2026/09/22 10:48:21 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 124.694132] niks3-server[1196]: 2026/09/22 10:48:21 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 124.696968] niks3-server[1196]: 2026/09/22 10:48:21 INFO Completed upload id=42 worker1 # [ 124.722069] nix-grpc-daemon[1285]: time=2026-09-22T10:48:21.844Z level=INFO msg="Upload complete. (204ms)" lb # [ 124.698922] niks3-server[1196]: 2026/09/22 10:48:21 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 124.725712] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49644 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 124.732948] nix-daemon[852]: reaped child process 1426, status = succeeded client # [ 124.737708] systemd[1]: rs.service: Deactivated successfully. client # [ 124.739568] systemd[1]: rs.service: Consumed 123ms CPU time over 8.183s wall clock time, 41.4M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 125.406419] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:22Z level=info event=signal_exit lb # [ 125.813265] niks3-server[1196]: 2026/09/22 10:48:22 INFO lead: released remote=192.168.1.3:45212 lb # [ 126.251186] niks3-server[1196]: 2026/09/22 10:48:23 INFO lead: acquired remote=192.168.1.4:57300 worker2 # [ 126.247029] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:23Z level=info event=scheduler_take_over worker2 # [ 126.806160] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:23Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 126.840943] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:23Z level=info event=scheduler_restarting worker1 # [ 126.845484] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42840 worker1 # [ 126.849160] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:23Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 126.852596] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:23Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 126.856343] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42840 worker1 # [ 126.860087] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:23Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 126.873432] nix-daemon[852]: reaped child process 1258, status = succeeded worker2 # [ 127.010865] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.014779] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 127.048382] nix-grpc-daemon[1206]: E0000 00:00:1790074104.170599 1251 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 127.058132] nix-grpc-daemon[1206]: E0000 00:00:1790074104.176389 1251 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 127.062887] nix-grpc-daemon[1206]: ts=2026-09-22T10:48:24Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 127.212877] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.216715] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 127.419140] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.422276] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 127.620509] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.624620] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.18 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.03 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 127.825481] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 127.829470] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2 # [ 128.029635] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.039068] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:25Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 128.040586] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:25Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:50134 worker2 # [ 128.042151] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 128.436696] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 128.438688] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 128.441689] systemd[1]: nix-grpc-daemon.service: Consumed 1.314s CPU time over 33.180s wall clock time, 35.8M memory peak, 48.6K incoming IP traffic, 105.3K outgoing IP traffic. worker1 # [ 128.451715] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 128.597935] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:25Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 128.599834] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 128.603536] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 128.610072] nix-grpc-daemon[1479]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 128.611430] nix-grpc-daemon[1479]: E0000 00:00:1790074105.731867 1479 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.616712] nix-grpc-daemon[1479]: E0000 00:00:1790074105.737227 1479 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.619762] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 128.621312] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 128.628070] nix-grpc-daemon[1479]: E0000 00:00:1790074105.749294 1521 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.639511] nix-grpc-daemon[1479]: E0000 00:00:1790074105.761822 1521 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.645057] nix-grpc-daemon[1479]: E0000 00:00:1790074105.764520 1521 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.654395] nix-grpc-daemon[1479]: E0000 00:00:1790074105.776713 1521 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.662293] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.633931] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:25Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:50134 worker2 # [ 128.638586] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # [ 128.681208] envoy[932]: conn peer=[2001:db8:1::1]:49888 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2973 tx=1536 ms=7960 lb # [ 128.682796] envoy[932]: conn peer=[2001:db8:1::3]:49364 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4581 tx=1106 ms=31600 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.49 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid client # [ 129.069721] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: a2306b1e8a0046128c58cbbfa359ea8e client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds) worker2 # [ 129.267145] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50142 worker2 # [ 129.278431] nix-daemon[873]: accepted connection from pid 1424, user nix-grpc-daemon (trusted) client # [ 129.307348] nix[1358]: don't know how to build these paths: client # [ 129.308202] nix[1358]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker2 # [ 129.297888] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:26Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 129.302643] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:26Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 129.346535] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50142 worker2 # [ 129.358230] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5) worker2 # [ 129.381946] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 2/5) worker2 # [ 129.422742] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 3/5) worker2 # [ 129.573431] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 4/5) worker2 # [ 129.624996] nix-grpc-daemon[1424]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 129.628291] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 129.647196] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50142 client # [ 129.673881] nix[1358]: copying 1 paths to 'lb:50051'... client # [ 129.674770] nix[1358]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker2 # [ 129.657326] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50142 worker2 # [ 129.667129] nix-daemon[873]: accepted connection from pid 1424, user nix-grpc-daemon (trusted) worker2 # [ 129.686159] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:26Z level=info event=niks3_push_started pid=1552 worker2 # [ 129.838471] nix-grpc-daemon[1552]: time=2026-09-22T10:48:27.015Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 129.996066] nix-daemon[873]: accepted connection from pid 1565, user nix-grpc-daemon (trusted) worker2 # [ 130.006853] nix-daemon[873]: reaped child process 1568, status = succeeded worker2 # [ 130.160502] nix-daemon[873]: accepted connection from pid 1570, user nix-grpc-daemon (trusted) worker2 # [ 130.172234] nix-daemon[873]: reaped child process 1573, status = succeeded lb # [ 130.192838] niks3-server[1196]: 2026/09/22 10:48:27 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 130.197420] nix-grpc-daemon[1552]: time=2026-09-22T10:48:27.374Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 130.201702] nix-grpc-daemon[1552]: time=2026-09-22T10:48:27.376Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 130.234259] niks3-server[1196]: 2026/09/22 10:48:27 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 130.247129] niks3-server[1196]: 2026/09/22 10:48:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker2 # [ 130.249961] nix-grpc-daemon[1552]: time=2026-09-22T10:48:27.426Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.256656] niks3-server[1196]: 2026/09/22 10:48:27 INFO Signed narinfos id=43 count=1 lb # [ 130.271198] niks3-server[1196]: 2026/09/22 10:48:27 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 130.274802] niks3-server[1196]: 2026/09/22 10:48:27 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 130.281342] niks3-server[1196]: 2026/09/22 10:48:27 INFO Completed upload id=43 worker2 # [ 130.275709] nix-grpc-daemon[1552]: time=2026-09-22T10:48:27.452Z level=INFO msg="Upload complete. (433ms)" worker2 # [ 130.278951] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50142 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 130.282590] nix-grpc-daemon[1424]: ts=2026-09-22T10:48:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50142 worker2 # [ 130.289306] nix-daemon[873]: accepted connection from pid 1424, user nix-grpc-daemon (trusted) worker2 # [ 130.299724] nix-daemon[873]: reaped child process 1550, status = succeeded client # [ 130.321668] nix[1358]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker2 # [ 130.306077] nix-daemon[873]: accepted connection from pid 1424, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 131.694285] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1424 (nix-grpc-daemon) on client request. worker2 # [ 131.696516] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 131.705815] niks3-server[1196]: 2026/09/22 10:48:28 INFO lead: released remote=192.168.1.4:57300 client # [ 131.725650] nix[1358]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 131.737827] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker2 # [ 131.714791] systemd[1]: Starting scheduler-token.service... client # [ 131.730303] nix[1358]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 131.726607] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 131.728177] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 131.732720] systemd[1]: nix-grpc-daemon.service: Consumed 415ms CPU time over 15.655s wall clock time, 33.7M memory peak, 15.7K incoming IP traffic, 30K outgoing IP traffic. worker2 # [ 131.738495] nix-daemon[873]: reaped child process 1579, status = succeeded worker2 # [ 131.740251] nix-daemon[873]: reaped child process 1542, status = succeeded worker2 # [ 131.750252] nix-daemon[1581]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 131.755173] nix-daemon[873]: reaped child process 1581, status = failed with exit code 1 worker2 # [ 131.791982] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 131.793549] systemd[1]: Finished scheduler-token.service. worker2 # [ 131.794824] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 77ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 131.797771] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 131.802091] systemd[1]: Starting scheduler-token.service... worker2 # [ 131.856686] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 131.857784] systemd[1]: Finished scheduler-token.service. worker2 # [ 131.859068] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 54ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 131.864203] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 131.937781] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 132.008896] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 132.011165] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 132.014620] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 132.020060] nix-grpc-daemon[1620]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 132.023098] nix-grpc-daemon[1620]: E0000 00:00:1790074109.197434 1620 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 132.025247] nix-grpc-daemon[1620]: E0000 00:00:1790074109.200452 1620 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 132.032078] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 132.033733] systemd[1]: Started Nix worker-protocol over gRPC. worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.38 seconds) client: must succeed: sleep 5.0 worker2 # [ 132.042081] nix-grpc-daemon[1620]: E0000 00:00:1790074109.219166 1662 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 132.048921] niks3-server[1196]: 2026/09/22 10:48:28 INFO lead: acquired remote=192.168.1.4:59828 worker2 # [ 132.045901] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=scheduler_take_over worker2 # [ 132.048823] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:50190 worker2 # [ 132.051591] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 132.062127] nix-grpc-daemon[1620]: E0000 00:00:1790074109.239569 1662 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 132.066056] nix-grpc-daemon[1620]: E0000 00:00:1790074109.241802 1662 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 132.076446] nix-grpc-daemon[1620]: E0000 00:00:1790074109.253851 1662 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 132.085544] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 132.087178] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 132.231939] nix[1358]: scheduler at lb:50051: no healthy upstream, reconnecting worker2 # [ 132.288680] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 132.292461] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 132.493182] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 132.495242] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 132.696125] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 132.698173] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 132.898937] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 132.900947] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 133.104234] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 133.114136] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:30Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 133.117926] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:30Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:44796 worker2 # [ 133.121874] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:30Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 133.224163] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:30Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 133.228165] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:30Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 133.274762] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43954 worker1 # [ 133.286284] nix-daemon[852]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) worker1 # [ 133.303736] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5) worker1 # [ 133.378793] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 2/5) worker1 # [ 133.526885] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 146 ms (attempt 3/5) worker1 # [ 133.673632] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 461 ms (attempt 4/5) worker1 # [ 134.141056] nix-grpc-daemon[1479]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 134.145239] nix-grpc-daemon[1479]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 134.160240] nix-grpc-daemon[1479]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'... worker1 # [ 134.179754] nix-daemon[852]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) worker1 # [ 134.195374] nix-daemon[852]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) client # [ 134.182458] nix[1358]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... client: (finished: must succeed: sleep 5.0, in 5.04 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 137.419298] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:34Z level=info event=niks3_push_started pid=1581 worker1 # [ 137.450083] nix-daemon[852]: reaped child process 1556, status = succeeded worker1 # [ 137.618754] nix-grpc-daemon[1581]: time=2026-09-22T10:48:34.740Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 137.782260] nix-daemon[852]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) worker1 # [ 137.795142] nix-daemon[852]: reaped child process 1597, status = succeeded lb # [ 137.784764] niks3-server[1196]: 2026/09/22 10:48:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 137.816930] nix-grpc-daemon[1581]: time=2026-09-22T10:48:34.939Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 137.818469] nix-grpc-daemon[1581]: time=2026-09-22T10:48:34.940Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 137.837214] niks3-server[1196]: 2026/09/22 10:48:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 137.843820] niks3-server[1196]: 2026/09/22 10:48:34 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 137.854506] niks3-server[1196]: 2026/09/22 10:48:34 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 137.866944] niks3-server[1196]: 2026/09/22 10:48:34 INFO Signed narinfos id=44 count=1 worker1 # [ 137.890793] nix-grpc-daemon[1581]: time=2026-09-22T10:48:35.013Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.873792] niks3-server[1196]: 2026/09/22 10:48:34 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 137.878069] niks3-server[1196]: 2026/09/22 10:48:34 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 137.885432] niks3-server[1196]: 2026/09/22 10:48:34 INFO Completed upload id=44 worker1 # [ 137.909390] nix-grpc-daemon[1581]: time=2026-09-22T10:48:35.031Z level=INFO msg="Upload complete. (287ms)" worker1 # [ 137.912052] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43954 duration_s=4 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 lb # [ 137.891609] niks3-server[1196]: 2026/09/22 10:48:34 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 137.919622] nix-daemon[852]: reaped child process 1554, status = succeeded client # [ 137.943606] systemd[1]: mid.service: Deactivated successfully. client # [ 137.947851] systemd[1]: mid.service: Consumed 138ms CPU time over 8.877s wall clock time, 41.4M memory peak, 9K incoming IP traffic, 11.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.48 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr client # [ 138.523171] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 14f9d0646b9f472099b2297a5966bbc9 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds) lb # [ 138.682389] envoy[932]: conn peer=[2001:db8:1::4]:42444 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6171 tx=511 ms=15430 lb # [ 138.687205] envoy[932]: conn peer=[2001:db8:1::1]:50826 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4119 tx=2036 ms=8631 worker2 # [ 138.716238] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 138.727233] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) client # [ 138.757364] nix[1394]: don't know how to build these paths: client # [ 138.758878] nix[1394]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker2 # [ 138.752462] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:35Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker2 # [ 138.757634] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:35Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 138.802318] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 138.814307] nix-grpc-daemon[1620]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5) worker2 # [ 138.852733] nix-grpc-daemon[1620]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 2/5) worker2 # [ 139.025613] nix-grpc-daemon[1620]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 368 ms (attempt 3/5) worker2 # [ 139.400579] nix-grpc-daemon[1620]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 793 ms (attempt 4/5) worker2 # [ 140.200890] nix-grpc-daemon[1620]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 140.205180] nix-grpc-daemon[1620]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 140.223420] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 client # [ 140.251331] nix[1394]: copying 1 paths to 'lb:50051'... client # [ 140.252220] nix[1394]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 140.234393] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 140.246152] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 140.265460] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:37Z level=info event=niks3_push_started pid=1700 worker2 # [ 140.440828] nix-grpc-daemon[1700]: time=2026-09-22T10:48:37.617Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 140.599372] nix-daemon[873]: accepted connection from pid 1713, user nix-grpc-daemon (trusted) worker2 # [ 140.614530] nix-daemon[873]: reaped child process 1716, status = succeeded worker2 # [ 140.772758] nix-daemon[873]: accepted connection from pid 1718, user nix-grpc-daemon (trusted) worker2 # [ 140.787196] nix-daemon[873]: reaped child process 1721, status = succeeded lb # [ 140.807368] niks3-server[1196]: 2026/09/22 10:48:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 140.807814] nix-grpc-daemon[1700]: time=2026-09-22T10:48:37.985Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 140.811169] nix-grpc-daemon[1700]: time=2026-09-22T10:48:37.986Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 140.838625] niks3-server[1196]: 2026/09/22 10:48:37 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 140.848497] niks3-server[1196]: 2026/09/22 10:48:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 140.853256] niks3-server[1196]: 2026/09/22 10:48:37 INFO Signed narinfos id=45 count=1 worker2 # [ 140.850520] nix-grpc-daemon[1700]: time=2026-09-22T10:48:38.027Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.866885] niks3-server[1196]: 2026/09/22 10:48:37 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 140.871219] niks3-server[1196]: 2026/09/22 10:48:37 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 140.880678] niks3-server[1196]: 2026/09/22 10:48:37 INFO Completed upload id=45 worker2 # [ 140.874424] nix-grpc-daemon[1700]: time=2026-09-22T10:48:38.051Z level=INFO msg="Upload complete. (430ms)" lb # [ 140.882347] niks3-server[1196]: 2026/09/22 10:48:37 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 140.876816] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 140.879747] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 140.885279] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 140.892743] nix-daemon[873]: reaped child process 1698, status = succeeded client # [ 140.912455] nix[1394]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... worker2 # [ 140.895778] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 142.042704] systemd[1]: intr.service: Sent signal SIGINT to main process 1394 (nix) on client request. worker2 # [ 142.027180] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:39Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 142.049656] nix[1394]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 142.054732] nix[1394]: error: interrupted by the user client # [ 142.075285] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 142.076677] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 142.078953] systemd[1]: intr.service: Consumed 108ms CPU time over 3.555s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.2K outgoing IP traffic. worker2 # [ 142.125303] nix-daemon[1729]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 142.126873] nix-daemon[873]: reaped child process 1727, status = succeeded worker2 # [ 142.131542] nix-daemon[873]: reaped child process 1729, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.66 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw client # [ 142.181711] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: b2b30940707a42f79901f0ac4c926540 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds) worker2 # [ 142.363816] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44800 client # [ 142.387879] nix[1415]: don't know how to build these paths: client # [ 142.388750] nix[1415]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker2 # [ 142.381168] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:39Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 142.385095] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:39Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 142.424759] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43954 worker1 # [ 142.436783] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43954 client # [ 142.434520] nix[1415]: copying 1 paths to 'lb:50051'... client # [ 142.435395] nix[1415]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 142.448448] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43954 worker1 # [ 142.462981] nix-daemon[852]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) worker1 # [ 142.624593] nix-daemon[852]: accepted connection from pid 1625, user nix-grpc-daemon (trusted) worker1 # [ 142.638644] nix-daemon[852]: reaped child process 1628, status = succeeded worker1 # [ 142.784953] nix-daemon[852]: accepted connection from pid 1630, user nix-grpc-daemon (trusted) worker1 # [ 142.796858] nix-daemon[852]: reaped child process 1633, status = succeeded lb # [ 142.788745] niks3-server[1196]: 2026/09/22 10:48:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 142.821783] nix-grpc-daemon[1581]: time=2026-09-22T10:48:39.943Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 142.823855] nix-grpc-daemon[1581]: time=2026-09-22T10:48:39.945Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 142.815564] niks3-server[1196]: 2026/09/22 10:48:39 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 142.827875] niks3-server[1196]: 2026/09/22 10:48:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 142.833051] niks3-server[1196]: 2026/09/22 10:48:39 INFO Signed narinfos id=46 count=1 worker1 # [ 142.859927] nix-grpc-daemon[1581]: time=2026-09-22T10:48:39.982Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.839796] niks3-server[1196]: 2026/09/22 10:48:39 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 142.852747] niks3-server[1196]: 2026/09/22 10:48:39 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete worker1 # [ 142.882761] nix-grpc-daemon[1581]: time=2026-09-22T10:48:40.005Z level=INFO msg="Upload complete. (407ms)" lb # [ 142.858882] niks3-server[1196]: 2026/09/22 10:48:39 INFO Completed upload id=46 worker1 # [ 142.884978] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43954 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 142.862317] niks3-server[1196]: 2026/09/22 10:48:39 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 142.890670] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43954 worker1 # [ 142.900914] nix-daemon[852]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) worker1 # [ 142.906775] nix-daemon[852]: reaped child process 1623, status = succeeded worker1 # [ 142.909791] nix-daemon[852]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) client # [ 142.896697] nix[1415]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 144.744257] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 144.783268] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.08 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 145.004439] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44800 worker1 # [ 145.038064] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43954 worker2 # [ 145.028588] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:42Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker2 # [ 145.033642] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:42Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 145.073376] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 145.088132] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 145.100682] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 145.112189] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 145.281725] nix-daemon[873]: accepted connection from pid 1776, user nix-grpc-daemon (trusted) worker2 # [ 145.296785] nix-daemon[873]: reaped child process 1779, status = succeeded worker2 # [ 145.450794] nix-daemon[873]: accepted connection from pid 1781, user nix-grpc-daemon (trusted) worker2 # [ 145.464459] nix-daemon[873]: reaped child process 1784, status = succeeded lb # [ 145.483957] niks3-server[1196]: 2026/09/22 10:48:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 145.482343] nix-grpc-daemon[1700]: time=2026-09-22T10:48:42.659Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 145.484288] nix-grpc-daemon[1700]: time=2026-09-22T10:48:42.661Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 145.501061] niks3-server[1196]: 2026/09/22 10:48:42 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 145.505057] niks3-server[1196]: 2026/09/22 10:48:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 145.506943] niks3-server[1196]: 2026/09/22 10:48:42 INFO Signed narinfos id=47 count=1 worker2 # [ 145.500895] nix-grpc-daemon[1700]: time=2026-09-22T10:48:42.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.515100] niks3-server[1196]: 2026/09/22 10:48:42 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 145.517650] niks3-server[1196]: 2026/09/22 10:48:42 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 145.521664] niks3-server[1196]: 2026/09/22 10:48:42 INFO Completed upload id=47 worker2 # [ 145.515235] nix-grpc-daemon[1700]: time=2026-09-22T10:48:42.692Z level=INFO msg="Upload complete. (390ms)" lb # [ 145.523868] niks3-server[1196]: 2026/09/22 10:48:42 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 145.517502] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 145.522039] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 145.528457] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 145.530863] nix-daemon[873]: reaped child process 1774, status = succeeded client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker2 # [ 145.536092] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker1 # [ 145.620738] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:42Z level=info event=draining client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 146.360988] nix-daemon[873]: reaped child process 1788, status = succeeded worker2 # [ 146.474949] nix-daemon[873]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker2 # [ 146.489026] nix-daemon[873]: reaped child process 1807, status = succeeded lb # [ 146.507660] niks3-server[1196]: 2026/09/22 10:48:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 146.510371] nix-grpc-daemon[1700]: time=2026-09-22T10:48:43.687Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 146.511857] nix-grpc-daemon[1700]: time=2026-09-22T10:48:43.689Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 146.547576] niks3-server[1196]: 2026/09/22 10:48:43 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 146.550109] niks3-server[1196]: 2026/09/22 10:48:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 146.553573] niks3-server[1196]: 2026/09/22 10:48:43 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 146.556267] niks3-server[1196]: 2026/09/22 10:48:43 INFO Signed narinfos id=48 count=1 lb # [ 146.558115] niks3-server[1196]: 2026/09/22 10:48:43 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls worker2 # [ 146.551739] nix-grpc-daemon[1700]: time=2026-09-22T10:48:43.728Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.564065] niks3-server[1196]: 2026/09/22 10:48:43 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 146.567578] niks3-server[1196]: 2026/09/22 10:48:43 INFO Completed upload id=48 worker2 # [ 146.561231] nix-grpc-daemon[1700]: time=2026-09-22T10:48:43.738Z level=INFO msg="Upload complete. (218ms)" lb # [ 146.570223] niks3-server[1196]: 2026/09/22 10:48:43 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 146.564245] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker2 # [ 146.570874] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:43Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 146.573245] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:43Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 146.578697] nix-daemon[873]: reaped child process 1786, status = succeeded worker2 # [ 146.614918] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 146.625308] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 146.637893] nix-grpc-daemon[1700]: time=2026-09-22T10:48:43.815Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 146.645683] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 146.652703] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 146.812176] nix-daemon[873]: accepted connection from pid 1813, user nix-grpc-daemon (trusted) worker2 # [ 146.829071] nix-daemon[873]: reaped child process 1816, status = succeeded worker2 # [ 146.974948] nix-daemon[873]: accepted connection from pid 1818, user nix-grpc-daemon (trusted) worker2 # [ 146.990191] nix-daemon[873]: reaped child process 1821, status = succeeded lb # [ 147.007707] niks3-server[1196]: 2026/09/22 10:48:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 147.005439] nix-grpc-daemon[1700]: time=2026-09-22T10:48:44.182Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 147.006981] nix-grpc-daemon[1700]: time=2026-09-22T10:48:44.184Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 147.024229] niks3-server[1196]: 2026/09/22 10:48:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 147.026748] niks3-server[1196]: 2026/09/22 10:48:43 INFO Signed narinfos id=49 count=1 worker2 # [ 147.020422] nix-grpc-daemon[1700]: time=2026-09-22T10:48:44.197Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.029739] niks3-server[1196]: 2026/09/22 10:48:43 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 147.032348] niks3-server[1196]: 2026/09/22 10:48:43 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 147.036839] niks3-server[1196]: 2026/09/22 10:48:43 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 147.039470] niks3-server[1196]: 2026/09/22 10:48:43 INFO Completed upload id=49 worker2 # [ 147.033103] nix-grpc-daemon[1700]: time=2026-09-22T10:48:44.210Z level=INFO msg="Upload complete. (369ms)" worker2 # [ 147.035408] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 147.042544] niks3-server[1196]: 2026/09/22 10:48:43 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 147.039567] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 147.046291] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 147.049751] nix-daemon[873]: reaped child process 1811, status = succeeded worker2 # [ 147.055179] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 147.885573] nix-daemon[873]: reaped child process 1825, status = succeeded worker2 # [ 148.021531] nix-daemon[873]: accepted connection from pid 1841, user nix-grpc-daemon (trusted) worker2 # [ 148.037455] nix-daemon[873]: reaped child process 1844, status = succeeded lb # [ 148.053054] niks3-server[1196]: 2026/09/22 10:48:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 148.053061] nix-grpc-daemon[1700]: time=2026-09-22T10:48:45.230Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 148.055127] nix-grpc-daemon[1700]: time=2026-09-22T10:48:45.231Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 148.071447] niks3-server[1196]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 148.076647] niks3-server[1196]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 148.078781] niks3-server[1196]: 2026/09/22 10:48:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 148.080925] niks3-server[1196]: 2026/09/22 10:48:44 INFO Signed narinfos id=50 count=1 worker2 # [ 148.074500] nix-grpc-daemon[1700]: time=2026-09-22T10:48:45.251Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.084641] niks3-server[1196]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 148.088824] niks3-server[1196]: 2026/09/22 10:48:44 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 148.091892] niks3-server[1196]: 2026/09/22 10:48:44 INFO Completed upload id=50 worker2 # [ 148.086734] nix-grpc-daemon[1700]: time=2026-09-22T10:48:45.264Z level=INFO msg="Upload complete. (224ms)" lb # [ 148.093509] niks3-server[1196]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 148.090261] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker2 # [ 148.096482] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:45Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker2 # [ 148.098548] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:45Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 148.103827] nix-daemon[873]: reaped child process 1823, status = succeeded worker2 # [ 148.139398] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 148.147168] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 148.156229] nix-grpc-daemon[1700]: time=2026-09-22T10:48:45.333Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 148.163234] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 148.169957] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 148.304411] nix-daemon[873]: accepted connection from pid 1850, user nix-grpc-daemon (trusted) worker2 # [ 148.319127] nix-daemon[873]: reaped child process 1853, status = succeeded worker2 # [ 148.465172] nix-daemon[873]: accepted connection from pid 1855, user nix-grpc-daemon (trusted) worker2 # [ 148.479172] nix-daemon[873]: reaped child process 1858, status = succeeded lb # [ 148.496798] niks3-server[1196]: 2026/09/22 10:48:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 148.499480] nix-grpc-daemon[1700]: time=2026-09-22T10:48:45.676Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 148.500968] nix-grpc-daemon[1700]: time=2026-09-22T10:48:45.676Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 148.521536] niks3-server[1196]: 2026/09/22 10:48:45 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 148.533843] niks3-server[1196]: 2026/09/22 10:48:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker2 # [ 148.535323] nix-grpc-daemon[1700]: time=2026-09-22T10:48:45.712Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.541589] niks3-server[1196]: 2026/09/22 10:48:45 INFO Signed narinfos id=51 count=1 lb # [ 148.546319] niks3-server[1196]: 2026/09/22 10:48:45 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 148.558557] niks3-server[1196]: 2026/09/22 10:48:45 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete worker2 # [ 148.559394] nix-grpc-daemon[1700]: time=2026-09-22T10:48:45.736Z level=INFO msg="Upload complete. (382ms)" lb # [ 148.565944] niks3-server[1196]: 2026/09/22 10:48:45 INFO Completed upload id=51 worker2 # [ 148.562129] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 148.569518] niks3-server[1196]: 2026/09/22 10:48:45 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 148.567753] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 148.578050] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 148.583686] nix-daemon[873]: reaped child process 1848, status = succeeded client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 148.586674] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) lb # [ 148.682728] envoy[932]: conn peer=[2001:db8:1::1]:49172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2967 tx=854 ms=3339 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 149.215925] nix-daemon[873]: reaped child process 1862, status = succeeded worker2 # [ 149.361510] nix-daemon[873]: accepted connection from pid 1878, user nix-grpc-daemon (trusted) worker2 # [ 149.376164] nix-daemon[873]: reaped child process 1881, status = succeeded lb # [ 149.397265] niks3-server[1196]: 2026/09/22 10:48:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 149.398266] nix-grpc-daemon[1700]: time=2026-09-22T10:48:46.575Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 149.400434] nix-grpc-daemon[1700]: time=2026-09-22T10:48:46.577Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 149.430301] niks3-server[1196]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 149.444597] niks3-server[1196]: 2026/09/22 10:48:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker2 # [ 149.443268] nix-grpc-daemon[1700]: time=2026-09-22T10:48:46.620Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.451125] niks3-server[1196]: 2026/09/22 10:48:46 INFO Signed narinfos id=52 count=1 lb # [ 149.458344] niks3-server[1196]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 149.465881] niks3-server[1196]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 149.473587] niks3-server[1196]: 2026/09/22 10:48:46 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 149.478576] niks3-server[1196]: 2026/09/22 10:48:46 INFO Completed upload id=52 worker2 # [ 149.472596] nix-grpc-daemon[1700]: time=2026-09-22T10:48:46.649Z level=INFO msg="Upload complete. (278ms)" lb # [ 149.480914] niks3-server[1196]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 149.480168] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=0 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker2 # [ 149.494496] nix-daemon[873]: reaped child process 1860, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 4.76 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.21 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 149.932352] nix-daemon[852]: reaped child process 1637, status = succeeded worker1 # [ 150.072482] nix-daemon[852]: accepted connection from pid 1679, user nix-grpc-daemon (trusted) worker1 # [ 150.085248] nix-daemon[852]: reaped child process 1682, status = succeeded lb # [ 150.074753] niks3-server[1196]: 2026/09/22 10:48:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.104839] nix-grpc-daemon[1581]: time=2026-09-22T10:48:47.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.107029] nix-grpc-daemon[1581]: time=2026-09-22T10:48:47.229Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 150.096096] niks3-server[1196]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 150.098915] niks3-server[1196]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 150.103237] niks3-server[1196]: 2026/09/22 10:48:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 150.105469] niks3-server[1196]: 2026/09/22 10:48:46 INFO Signed narinfos id=53 count=1 worker1 # [ 150.131193] nix-grpc-daemon[1581]: time=2026-09-22T10:48:47.252Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.109280] niks3-server[1196]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 150.113055] niks3-server[1196]: 2026/09/22 10:48:46 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 150.116582] niks3-server[1196]: 2026/09/22 10:48:46 INFO Completed upload id=53 worker1 # [ 150.140330] nix-grpc-daemon[1581]: time=2026-09-22T10:48:47.262Z level=INFO msg="Upload complete. (217ms)" lb # [ 150.118195] niks3-server[1196]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 150.143335] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43954 duration_s=7 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 150.151233] nix-daemon[852]: reaped child process 1635, status = succeeded client # [ 150.173838] systemd[1]: sw.service: Deactivated successfully. client # [ 150.178516] systemd[1]: sw.service: Consumed 121ms CPU time over 7.994s wall clock time, 41.4M memory peak, 7.3K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 150.624979] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:47Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.07 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 151.827286] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50190 worker1 # [ 151.851840] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:48Z level=info event=scheduler_restarting worker2 # [ 151.831174] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:49Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 151.868305] nix-grpc-daemon[1479]: ts=2026-09-22T10:48:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 151.885299] nix-daemon[852]: reaped child process 1547, status = succeeded worker1 # [ 152.471475] nix-grpc-daemon[1479]: E0000 00:00:1790074129.593595 1524 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 152.476337] nix-grpc-daemon[1479]: E0000 00:00:1790074129.593740 1524 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 152.658551] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 152.663325] systemd[1]: nix-grpc-daemon.service: Consumed 646ms CPU time over 24.206s wall clock time, 32.5M memory peak, 20.9K incoming IP traffic, 27.6K outgoing IP traffic. worker1 # [ 152.678806] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 152.864467] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 152.866908] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 152.871396] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 152.878165] nix-grpc-daemon[1696]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 152.881101] nix-grpc-daemon[1696]: E0000 00:00:1790074130.000222 1696 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 152.886615] nix-grpc-daemon[1696]: E0000 00:00:1790074130.005717 1696 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 152.890761] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 152.892759] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 152.898102] nix-grpc-daemon[1696]: E0000 00:00:1790074130.020025 1737 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.95 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 152.910685] nix-grpc-daemon[1696]: E0000 00:00:1790074130.033054 1737 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 152.913990] nix-grpc-daemon[1696]: E0000 00:00:1790074130.035218 1737 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 152.924767] nix-grpc-daemon[1696]: E0000 00:00:1790074130.047079 1737 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 152.936940] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 152.909271] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:50Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:44796 worker2 # [ 152.910870] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.14 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 11.97 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 154.370398] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 154.382380] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker2 # [ 154.367951] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 154.411962] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:51Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 154.413648] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:51Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 154.415425] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:51Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 154.416987] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:51Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 154.487105] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 154.499651] nix-grpc-daemon[1696]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5) worker1 # [ 154.565498] nix-grpc-daemon[1696]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 161 ms (attempt 2/5) worker1 # [ 154.732602] nix-grpc-daemon[1696]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 3/5) worker1 # [ 154.793743] nix-grpc-daemon[1696]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 263 ms (attempt 4/5) worker1 # [ 155.063128] nix-grpc-daemon[1696]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 155.067091] nix-grpc-daemon[1696]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 155.084967] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 155.096890] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 155.107200] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 155.128387] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:52Z level=info event=niks3_push_started pid=1756 worker1 # [ 155.330620] nix-grpc-daemon[1756]: time=2026-09-22T10:48:52.452Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 155.505881] nix-daemon[852]: accepted connection from pid 1769, user nix-grpc-daemon (trusted) worker1 # [ 155.518066] nix-daemon[852]: reaped child process 1772, status = succeeded worker1 # [ 155.689765] nix-daemon[852]: accepted connection from pid 1774, user nix-grpc-daemon (trusted) worker1 # [ 155.702410] nix-daemon[852]: reaped child process 1777, status = succeeded lb # [ 155.696078] niks3-server[1196]: 2026/09/22 10:48:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.729688] nix-grpc-daemon[1756]: time=2026-09-22T10:48:52.852Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 155.732654] nix-grpc-daemon[1756]: time=2026-09-22T10:48:52.853Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 155.737975] niks3-server[1196]: 2026/09/22 10:48:52 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 155.751062] niks3-server[1196]: 2026/09/22 10:48:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 155.757263] niks3-server[1196]: 2026/09/22 10:48:52 INFO Signed narinfos id=54 count=1 worker1 # [ 155.785032] nix-grpc-daemon[1756]: time=2026-09-22T10:48:52.907Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.771056] niks3-server[1196]: 2026/09/22 10:48:52 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 155.775485] niks3-server[1196]: 2026/09/22 10:48:52 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 155.779162] niks3-server[1196]: 2026/09/22 10:48:52 INFO Completed upload id=54 lb # [ 155.781452] niks3-server[1196]: 2026/09/22 10:48:52 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 155.804460] nix-grpc-daemon[1756]: time=2026-09-22T10:48:52.926Z level=INFO msg="Upload complete. (469ms)" worker1 # [ 155.811278] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 155.816280] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 155.824257] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 155.831905] nix-daemon[852]: reaped child process 1754, status = succeeded worker1 # [ 155.838148] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 156.660871] nix-daemon[852]: reaped child process 1781, status = succeeded worker1 # [ 156.823386] nix-daemon[852]: accepted connection from pid 1797, user nix-grpc-daemon (trusted) worker1 # [ 156.836888] nix-daemon[852]: reaped child process 1800, status = succeeded lb # [ 156.826745] niks3-server[1196]: 2026/09/22 10:48:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.860824] nix-grpc-daemon[1756]: time=2026-09-22T10:48:53.982Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 156.862585] nix-grpc-daemon[1756]: time=2026-09-22T10:48:53.984Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 156.865415] niks3-server[1196]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 156.873145] niks3-server[1196]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 156.882620] niks3-server[1196]: 2026/09/22 10:48:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 156.886738] niks3-server[1196]: 2026/09/22 10:48:53 INFO Signed narinfos id=55 count=1 worker1 # [ 156.911417] nix-grpc-daemon[1756]: time=2026-09-22T10:48:54.033Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.891752] niks3-server[1196]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 156.896232] niks3-server[1196]: 2026/09/22 10:48:53 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 156.901310] niks3-server[1196]: 2026/09/22 10:48:53 INFO Completed upload id=55 worker1 # [ 156.925435] nix-grpc-daemon[1756]: time=2026-09-22T10:48:54.047Z level=INFO msg="Upload complete. (281ms)" lb # [ 156.903659] niks3-server[1196]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 156.930646] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=1 worker2 # [ 156.902283] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:54Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.942971] nix-daemon[852]: reaped child process 1779, status = succeeded worker2 # [ 156.912277] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:54Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 156.974742] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 156.985405] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 156.995518] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 157.005164] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 157.178906] nix-daemon[852]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 157.191644] nix-daemon[852]: reaped child process 1807, status = succeeded worker1 # [ 157.356438] nix-daemon[852]: accepted connection from pid 1809, user nix-grpc-daemon (trusted) worker1 # [ 157.369085] nix-daemon[852]: reaped child process 1812, status = succeeded lb # [ 157.360836] niks3-server[1196]: 2026/09/22 10:48:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.393217] nix-grpc-daemon[1756]: time=2026-09-22T10:48:54.515Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 157.394724] nix-grpc-daemon[1756]: time=2026-09-22T10:48:54.515Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 157.386314] niks3-server[1196]: 2026/09/22 10:48:54 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 157.393717] niks3-server[1196]: 2026/09/22 10:48:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 157.398727] niks3-server[1196]: 2026/09/22 10:48:54 INFO Signed narinfos id=56 count=1 worker1 # [ 157.425082] nix-grpc-daemon[1756]: time=2026-09-22T10:48:54.547Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.402587] niks3-server[1196]: 2026/09/22 10:48:54 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 157.408526] niks3-server[1196]: 2026/09/22 10:48:54 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 157.412027] niks3-server[1196]: 2026/09/22 10:48:54 INFO Completed upload id=56 worker1 # [ 157.437227] nix-grpc-daemon[1756]: time=2026-09-22T10:48:54.559Z level=INFO msg="Upload complete. (421ms)" lb # [ 157.413843] niks3-server[1196]: 2026/09/22 10:48:54 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 157.439511] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 157.442071] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 157.450443] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 157.452664] nix-daemon[852]: reaped child process 1802, status = succeeded worker1 # [ 157.457860] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 158.079559] nix-daemon[852]: reaped child process 1816, status = succeeded worker1 # [ 158.233485] nix-daemon[852]: accepted connection from pid 1832, user nix-grpc-daemon (trusted) worker1 # [ 158.245488] nix-daemon[852]: reaped child process 1835, status = succeeded lb # [ 158.239864] niks3-server[1196]: 2026/09/22 10:48:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.270249] nix-grpc-daemon[1756]: time=2026-09-22T10:48:55.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.272446] nix-grpc-daemon[1756]: time=2026-09-22T10:48:55.394Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 158.272979] niks3-server[1196]: 2026/09/22 10:48:55 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 158.281975] niks3-server[1196]: 2026/09/22 10:48:55 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 158.293194] niks3-server[1196]: 2026/09/22 10:48:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 158.297461] niks3-server[1196]: 2026/09/22 10:48:55 INFO Signed narinfos id=57 count=1 worker1 # [ 158.323859] nix-grpc-daemon[1756]: time=2026-09-22T10:48:55.445Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.303155] niks3-server[1196]: 2026/09/22 10:48:55 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 158.311773] niks3-server[1196]: 2026/09/22 10:48:55 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 158.318311] niks3-server[1196]: 2026/09/22 10:48:55 INFO Completed upload id=57 lb # [ 158.319686] niks3-server[1196]: 2026/09/22 10:48:55 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 158.342646] nix-grpc-daemon[1756]: time=2026-09-22T10:48:55.464Z level=INFO msg="Upload complete. (278ms)" worker2 # [ 158.318544] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:55Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 158.324319] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:55Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 158.351234] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=1 worker1 # [ 158.357702] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 158.366783] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 158.371407] nix-daemon[852]: reaped child process 1814, status = succeeded worker1 # [ 158.374781] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 158.379848] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 158.534642] nix-daemon[852]: accepted connection from pid 1839, user nix-grpc-daemon (trusted) worker1 # [ 158.547721] nix-daemon[852]: reaped child process 1842, status = succeeded lb # [ 158.682994] envoy[932]: conn peer=[2001:db8:1::1]:44822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9611 tx=4423 ms=4533 worker1 # [ 158.710844] nix-daemon[852]: accepted connection from pid 1844, user nix-grpc-daemon (trusted) lb # [ 158.686753] envoy[932]: conn peer=[2001:db8:1::1]:49188 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2962 tx=1516 ms=7766 lb # [ 158.690267] envoy[932]: conn peer=[2001:db8:1::3]:51372 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1114 tx=448 ms=23197 worker1 # [ 158.722259] nix-daemon[852]: reaped child process 1847, status = succeeded lb # [ 158.713729] niks3-server[1196]: 2026/09/22 10:48:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.745549] nix-grpc-daemon[1756]: time=2026-09-22T10:48:55.867Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.747090] nix-grpc-daemon[1756]: time=2026-09-22T10:48:55.869Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 158.741587] niks3-server[1196]: 2026/09/22 10:48:55 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 158.752599] niks3-server[1196]: 2026/09/22 10:48:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 158.759314] niks3-server[1196]: 2026/09/22 10:48:55 INFO Signed narinfos id=58 count=1 worker1 # [ 158.786088] nix-grpc-daemon[1756]: time=2026-09-22T10:48:55.908Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.763112] niks3-server[1196]: 2026/09/22 10:48:55 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 158.773612] niks3-server[1196]: 2026/09/22 10:48:55 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 158.802550] nix-grpc-daemon[1756]: time=2026-09-22T10:48:55.924Z level=INFO msg="Upload complete. (417ms)" lb # [ 158.779138] niks3-server[1196]: 2026/09/22 10:48:55 INFO Completed upload id=58 worker1 # [ 158.804658] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 158.783598] niks3-server[1196]: 2026/09/22 10:48:55 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 158.807568] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 158.814064] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 158.820130] nix-daemon[852]: reaped child process 1837, status = succeeded worker1 # [ 158.823073] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 159.850800] nix-daemon[852]: reaped child process 1851, status = succeeded worker1 # [ 160.007821] nix-daemon[852]: accepted connection from pid 1867, user nix-grpc-daemon (trusted) worker1 # [ 160.020955] nix-daemon[852]: reaped child process 1870, status = succeeded lb # [ 160.011431] niks3-server[1196]: 2026/09/22 10:48:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.040047] nix-grpc-daemon[1756]: time=2026-09-22T10:48:57.162Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 160.043280] nix-grpc-daemon[1756]: time=2026-09-22T10:48:57.163Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 160.031211] niks3-server[1196]: 2026/09/22 10:48:56 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 160.035328] niks3-server[1196]: 2026/09/22 10:48:56 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 160.039237] niks3-server[1196]: 2026/09/22 10:48:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 160.041969] niks3-server[1196]: 2026/09/22 10:48:56 INFO Signed narinfos id=59 count=1 worker1 # [ 160.065746] nix-grpc-daemon[1756]: time=2026-09-22T10:48:57.187Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.044762] niks3-server[1196]: 2026/09/22 10:48:56 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 160.049975] niks3-server[1196]: 2026/09/22 10:48:56 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 160.053062] niks3-server[1196]: 2026/09/22 10:48:56 INFO Completed upload id=59 worker1 # [ 160.078132] nix-grpc-daemon[1756]: time=2026-09-22T10:48:57.200Z level=INFO msg="Upload complete. (247ms)" lb # [ 160.054779] niks3-server[1196]: 2026/09/22 10:48:56 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 160.080873] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=1 worker1 # [ 160.085162] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker2 # [ 160.052607] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:57Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 160.092166] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 160.094121] nix-daemon[852]: reaped child process 1849, status = succeeded worker2 # [ 160.062177] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:57Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 160.099228] nix-grpc-daemon[1756]: time=2026-09-22T10:48:57.221Z level=INFO msg="All 1 paths already cached" worker1 # [ 160.102926] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 160.107948] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 160.261189] nix-daemon[852]: accepted connection from pid 1874, user nix-grpc-daemon (trusted) worker1 # [ 160.274632] nix-daemon[852]: reaped child process 1877, status = succeeded worker1 # [ 160.441375] nix-daemon[852]: accepted connection from pid 1879, user nix-grpc-daemon (trusted) worker1 # [ 160.454242] nix-daemon[852]: reaped child process 1882, status = succeeded lb # [ 160.446386] niks3-server[1196]: 2026/09/22 10:48:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.474839] nix-grpc-daemon[1756]: time=2026-09-22T10:48:57.597Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 160.476349] nix-grpc-daemon[1756]: time=2026-09-22T10:48:57.598Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 160.463234] niks3-server[1196]: 2026/09/22 10:48:57 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 160.473286] niks3-server[1196]: 2026/09/22 10:48:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 160.480606] niks3-server[1196]: 2026/09/22 10:48:57 INFO Signed narinfos id=60 count=1 worker1 # [ 160.507826] nix-grpc-daemon[1756]: time=2026-09-22T10:48:57.630Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.484827] niks3-server[1196]: 2026/09/22 10:48:57 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 160.497788] niks3-server[1196]: 2026/09/22 10:48:57 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 160.528353] nix-grpc-daemon[1756]: time=2026-09-22T10:48:57.650Z level=INFO msg="Upload complete. (415ms)" lb # [ 160.504538] niks3-server[1196]: 2026/09/22 10:48:57 INFO Completed upload id=60 worker1 # [ 160.530516] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 160.508264] niks3-server[1196]: 2026/09/22 10:48:57 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 160.534565] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 160.541472] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 160.544338] nix-daemon[852]: reaped child process 1872, status = succeeded worker1 # [ 160.549266] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 161.764868] nix-daemon[852]: reaped child process 1886, status = succeeded worker1 # [ 161.902102] nix-daemon[852]: accepted connection from pid 1902, user nix-grpc-daemon (trusted) worker1 # [ 161.914329] nix-daemon[852]: reaped child process 1905, status = succeeded lb # [ 161.904975] niks3-server[1196]: 2026/09/22 10:48:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.938885] nix-grpc-daemon[1756]: time=2026-09-22T10:48:59.060Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 161.944178] nix-grpc-daemon[1756]: time=2026-09-22T10:48:59.062Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 161.940850] niks3-server[1196]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 161.950392] niks3-server[1196]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 161.959155] niks3-server[1196]: 2026/09/22 10:48:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 161.988882] nix-grpc-daemon[1756]: time=2026-09-22T10:48:59.111Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.965101] niks3-server[1196]: 2026/09/22 10:48:58 INFO Signed narinfos id=61 count=1 lb # [ 161.970210] niks3-server[1196]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 161.976398] niks3-server[1196]: 2026/09/22 10:48:58 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 161.980466] niks3-server[1196]: 2026/09/22 10:48:58 INFO Completed upload id=61 lb # [ 161.982337] niks3-server[1196]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 162.005720] nix-grpc-daemon[1756]: time=2026-09-22T10:48:59.128Z level=INFO msg="Upload complete. (249ms)" worker1 # [ 162.010797] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=1 worker2 # [ 161.982302] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:59Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.023743] nix-daemon[852]: reaped child process 1884, status = succeeded worker2 # [ 161.991916] nix-grpc-daemon[1620]: ts=2026-09-22T10:48:59Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 162.056181] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 162.067264] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 162.080433] nix-grpc-daemon[1756]: time=2026-09-22T10:48:59.202Z level=INFO msg="All 1 paths already cached" worker1 # [ 162.088492] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 162.097170] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 162.241283] nix-daemon[852]: accepted connection from pid 1909, user nix-grpc-daemon (trusted) worker1 # [ 162.254306] nix-daemon[852]: reaped child process 1912, status = succeeded worker1 # [ 162.374566] nix-daemon[852]: accepted connection from pid 1914, user nix-grpc-daemon (trusted) worker1 # [ 162.387703] nix-daemon[852]: reaped child process 1917, status = succeeded lb # [ 162.377081] niks3-server[1196]: 2026/09/22 10:48:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.409751] nix-grpc-daemon[1756]: time=2026-09-22T10:48:59.532Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 162.411370] nix-grpc-daemon[1756]: time=2026-09-22T10:48:59.533Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 162.405400] niks3-server[1196]: 2026/09/22 10:48:59 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 162.416644] niks3-server[1196]: 2026/09/22 10:48:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 162.420616] niks3-server[1196]: 2026/09/22 10:48:59 INFO Signed narinfos id=62 count=1 worker1 # [ 162.446837] nix-grpc-daemon[1756]: time=2026-09-22T10:48:59.569Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.428739] niks3-server[1196]: 2026/09/22 10:48:59 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 162.438885] niks3-server[1196]: 2026/09/22 10:48:59 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 162.442660] niks3-server[1196]: 2026/09/22 10:48:59 INFO Completed upload id=62 worker1 # [ 162.466594] nix-grpc-daemon[1756]: time=2026-09-22T10:48:59.588Z level=INFO msg="Upload complete. (358ms)" worker1 # [ 162.468739] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 162.445712] niks3-server[1196]: 2026/09/22 10:48:59 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 162.472043] nix-grpc-daemon[1696]: ts=2026-09-22T10:48:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 162.478595] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 162.482192] nix-daemon[852]: reaped child process 1907, status = succeeded worker1 # [ 162.487219] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 163.303430] nix-daemon[852]: reaped child process 1921, status = succeeded worker1 # [ 163.429102] nix-daemon[852]: accepted connection from pid 1937, user nix-grpc-daemon (trusted) worker1 # [ 163.441651] nix-daemon[852]: reaped child process 1940, status = succeeded lb # [ 163.427804] niks3-server[1196]: 2026/09/22 10:49:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.460073] nix-grpc-daemon[1756]: time=2026-09-22T10:49:00.582Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 163.462344] nix-grpc-daemon[1756]: time=2026-09-22T10:49:00.583Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 163.464150] niks3-server[1196]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 163.478619] niks3-server[1196]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 163.486350] niks3-server[1196]: 2026/09/22 10:49:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 163.491635] niks3-server[1196]: 2026/09/22 10:49:00 INFO Signed narinfos id=63 count=1 worker1 # [ 163.518580] nix-grpc-daemon[1756]: time=2026-09-22T10:49:00.640Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.498233] niks3-server[1196]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 163.507384] niks3-server[1196]: 2026/09/22 10:49:00 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 163.512303] niks3-server[1196]: 2026/09/22 10:49:00 INFO Completed upload id=63 worker1 # [ 163.536314] nix-grpc-daemon[1756]: time=2026-09-22T10:49:00.658Z level=INFO msg="Upload complete. (242ms)" lb # [ 163.517071] niks3-server[1196]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 163.541700] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=1 worker2 # [ 163.514487] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:00Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.549264] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker2 # [ 163.521813] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:00Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 163.559358] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 163.562119] nix-daemon[852]: reaped child process 1919, status = succeeded worker1 # [ 163.565746] nix-grpc-daemon[1756]: time=2026-09-22T10:49:00.688Z level=INFO msg="All 1 paths already cached" worker1 # [ 163.569341] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 163.573539] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 163.703756] nix-daemon[852]: accepted connection from pid 1944, user nix-grpc-daemon (trusted) worker1 # [ 163.718264] nix-daemon[852]: reaped child process 1947, status = succeeded worker1 # [ 163.850038] nix-daemon[852]: accepted connection from pid 1949, user nix-grpc-daemon (trusted) worker1 # [ 163.862917] nix-daemon[852]: reaped child process 1952, status = succeeded lb # [ 163.849739] niks3-server[1196]: 2026/09/22 10:49:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.882352] nix-grpc-daemon[1756]: time=2026-09-22T10:49:01.004Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 163.883775] nix-grpc-daemon[1756]: time=2026-09-22T10:49:01.004Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 163.874146] niks3-server[1196]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 163.886566] niks3-server[1196]: 2026/09/22 10:49:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker1 # [ 163.917548] nix-grpc-daemon[1756]: time=2026-09-22T10:49:01.039Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.893535] niks3-server[1196]: 2026/09/22 10:49:00 INFO Signed narinfos id=64 count=1 lb # [ 163.897647] niks3-server[1196]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 163.910097] niks3-server[1196]: 2026/09/22 10:49:00 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete worker1 # [ 163.940445] nix-grpc-daemon[1756]: time=2026-09-22T10:49:01.062Z level=INFO msg="Upload complete. (361ms)" lb # [ 163.916798] niks3-server[1196]: 2026/09/22 10:49:00 INFO Completed upload id=64 worker1 # [ 163.942618] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 163.920075] niks3-server[1196]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 163.948435] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 163.956060] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 163.957370] nix-daemon[852]: reaped child process 1942, status = succeeded worker1 # [ 163.962711] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 164.778422] nix-daemon[852]: reaped child process 1956, status = succeeded worker1 # [ 164.919603] nix-daemon[852]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) worker1 # [ 164.932653] nix-daemon[852]: reaped child process 1975, status = succeeded lb # [ 164.925457] niks3-server[1196]: 2026/09/22 10:49:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.957465] nix-grpc-daemon[1756]: time=2026-09-22T10:49:02.079Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 164.960042] nix-grpc-daemon[1756]: time=2026-09-22T10:49:02.081Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 164.953361] niks3-server[1196]: 2026/09/22 10:49:01 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 164.971412] niks3-server[1196]: 2026/09/22 10:49:01 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 164.980422] niks3-server[1196]: 2026/09/22 10:49:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 164.986567] niks3-server[1196]: 2026/09/22 10:49:01 INFO Signed narinfos id=65 count=1 worker1 # [ 165.010847] nix-grpc-daemon[1756]: time=2026-09-22T10:49:02.132Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.989921] niks3-server[1196]: 2026/09/22 10:49:01 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 164.999307] niks3-server[1196]: 2026/09/22 10:49:01 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 165.004412] niks3-server[1196]: 2026/09/22 10:49:01 INFO Completed upload id=65 lb # [ 165.008076] niks3-server[1196]: 2026/09/22 10:49:01 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 165.030788] nix-grpc-daemon[1756]: time=2026-09-22T10:49:02.152Z level=INFO msg="Upload complete. (261ms)" worker2 # [ 165.007690] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:02Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 165.036734] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=1 worker1 # [ 165.051326] nix-daemon[852]: reaped child process 1954, status = succeeded worker1 # [ 165.080773] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker2 # [ 165.053807] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:02Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 165.093070] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 165.105817] nix-grpc-daemon[1756]: time=2026-09-22T10:49:02.228Z level=INFO msg="All 2 paths already cached" worker1 # [ 165.113870] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 165.124181] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 165.286739] nix-daemon[852]: accepted connection from pid 1979, user nix-grpc-daemon (trusted) worker1 # [ 165.300149] nix-daemon[852]: reaped child process 1982, status = succeeded worker1 # [ 165.446087] nix-daemon[852]: accepted connection from pid 1984, user nix-grpc-daemon (trusted) worker1 # [ 165.459172] nix-daemon[852]: reaped child process 1987, status = succeeded lb # [ 165.448612] niks3-server[1196]: 2026/09/22 10:49:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.477203] nix-grpc-daemon[1756]: time=2026-09-22T10:49:02.599Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.478714] nix-grpc-daemon[1756]: time=2026-09-22T10:49:02.601Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 165.466065] niks3-server[1196]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 165.470105] niks3-server[1196]: 2026/09/22 10:49:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 165.472481] niks3-server[1196]: 2026/09/22 10:49:02 INFO Signed narinfos id=66 count=1 worker1 # [ 165.497776] nix-grpc-daemon[1756]: time=2026-09-22T10:49:02.620Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.475270] niks3-server[1196]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 165.481876] niks3-server[1196]: 2026/09/22 10:49:02 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 165.485529] niks3-server[1196]: 2026/09/22 10:49:02 INFO Completed upload id=66 worker1 # [ 165.509301] nix-grpc-daemon[1756]: time=2026-09-22T10:49:02.631Z level=INFO msg="Upload complete. (374ms)" lb # [ 165.487197] niks3-server[1196]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 165.511490] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 165.515970] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 165.521978] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 165.524346] nix-daemon[852]: reaped child process 1977, status = succeeded worker1 # [ 165.529770] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 166.551571] nix-daemon[852]: reaped child process 1991, status = succeeded worker1 # [ 166.686251] nix-daemon[852]: accepted connection from pid 2007, user nix-grpc-daemon (trusted) worker1 # [ 166.699469] nix-daemon[852]: reaped child process 2010, status = succeeded lb # [ 166.691664] niks3-server[1196]: 2026/09/22 10:49:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.724600] nix-grpc-daemon[1756]: time=2026-09-22T10:49:03.846Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 166.726345] nix-grpc-daemon[1756]: time=2026-09-22T10:49:03.848Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 166.732412] niks3-server[1196]: 2026/09/22 10:49:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker1 # [ 166.761133] nix-grpc-daemon[1756]: time=2026-09-22T10:49:03.883Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.738096] niks3-server[1196]: 2026/09/22 10:49:03 INFO Signed narinfos id=67 count=1 lb # [ 166.747584] niks3-server[1196]: 2026/09/22 10:49:03 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 166.755139] niks3-server[1196]: 2026/09/22 10:49:03 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 166.761879] niks3-server[1196]: 2026/09/22 10:49:03 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 166.770625] niks3-server[1196]: 2026/09/22 10:49:03 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 166.774842] niks3-server[1196]: 2026/09/22 10:49:03 INFO Completed upload id=67 lb # [ 166.776644] niks3-server[1196]: 2026/09/22 10:49:03 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 166.800278] nix-grpc-daemon[1756]: time=2026-09-22T10:49:03.922Z level=INFO msg="Upload complete. (263ms)" worker2 # [ 166.776554] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:03Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 166.805712] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=1 worker1 # [ 166.818444] nix-daemon[852]: reaped child process 1989, status = succeeded worker1 # [ 166.850450] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 166.862668] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 166.875165] nix-grpc-daemon[1756]: time=2026-09-22T10:49:03.997Z level=INFO msg="All 2 paths already cached" worker1 # [ 166.882869] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 166.893168] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 167.061204] nix-daemon[852]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker1 # [ 167.075270] nix-daemon[852]: reaped child process 2017, status = succeeded worker1 # [ 167.224209] nix-daemon[852]: accepted connection from pid 2019, user nix-grpc-daemon (trusted) worker1 # [ 167.236897] nix-daemon[852]: reaped child process 2022, status = succeeded lb # [ 167.228795] niks3-server[1196]: 2026/09/22 10:49:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.260589] nix-grpc-daemon[1756]: time=2026-09-22T10:49:04.382Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 167.262158] nix-grpc-daemon[1756]: time=2026-09-22T10:49:04.384Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 167.256110] niks3-server[1196]: 2026/09/22 10:49:04 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 167.267512] niks3-server[1196]: 2026/09/22 10:49:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 167.273891] niks3-server[1196]: 2026/09/22 10:49:04 INFO Signed narinfos id=68 count=1 worker1 # [ 167.300846] nix-grpc-daemon[1756]: time=2026-09-22T10:49:04.423Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.277470] niks3-server[1196]: 2026/09/22 10:49:04 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 167.289983] niks3-server[1196]: 2026/09/22 10:49:04 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete worker1 # [ 167.319952] nix-grpc-daemon[1756]: time=2026-09-22T10:49:04.442Z level=INFO msg="Upload complete. (415ms)" lb # [ 167.296267] niks3-server[1196]: 2026/09/22 10:49:04 INFO Completed upload id=68 worker1 # [ 167.322642] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 167.299900] niks3-server[1196]: 2026/09/22 10:49:04 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 167.328128] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 167.337284] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 167.341726] nix-daemon[852]: reaped child process 2012, status = succeeded worker1 # [ 167.346933] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 168.174832] nix-daemon[852]: reaped child process 2026, status = succeeded worker1 # [ 168.325097] nix-daemon[852]: accepted connection from pid 2042, user nix-grpc-daemon (trusted) worker1 # [ 168.336788] nix-daemon[852]: reaped child process 2045, status = succeeded lb # [ 168.330409] niks3-server[1196]: 2026/09/22 10:49:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.363401] nix-grpc-daemon[1756]: time=2026-09-22T10:49:05.485Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.365647] nix-grpc-daemon[1756]: time=2026-09-22T10:49:05.487Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 168.366136] niks3-server[1196]: 2026/09/22 10:49:05 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 168.373347] niks3-server[1196]: 2026/09/22 10:49:05 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 168.386332] niks3-server[1196]: 2026/09/22 10:49:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 168.392053] niks3-server[1196]: 2026/09/22 10:49:05 INFO Signed narinfos id=69 count=1 worker1 # [ 168.418922] nix-grpc-daemon[1756]: time=2026-09-22T10:49:05.541Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.397411] niks3-server[1196]: 2026/09/22 10:49:05 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 168.406831] niks3-server[1196]: 2026/09/22 10:49:05 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 168.412201] niks3-server[1196]: 2026/09/22 10:49:05 INFO Completed upload id=69 lb # [ 168.415520] niks3-server[1196]: 2026/09/22 10:49:05 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 168.438170] nix-grpc-daemon[1756]: time=2026-09-22T10:49:05.560Z level=INFO msg="Upload complete. (284ms)" worker2 # [ 168.415200] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:05Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 168.446653] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=1 worker1 # [ 168.459846] nix-daemon[852]: reaped child process 2024, status = succeeded worker1 # [ 168.490255] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 168.503686] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 168.519365] nix-grpc-daemon[1756]: time=2026-09-22T10:49:05.641Z level=INFO msg="All 2 paths already cached" worker1 # [ 168.527584] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 168.535861] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 168.706651] nix-daemon[852]: accepted connection from pid 2049, user nix-grpc-daemon (trusted) worker1 # [ 168.719913] nix-daemon[852]: reaped child process 2052, status = succeeded worker1 # [ 168.874258] nix-daemon[852]: accepted connection from pid 2054, user nix-grpc-daemon (trusted) worker1 # [ 168.886877] nix-daemon[852]: reaped child process 2057, status = succeeded lb # [ 168.878857] niks3-server[1196]: 2026/09/22 10:49:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.911108] nix-grpc-daemon[1756]: time=2026-09-22T10:49:06.033Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.912551] nix-grpc-daemon[1756]: time=2026-09-22T10:49:06.033Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 168.902145] niks3-server[1196]: 2026/09/22 10:49:05 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 168.914985] niks3-server[1196]: 2026/09/22 10:49:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign lb # [ 168.920327] niks3-server[1196]: 2026/09/22 10:49:05 INFO Signed narinfos id=70 count=1 worker1 # [ 168.947343] nix-grpc-daemon[1756]: time=2026-09-22T10:49:06.069Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.927391] niks3-server[1196]: 2026/09/22 10:49:05 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 168.939093] niks3-server[1196]: 2026/09/22 10:49:05 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete worker1 # [ 168.969250] nix-grpc-daemon[1756]: time=2026-09-22T10:49:06.091Z level=INFO msg="Upload complete. (420ms)" lb # [ 168.945548] niks3-server[1196]: 2026/09/22 10:49:05 INFO Completed upload id=70 lb # [ 168.948351] niks3-server[1196]: 2026/09/22 10:49:05 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 168.972639] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 168.978839] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 worker1 # [ 168.988278] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 168.991485] nix-daemon[852]: reaped child process 2047, status = succeeded worker1 # [ 168.997508] nix-daemon[852]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 170.213350] nix-daemon[852]: reaped child process 2061, status = succeeded worker1 # [ 170.351458] nix-daemon[852]: accepted connection from pid 2077, user nix-grpc-daemon (trusted) worker1 # [ 170.365568] nix-daemon[852]: reaped child process 2080, status = succeeded lb # [ 170.357585] niks3-server[1196]: 2026/09/22 10:49:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.389650] nix-grpc-daemon[1756]: time=2026-09-22T10:49:07.511Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 170.391464] nix-grpc-daemon[1756]: time=2026-09-22T10:49:07.513Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 170.399372] niks3-server[1196]: 2026/09/22 10:49:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 170.407364] niks3-server[1196]: 2026/09/22 10:49:07 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst worker1 # [ 170.439726] nix-grpc-daemon[1756]: time=2026-09-22T10:49:07.561Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.415273] niks3-server[1196]: 2026/09/22 10:49:07 INFO Signed narinfos id=71 count=1 lb # [ 170.420269] niks3-server[1196]: 2026/09/22 10:49:07 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 170.424827] niks3-server[1196]: 2026/09/22 10:49:07 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 170.436498] niks3-server[1196]: 2026/09/22 10:49:07 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 170.442597] niks3-server[1196]: 2026/09/22 10:49:07 INFO Completed upload id=71 lb # [ 170.444561] niks3-server[1196]: 2026/09/22 10:49:07 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 170.468481] nix-grpc-daemon[1756]: time=2026-09-22T10:49:07.590Z level=INFO msg="Upload complete. (264ms)" worker1 # [ 170.476383] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44278 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=1 worker1 # [ 170.489616] nix-daemon[852]: reaped child process 2059, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.40 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 170.615317] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 8a317e263d3b4f5d8b7994e260f60c34 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client # [ 170.840967] nix[1495]: don't know how to build these paths: client # [ 170.841894] nix[1495]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker2 # [ 170.822511] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 170.828074] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 client # [ 170.867726] nix[1495]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker worker2 # [ 170.849602] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:08Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 178.686245] envoy[932]: conn peer=[2001:db8:1::1]:52754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27098 tx=12410 ms=16127 client # [ 200.870360] nix[1495]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu} client # [ 200.876787] nix[1495]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 200.917434] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 200.920892] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 200.925764] systemd[1]: gpu.service: Consumed 143ms CPU time over 30.309s wall clock time, 37.6M memory peak, 5.1K incoming IP traffic, 5.1K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.74 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 47.83 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1 # [ 202.904355] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:40Z level=info event=unhealthy reason=min_free worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.98 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 203.175144] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 203.180551] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 203.197305] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:40Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 203.201575] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:40Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 203.244710] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 203.255487] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 203.266712] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 203.277712] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 203.441985] nix-daemon[873]: accepted connection from pid 1915, user nix-grpc-daemon (trusted) worker2 # [ 203.453721] nix-daemon[873]: reaped child process 1918, status = succeeded worker2 # [ 203.607783] nix-daemon[873]: accepted connection from pid 1920, user nix-grpc-daemon (trusted) worker2 # [ 203.619300] nix-daemon[873]: reaped child process 1923, status = succeeded lb # [ 203.640359] niks3-server[1196]: 2026/09/22 10:49:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.639139] nix-grpc-daemon[1700]: time=2026-09-22T10:49:40.816Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 203.640491] nix-grpc-daemon[1700]: time=2026-09-22T10:49:40.816Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 203.656061] niks3-server[1196]: 2026/09/22 10:49:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign worker2 # [ 203.652371] nix-grpc-daemon[1700]: time=2026-09-22T10:49:40.829Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.659212] niks3-server[1196]: 2026/09/22 10:49:40 INFO Signed narinfos id=72 count=1 lb # [ 203.661563] niks3-server[1196]: 2026/09/22 10:49:40 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 203.665302] niks3-server[1196]: 2026/09/22 10:49:40 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 203.669714] niks3-server[1196]: 2026/09/22 10:49:40 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 203.673683] niks3-server[1196]: 2026/09/22 10:49:40 INFO Completed upload id=72 worker2 # [ 203.667371] nix-grpc-daemon[1700]: time=2026-09-22T10:49:40.844Z level=INFO msg="Upload complete. (378ms)" lb # [ 203.675471] niks3-server[1196]: 2026/09/22 10:49:40 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 203.669538] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 203.673838] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 203.679295] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 203.681449] nix-daemon[873]: reaped child process 1913, status = succeeded worker2 # [ 203.686570] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 204.910863] nix-daemon[873]: reaped child process 1927, status = succeeded worker2 # [ 205.070652] nix-daemon[873]: accepted connection from pid 1943, user nix-grpc-daemon (trusted) worker2 # [ 205.081087] nix-daemon[873]: reaped child process 1946, status = succeeded lb # [ 205.103816] niks3-server[1196]: 2026/09/22 10:49:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.107610] nix-grpc-daemon[1700]: time=2026-09-22T10:49:42.284Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 205.109813] nix-grpc-daemon[1700]: time=2026-09-22T10:49:42.286Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 205.139977] niks3-server[1196]: 2026/09/22 10:49:41 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 205.150695] niks3-server[1196]: 2026/09/22 10:49:41 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 205.160721] niks3-server[1196]: 2026/09/22 10:49:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 205.165474] niks3-server[1196]: 2026/09/22 10:49:42 INFO Signed narinfos id=73 count=1 worker2 # [ 205.159504] nix-grpc-daemon[1700]: time=2026-09-22T10:49:42.336Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.170956] niks3-server[1196]: 2026/09/22 10:49:42 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 205.179578] niks3-server[1196]: 2026/09/22 10:49:42 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 205.183084] niks3-server[1196]: 2026/09/22 10:49:42 INFO Completed upload id=73 lb # [ 205.185243] niks3-server[1196]: 2026/09/22 10:49:42 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 205.178192] nix-grpc-daemon[1700]: time=2026-09-22T10:49:42.355Z level=INFO msg="Upload complete. (283ms)" worker2 # [ 205.184386] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=1 worker2 # [ 205.196807] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:42Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 205.200806] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:42Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 205.209253] nix-daemon[873]: reaped child process 1925, status = succeeded worker2 # [ 205.240769] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 205.250467] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 205.260426] nix-grpc-daemon[1700]: time=2026-09-22T10:49:42.437Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 205.268158] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 205.277153] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 205.441299] nix-daemon[873]: accepted connection from pid 1952, user nix-grpc-daemon (trusted) worker2 # [ 205.453907] nix-daemon[873]: reaped child process 1955, status = succeeded worker2 # [ 205.607774] nix-daemon[873]: accepted connection from pid 1957, user nix-grpc-daemon (trusted) worker2 # [ 205.619909] nix-daemon[873]: reaped child process 1960, status = succeeded lb # [ 205.634823] niks3-server[1196]: 2026/09/22 10:49:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.632969] nix-grpc-daemon[1700]: time=2026-09-22T10:49:42.810Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 205.634459] nix-grpc-daemon[1700]: time=2026-09-22T10:49:42.811Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 205.651724] niks3-server[1196]: 2026/09/22 10:49:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 205.653780] niks3-server[1196]: 2026/09/22 10:49:42 INFO Signed narinfos id=74 count=1 worker2 # [ 205.647487] nix-grpc-daemon[1700]: time=2026-09-22T10:49:42.824Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.657068] niks3-server[1196]: 2026/09/22 10:49:42 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 205.661601] niks3-server[1196]: 2026/09/22 10:49:42 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 205.664027] niks3-server[1196]: 2026/09/22 10:49:42 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 205.667696] niks3-server[1196]: 2026/09/22 10:49:42 INFO Completed upload id=74 worker2 # [ 205.662508] nix-grpc-daemon[1700]: time=2026-09-22T10:49:42.839Z level=INFO msg="Upload complete. (374ms)" lb # [ 205.669587] niks3-server[1196]: 2026/09/22 10:49:42 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 205.664660] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 205.668179] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 205.673983] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 205.676222] nix-daemon[873]: reaped child process 1950, status = succeeded worker2 # [ 205.681050] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 207.105968] nix-daemon[873]: reaped child process 1964, status = succeeded worker2 # [ 207.255664] nix-daemon[873]: accepted connection from pid 1980, user nix-grpc-daemon (trusted) worker2 # [ 207.266115] nix-daemon[873]: reaped child process 1983, status = succeeded lb # [ 207.288164] niks3-server[1196]: 2026/09/22 10:49:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 207.289762] nix-grpc-daemon[1700]: time=2026-09-22T10:49:44.466Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 207.291526] nix-grpc-daemon[1700]: time=2026-09-22T10:49:44.468Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 207.331133] niks3-server[1196]: 2026/09/22 10:49:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign worker2 # [ 207.333328] nix-grpc-daemon[1700]: time=2026-09-22T10:49:44.510Z level=INFO msg="Uploading 1 narinfos" lb # [ 207.339650] niks3-server[1196]: 2026/09/22 10:49:44 INFO Signed narinfos id=75 count=1 lb # [ 207.349689] niks3-server[1196]: 2026/09/22 10:49:44 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 207.354362] niks3-server[1196]: 2026/09/22 10:49:44 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 207.360983] niks3-server[1196]: 2026/09/22 10:49:44 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 207.369270] niks3-server[1196]: 2026/09/22 10:49:44 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 207.372123] niks3-server[1196]: 2026/09/22 10:49:44 INFO Completed upload id=75 lb # [ 207.373975] niks3-server[1196]: 2026/09/22 10:49:44 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 207.367319] nix-grpc-daemon[1700]: time=2026-09-22T10:49:44.544Z level=INFO msg="Upload complete. (278ms)" worker2 # [ 207.373636] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=1 worker2 # [ 207.383196] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:44Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 207.387211] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:44Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 207.394626] nix-daemon[873]: reaped child process 1962, status = succeeded worker2 # [ 207.427475] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 207.440579] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 207.454385] nix-grpc-daemon[1700]: time=2026-09-22T10:49:44.631Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 207.463421] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 207.471300] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 207.639104] nix-daemon[873]: accepted connection from pid 1989, user nix-grpc-daemon (trusted) worker2 # [ 207.651885] nix-daemon[873]: reaped child process 1992, status = succeeded worker2 # [ 207.787462] nix-daemon[873]: accepted connection from pid 1994, user nix-grpc-daemon (trusted) worker2 # [ 207.798900] nix-daemon[873]: reaped child process 1997, status = succeeded lb # [ 207.816149] niks3-server[1196]: 2026/09/22 10:49:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 207.817898] nix-grpc-daemon[1700]: time=2026-09-22T10:49:44.995Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 207.819221] nix-grpc-daemon[1700]: time=2026-09-22T10:49:44.995Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 207.841828] niks3-server[1196]: 2026/09/22 10:49:44 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 207.852879] niks3-server[1196]: 2026/09/22 10:49:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign lb # [ 207.858801] niks3-server[1196]: 2026/09/22 10:49:44 INFO Signed narinfos id=76 count=1 worker2 # [ 207.855615] nix-grpc-daemon[1700]: time=2026-09-22T10:49:45.032Z level=INFO msg="Uploading 1 narinfos" lb # [ 207.863781] niks3-server[1196]: 2026/09/22 10:49:44 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 207.876732] niks3-server[1196]: 2026/09/22 10:49:44 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete worker2 # [ 207.876291] nix-grpc-daemon[1700]: time=2026-09-22T10:49:45.053Z level=INFO msg="Upload complete. (393ms)" lb # [ 207.882490] niks3-server[1196]: 2026/09/22 10:49:44 INFO Completed upload id=76 worker2 # [ 207.878346] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 207.886147] niks3-server[1196]: 2026/09/22 10:49:44 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 207.883841] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 worker2 # [ 207.891768] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 207.894104] nix-daemon[873]: reaped child process 1987, status = succeeded worker2 # [ 207.899210] nix-daemon[873]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain lb # [ 208.687737] envoy[932]: conn peer=[2001:db8:1::1]:34044 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=30051 worker2 # [ 208.719296] nix-daemon[873]: reaped child process 2001, status = succeeded worker2 # [ 208.864089] nix-daemon[873]: accepted connection from pid 2017, user nix-grpc-daemon (trusted) worker2 # [ 208.874753] nix-daemon[873]: reaped child process 2020, status = succeeded lb # [ 208.896805] niks3-server[1196]: 2026/09/22 10:49:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 208.898502] nix-grpc-daemon[1700]: time=2026-09-22T10:49:46.075Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 208.900415] nix-grpc-daemon[1700]: time=2026-09-22T10:49:46.077Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 208.926658] niks3-server[1196]: 2026/09/22 10:49:45 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 208.941150] niks3-server[1196]: 2026/09/22 10:49:45 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 208.953085] niks3-server[1196]: 2026/09/22 10:49:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign worker2 # [ 208.950639] nix-grpc-daemon[1700]: time=2026-09-22T10:49:46.127Z level=INFO msg="Uploading 1 narinfos" lb # [ 208.957100] niks3-server[1196]: 2026/09/22 10:49:45 INFO Signed narinfos id=77 count=1 lb # [ 208.962698] niks3-server[1196]: 2026/09/22 10:49:45 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 208.970680] niks3-server[1196]: 2026/09/22 10:49:45 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 208.977189] niks3-server[1196]: 2026/09/22 10:49:45 INFO Completed upload id=77 lb # [ 208.978934] niks3-server[1196]: 2026/09/22 10:49:45 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 208.971109] nix-grpc-daemon[1700]: time=2026-09-22T10:49:46.148Z level=INFO msg="Upload complete. (265ms)" worker2 # [ 208.977568] nix-grpc-daemon[1620]: ts=2026-09-22T10:49:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44800 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=1 worker2 # [ 208.990945] nix-daemon[873]: reaped child process 1999, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.06 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.18 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 209.908449] nix-grpc-daemon[1696]: ts=2026-09-22T10:49:47Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.60 seconds) (finished: run the VM test script, in 211.42 seconds) test script finished in 211.64s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.19 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh