tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.9UuD2ZG9El', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done client: QEMU running (pid 49) client # Creating filesystem with 262144 4k blocks and 65536 inodes client # Filesystem UUID: e633dfbf-1afc-450a-99d4-3a91ae674564 client # Superblock backups stored on blocks: worker2 # Disk image does not exist, creating the virtualisation disk image... client # 32768, 98304, 163840, 229376 worker2 # Formatting '/build/vm-state-worker2/tmp.oy6XD1KVJ6', fmt=raw size=1073741824 client # worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # Disk image does not exist, creating the virtualisation disk image... client # Allocating group tables: 0/8 done worker1 # Disk image does not exist, creating the virtualisation disk image... worker2 # Discarding device blocks: 0/262144 done lb # Formatting '/build/vm-state-lb/tmp.zYzNTYVmhS', fmt=raw size=1073741824 client # Writing inode tables: 0/8 done worker1 # Formatting '/build/vm-state-worker1/tmp.EgzVbUqF1P', fmt=raw size=1073741824 worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # mke2fs 1.47.4 (6-Mar-2025) client # Creating journal (8192 blocks): done worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Filesystem UUID: 1cba956f-61fe-4621-bf1c-67f0b10fbb8d lb # Discarding device blocks: 0/262144 done client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Discarding device blocks: 0/262144 done worker2 # Superblock backups stored on blocks: lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # 32768, 98304, 163840, 229376 lb # Filesystem UUID: 95d72eab-f798-408f-a4a0-9a641bb5b950 client # Virtualisation disk image created. worker1 # Filesystem UUID: 011e19e4-05fe-4d6c-8c0f-8d704f716400 worker2 # lb # Superblock backups stored on blocks: worker1: QEMU running (pid 52) lb: QEMU running (pid 50) worker2: QEMU running (pid 51) worker1 # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 worker1 # 32768, 98304, 163840, 229376 lb # (finished: start all VMs, in 0.22 seconds) worker2 # Allocating group tables: 0/8 done worker1 # lb # Allocating group tables: 0/8 done client: waiting for unit network-addresses-eth1.service worker2 # Writing inode tables: 0/8 done worker1 # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done client: waiting for the VM to finish booting worker2 # Creating journal (8192 blocks): done worker1 # Writing inode tables: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Creating journal (8192 blocks): done worker2 # worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Virtualisation disk image created. worker1 # lb # Creating journal (8192 blocks): done worker1 # Virtualisation disk image created. lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # worker2 # worker1 # worker1 # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # client # worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker2 # worker2 # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)... worker1 # worker1 # client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:08.0)... client # client # lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)... lb # lb # worker2 # Booting from ROM... worker1 # Booting from ROM... client # Booting from ROM... lb # Booting from ROM... worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/475bgh1218crwnxd90vcgf549d3xm0l5-nixos-system-worker2-test/init regInfo=/nix/store/952y3zfhajkahzwaw24ihil46ck3p195-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test/init regInfo=/nix/store/qa6ya6zrr87bipdarghx8a1k6ph447h1-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] kvm-clock: using sched offset of 469206254 cycles client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c29xnmznw4lyy9ki05g66bk4sbx7ky11-nixos-system-worker1-test/init regInfo=/nix/store/3hn4cmks610pg0kl9z9dfk7vz94ihdl3-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.002728] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.002739] Using GB pages for direct mapping client # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.002867] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.002875] ACPI: Early table checksum verification disabled worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.002877] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.002881] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.002885] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] kvm-clock: using sched offset of 490042940 cycles worker2 # [ 0.002892] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.002894] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fj20bcn47ir2axl7b7sxwa0fvig2ds2j-nixos-system-lb-test/init regInfo=/nix/store/l5iprc9wdxb7nl0q1bx2grj7psaadl34-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.002895] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.002897] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.002898] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000833] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.002900] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002726] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.002737] Using GB pages for direct mapping worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.002901] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.000000] Hypervisor detected: KVM client # [ 0.002885] RAMDISK: [mem 0x5e366000-0x5ffcffff] lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.002902] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002892] ACPI: Early table checksum verification disabled worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.002895] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.002903] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.000001] kvm-clock: using sched offset of 493485913 cycles lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.002903] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.002899] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.002904] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.002903] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.002904] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.002909] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.002905] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.000000] APIC: Static calls initialized client # [ 0.002911] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.003135] No NUMA configuration found worker1 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002913] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003136] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.002914] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003138] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.005561] Zone ranges: worker1 # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.002746] Using GB pages for direct mapping client # [ 0.002916] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005562] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002892] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker2 # [ 0.005564] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.002917] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005565] Normal empty worker1 # [ 0.002901] ACPI: Early table checksum verification disabled worker2 # [ 0.005566] Device empty lb # [ 0.000000] kvm-clock: using sched offset of 483610732 cycles client # [ 0.002919] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.002904] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.005566] Movable zone start for each node worker2 # [ 0.005567] Early memory node ranges lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.002920] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.002908] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005567] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.000004] tsc: Detected 2400.012 MHz processor client # [ 0.002920] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.005568] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.002912] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002921] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.005569] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002921] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.002919] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005590] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.002921] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.002922] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.005850] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.002737] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.002923] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002922] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.002747] Using GB pages for direct mapping worker2 # [ 0.031826] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.003142] No NUMA configuration found lb # [ 0.002894] RAMDISK: [mem 0x5e367000-0x5ffcffff] worker2 # [ 0.032274] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.002924] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.003143] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.002901] ACPI: Early table checksum verification disabled worker2 # [ 0.032284] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.003145] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.002904] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002926] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005353] Zone ranges: worker2 # [ 0.032311] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.002908] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005354] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.032313] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.002927] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005356] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.032315] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.002912] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005357] Normal empty worker1 # [ 0.002929] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.005358] Device empty worker2 # [ 0.032316] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.005358] Movable zone start for each node worker1 # [ 0.002930] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.002919] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005359] Early memory node ranges worker2 # [ 0.032317] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.002921] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.002930] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.005359] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.032317] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.002922] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002931] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.005360] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.032320] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.002924] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005361] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.002931] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.032321] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.032324] TSC deadline timer available client # [ 0.005381] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.002925] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002932] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.032328] CPU topo: Max. logical packages: 1 client # [ 0.005642] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.032329] CPU topo: Max. logical dies: 1 worker1 # [ 0.002932] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.002927] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.031796] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.032330] CPU topo: Max. dies per package: 1 worker1 # [ 0.003191] No NUMA configuration found client # [ 0.032250] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.002928] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.032333] CPU topo: Max. threads per core: 1 worker1 # [ 0.003192] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.032261] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.032334] CPU topo: Num. cores per package: 1 lb # [ 0.002929] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.003194] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.032289] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.032334] CPU topo: Num. threads per package: 1 worker1 # [ 0.005640] Zone ranges: lb # [ 0.002930] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.032334] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.032292] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.005641] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.002930] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.032293] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.032350] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.005642] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.002930] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.005644] Normal empty client # [ 0.032295] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.005644] Device empty worker2 # [ 0.032380] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.002931] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.005645] Movable zone start for each node client # [ 0.032295] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.032382] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.005646] Early memory node ranges lb # [ 0.002932] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.032296] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.003154] No NUMA configuration found worker2 # [ 0.032383] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.005646] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.032299] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.032384] Booting paravirtualized kernel on KVM lb # [ 0.003155] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.005647] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.032300] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.003157] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.032303] TSC deadline timer available lb # [ 0.005374] Zone ranges: worker2 # [ 0.032387] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.005648] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.032307] CPU topo: Max. logical packages: 1 lb # [ 0.005375] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.005673] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.032308] CPU topo: Max. logical dies: 1 worker2 # [ 0.036821] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.005377] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.032308] CPU topo: Max. dies per package: 1 worker1 # [ 0.005960] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.005378] Normal empty worker2 # [ 0.039239] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.005379] Device empty client # [ 0.032311] CPU topo: Max. threads per core: 1 worker1 # [ 0.034632] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.039282] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.032312] CPU topo: Num. cores per package: 1 lb # [ 0.005379] Movable zone start for each node worker1 # [ 0.035142] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.005380] Early memory node ranges client # [ 0.032312] CPU topo: Num. threads per package: 1 worker1 # [ 0.035155] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.005381] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.032313] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.035186] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.005382] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.032331] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.035189] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.005383] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.032362] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.005402] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.035190] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.039283] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/475bgh1218crwnxd90vcgf549d3xm0l5-nixos-system-worker2-test/init regInfo=/nix/store/952y3zfhajkahzwaw24ihil46ck3p195-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.032364] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.005662] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.035191] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.032365] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.031675] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.035192] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.032367] Booting paravirtualized kernel on KVM lb # [ 0.032128] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.039374] Unknown kernel command line parameters "regInfo=/nix/store/952y3zfhajkahzwaw24ihil46ck3p195-closure-info/registration", will be passed to user space. worker2 # [ 0.039386] random: crng init done lb # [ 0.032138] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.035193] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.032370] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.032170] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.039387] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.035195] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.036830] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.032172] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.035197] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.041459] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.035199] TSC deadline timer available client # [ 0.039108] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.032174] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.035203] CPU topo: Max. logical packages: 1 worker2 # [ 0.042508] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.039147] kvm-guest: PV spinlocks disabled, single CPU lb # [ 0.032175] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.035204] CPU topo: Max. logical dies: 1 worker2 # [ 0.042540] Fallback order for Node 0: 0 worker1 # [ 0.035205] CPU topo: Max. dies per package: 1 lb # [ 0.032176] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.042543] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.035208] CPU topo: Max. threads per core: 1 worker2 # [ 0.042544] Policy zone: DMA32 lb # [ 0.032177] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.035208] CPU topo: Num. cores per package: 1 worker2 # [ 0.045146] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.032179] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.035209] CPU topo: Num. threads per package: 1 worker2 # [ 0.048165] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.032180] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.039149] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test/init regInfo=/nix/store/qa6ya6zrr87bipdarghx8a1k6ph447h1-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.035209] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.051471] allocated 3145728 bytes of page_ext lb # [ 0.032183] TSC deadline timer available lb # [ 0.032188] CPU topo: Max. logical packages: 1 worker2 # [ 0.061318] ftrace: allocating 48731 entries in 192 pages worker1 # [ 0.035228] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.032189] CPU topo: Max. logical dies: 1 worker2 # [ 0.061320] ftrace: allocated 192 pages with 2 groups client # [ 0.039241] Unknown kernel command line parameters "regInfo=/nix/store/qa6ya6zrr87bipdarghx8a1k6ph447h1-closure-info/registration", will be passed to user space. lb # [ 0.032189] CPU topo: Max. dies per package: 1 worker2 # [ 0.062129] Dynamic Preempt: lazy worker1 # [ 0.035260] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.039254] random: crng init done lb # [ 0.032193] CPU topo: Max. threads per core: 1 worker2 # [ 0.062283] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.035262] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.032193] CPU topo: Num. cores per package: 1 client # [ 0.039254] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.062284] rcu: RCU event tracing is enabled. lb # [ 0.032194] CPU topo: Num. threads per package: 1 worker1 # [ 0.035263] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.041339] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.062285] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.035265] Booting paravirtualized kernel on KVM lb # [ 0.032194] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.062286] Trampoline variant of Tasks RCU enabled. client # [ 0.042380] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.032211] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.062287] Rude variant of Tasks RCU enabled. client # [ 0.042411] Fallback order for Node 0: 0 worker1 # [ 0.035267] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.062287] Tracing variant of Tasks RCU enabled. lb # [ 0.032242] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.042414] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.039741] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.042415] Policy zone: DMA32 worker2 # [ 0.062288] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.032244] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.042036] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.044837] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.032245] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.062289] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.042085] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.047869] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.032246] Booting paravirtualized kernel on KVM client # [ 0.051275] allocated 3145728 bytes of page_ext worker2 # [ 0.062310] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.061135] ftrace: allocating 48731 entries in 192 pages lb # [ 0.032249] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.062311] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.061137] ftrace: allocated 192 pages with 2 groups lb # [ 0.036670] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.061950] Dynamic Preempt: lazy worker2 # [ 0.062312] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.062073] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.038769] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.062074] rcu: RCU event tracing is enabled. lb # [ 0.038811] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.066633] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.042086] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c29xnmznw4lyy9ki05g66bk4sbx7ky11-nixos-system-worker1-test/init regInfo=/nix/store/3hn4cmks610pg0kl9z9dfk7vz94ihdl3-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.062074] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.066904] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.062076] Trampoline variant of Tasks RCU enabled. client # [ 0.062076] Rude variant of Tasks RCU enabled. worker2 # [ 0.066910] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.042181] Unknown kernel command line parameters "regInfo=/nix/store/3hn4cmks610pg0kl9z9dfk7vz94ihdl3-closure-info/registration", will be passed to user space. client # [ 0.062077] Tracing variant of Tasks RCU enabled. worker1 # [ 0.042194] random: crng init done worker2 # [ 0.067012] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.062077] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.042195] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.038812] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fj20bcn47ir2axl7b7sxwa0fvig2ds2j-nixos-system-lb-test/init regInfo=/nix/store/l5iprc9wdxb7nl0q1bx2grj7psaadl34-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.070522] Console: colour VGA+ 80x25 client # [ 0.062078] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.070524] printk: legacy console [tty0] enabled worker1 # [ 0.044481] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.100594] printk: legacy console [ttyS0] enabled client # [ 0.062134] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.038903] Unknown kernel command line parameters "regInfo=/nix/store/l5iprc9wdxb7nl0q1bx2grj7psaadl34-closure-info/registration", will be passed to user space. worker1 # [ 0.045608] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.200747] ACPI: Core revision 20250807 lb # [ 0.038916] random: crng init done worker1 # [ 0.045639] Fallback order for Node 0: 0 client # [ 0.062136] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.045642] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.038916] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.045643] Policy zone: DMA32 client # [ 0.062137] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.201659] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.040988] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.066465] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.048562] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.203210] APIC: Switch to symmetric I/O mode setup lb # [ 0.042204] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.066745] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.051884] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.042239] Fallback order for Node 0: 0 worker2 # [ 0.204207] x2apic enabled worker1 # [ 0.055439] allocated 3145728 bytes of page_ext lb # [ 0.042242] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.066751] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.042243] Policy zone: DMA32 worker2 # [ 0.204997] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.065416] ftrace: allocating 48731 entries in 192 pages worker1 # [ 0.065418] ftrace: allocated 192 pages with 2 groups lb # [ 0.044653] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.066856] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.066305] Dynamic Preempt: lazy client # [ 0.070363] Console: colour VGA+ 80x25 lb # [ 0.047606] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.066499] rcu: Preemptible hierarchical RCU implementation. client # [ 0.070366] printk: legacy console [tty0] enabled worker2 # [ 0.206873] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.050811] allocated 3145728 bytes of page_ext worker1 # [ 0.066500] rcu: RCU event tracing is enabled. client # [ 0.099684] printk: legacy console [ttyS0] enabled lb # [ 0.060697] ftrace: allocating 48731 entries in 192 pages worker1 # [ 0.066500] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.195430] ACPI: Core revision 20250807 lb # [ 0.060699] ftrace: allocated 192 pages with 2 groups lb # [ 0.061529] Dynamic Preempt: lazy worker2 # [ 0.207882] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.066502] Trampoline variant of Tasks RCU enabled. lb # [ 0.061658] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.066503] Rude variant of Tasks RCU enabled. client # [ 0.196267] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.061659] rcu: RCU event tracing is enabled. worker1 # [ 0.066503] Tracing variant of Tasks RCU enabled. worker2 # [ 0.209569] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.061659] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.197756] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.066504] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.061660] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.210660] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.198692] x2apic enabled lb # [ 0.061661] Rude variant of Tasks RCU enabled. worker1 # [ 0.066505] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.212565] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.061661] Tracing variant of Tasks RCU enabled. client # [ 0.199427] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.066526] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.061662] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.213546] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.061663] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.066528] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.201216] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.061721] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.214570] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.066529] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.202181] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.070939] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.061723] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.215566] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.071221] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.061724] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.203788] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.217566] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.066246] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.071228] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.205867] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.218565] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.066542] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.071334] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.206956] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.219506] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.066549] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.075265] Console: colour VGA+ 80x25 worker1 # [ 0.075268] printk: legacy console [tty0] enabled client # [ 0.207781] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.066658] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.105899] printk: legacy console [ttyS0] enabled lb # [ 0.070138] Console: colour VGA+ 80x25 worker1 # [ 0.208533] ACPI: Core revision 20250807 lb # [ 0.070141] printk: legacy console [tty0] enabled client # [ 0.208784] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.099491] printk: legacy console [ttyS0] enabled lb # [ 0.194721] ACPI: Core revision 20250807 client # [ 0.209781] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.220566] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.209481] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.222573] Spectre V2 : Enabling IBPB for BPF client # [ 0.210781] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.211061] APIC: Switch to symmetric I/O mode setup lb # [ 0.195595] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.212097] x2apic enabled client # [ 0.211780] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.197060] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.223296] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.212781] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.212852] APIC: Switched APIC routing to: physical x2apic lb # [ 0.198041] x2apic enabled worker2 # [ 0.224566] active return thunk: srso_alias_return_thunk lb # [ 0.198803] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.225587] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.214763] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.226565] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.200617] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.227565] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.215846] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.213780] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.215788] Spectre V2 : Enabling IBPB for BPF lb # [ 0.201611] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.228566] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.217583] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.229566] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.216782] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.203226] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.219583] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.230565] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.217781] active return thunk: srso_alias_return_thunk lb # [ 0.204310] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.231566] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.221111] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.205391] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.218802] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.221580] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.233490] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.219781] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.206224] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.234280] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.220781] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.222584] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.207227] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.235289] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.221781] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.236289] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.222781] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.209223] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.224580] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.237280] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.223781] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.210224] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.225580] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.211223] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.227349] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.224781] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.238295] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.212223] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.228295] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.225781] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.226781] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.227780] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.228781] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.213223] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.229293] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.229780] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.215230] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.230588] Spectre V2 : Enabling IBPB for BPF client # [ 0.230780] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.216224] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.231581] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.217224] active return thunk: srso_alias_return_thunk worker1 # [ 0.232580] active return thunk: srso_alias_return_thunk lb # [ 0.218244] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.234268] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.219224] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.235518] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.220223] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.236579] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.221223] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.237579] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.222223] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.238580] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.223223] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.239579] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.224223] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.240580] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.226223] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.241580] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.227223] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.242580] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.228223] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.243579] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.229223] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.244580] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.230176] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.245580] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.230975] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.246580] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.272122] Freeing SMP alternatives memory: 44K worker2 # [ 0.272568] pid_max: default: 32768 minimum: 301 worker2 # [ 0.273651] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.274696] landlock: Up and running. worker2 # [ 0.275566] Yama: becoming mindful. worker2 # [ 0.276398] LSM support for eBPF active worker2 # [ 0.277182] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.264826] Freeing SMP alternatives memory: 44K worker2 # [ 0.278596] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.265603] pid_max: default: 32768 minimum: 301 client # [ 0.266436] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.280881] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.266887] landlock: Up and running. client # [ 0.267781] Yama: becoming mindful. worker2 # [ 0.282095] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.269002] LSM support for eBPF active worker2 # [ 0.282575] ... version: 2 client # [ 0.269832] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.283325] ... bit width: 48 worker2 # [ 0.283568] ... generic counters: 6 client # [ 0.270819] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.284297] ... generic bitmap: 000000000000003f worker2 # [ 0.284568] ... fixed-purpose counters: 0 worker2 # [ 0.285323] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.273281] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.285568] ... value mask: 0000ffffffffffff worker2 # [ 0.286471] ... max period: 00007fffffffffff client # [ 0.274305] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.274785] ... version: 2 worker2 # [ 0.287235] ... global_ctrl mask: 000000000000003f client # [ 0.275507] ... bit width: 48 worker2 # [ 0.287664] signal: max sigframe size: 3376 client # [ 0.275783] ... generic counters: 6 worker2 # [ 0.288475] rcu: Hierarchical SRCU implementation. client # [ 0.276504] ... generic bitmap: 000000000000003f worker2 # [ 0.289164] rcu: Max phase no-delay instances is 400. client # [ 0.276794] ... fixed-purpose counters: 0 lb # [ 0.265519] Freeing SMP alternatives memory: 44K client # [ 0.277514] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.266226] pid_max: default: 32768 minimum: 301 client # [ 0.277783] ... value mask: 0000ffffffffffff worker1 # [ 0.281083] Freeing SMP alternatives memory: 44K worker1 # [ 0.281584] pid_max: default: 32768 minimum: 301 lb # [ 0.267049] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.278666] ... max period: 00007fffffffffff lb # [ 0.268241] landlock: Up and running. client # [ 0.279418] ... global_ctrl mask: 000000000000003f worker1 # [ 0.282682] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.268845] Yama: becoming mindful. client # [ 0.279892] signal: max sigframe size: 3376 worker1 # [ 0.283692] landlock: Up and running. lb # [ 0.269435] LSM support for eBPF active worker1 # [ 0.284315] Yama: becoming mindful. worker2 # [ 0.294297] smp: Bringing up secondary CPUs ... client # [ 0.280695] rcu: Hierarchical SRCU implementation. worker2 # [ 0.294582] smp: Brought up 1 node, 1 CPU worker1 # [ 0.285227] LSM support for eBPF active client # [ 0.281379] rcu: Max phase no-delay instances is 400. lb # [ 0.270332] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.295259] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.285709] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.271266] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.286622] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.295748] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) lb # [ 0.273902] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.296796] devtmpfs: initialized worker2 # [ 0.297627] x86/mm: Memory block size: 128MB client # [ 0.286242] smp: Bringing up secondary CPUs ... worker1 # [ 0.289964] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.274764] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.286797] smp: Brought up 1 node, 1 CPU lb # [ 0.275228] ... version: 2 lb # [ 0.275951] ... bit width: 48 client # [ 0.287492] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.291193] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.299439] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.276226] ... generic counters: 6 worker1 # [ 0.291589] ... version: 2 lb # [ 0.276900] ... generic bitmap: 000000000000003f worker1 # [ 0.292364] ... bit width: 48 worker2 # [ 0.300483] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.277235] ... fixed-purpose counters: 0 client # [ 0.287931] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved) worker1 # [ 0.292582] ... generic counters: 6 worker2 # [ 0.301653] pinctrl core: initialized pinctrl subsystem lb # [ 0.277931] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.288998] devtmpfs: initialized worker1 # [ 0.293303] ... generic bitmap: 000000000000003f worker2 # [ 0.302787] PM: RTC time: 12:57:28, date: 2026-09-21 lb # [ 0.278225] ... value mask: 0000ffffffffffff client # [ 0.289864] x86/mm: Memory block size: 128MB worker1 # [ 0.293582] ... fixed-purpose counters: 0 lb # [ 0.279109] ... max period: 00007fffffffffff worker1 # [ 0.294323] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.279921] ... global_ctrl mask: 000000000000003f worker1 # [ 0.294582] ... value mask: 0000ffffffffffff client # [ 0.291579] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.280353] signal: max sigframe size: 3376 worker1 # [ 0.295556] ... max period: 00007fffffffffff lb # [ 0.281167] rcu: Hierarchical SRCU implementation. worker2 # [ 0.306339] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.292691] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.296337] ... global_ctrl mask: 000000000000003f lb # [ 0.281764] rcu: Max phase no-delay instances is 400. client # [ 0.293862] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.296694] signal: max sigframe size: 3376 worker2 # [ 0.307780] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.294984] PM: RTC time: 12:57:28, date: 2026-09-21 worker1 # [ 0.297594] rcu: Hierarchical SRCU implementation. worker1 # [ 0.298427] rcu: Max phase no-delay instances is 400. worker2 # [ 0.308591] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.309843] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.310578] audit: initializing netlink subsys (disabled) client # [ 0.298438] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.286783] smp: Bringing up secondary CPUs ... lb # [ 0.287239] smp: Brought up 1 node, 1 CPU worker2 # [ 0.311701] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.299278] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.287939] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.311703] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.303889] smp: Bringing up secondary CPUs ... client # [ 0.299808] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.312569] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.304597] smp: Brought up 1 node, 1 CPU worker2 # [ 0.313512] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.288438] Memory: 1454592K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved) client # [ 0.301048] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.305329] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.289435] devtmpfs: initialized client # [ 0.301793] audit: initializing netlink subsys (disabled) worker2 # [ 0.314337] audit: type=2000 audit(1789995449.163:1): state=initialized audit_enabled=0 res=1 lb # [ 0.290178] x86/mm: Memory block size: 128MB worker2 # [ 0.316571] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.302949] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.305739] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved) worker2 # [ 0.316585] cpuidle: using governor menu client # [ 0.302951] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.306849] devtmpfs: initialized lb # [ 0.291748] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.303784] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.307616] x86/mm: Memory block size: 128MB worker2 # [ 0.318810] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.304710] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.292250] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.319792] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.293319] pinctrl core: initialized pinctrl subsystem client # [ 0.305503] audit: type=2000 audit(1789995449.172:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.309407] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.320571] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.294402] PM: RTC time: 12:57:28, date: 2026-09-21 client # [ 0.306786] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.321581] PCI: Using configuration type 1 for base access client # [ 0.306809] cpuidle: using governor menu worker1 # [ 0.310488] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.311670] pinctrl core: initialized pinctrl subsystem client # [ 0.309004] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.322722] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.312892] PM: RTC time: 12:57:28, date: 2026-09-21 lb # [ 0.297863] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.310005] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.310786] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.298735] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.311795] PCI: Using configuration type 1 for base access lb # [ 0.299263] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.316370] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.312915] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.327648] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.300493] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.317862] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.328569] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.301236] audit: initializing netlink subsys (disabled) worker1 # [ 0.318607] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.302341] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.302343] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.319874] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.303227] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.320594] audit: initializing netlink subsys (disabled) lb # [ 0.304208] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.333569] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.321759] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.304989] audit: type=2000 audit(1789995449.187:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.334569] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.321762] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.320046] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.306228] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.322583] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.320784] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.306251] cpuidle: using governor menu worker1 # [ 0.323557] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.308438] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.324326] audit: type=2000 audit(1789995449.183:1): state=initialized audit_enabled=0 res=1 lb # [ 0.309458] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.325585] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.325599] cpuidle: using governor menu lb # [ 0.310229] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.325784] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.311237] PCI: Using configuration type 1 for base access worker1 # [ 0.327821] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.326784] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.312326] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.328831] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.329585] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.344934] ACPI: Added _OSI(Module Device) worker1 # [ 0.330595] PCI: Using configuration type 1 for base access worker2 # [ 0.345570] ACPI: Added _OSI(Processor Device) worker2 # [ 0.346352] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.331753] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.335323] ACPI: Added _OSI(Module Device) lb # [ 0.319457] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.335785] ACPI: Added _OSI(Processor Device) lb # [ 0.320227] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.336546] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.336874] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.337584] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.354804] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.325227] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.326227] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.342584] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.343315] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.343582] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.358975] ACPI: Interpreter enabled worker2 # [ 0.359582] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.360334] ACPI: Using IOAPIC for interrupt routing client # [ 0.346728] ACPI: Interpreter enabled client # [ 0.347281] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.347784] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.362603] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.334843] ACPI: Added _OSI(Module Device) worker2 # [ 0.363569] PCI: Using E820 reservations for host bridge windows client # [ 0.348636] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.335228] ACPI: Added _OSI(Processor Device) lb # [ 0.335981] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.366645] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.353988] ACPI: Added _OSI(Module Device) worker1 # [ 0.354584] ACPI: Added _OSI(Processor Device) client # [ 0.353784] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.355328] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.354881] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.342787] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.374172] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.374575] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.346144] ACPI: Interpreter enabled lb # [ 0.346700] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.375647] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.347226] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.376690] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.363504] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.363857] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.377922] PCI host bridge to bus 0000:00 lb # [ 0.348134] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.364376] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.378573] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.379569] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.364861] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.368000] ACPI: Interpreter enabled worker2 # [ 0.380568] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.365906] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.368598] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.367158] PCI host bridge to bus 0000:00 worker2 # [ 0.381569] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.353226] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.369395] ACPI: Using IOAPIC for interrupt routing client # [ 0.367788] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.354313] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.382569] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.368784] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.383569] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.369783] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.384569] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.372658] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.370784] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.385505] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.373590] PCI: Using E820 reservations for host bridge windows client # [ 0.371783] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.387038] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.372784] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.373784] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.376723] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.374733] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.362938] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.376250] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.363782] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.364320] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.365350] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.389688] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.366555] PCI host bridge to bus 0000:00 worker1 # [ 0.383984] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.390624] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.367220] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.391590] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.384590] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.368226] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.385660] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.392900] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.369226] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.378888] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.386704] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.370226] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.379795] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.394313] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.387998] PCI host bridge to bus 0000:00 client # [ 0.380751] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.371225] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.388587] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.372226] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.381736] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.389583] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.373226] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.396596] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.390583] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.374159] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.397497] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.383501] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.391583] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.398325] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.375659] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.399434] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.392583] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.386819] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.393583] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.387677] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.400954] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.394583] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.388529] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.395624] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.388790] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.403597] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.397089] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.404525] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.390873] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.405332] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.378291] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.406971] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.392790] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.379239] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.393677] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.380201] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.394553] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.381389] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.409794] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.396243] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.411260] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.382949] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.399727] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.411592] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.400596] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.385252] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.413179] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.401609] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.399066] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.386103] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.400421] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.402954] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.386977] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.400805] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.414598] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] lb # [ 0.387232] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.415445] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.404352] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.402330] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.416361] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.389066] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.403818] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] worker2 # [ 0.418653] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.407617] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.391251] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.404678] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.408478] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.392055] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.405512] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.392921] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.409315] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.420601] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker2 # [ 0.421496] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.409613] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.406319] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.393812] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.422342] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.411202] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.424031] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.408814] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] client # [ 0.409678] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.396405] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.410534] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.413614] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.397232] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.414438] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.398216] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.426848] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.411399] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.415389] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.428211] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.399608] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.428594] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.417151] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.401233] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] client # [ 0.413762] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.430222] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.414790] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.402076] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.402977] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.415742] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.419544] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.431576] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] worker1 # [ 0.420275] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.432432] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.417167] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.403785] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.433345] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.420609] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.434405] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.418818] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] lb # [ 0.405251] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker1 # [ 0.422180] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.419670] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.406078] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.436154] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.420526] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.406995] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.420789] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.437558] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.407816] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.424821] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] worker2 # [ 0.438320] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.422320] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.426270] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.439129] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.410191] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.426608] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.424790] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.410844] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.425748] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.428134] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.440607] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] lb # [ 0.411248] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.427175] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.441508] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.412770] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.430441] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] worker2 # [ 0.442593] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.431302] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.428827] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] lb # [ 0.414234] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] client # [ 0.429686] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.431608] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.444161] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.415127] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.415936] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.430499] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.416232] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.445599] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker1 # [ 0.433893] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.431356] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.446575] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.417771] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.447530] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.432818] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] worker1 # [ 0.436558] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.419018] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.433677] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.437330] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.449077] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.419947] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.434473] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.437605] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.450273] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] lb # [ 0.420780] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.435375] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.439216] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.450804] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.422234] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] worker2 # [ 0.452226] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] client # [ 0.436687] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] lb # [ 0.423087] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.423986] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.441616] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] client # [ 0.438119] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.442550] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.439596] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker1 # [ 0.443429] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.424795] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.444522] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.427251] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] lb # [ 0.428153] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.446043] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.428973] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.447598] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.429784] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.448609] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.431011] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker1 # [ 0.450222] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.432080] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.452784] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.433779] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker2 # [ 0.455231] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker1 # [ 0.452386] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] client # [ 0.440584] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.455833] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.453302] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.442486] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker1 # [ 0.453606] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.457202] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.443052] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.455198] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.457847] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.444416] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.458857] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.445033] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.459840] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.457616] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] client # [ 0.446070] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.458533] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.461598] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker1 # [ 0.459394] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.447085] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.462523] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.434420] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.461097] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.448811] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker2 # [ 0.463932] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.436797] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] client # [ 0.449664] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.462348] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] worker2 # [ 0.465231] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.437506] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.450856] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.462801] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.438742] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.452789] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.439443] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.464643] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] worker2 # [ 0.468577] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.440857] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.469680] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.456571] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.470671] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.441470] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.457594] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.471668] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.458586] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.443027] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] worker2 # [ 0.472669] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.459618] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.444166] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.473680] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.460622] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.474670] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.445282] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.461630] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.475667] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.462737] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.446794] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.476608] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.463616] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.477583] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.464563] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.478584] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.464800] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.479580] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.465777] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.465759] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.450520] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.480576] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.466511] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.451336] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.468408] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] worker2 # [ 0.481584] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.466798] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.452326] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.482579] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.467742] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.469541] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.453326] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.483571] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.468513] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.454322] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.468795] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.471310] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.455322] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.485633] iommu: Default domain type: Translated lb # [ 0.456323] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.486456] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.470812] iommu: Default domain type: Translated worker1 # [ 0.471858] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint client # [ 0.471561] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.487584] ACPI: bus type USB registered lb # [ 0.457321] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.472049] ACPI: bus type USB registered worker2 # [ 0.488384] usbcore: registered new interface driver usbfs worker1 # [ 0.472899] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.458280] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.472746] usbcore: registered new interface driver usbfs worker2 # [ 0.489264] usbcore: registered new interface driver hub lb # [ 0.459206] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.473434] usbcore: registered new interface driver hub worker1 # [ 0.473871] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.489589] usbcore: registered new device driver usb lb # [ 0.459936] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.473795] usbcore: registered new device driver usb lb # [ 0.460242] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.491417] NetLabel: Initializing worker1 # [ 0.475635] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] lb # [ 0.461212] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.475511] NetLabel: Initializing worker2 # [ 0.492023] NetLabel: domain hash size = 128 client # [ 0.475789] NetLabel: domain hash size = 128 lb # [ 0.461949] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.476538] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.492573] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.476490] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.462242] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.493653] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.477681] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.476837] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.494578] PCI: Using ACPI for IRQ routing lb # [ 0.463195] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.477796] PCI: Using ACPI for IRQ routing lb # [ 0.464971] iommu: Default domain type: Translated worker1 # [ 0.479336] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.465233] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.466468] ACPI: bus type USB registered lb # [ 0.467265] usbcore: registered new interface driver usbfs lb # [ 0.468215] usbcore: registered new interface driver hub worker1 # [ 0.483006] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.469014] usbcore: registered new device driver usb worker1 # [ 0.483699] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.470165] NetLabel: Initializing worker1 # [ 0.484688] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.470659] NetLabel: domain hash size = 128 lb # [ 0.471226] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.485684] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.472190] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.486683] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.472951] PCI: Using ACPI for IRQ routing worker1 # [ 0.487691] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.488696] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.489695] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.490619] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.491610] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.492599] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.493595] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.494595] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.495595] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.496598] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.497623] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.499765] iommu: Default domain type: Translated worker1 # [ 0.500622] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.501872] ACPI: bus type USB registered worker1 # [ 0.502644] usbcore: registered new interface driver usbfs worker1 # [ 0.503599] usbcore: registered new interface driver hub worker1 # [ 0.504554] usbcore: registered new device driver usb worker1 # [ 0.506218] NetLabel: Initializing worker1 # [ 0.506583] NetLabel: domain hash size = 128 worker1 # [ 0.507385] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.508400] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.509344] PCI: Using ACPI for IRQ routing client # [ 0.522034] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.522779] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.522779] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.541033] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.522787] vgaarb: loaded worker2 # [ 0.541564] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.523514] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.523785] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.541564] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.541573] vgaarb: loaded worker2 # [ 0.542367] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.543208] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.526864] clocksource: Switched to clocksource kvm-clock lb # [ 0.516219] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.516222] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.530362] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.547665] clocksource: Switched to clocksource kvm-clock lb # [ 0.516222] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.531093] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.516231] vgaarb: loaded client # [ 0.532440] pnp: PnP ACPI init worker2 # [ 0.549487] VFS: Disk quotas dquot_6.6.0 lb # [ 0.516975] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.533223] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.517227] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.534221] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.552153] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.535802] pnp: PnP ACPI: found 6 devices worker2 # [ 0.553628] pnp: PnP ACPI init lb # [ 0.519313] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.554503] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.555544] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.522690] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.557207] pnp: PnP ACPI: found 6 devices lb # [ 0.523407] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.524820] pnp: PnP ACPI init lb # [ 0.525602] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.543456] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.526611] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.544895] clocksource: Switched to clocksource acpi_pm lb # [ 0.528149] pnp: PnP ACPI: found 6 devices client # [ 0.545872] NET: Registered PF_INET protocol family client # [ 0.547081] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.564960] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.566552] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.567610] NET: Registered PF_INET protocol family worker2 # [ 0.568884] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.535721] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.537211] clocksource: Switched to clocksource acpi_pm lb # [ 0.538227] NET: Registered PF_INET protocol family lb # [ 0.539424] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.558165] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.558579] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.558579] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.558587] vgaarb: loaded client # [ 0.563339] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.559344] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.559585] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.564890] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.566265] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.567666] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.568957] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.586199] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.564677] clocksource: Switched to clocksource kvm-clock client # [ 0.570135] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.587827] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.571371] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.589182] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.572488] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.555543] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.573698] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.590519] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.568719] VFS: Disk quotas dquot_6.6.0 client # [ 0.574656] NET: Registered PF_XDP protocol family lb # [ 0.557060] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.591784] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.569481] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.575479] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.558319] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.570898] pnp: PnP ACPI init worker2 # [ 0.592916] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.576470] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.571742] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.559608] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.594185] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.577469] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.560844] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.595256] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.572746] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.578543] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.561913] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.596442] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.574311] pnp: PnP ACPI: found 6 devices client # [ 0.579598] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.597424] NET: Registered PF_XDP protocol family lb # [ 0.563142] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.580654] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.598280] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.564218] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.582380] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.599286] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.565440] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.600283] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.566415] NET: Registered PF_XDP protocol family worker2 # [ 0.601397] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.567271] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.584642] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.568267] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.602465] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.586645] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.569293] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.603607] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.570362] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.605279] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.582082] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.588638] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.571455] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.583590] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.584575] NET: Registered PF_INET protocol family lb # [ 0.572500] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.590318] PCI: CLS 0 bytes, default 64 worker2 # [ 0.607494] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.574148] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.585800] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.591181] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.609809] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.592894] Trying to unpack rootfs image as initramfs... lb # [ 0.576294] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.611761] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.578216] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.613416] PCI: CLS 0 bytes, default 64 lb # [ 0.580195] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.614298] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.581868] PCI: CLS 0 bytes, default 64 worker2 # [ 0.616025] Trying to unpack rootfs image as initramfs... lb # [ 0.582815] Trying to unpack rootfs image as initramfs... lb # [ 0.585195] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.602807] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.604456] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.605885] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.607370] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.608698] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.609917] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.611253] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.612436] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.613754] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.614788] NET: Registered PF_XDP protocol family worker1 # [ 0.615693] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.616781] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.617890] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.619077] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.620241] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.621427] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.623190] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.625957] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.627961] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.629981] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.636459] Initialise system trusted keyrings worker1 # [ 0.631807] PCI: CLS 0 bytes, default 64 client # [ 0.637451] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.632729] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.634550] Trying to unpack rootfs image as initramfs... lb # [ 0.627156] Initialise system trusted keyrings worker2 # [ 0.662108] Initialise system trusted keyrings lb # [ 0.630743] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.665733] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.661241] Key type asymmetric registered client # [ 0.661960] Asymmetric key parser 'x509' registered client # [ 0.662858] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.666227] io scheduler mq-deadline registered client # [ 0.667009] io scheduler kyber registered lb # [ 0.650194] Key type asymmetric registered worker2 # [ 0.684963] Key type asymmetric registered worker2 # [ 0.687716] Asymmetric key parser 'x509' registered lb # [ 0.653709] Asymmetric key parser 'x509' registered client # [ 0.671255] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.688587] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.654538] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.672559] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.691841] io scheduler mq-deadline registered lb # [ 0.657866] io scheduler mq-deadline registered worker2 # [ 0.692601] io scheduler kyber registered lb # [ 0.658653] io scheduler kyber registered client # [ 0.677861] Linux agpgart interface v0.103 client # [ 0.678652] ACPI: bus type drm_connector registered worker2 # [ 0.696258] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.662299] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.697560] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.663569] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.683527] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.701479] Linux agpgart interface v0.103 client # [ 0.684657] usbserial: USB Serial support registered for generic worker2 # [ 0.702259] ACPI: bus type drm_connector registered worker1 # [ 0.679815] Initialise system trusted keyrings lb # [ 0.668974] Linux agpgart interface v0.103 lb # [ 0.669741] ACPI: bus type drm_connector registered client # [ 0.688060] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.683421] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.688060] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.707148] usbcore: registered new interface driver usbserial_generic lb # [ 0.673043] usbcore: registered new interface driver usbserial_generic client # [ 0.690314] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.708215] usbserial: USB Serial support registered for generic lb # [ 0.674102] usbserial: USB Serial support registered for generic client # [ 0.694186] drop_monitor: Initializing network drop monitor service lb # [ 0.676716] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.711690] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.695370] NET: Registered PF_INET6 protocol family lb # [ 0.676716] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.711690] Please enable it if your BIOS has the CPPC option. lb # [ 0.678936] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.713956] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.698160] Segment Routing with IPv6 client # [ 0.698816] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.716826] drop_monitor: Initializing network drop monitor service lb # [ 0.682829] drop_monitor: Initializing network drop monitor service worker2 # [ 0.718017] NET: Registered PF_INET6 protocol family lb # [ 0.684008] NET: Registered PF_INET6 protocol family client # [ 0.702333] IPI shorthand broadcast: enabled worker2 # [ 0.721151] Segment Routing with IPv6 lb # [ 0.687193] Segment Routing with IPv6 worker2 # [ 0.723700] In-situ OAM (IOAM) with IPv6 lb # [ 0.689719] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.724749] IPI shorthand broadcast: enabled lb # [ 0.690736] IPI shorthand broadcast: enabled worker1 # [ 0.704817] Key type asymmetric registered client # [ 0.710626] sched_clock: Marking stable (577014187, 133029035)->(785808231, -75765009) worker1 # [ 0.707406] Asymmetric key parser 'x509' registered client # [ 0.714228] registered taskstats version 1 worker1 # [ 0.708287] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.715198] Loading compiled-in X.509 certificates worker2 # [ 0.732918] sched_clock: Marking stable (595014390, 137654417)->(804390388, -71721581) lb # [ 0.698978] sched_clock: Marking stable (566014113, 132673587)->(776046109, -77358409) worker1 # [ 0.711497] io scheduler mq-deadline registered worker1 # [ 0.712252] io scheduler kyber registered lb # [ 0.702923] registered taskstats version 1 worker2 # [ 0.737854] registered taskstats version 1 lb # [ 0.703904] Loading compiled-in X.509 certificates worker1 # [ 0.715960] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.738944] Loading compiled-in X.509 certificates worker1 # [ 0.719383] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.723010] Linux agpgart interface v0.103 worker1 # [ 0.723852] ACPI: bus type drm_connector registered worker1 # [ 0.726924] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.728067] usbserial: USB Serial support registered for generic client # [ 0.734066] Demotion targets for Node 0: null client # [ 0.734924] Key type .fscrypt registered client # [ 0.735636] Key type fscrypt-provisioning registered client # [ 0.736644] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.731381] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.731381] Please enable it if your BIOS has the CPPC option. lb # [ 0.721712] Demotion targets for Node 0: null worker1 # [ 0.733733] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.756689] Demotion targets for Node 0: null client # [ 0.740067] ima: Allocated hash algorithm: sha1 client # [ 0.740835] ima: No architecture policies found lb # [ 0.723733] Key type .fscrypt registered worker2 # [ 0.758720] Key type .fscrypt registered lb # [ 0.724398] Key type fscrypt-provisioning registered worker2 # [ 0.759383] Key type fscrypt-provisioning registered lb # [ 0.725360] ima: No TPM chip found, activating TPM-bypass! client # [ 0.743056] PM: Magic number: 10:312:987 worker1 # [ 0.737494] drop_monitor: Initializing network drop monitor service worker2 # [ 0.760335] ima: No TPM chip found, activating TPM-bypass! client # [ 0.743724] machinecheck machinecheck0: hash matches worker1 # [ 0.738726] NET: Registered PF_INET6 protocol family lb # [ 0.729705] ima: Allocated hash algorithm: sha1 worker1 # [ 0.741890] Segment Routing with IPv6 client # [ 0.747509] RAS: Correctable Errors collector initialized. worker2 # [ 0.764684] ima: Allocated hash algorithm: sha1 lb # [ 0.730471] ima: No architecture policies found worker2 # [ 0.765457] ima: No architecture policies found lb # [ 0.732702] PM: Magic number: 10:312:987 worker2 # [ 0.767687] PM: Magic number: 10:312:987 lb # [ 0.733421] machinecheck machinecheck0: hash matches worker1 # [ 0.745400] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.768391] machinecheck machinecheck0: hash matches worker1 # [ 0.746485] IPI shorthand broadcast: enabled lb # [ 0.737102] RAS: Correctable Errors collector initialized. worker2 # [ 0.772130] RAS: Correctable Errors collector initialized. client # [ 0.756127] clk: Disabling unused clocks client # [ 0.756830] PM: genpd: Disabling unused power domains worker1 # [ 0.754810] sched_clock: Marking stable (613014872, 141350828)->(835100985, -80735285) lb # [ 0.745782] clk: Disabling unused clocks worker2 # [ 0.780809] clk: Disabling unused clocks lb # [ 0.746487] PM: genpd: Disabling unused power domains worker2 # [ 0.781529] PM: genpd: Disabling unused power domains worker1 # [ 0.759609] registered taskstats version 1 worker1 # [ 0.760609] Loading compiled-in X.509 certificates worker1 # [ 0.778380] Demotion targets for Node 0: null worker1 # [ 0.781420] Key type .fscrypt registered worker1 # [ 0.782137] Key type fscrypt-provisioning registered worker1 # [ 0.783158] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.787388] ima: Allocated hash algorithm: sha1 worker1 # [ 0.788260] ima: No architecture policies found worker1 # [ 0.790384] PM: Magic number: 10:312:987 worker1 # [ 0.791137] machinecheck machinecheck0: hash matches worker1 # [ 0.795015] RAS: Correctable Errors collector initialized. worker1 # [ 0.803809] clk: Disabling unused clocks worker1 # [ 0.806379] PM: genpd: Disabling unused power domains client # [ 0.918474] Freeing initrd memory: 29096K client # [ 0.921615] Freeing unused decrypted memory: 2028K client # [ 0.924325] Freeing unused kernel image (initmem) memory: 3644K client # [ 0.925460] Write protecting the kernel read-only data: 32768k lb # [ 0.910454] Freeing initrd memory: 29092K client # [ 0.927398] Freeing unused kernel image (text/rodata gap) memory: 1208K client # [ 0.928903] Freeing unused kernel image (rodata/data gap) memory: 752K lb # [ 0.913591] Freeing unused decrypted memory: 2028K lb # [ 0.916166] Freeing unused kernel image (initmem) memory: 3644K worker2 # [ 0.951722] Freeing initrd memory: 29092K lb # [ 0.917273] Write protecting the kernel read-only data: 32768k lb # [ 0.919151] Freeing unused kernel image (text/rodata gap) memory: 1208K worker2 # [ 0.954785] Freeing unused decrypted memory: 2028K lb # [ 0.920690] Freeing unused kernel image (rodata/data gap) memory: 752K worker2 # [ 0.957346] Freeing unused kernel image (initmem) memory: 3644K worker2 # [ 0.958437] Write protecting the kernel read-only data: 32768k worker2 # [ 0.960351] Freeing unused kernel image (text/rodata gap) memory: 1208K worker2 # [ 0.961883] Freeing unused kernel image (rodata/data gap) memory: 752K client # [ 0.979936] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.981100] Run /init as init process worker1 # [ 0.978230] Freeing initrd memory: 29092K worker1 # [ 0.981502] Freeing unused decrypted memory: 2028K lb # [ 0.971703] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.984254] Freeing unused kernel image (initmem) memory: 3644K lb # [ 0.972827] Run /init as init process worker1 # [ 0.985333] Write protecting the kernel read-only data: 32768k client # [ 0.991239] systemd[1]: Inserted module 'autofs4' worker1 # [ 0.987245] Freeing unused kernel image (text/rodata gap) memory: 1208K worker1 # [ 0.988867] Freeing unused kernel image (rodata/data gap) memory: 752K worker2 # [ 1.013245] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 1.014371] Run /init as init process lb # [ 0.983086] systemd[1]: Inserted module 'autofs4' client # [ 1.007408] fuse: init (API version 7.45) worker2 # [ 1.024294] systemd[1]: Inserted module 'autofs4' client # [ 1.013193] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.015490] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 0.999313] fuse: init (API version 7.45) client # [ 1.018629] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.020876] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.005023] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.040401] fuse: init (API version 7.45) lb # [ 1.007411] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.011171] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.046090] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.013946] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.048486] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.051483] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.053690] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.040311] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 1.041506] Run /init as init process client # [ 1.046851] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.052487] systemd[1]: Inserted module 'autofs4' lb # [ 1.040630] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.083823] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.068808] fuse: init (API version 7.45) worker1 # [ 1.074740] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.077583] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.080976] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.083492] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.111224] systemd[1]: Successfully made /usr/ read-only. client # [ 1.383350] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.395230] systemd[1]: Detected virtualization kvm. client # [ 1.397310] systemd[1]: Detected architecture x86-64. client # [ 1.399423] systemd[1]: Running in initrd. client # [ 1.401824] systemd[1]: Initializing machine ID from random generator. lb # [ 1.377033] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.404667] systemd[1]: Hostname set to . lb # [ 1.389158] systemd[1]: Detected virtualization kvm. lb # [ 1.391366] systemd[1]: Detected architecture x86-64. lb # [ 1.393579] systemd[1]: Running in initrd. worker2 # [ 1.420796] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.430781] systemd[1]: Detected virtualization kvm. lb # [ 1.396164] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.432546] systemd[1]: Detected architecture x86-64. lb # [ 1.399109] systemd[1]: Hostname set to . worker2 # [ 1.434314] systemd[1]: Running in initrd. worker2 # [ 1.436403] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.438810] systemd[1]: Hostname set to . worker1 # [ 1.446780] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.451904] systemd[1]: Detected virtualization kvm. worker1 # [ 1.452796] systemd[1]: Detected architecture x86-64. worker1 # [ 1.453752] systemd[1]: Running in initrd. worker1 # [ 1.454886] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.456175] systemd[1]: Hostname set to . client # [ 1.623486] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.623196] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.661095] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.665569] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.678865] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.683327] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.684524] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.685982] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.687222] systemd[1]: Reached target Path Units. client # [ 1.688116] systemd[1]: Reached target Slice Units. client # [ 1.688973] systemd[1]: Reached target Swaps. client # [ 1.689787] systemd[1]: Reached target Timer Units. client # [ 1.690751] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.691969] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.693177] systemd[1]: Listening on Journal Sockets. client # [ 1.694180] systemd[1]: Listening on udev Control Socket. lb # [ 1.677328] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.695234] systemd[1]: Listening on udev Kernel Socket. client # [ 1.696187] systemd[1]: Reached target Socket Units. client # [ 1.697957] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.681027] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.682210] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.716584] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.683616] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.684776] systemd[1]: Reached target Path Units. client # [ 1.701846] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.685592] systemd[1]: Reached target Slice Units. lb # [ 1.686476] systemd[1]: Reached target Swaps. worker2 # [ 1.721077] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.687287] systemd[1]: Reached target Timer Units. worker2 # [ 1.722230] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.688272] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.723587] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.689481] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.724738] systemd[1]: Reached target Path Units. lb # [ 1.690637] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.725560] systemd[1]: Reached target Slice Units. lb # [ 1.691626] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.726395] systemd[1]: Reached target Swaps. client # [ 1.709272] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.692645] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.727192] systemd[1]: Reached target Timer Units. lb # [ 1.693580] systemd[1]: Reached target Socket Units. worker2 # [ 1.728146] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.729319] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.695312] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.730421] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.731386] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.732360] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.733263] systemd[1]: Reached target Socket Units. lb # [ 1.699759] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.735129] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.739741] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.723118] systemd[1]: Starting Journal Service... lb # [ 1.706764] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.719152] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.723711] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.746864] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.724998] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.726509] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.727678] systemd[1]: Reached target Path Units. worker1 # [ 1.728587] systemd[1]: Reached target Slice Units. worker1 # [ 1.729509] systemd[1]: Reached target Swaps. worker1 # [ 1.730312] systemd[1]: Reached target Timer Units. lb # [ 1.719660] systemd[1]: Starting Journal Service... worker1 # [ 1.731300] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.732573] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.733805] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.734861] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.736019] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.737032] systemd[1]: Reached target Socket Units. worker2 # [ 1.760859] systemd[1]: Starting Journal Service... worker1 # [ 1.738963] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.733736] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.743460] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.754534] netfs: FS-Cache loaded worker1 # [ 1.750443] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.759210] 9pnet: Installing 9P2000 support lb # [ 1.730781] systemd[1]: Starting Load Kernel Modules... lb # [ 1.751728] netfs: FS-Cache loaded worker2 # [ 1.774738] systemd[1]: Starting Load Kernel Modules... client # [ 1.769114] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.765555] systemd[1]: Starting Journal Service... lb # [ 1.757300] 9pnet: Installing 9P2000 support client # [ 1.776145] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.794415] netfs: FS-Cache loaded worker2 # [ 1.800299] 9pnet: Installing 9P2000 support lb # [ 1.765879] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.788238] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.805866] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.773950] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.795655] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.779499] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.815763] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.798756] systemd-journald[67]: Collecting audit messages is disabled. worker1 # [ 1.798781] netfs: FS-Cache loaded lb # [ 1.787171] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.805192] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.804169] 9pnet: Installing 9P2000 support lb # [ 1.792292] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.810461] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.796380] systemd-journald[67]: Collecting audit messages is disabled. worker2 # [ 1.830821] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.814778] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.801060] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.818411] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.812892] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.838338] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.805910] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.822511] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.821467] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.844410] systemd-journald[67]: Collecting audit messages is disabled. client # [ 1.827184] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.811803] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.847058] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.813615] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.851128] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.835129] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.818153] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker2 # [ 1.859022] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.824863] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.837690] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.863149] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.829757] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.842139] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.865707] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.849254] systemd-journald[67]: Collecting audit messages is disabled. client # [ 1.856172] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.850936] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.873834] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.876773] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.856793] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.863283] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.865405] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.854757] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.867638] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.876226] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.871921] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.862790] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.877553] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.885704] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.904242] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.882448] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.910855] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.877768] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.885897] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.921818] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.905365] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.907470] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.931352] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.898767] systemd[1]: Finished Apply Kernel Variables. client # [ 1.783674] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.917759] systemd[1]: Started Journal Service. client # worker1 # [ 1.915585] systemd[1]: Starting Apply Kernel Variables... client # [ 1.788324] systemd-modules-load[68]: Inserted module 'virtio_balloon' client # [ 1.789419] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.790501] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.792348] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.794334] systemd[1]: Reached target Local File Systems. client # [ 1.796281] systemd[1]: Starting Create System Files and Directories... lb # [ 1.782479] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.916259] systemd[1]: Started Journal Service. lb # client # [ 1.801199] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.785300] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker2 # [ 1.952234] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.930522] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.788180] systemd-modules-load[68]: Inserted module 'virtio_gpu' lb # [ 1.795119] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.940574] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.964266] systemd[1]: Started Journal Service. lb # [ 1.799680] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.801103] systemd[1]: Reached target Local File Systems. worker2 # [ 1.828222] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 1.832442] systemd-modules-load[68]: Inserted module 'virtio_balloon' lb # [ 1.803277] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.833574] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker2 # [ 1.836076] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.824444] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.837252] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.839315] systemd[1]: Reached target Local File Systems. worker1 # [ 1.954492] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.810384] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.841257] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.847054] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.972979] systemd[1]: Started Journal Service. worker1 # [ 1.832691] systemd-modules-load[68]: Inserted module 'dm_mod' lb # [ 1.832377] systemd[1]: Finished Create System Files and Directories. worker1 # [ 1.835905] systemd-modules-load[68]: Inserted module 'virtio_balloon' worker1 # [ 1.836940] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.854732] systemd-udevd[76]: Using default interface naming scheme 'v261'. worker1 # [ 1.842681] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.872651] systemd[1]: Finished Create System Files and Directories. worker1 # [ 1.850116] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.851119] systemd[1]: Reached target Local File Systems. worker1 # [ 1.854075] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.859079] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.857594] systemd-udevd[84]: Using default interface naming scheme 'v261'. client # [ 1.879094] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.898854] systemd-udevd[76]: Using default interface naming scheme 'v261'. worker1 # [ 1.886439] systemd[1]: Finished Create System Files and Directories. lb # [ 1.884071] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.923298] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.910306] systemd-udevd[83]: Using default interface naming scheme 'v261'. client # [ 1.928974] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.929886] systemd[1]: Reached target System Initialization. client # [ 1.930732] systemd[1]: Reached target Basic System. lb # [ 1.931180] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.932108] systemd[1]: Reached target System Initialization. lb # [ 1.932862] systemd[1]: Reached target Basic System. worker1 # [ 1.936374] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.975074] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.975910] systemd[1]: Reached target System Initialization. worker2 # [ 1.976815] systemd[1]: Reached target Basic System. worker1 # [ 1.985727] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.986748] systemd[1]: Reached target System Initialization. worker1 # [ 1.987646] systemd[1]: Reached target Basic System. client # [ 2.234883] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.249555] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 2.244531] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.263723] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.251363] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 2.271796] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.292513] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.277492] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.285089] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.302004] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 2.285788] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.288271] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.272953] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.274613] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.279417] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.296272] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.299549] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.300685] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.304083] usb usb1: Product: EHCI Host Controller client # [ 2.304736] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker2 # [ 2.321485] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.307046] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.324963] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.308734] hub 1-0:1.0: USB hub found worker2 # [ 2.325688] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.309914] hub 1-0:1.0: 6 ports detected lb # [ 2.293687] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.294949] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.296617] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.317310] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.318138] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.337188] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.338127] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.304946] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.339857] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.306982] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.308100] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.328582] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.311386] usb usb1: Product: EHCI Host Controller lb # [ 2.313051] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker2 # [ 2.348714] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.314700] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.349958] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.316734] hub 1-0:1.0: USB hub found worker2 # [ 2.351128] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.329094] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 2.317960] hub 1-0:1.0: 6 ports detected client # [ 2.335443] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 worker2 # [ 2.354419] usb usb1: Product: EHCI Host Controller worker2 # [ 2.356000] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd lb # [ 2.322068] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.334418] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.322840] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.357674] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.359470] hub 1-0:1.0: USB hub found worker2 # [ 2.361064] hub 1-0:1.0: 6 ports detected client # [ 2.345822] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.347157] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.365291] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.366043] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.344946] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.347982] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.338206] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.358805] usb usb2: Product: UHCI Host Controller worker1 # [ 2.353783] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.360057] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.360790] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.344105] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 client # [ 2.362763] SCSI subsystem initialized worker2 # [ 2.380288] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.363998] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.386551] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 worker1 # [ 2.364925] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.366756] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.355776] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.390107] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.356957] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.391273] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.375488] hub 2-0:1.0: USB hub found worker1 # [ 2.374386] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.381268] hub 2-0:1.0: 2 ports detected lb # [ 2.365330] SCSI subsystem initialized worker1 # [ 2.376773] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.377906] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.383847] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.382371] usb usb1: Product: EHCI Host Controller client # [ 2.254418] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.238032] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.383030] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd worker1 # [ 2.384378] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.240198] systemd[1]: Starting Virtual Console Setup... client # [ 2.257254] (udev-worker)[89]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.386383] hub 1-0:1.0: USB hub found worker1 # [ 2.387643] hub 1-0:1.0: 6 ports detected client # [ 2.261174] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.378070] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.413686] usb usb2: Product: UHCI Host Controller worker1 # [ 2.391224] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.414420] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.391993] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.416940] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.402167] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.402869] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.386703] usb usb2: Product: UHCI Host Controller lb # [ 2.387388] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.272158] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.286090] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.403405] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.289074] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.404232] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 lb # [ 2.260305] (udev-worker)[87]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.262706] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.432799] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.412813] SCSI subsystem initialized worker2 # [ 2.302729] (udev-worker)[86]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.306068] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.421745] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.422921] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.279551] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.281553] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.451138] hub 2-0:1.0: USB hub found lb # [ 2.418226] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.456786] hub 2-0:1.0: 2 ports detected lb # [ 2.425748] hub 2-0:1.0: USB hub found client # [ 2.309333] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.311852] systemd[1]: Finished Virtual Console Setup. lb # [ 2.429422] hub 2-0:1.0: 2 ports detected client # [ 2.447692] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.328507] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.446388] usb usb2: Product: UHCI Host Controller worker1 # [ 2.447128] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.452770] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 client # [ 2.455115] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.456267] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.440713] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.311157] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.441421] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.339074] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.313144] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.479078] SCSI subsystem initialized lb # [ 2.445727] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.329880] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.463762] usb usb3: Product: UHCI Host Controller lb # [ 2.446482] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker1 # [ 2.458894] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.464515] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.482694] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.333076] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.483414] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.334462] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.318070] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.318870] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.322840] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.322065] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.489730] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.473050] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.490524] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 lb # [ 2.456809] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.469020] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.476347] hub 3-0:1.0: USB hub found lb # [ 2.459253] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.477372] hub 3-0:1.0: 2 ports detected worker1 # [ 2.331517] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.461696] usb usb3: Product: UHCI Host Controller lb # [ 2.462369] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.496737] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.497905] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.362808] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.363676] systemd[1]: Reached target Initrd Root Device. client # [ 2.486763] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.469765] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.367061] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.487545] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.485649] hub 2-0:1.0: USB hub found worker2 # [ 2.508343] usb usb3: Product: UHCI Host Controller lb # [ 2.474771] hub 3-0:1.0: USB hub found worker2 # [ 2.509736] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.475658] hub 3-0:1.0: 2 ports detected worker2 # [ 2.510522] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.496001] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.497728] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 worker1 # [ 2.492379] hub 2-0:1.0: 2 ports detected lb # [ 2.482120] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.516871] hub 3-0:1.0: USB hub found lb # [ 2.482960] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.518706] hub 3-0:1.0: 2 ports detected client # [ 2.501576] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.355080] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.359523] systemd[1]: Finished Virtual Console Setup. lb # [ 2.356503] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.373768] systemd-fsck[109]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.509090] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.526758] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.527472] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.362374] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.529727] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.530477] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 lb # [ 2.497128] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.381495] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.498319] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 client # [ 2.515873] usb usb4: Product: UHCI Host Controller client # [ 2.516705] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker2 # [ 2.533970] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.518348] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.501979] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.519348] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.536810] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.520485] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.522111] hub 4-0:1.0: USB hub found client # [ 2.522707] hub 4-0:1.0: 2 ports detected lb # [ 2.505366] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.540266] usb usb4: Product: UHCI Host Controller worker1 # [ 2.518874] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.519646] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.525527] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.542750] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.508246] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.543511] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.509482] usb usb4: Product: UHCI Host Controller lb # [ 2.510189] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd lb # [ 2.510959] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.407356] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.546712] hub 4-0:1.0: USB hub found lb # [ 2.512704] hub 4-0:1.0: USB hub found worker2 # [ 2.548360] hub 4-0:1.0: 2 ports detected lb # [ 2.515008] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.516124] hub 4-0:1.0: 2 ports detected worker1 # [ 2.528688] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.517643] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.414293] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.531538] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 worker1 # [ 2.392072] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.539155] scsi host0: ahci client # [ 2.539835] scsi host1: ahci worker1 # [ 2.395890] systemd[1]: Reached target Initrd Root Device. client # [ 2.543109] scsi host2: ahci client # [ 2.545090] scsi host3: ahci worker1 # [ 2.398074] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 2.529320] scsi host0: ahci lb # [ 2.530073] scsi host1: ahci worker1 # [ 2.541414] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.542568] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.532730] scsi host2: ahci client # [ 2.550099] scsi host4: ahci worker1 # [ 2.546412] usb usb3: Product: UHCI Host Controller client # [ 2.552075] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.547106] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd client # [ 2.554686] scsi host5: ahci lb # [ 2.538597] scsi host3: ahci lb # [ 2.541049] scsi host4: ahci client # [ 2.558130] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker1 # [ 2.554374] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.576618] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.543734] scsi host5: ahci worker1 # [ 2.555784] hub 3-0:1.0: USB hub found lb # [ 2.544297] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker1 # [ 2.557587] hub 3-0:1.0: 2 ports detected client # [ 2.563109] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 client # [ 2.565170] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 client # [ 2.566401] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker2 # [ 2.584403] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.567585] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker2 # [ 2.585680] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.568770] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker2 # [ 2.589997] scsi host0: ahci lb # [ 2.556372] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker2 # [ 2.591638] scsi host1: ahci lb # [ 2.557588] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 worker1 # [ 2.570410] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker2 # [ 2.593320] scsi host2: ahci worker1 # [ 2.571177] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.559709] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.595014] scsi host3: ahci worker2 # [ 2.596624] scsi host4: ahci worker2 # [ 2.597129] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.562650] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker1 # [ 2.433328] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.575933] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.563911] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker2 # [ 2.599362] scsi host5: ahci lb # [ 2.565133] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker2 # [ 2.600403] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker1 # [ 2.437872] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.601554] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker2 # [ 2.603302] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 worker2 # [ 2.604456] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker2 # [ 2.605679] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker1 # [ 2.583823] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 worker2 # [ 2.606884] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 worker1 # [ 2.586640] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.588834] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.590023] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.591056] usb usb4: Product: UHCI Host Controller worker1 # [ 2.592282] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.593487] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.594662] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd worker1 # [ 2.595589] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.599904] hub 4-0:1.0: USB hub found worker1 # [ 2.602544] scsi host0: ahci worker1 # [ 2.603934] hub 4-0:1.0: 2 ports detected worker1 # [ 2.607204] scsi host1: ahci worker1 # [ 2.611127] scsi host2: ahci worker1 # [ 2.614323] scsi host3: ahci worker1 # [ 2.618452] scsi host4: ahci worker1 # [ 2.623874] scsi host5: ahci worker1 # [ 2.624844] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 44 lpm-pol 1 worker1 # [ 2.629396] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.635994] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 44 lpm-pol 1 worker1 # [ 2.637232] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 44 lpm-pol 1 worker1 # [ 2.644433] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 44 lpm-pol 1 worker1 # [ 2.648311] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 44 lpm-pol 1 worker1 # [ 2.650080] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 44 lpm-pol 1 client # [ 2.682197] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.685078] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.688310] usb 1-1: Product: QEMU USB Tablet client # [ 2.690181] usb 1-1: Manufacturer: QEMU client # [ 2.691838] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.689018] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.691890] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.726973] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.694970] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.729815] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.696922] usb 1-1: Manufacturer: QEMU worker2 # [ 2.732921] usb 1-1: Product: QEMU USB Tablet lb # [ 2.698526] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.734645] usb 1-1: Manufacturer: QEMU worker2 # [ 2.736250] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.722297] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.726772] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.766365] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.758685] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.761602] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.764820] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.766610] usb 1-1: Manufacturer: QEMU worker1 # [ 2.768224] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.656200] systemd[1]: Mounting /sysroot... lb # [ 2.651332] systemd[1]: Mounting /sysroot... worker1 # [ 2.798175] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.692354] systemd[1]: Mounting /sysroot... worker1 # [ 2.693292] systemd[1]: Mounting /sysroot... client # [ 2.881407] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.883622] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.886492] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.888967] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.891104] ata3.00: applying bridge limits client # [ 2.892986] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.895332] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.879639] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.897449] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.882127] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.899794] ata3.00: configured for UDMA/100 worker2 # [ 2.917958] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.884484] ata3.00: applying bridge limits worker2 # [ 2.920191] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.886533] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.903380] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.922723] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.888847] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.925039] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.891005] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.927173] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.893342] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.929633] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.895662] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.931845] ata3.00: applying bridge limits lb # [ 2.897971] ata3.00: configured for UDMA/100 worker2 # [ 2.933785] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.900274] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.935999] ata3.00: configured for UDMA/100 worker2 # [ 2.938351] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.959842] usbcore: registered new interface driver usbhid client # [ 2.965040] usbhid: USB HID core driver worker1 # [ 2.964401] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.966738] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.969171] ata3.00: applying bridge limits worker1 # [ 2.971050] ata3.00: configured for UDMA/100 worker1 # [ 2.973017] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.975387] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.965443] usbcore: registered new interface driver usbhid client # [ 2.982574] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.977796] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.979983] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 3.004887] usbcore: registered new interface driver usbhid lb # [ 2.971038] usbhid: USB HID core driver client # [ 2.988073] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.982599] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.985252] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 3.011935] usbhid: USB HID core driver client # [ 2.995096] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 3.005262] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 3.008409] EXT4-fs (vda): mounted filesystem e633dfbf-1afc-450a-99d4-3a91ae674564 r/w with ordered data mode. Quota mode: none. lb # [ 2.994002] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 3.029859] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.882094] systemd[1]: Mounted /sysroot. worker2 # [ 3.031844] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.882743] systemd[1]: Reached target Initrd Root File System. lb # [ 2.998610] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker2 # [ 3.036194] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.887289] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.004032] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.894826] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.046579] EXT4-fs (vda): mounted filesystem 1cba956f-61fe-4621-bf1c-67f0b10fbb8d r/w with ordered data mode. Quota mode: none. lb # [ 3.012771] EXT4-fs (vda): mounted filesystem 95d72eab-f798-408f-a4a0-9a641bb5b950 r/w with ordered data mode. Quota mode: none. client # [ 2.900154] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.050350] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.885785] systemd[1]: Mounted /sysroot. lb # [ 3.019143] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.915972] systemd[1]: Mounted /sysroot. worker2 # [ 2.916631] systemd[1]: Reached target Initrd Root File System. lb # [ 2.887848] systemd[1]: Reached target Initrd Root File System. client # [ 2.905164] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 2.892172] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.922072] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 2.912167] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 2.928698] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 2.920700] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.934782] systemd[1]: Mounting /sysroot/run... lb # [ 2.906555] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.939450] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 2.910063] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.911514] systemd[1]: Reloading... worker2 # [ 2.948148] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.063508] usbcore: registered new interface driver usbhid worker1 # [ 3.064289] usbhid: USB HID core driver worker2 # [ 2.951281] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.083019] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 3.091792] 9p: Installing v9fs 9p2000 file system support worker1 # [ 3.086674] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 3.090506] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.966674] systemd-sysroot-fstab-check[148]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.102521] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.976235] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.126167] 9p: Installing v9fs 9p2000 file system support worker1 # [ 3.104602] EXT4-fs (vda): mounted filesystem 011e19e4-05fe-4d6c-8c0f-8d704f716400 r/w with ordered data mode. Quota mode: none. client # [ 2.979408] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 2.980193] systemd[1]: Mounted /sysroot/run. client # [ 2.980788] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 2.992767] systemd-sysroot-fstab-check[148]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.968642] systemd[1]: Mounted /sysroot. client # [ 2.984070] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 2.970638] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.974937] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.990728] systemd[1]: Reload requested from client PID 148 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.992318] systemd[1]: Reloading... worker2 # [ 3.004837] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.008063] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.009259] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.010319] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.013203] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 2.992611] systemd-sysroot-fstab-check[141]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.019058] systemd[1]: Reload requested from client PID 148 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.020547] systemd[1]: Reloading... lb # [ 2.994682] systemd[1]: Reloading finished in 85 ms. worker1 # [ 2.997502] systemd[1]: Reload requested from client PID 141 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.998964] systemd[1]: Reloading... lb # [ 3.003111] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... lb # [ 3.007248] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... lb # [ 3.010320] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.011691] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.013234] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.015426] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 3.058720] systemd[1]: Reloading finished in 65 ms. client # [ 3.068379] systemd-sysroot-fstab-check[148]: Requesting initrd-fs.target/start/replace... client # [ 3.070750] systemd-sysroot-fstab-check[148]: Requesting swap.target/start/replace... worker2 # [ 3.085974] systemd[1]: Reloading finished in 67 ms. client # [ 3.074916] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.077302] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.078658] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.079682] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.093526] systemd-sysroot-fstab-check[148]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.097104] systemd-sysroot-fstab-check[148]: Requesting swap.target/start/replace... worker2 # [ 3.100084] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.103036] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.091237] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.092682] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.105434] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.106431] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.083192] systemd[1]: Reloading finished in 86 ms. worker2 # [ 3.115806] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.117086] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.091093] systemd-sysroot-fstab-check[141]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.095234] systemd-sysroot-fstab-check[141]: Requesting swap.target/start/replace... worker1 # [ 3.099700] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.101550] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.102728] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.103881] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 3.654876] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.653208] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.676555] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.677885] systemd[1]: Reached target Initrd File Systems. lb # [ 3.660187] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.680088] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.691898] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.682155] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.668225] systemd[1]: Mounting /sysroot/run... lb # [ 3.676199] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.701214] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.702871] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 3.691835] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.695336] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.711853] systemd[1]: Finished Find NixOS closure. client # [ 3.713095] systemd[1]: Reached target Initrd Default Target. client # [ 3.714757] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.703192] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.738550] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.711330] systemd[1]: Mounting /sysroot/run... client # [ 3.728599] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.741460] systemd[1]: Reached target Initrd File Systems. client # [ 3.729958] systemd[1]: Stopped target Basic System. client # [ 3.730910] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.744690] systemd[1]: Starting Find NixOS closure... client # [ 3.733296] systemd[1]: Stopped target Path Units. worker1 # [ 3.718982] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.733962] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.734919] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.735930] systemd[1]: Stopped target Slice Units. client # [ 3.736675] systemd[1]: Stopped target Socket Units. client # [ 3.737419] systemd[1]: Stopped target System Initialization. client # [ 3.738233] systemd[1]: Stopped target Swaps. client # [ 3.738831] systemd[1]: Stopped target Timer Units. worker2 # [ 3.749809] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.739618] systemd[1]: dbus.socket: Deactivated successfully. client # [ 3.741300] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.742141] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.743167] systemd[1]: Stopped Find NixOS closure. client # [ 3.744061] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 3.746075] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.732339] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.747106] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 3.748183] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.731616] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.749355] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.751226] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.867109] 9p: Installing v9fs 9p2000 file system support client # [ 3.752223] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.753484] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.737591] systemd[1]: Mounted /sysroot/run. client # [ 3.754792] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.756122] systemd[1]: Stopped Create System Files and Directories. client # [ 3.757247] systemd[1]: Stopped target Local File Systems. client # [ 3.758205] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 3.743334] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.760226] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.744304] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.761412] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 3.745235] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.763905] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 3.764926] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.777589] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.765889] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.749151] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.781231] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 3.773682] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.787639] systemd[1]: Finished Find NixOS closure. lb # [ 3.758218] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.788737] systemd[1]: Reached target Initrd Default Target. lb # [ 3.759558] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.777090] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.790496] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.761758] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.768920] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.785374] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.787356] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.789263] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.917574] 9p: Installing v9fs 9p2000 file system support client # [ 3.790354] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.803353] systemd[1]: Stopped target Initrd Default Target. client # [ 3.791872] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.804586] systemd[1]: Stopped target Basic System. client # [ 3.793220] systemd[1]: Closed udev Control Socket. worker2 # [ 3.805532] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.806573] systemd[1]: Stopped target Path Units. client # [ 3.794813] systemd[1]: Starting Cleanup udev Database... worker2 # [ 3.808104] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.796152] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.782720] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.779803] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.809239] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.797185] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.780864] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.810384] systemd[1]: Stopped target Slice Units. client # [ 3.798132] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 3.811138] systemd[1]: Stopped target Socket Units. lb # [ 3.782456] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.811803] systemd[1]: Stopped target System Initialization. client # [ 3.800146] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.812851] systemd[1]: Stopped target Swaps. client # [ 3.801127] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 3.813647] systemd[1]: Stopped target Timer Units. worker1 # [ 3.788265] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.801986] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.814575] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.785148] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.815663] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.790699] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.816929] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.792088] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.818791] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.792864] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.819556] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 3.821378] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.822311] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.824309] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.826220] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.827255] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.828047] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.802079] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.816646] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.829150] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.803248] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.830198] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.818295] systemd[1]: Finished Cleanup udev Database. lb # [ 3.801174] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.831176] systemd[1]: Stopped Create System Files and Directories. client # [ 3.819361] systemd[1]: Reached target Switch Root. worker1 # [ 3.805690] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.833046] systemd[1]: Stopped target Local File Systems. client # [ 3.820990] systemd[1]: Starting NixOS Activation... worker2 # [ 3.833795] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.834701] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.835723] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.838223] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.809292] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.839242] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.810376] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.840604] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.812082] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.848539] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.824333] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.825465] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.827105] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.853780] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 3.824887] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.826245] systemd[1]: Stopped target Basic System. worker1 # [ 3.829772] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.827126] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.828075] systemd[1]: Stopped target Path Units. worker2 # [ 3.859109] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 3.830111] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.860149] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 3.831082] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 3.832058] systemd[1]: Stopped target Slice Units. worker2 # [ 3.861637] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.832715] systemd[1]: Stopped target Socket Units. lb # [ 3.833436] systemd[1]: Stopped target System Initialization. worker2 # [ 3.863040] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.834466] systemd[1]: Stopped target Swaps. lb # [ 3.835173] systemd[1]: Stopped target Timer Units. worker2 # [ 3.864313] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 3.835832] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.865396] systemd[1]: Closed udev Control Socket. lb # [ 3.836646] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.866941] systemd[1]: Starting Cleanup udev Database... lb # [ 3.838112] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.868069] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 3.839183] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.869100] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 3.839832] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 3.869896] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 3.841820] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.872115] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 3.843187] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.873104] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.844265] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.874090] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.848195] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 3.845294] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.846414] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.848321] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 3.849580] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 3.850913] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 3.852137] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.856124] systemd[1]: Finished Find NixOS closure. lb # [ 3.853514] systemd[1]: Stopped target Local File Systems. lb # [ 3.854537] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.858151] systemd[1]: Reached target Initrd Default Target. lb # [ 3.855874] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.860146] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 3.857142] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.888200] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.859105] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.889471] systemd[1]: Finished Cleanup udev Database. lb # [ 3.860097] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 3.861263] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.891141] systemd[1]: Reached target Switch Root. worker2 # [ 3.892189] systemd[1]: Starting NixOS Activation... worker1 # [ 3.872432] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.873509] systemd[1]: Stopped target Basic System. worker1 # [ 3.874454] systemd[1]: Stopped target Initrd Root Device. lb # [ 3.872125] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.875563] systemd[1]: Stopped target Path Units. lb # [ 3.873103] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.877108] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.878162] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 3.879352] systemd[1]: Stopped target Slice Units. worker1 # [ 3.880444] systemd[1]: Stopped target Socket Units. worker1 # [ 3.881652] systemd[1]: Stopped target System Initialization. lb # [ 3.878430] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.882921] systemd[1]: Stopped target Swaps. lb # [ 3.880081] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.883837] systemd[1]: Stopped target Timer Units. worker1 # [ 3.884797] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 3.881511] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.882936] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.885978] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 3.884428] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.887673] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.888778] systemd[1]: Stopped Find NixOS closure. lb # [ 3.886244] systemd[1]: Closed udev Control Socket. worker1 # [ 3.889554] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 3.887914] systemd[1]: Starting Cleanup udev Database... lb # [ 3.888728] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.892061] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.889755] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.892940] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 3.893897] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.890634] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.894844] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 3.892144] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.896113] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.893084] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 3.894109] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.897130] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.899121] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.900260] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.901469] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.902685] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.904149] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.905995] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.907136] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.910320] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 3.907293] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 3.908854] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.912247] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.913372] systemd[1]: Stopped Virtual Console Setup. lb # [ 3.910301] systemd[1]: Reached target Switch Root. lb # [ 3.911876] systemd[1]: Starting NixOS Activation... worker1 # [ 3.921881] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.925072] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.932116] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.934086] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.935131] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.936184] systemd[1]: Closed udev Control Socket. worker1 # [ 3.937875] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.939147] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.940250] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.942143] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.943298] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.944454] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.945528] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.946863] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.949141] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.964262] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.965831] systemd[1]: Finished Cleanup udev Database. client # [ 3.979541] initrd-nixos-activation-start[195]: booting system configuration /nix/store/lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test worker1 # [ 3.968123] systemd[1]: Reached target Switch Root. worker1 # [ 3.969460] systemd[1]: Starting NixOS Activation... worker2 # [ 4.049895] initrd-nixos-activation-start[195]: booting system configuration /nix/store/475bgh1218crwnxd90vcgf549d3xm0l5-nixos-system-worker2-test client # [ 4.043918] initrd-nixos-activation-start[195]: running activation script... lb # [ 4.065297] initrd-nixos-activation-start[196]: booting system configuration /nix/store/fj20bcn47ir2axl7b7sxwa0fvig2ds2j-nixos-system-lb-test worker2 # [ 4.103438] initrd-nixos-activation-start[195]: running activation script... worker1 # [ 4.122836] initrd-nixos-activation-start[194]: booting system configuration /nix/store/c29xnmznw4lyy9ki05g66bk4sbx7ky11-nixos-system-worker1-test lb # [ 4.126989] initrd-nixos-activation-start[196]: running activation script... worker1 # [ 4.185903] initrd-nixos-activation-start[194]: running activation script... client # [ 4.458490] initrd-nixos-activation-start[218]: setting up /etc... worker2 # [ 4.477860] initrd-nixos-activation-start[218]: setting up /etc... lb # [ 4.520862] initrd-nixos-activation-start[219]: setting up /etc... worker1 # [ 4.590306] initrd-nixos-activation-start[217]: setting up /etc... worker2 # [ 4.736973] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.739058] systemd[1]: Finished NixOS Activation. worker2 # [ 4.740309] systemd[1]: Starting Switch Root... client # [ 4.727411] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.730086] systemd[1]: Finished NixOS Activation. client # [ 4.731419] systemd[1]: Starting Switch Root... worker2 # [ 4.752966] systemd[1]: Switching root. client # [ 4.745026] systemd[1]: Switching root. lb # [ 4.766646] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.769079] systemd[1]: Finished NixOS Activation. lb # [ 4.770136] systemd[1]: Starting Switch Root... lb # [ 4.783109] systemd[1]: Switching root. worker1 # [ 4.850812] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.852567] systemd[1]: Finished NixOS Activation. worker1 # [ 4.854499] systemd[1]: Starting Switch Root... worker2 # [ 5.022021] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). client # [ 5.009358] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.867056] systemd[1]: Switching root. lb # [ 5.047292] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.142148] systemd-journald[67]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.174481] NET: Registered PF_VSOCK protocol family client # [ 5.162780] NET: Registered PF_VSOCK protocol family lb # [ 5.191704] NET: Registered PF_VSOCK protocol family worker1 # [ 5.296524] NET: Registered PF_VSOCK protocol family worker2 # [ 5.558104] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.547715] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.551627] systemd[1]: Detected virtualization kvm. worker2 # [ 5.567827] systemd[1]: Detected virtualization kvm. client # [ 5.552358] systemd[1]: Detected architecture x86-64. client # [ 5.553264] systemd[1]: Detected first boot. worker2 # [ 5.569766] systemd[1]: Detected architecture x86-64. worker2 # [ 5.571943] systemd[1]: Detected first boot. client # [ 5.558252] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.578148] systemd[1]: Initializing machine ID from random generator. lb # [ 5.570230] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.579918] systemd[1]: Detected virtualization kvm. lb # [ 5.581712] systemd[1]: Detected architecture x86-64. lb # [ 5.583581] systemd[1]: Detected first boot. lb # [ 5.589465] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.677991] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.681887] systemd[1]: Detected virtualization kvm. worker1 # [ 5.682589] systemd[1]: Detected architecture x86-64. worker1 # [ 5.683363] systemd[1]: Detected first boot. worker1 # [ 5.687190] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.724864] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.796223] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 5.845173] systemd[1]: Applying preset policy. lb # [ 5.840123] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.918865] systemd[1]: Applying preset policy. worker1 # [ 5.926193] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.960468] systemd[1]: Applying preset policy. worker1 # [ 6.054558] systemd[1]: Applying preset policy. worker2 # [ 6.260978] systemd[1]: Populated /etc with preset unit settings. client # [ 6.370675] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.389685] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 6.479136] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.731846] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 6.733245] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 6.735962] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 6.737993] systemd[1]: Created slice Slice /system/getty. worker2 # [ 6.739411] systemd[1]: Created slice User and Session Slice. worker2 # [ 6.740335] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 6.741540] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 6.742684] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 6.743360] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 6.744115] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 6.744961] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 6.745732] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 6.746523] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 6.747358] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 6.748261] systemd[1]: Reached target Path Units. worker2 # [ 6.748986] systemd[1]: Reached target Remote File Systems. worker2 # [ 6.749793] systemd[1]: Reached target Slice Units. worker2 # [ 6.762119] systemd[1]: Reached target Swaps. worker2 # [ 6.765360] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.768959] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.771708] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 6.774376] systemd[1]: Listening on Factory Reset Management. worker2 # [ 6.775301] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 6.779116] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 6.780492] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 6.783372] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 6.784669] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 6.786545] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.787881] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 6.796736] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 6.797838] systemd[1]: Listening on udev Control Socket. worker2 # [ 6.798749] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 6.802944] systemd[1]: Mounting Huge Pages File System... worker2 # [ 6.806192] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.811185] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 6.817821] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 6.824090] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 6.825845] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker2 # [ 6.837233] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.838805] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.840487] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.842457] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.851839] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.852956] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.848501] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.849835] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.852741] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.854763] systemd[1]: Created slice Slice /system/getty. client # [ 6.856155] systemd[1]: Created slice User and Session Slice. client # [ 6.856990] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.859174] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.860355] systemd[1]: Expecting device /dev/hvc0... client # [ 6.861104] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.861810] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.862691] systemd[1]: Stopped target initrd-fs.target. client # [ 6.863478] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.864281] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.865150] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.866073] systemd[1]: Reached target Path Units. client # [ 6.866745] systemd[1]: Reached target Remote File Systems. lb # [ 6.853012] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.854340] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 6.888891] systemd[1]: Starting Journal Service... lb # [ 6.857160] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.859192] systemd[1]: Created slice Slice /system/getty. lb # [ 6.860501] systemd[1]: Created slice User and Session Slice. client # [ 6.867582] systemd[1]: Reached target Slice Units. lb # [ 6.861400] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.879852] systemd[1]: Reached target Swaps. lb # [ 6.862588] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.863641] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.864362] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.865122] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.865962] systemd[1]: Stopped target initrd-fs.target. client # [ 6.883634] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 6.866682] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 6.867443] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 6.902321] systemd[1]: Starting Load Kernel Modules... lb # [ 6.868298] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 6.869201] systemd[1]: Reached target Path Units. lb # [ 6.869925] systemd[1]: Reached target Remote File Systems. client # [ 6.887749] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.890710] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.893498] systemd[1]: Listening on Factory Reset Management. client # [ 6.894468] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 6.914377] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.898554] systemd[1]: Starting Journal Log Access Socket... lb # [ 6.870691] systemd[1]: Reached target Slice Units. lb # [ 6.882888] systemd[1]: Reached target Swaps. client # [ 6.900527] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.885761] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.903720] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.904865] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 6.922616] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 6.889154] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.906569] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.924814] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.907890] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.891712] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.894171] systemd[1]: Listening on Factory Reset Management. lb # [ 6.895110] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.898635] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 6.932933] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.900148] systemd[1]: Listening on Journal Audit Socket. client # [ 6.917443] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.918522] systemd[1]: Listening on udev Control Socket. client # [ 6.919447] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.903189] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 6.938226] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.904323] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.905871] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.941165] systemd[1]: Mounted Huge Pages File System. client # [ 6.924086] systemd[1]: Mounting Huge Pages File System... lb # [ 6.907425] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 6.942861] systemd[1]: Mounted POSIX Message Queue File System. client # [ 6.927466] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.945114] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 6.947420] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.926166] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 6.949575] systemd[1]: Mounted FUSE Control File System. lb # [ 6.915547] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.927593] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.916565] systemd[1]: Listening on udev Control Socket. client # [ 6.933956] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.917442] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.930292] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 6.954029] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.932481] systemd[1]: Created slice Slice /system/getty. lb # [ 6.921164] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.933839] systemd[1]: Created slice User and Session Slice. client # [ 6.939234] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 6.934787] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.924293] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.936021] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 6.958787] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 6.937147] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.937874] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 6.938692] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.939569] systemd[1]: Stopped target initrd-fs.target. client # [ 6.945311] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.940391] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.941148] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 6.941984] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.946991] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio lb # [ 6.930952] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 6.942919] systemd[1]: Reached target Path Units. worker1 # [ 6.943663] systemd[1]: Reached target Remote File Systems. lb # [ 6.935540] systemd[1]: Mounting Kernel Trace File System... client # [ 6.957409] systemd[1]: Starting Load Kernel Module configfs... client # [ 6.958943] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.942799] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.944463] systemd[1]: Reached target Slice Units. client # [ 6.960734] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.956719] systemd[1]: Reached target Swaps. lb # [ 6.944440] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio client # [ 6.962567] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.960046] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.985382] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 6.963733] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.986758] systemd[1]: Finished Load Kernel Module configfs. lb # [ 6.954101] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 6.966432] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.972693] systemd[1]: Mounting FUSE Control File System... lb # [ 6.955910] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.969065] systemd[1]: Listening on Factory Reset Management. client # [ 6.973674] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.992193] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 6.970033] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.958698] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.960329] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.973685] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.975220] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 6.977996] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 6.979251] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.981088] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.982428] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.971752] systemd[1]: Mounting FUSE Control File System... lb # [ 6.973027] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.991026] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.992062] systemd[1]: Listening on udev Control Socket. worker1 # [ 6.992966] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.996676] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.021334] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 6.999983] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 7.023780] EXT4-fs (vda): re-mounted 1cba956f-61fe-4621-bf1c-67f0b10fbb8d. client # [ 7.009550] systemd[1]: Starting Journal Service... worker1 # [ 7.006980] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.031296] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.032953] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.013398] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.035740] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.041262] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.019230] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.043369] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.028961] systemd[1]: Starting Load Kernel Modules... lb # [ 7.013985] systemd[1]: Starting Journal Service... worker1 # [ 7.025610] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio worker1 # [ 7.034761] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 7.057269] systemd-journald[288]: Collecting audit messages is enabled. worker1 # [ 7.036393] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 7.038607] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.045742] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 7.040544] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.030432] systemd[1]: Starting Load Kernel Modules... worker1 # [ 7.048126] systemd[1]: Mounting FUSE Control File System... client # [ 7.054415] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.049790] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.057307] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.076824] loop: module loaded lb # [ 7.043341] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.088098] systemd[1]: Finished Load Kernel Modules. worker2 # [ 7.093180] systemd[1]: Starting Firewall... client # [ 7.076156] systemd[1]: Starting Coldplug All udev Devices... lb # [ 7.059503] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 7.062475] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.099819] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 7.102980] systemd[1]: Started Journal Service. worker1 # [ 7.085732] systemd[1]: Starting Journal Service... worker2 # [ 6.970446] systemd[1]: Queued start job for default target Multi-User System. lb # [ 7.077890] systemd[1]: Starting Coldplug All udev Devices... client # [ 7.096087] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.976619] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 7.099974] systemd[1]: Mounted Huge Pages File System. worker2 # [ 6.980256] systemd-modules-load[289]: Inserted module 'loop' worker1 # [ 7.096297] systemd[1]: Starting Load Kernel Modules... client # [ 7.103790] systemd[1]: Mounted POSIX Message Queue File System. client # [ 7.105805] systemd-journald[288]: Collecting audit messages is enabled. worker2 # [ 6.986591] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 7.108377] systemd[1]: Mounted Kernel Debug File System. lb # [ 7.094838] systemd[1]: Listening on Journal Log Access Socket. client # [ 7.113958] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.109266] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 7.098569] systemd-journald[289]: Collecting audit messages is enabled. lb # [ 7.101018] systemd[1]: Mounted Huge Pages File System. worker1 # [ 7.115724] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 7.122607] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 7.105976] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 7.117655] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.125890] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 7.005207] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 7.110472] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.007750] systemd[1]: Reached target First Boot Complete. worker1 # [ 7.123766] systemd[1]: Starting Coldplug All udev Devices... lb # [ 7.115378] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.128639] systemd[1]: Listening on Journal Log Access Socket. client # [ 7.134435] EXT4-fs (vda): re-mounted e633dfbf-1afc-450a-99d4-3a91ae674564. client # [ 7.135831] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 7.130949] systemd[1]: Mounted Huge Pages File System. client # [ 7.136843] systemd[1]: Mounted FUSE Control File System. worker1 # [ 7.132874] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 7.134975] systemd[1]: Mounted Kernel Debug File System. lb # [ 7.124567] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 7.137278] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.139566] systemd[1]: Mounted FUSE Control File System. client # [ 7.146212] loop: module loaded lb # [ 7.129499] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 7.147234] systemd[1]: Started Journal Service. worker1 # [ 7.143199] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 7.028819] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.016364] systemd[1]: Queued start job for default target Multi-User System. client # [ 7.019305] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 7.147248] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.136927] systemd[1]: Finished Load Kernel Module configfs. client # [ 7.021565] systemd-modules-load[289]: Inserted module 'loop' worker2 # [ 7.034274] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 7.139718] EXT4-fs (vda): re-mounted 95d72eab-f798-408f-a4a0-9a641bb5b950. lb # [ 7.009033] systemd[1]: Queued start job for default target Multi-User System. client # [ 7.026179] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 7.144442] systemd[1]: Started Journal Service. lb # [ 7.012888] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 7.031131] systemd[1]: Finished Load Kernel Modules. lb # [ 7.149806] loop: module loaded lb # [ 7.023044] systemd[1]: Mounted FUSE Control File System. lb # [ 7.024188] systemd-modules-load[290]: Inserted module 'loop' worker2 # [ 7.055121] systemd-oomd[290]: No swap; memory pressure usage will be degraded client # [ 7.044074] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 7.030316] systemd[1]: Finished Load Kernel Modules. lb # [ 7.034247] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 7.052078] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.203447] systemd-journald[288]: Received client request to flush runtime journal. client # [ 7.058431] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 7.059413] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.190268] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 7.046064] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.192146] systemd[1]: Finished Load Kernel Module configfs. lb # [ 7.053091] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 7.197933] systemd[1]: Mounting Kernel Configuration File System... client # [ 7.070763] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 7.057651] systemd[1]: Starting Firewall... client # [ 7.080300] systemd-oomd[291]: No swap; memory pressure usage will be degraded lb # [ 7.069260] systemd-oomd[291]: No swap; memory pressure usage will be degraded client # [ 7.088128] systemd[1]: Starting Apply Kernel Variables... lb # [ 7.072252] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 7.073190] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.223424] EXT4-fs (vda): re-mounted 011e19e4-05fe-4d6c-8c0f-8d704f716400. client # [ 7.099130] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.101398] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.229522] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.102572] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 7.087091] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 7.093494] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 7.237982] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 7.240728] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.242075] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.250779] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.252649] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.110358] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.262400] systemd-journald[288]: Received client request to flush runtime journal. lb # [ 7.113681] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.114952] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.261208] systemd-journald[287]: Collecting audit messages is enabled. worker1 # [ 7.276551] loop: module loaded lb # [ 7.270260] systemd-journald[289]: Received client request to flush runtime journal. worker1 # [ 7.288058] systemd[1]: Finished Load Kernel Modules. worker1 # [ 7.292656] systemd[1]: Starting Firewall... worker1 # [ 7.297253] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 7.308377] systemd[1]: Started Journal Service. worker1 # [ 7.172137] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 7.177811] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 7.205636] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 7.209758] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.184254] systemd-modules-load[288]: Inserted module 'loop' worker2 # [ 7.211875] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 7.213244] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.190036] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 7.217126] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.218179] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 7.204797] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 7.213385] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 7.218979] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 7.224169] systemd[1]: Reached target First Boot Complete. client # [ 7.250057] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.252721] systemd[1]: Reached target First Boot Complete. client # [ 7.253738] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.254631] systemd[1]: Finished Apply Kernel Variables. client # [ 7.256067] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.257023] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 7.244757] systemd-oomd[289]: No swap; memory pressure usage will be degraded client # [ 7.260771] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 7.274363] systemd-udevd[321]: Using default interface naming scheme 'v261'. worker1 # [ 7.404830] systemd-journald[287]: Received client request to flush runtime journal. lb # [ 7.288746] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.289947] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 7.292819] systemd[1]: Reached target First Boot Complete. lb # [ 7.293798] systemd[1]: Finished Apply Kernel Variables. lb # [ 7.297803] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 7.299093] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 7.301211] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.327101] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.328244] systemd[1]: Reached target Preparation for Local File Systems. client # [ 7.332725] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.350375] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.351167] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.358220] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 7.360391] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 7.364963] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.398606] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.405798] systemd-udevd[319]: Using default interface naming scheme 'v261'. worker1 # [ 7.410952] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.415594] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.417716] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.420100] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.421482] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.424342] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 7.436284] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.455573] systemd-udevd[330]: Using default interface naming scheme 'v261'. worker1 # [ 7.469322] systemd-udevd[318]: Using default interface naming scheme 'v261'. client # [ 7.503454] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 7.527694] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.553899] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.564432] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 7.598568] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.599783] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.588095] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.603799] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 7.637067] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 7.642071] systemd[1]: Mounted /run/wrappers. worker2 # [ 7.644965] systemd[1]: Reached target Local File Systems. client # [ 7.634687] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 7.648763] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.652223] systemd[1]: Starting register-nix-paths.service... worker2 # [ 7.655712] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.656622] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.646966] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker2 # [ 7.660812] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.667147] systemd[1]: Starting Create System Files and Directories... client # [ 7.686939] (udev-worker)[324]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.689454] (udev-worker)[324]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.691245] (udev-worker)[331]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.690310] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.720084] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.740697] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.744623] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.726413] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.734438] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.755672] systemd[1]: Mounted /run/wrappers. client # [ 7.757408] systemd[1]: Reached target Local File Systems. client # [ 7.761080] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.772778] (udev-worker)[355]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 7.775573] (udev-worker)[355]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.765114] systemd[1]: Starting register-nix-paths.service... client # [ 7.770260] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.783745] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.772446] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.782068] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 7.769466] systemd[1]: Mounted /run/wrappers. lb # [ 7.770222] systemd[1]: Reached target Local File Systems. client # [ 7.788715] systemd[1]: Starting Create System Files and Directories... lb # [ 7.774421] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.778890] systemd[1]: Starting register-nix-paths.service... worker2 # [ 7.809103] systemd[1]: Finished Create System Files and Directories. worker2 # [ 7.813260] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 7.785572] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.790097] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.816191] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 7.786858] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.800141] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.811256] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.812727] systemd[1]: Starting Create System Files and Directories... client # [ 7.837231] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 7.821096] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.840218] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.841602] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.843327] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.846932] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.835655] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.836834] systemd[1]: Reached target Local File Systems. client # [ 7.850480] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.853176] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.839717] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.844027] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.848204] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.849215] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.854596] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.857730] systemd[1]: Starting Create System Files and Directories... client # [ 7.872158] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.878388] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.891242] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 7.878985] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 7.876761] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 7.883241] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.891872] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 7.919490] systemd[1]: Finished Create System Files and Directories. client # [ 7.928940] systemd[1]: Starting Rebuild Journal Catalog... client # [ 7.933844] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.951257] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 7.955685] systemd[1]: Starting Update is Completed... worker1 # [ 7.936868] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.940762] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.108084] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.960298] systemd[1]: Finished Create System Files and Directories. lb # [ 7.963945] (udev-worker)[371]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.967248] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.971457] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 7.976481] (udev-worker)[362]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.982858] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 8.013714] systemd[1]: Finished Update is Completed. client # [ 8.005501] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 7.992064] (udev-worker)[357]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 7.994385] (udev-worker)[357]: Network interface NamePolicy= disabled on kernel command line. client # [ 8.143446] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 8.001499] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 8.008188] systemd[1]: Finished Create System Files and Directories. worker1 # [ 8.014141] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 8.016551] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 8.044569] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 8.045738] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.047431] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.049395] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.051964] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.054604] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.056600] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.047795] systemd[1]: Finished Rebuild Journal Catalog. client # [ 8.051400] systemd[1]: Starting Update is Completed... lb # [ 8.068229] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 8.097290] systemd[1]: Finished Update is Completed. worker1 # [ 8.086413] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 8.119962] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 8.127584] systemd[1]: Starting Update is Completed... worker1 # [ 8.142814] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 8.151684] systemd[1]: Starting Update is Completed... lb # [ 8.182326] systemd[1]: Finished Update is Completed. worker1 # [ 8.216246] systemd[1]: Finished Update is Completed. worker2 # [ 8.382369] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 8.229234] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 8.231781] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.233537] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.235458] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.405350] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 8.239041] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 8.241410] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.243334] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.249099] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 8.251765] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.254165] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.255591] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.258169] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 8.260735] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.203367] ACPI: button: Power Button [PWRF] client # [ 8.212924] mousedev: PS/2 mouse device common for all mice client # [ 8.308639] rtc_cmos 00:04: RTC can wake from S4 worker1 # [ 8.263567] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.332623] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 client # [ 8.332874] rtc_cmos 00:04: registered as rtc0 client # [ 8.332963] rtc_cmos 00:04: setting system clock to 2026-09-21T12:57:36 UTC (1789995456) client # [ 8.333111] systemd-journald[288]: Time jumped backwards, rotating. worker2 # [ 8.330378] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 8.331572] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.333392] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 8.384587] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 8.349401] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 8.351534] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.379151] systemd[1]: Finished Firewall. client # [ 8.399801] parport_pc 00:02: reported by Plug and Play ACPI client # [ 8.400540] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 8.408800] Console: switching to colour dummy device 80x25 client # [ 8.527162] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 8.527296] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.547321] [drm] Found bochs VGA, ID 0xb0c5. client # [ 8.547323] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 8.552194] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 8.552841] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 8.550559] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 8.452010] ACPI: button: Power Button [PWRF] worker2 # [ 8.510202] mousedev: PS/2 mouse device common for all mice client # [ 8.584536] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 8.585702] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 8.562790] rtc_cmos 00:04: RTC can wake from S4 worker2 # [ 8.573960] rtc_cmos 00:04: registered as rtc0 worker2 # [ 8.574028] rtc_cmos 00:04: setting system clock to 2026-09-21T12:57:37 UTC (1789995457) worker2 # [ 8.574111] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 8.594467] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 8.594547] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 8.599861] Console: switching to colour dummy device 80x25 lb # [ 8.462907] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.465235] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 8.609718] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 8.605196] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 8.607267] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 worker1 # [ 8.621074] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 8.501755] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.662835] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 8.663250] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 8.681053] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 8.688099] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 8.541807] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.544133] systemd[1]: Stopped Virtual Console Setup. client # [ 8.549753] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.705917] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 8.708047] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.684967] Console: switching to colour frame buffer device 160x50 worker1 # [ 8.557338] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.560074] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.722168] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 8.766247] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.770284] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 8.632447] systemd[1]: Finished Firewall. client # [ 8.784560] ppdev: user-space parallel port driver lb # [ 8.574754] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 8.639323] systemd[1]: Finished Firewall. worker2 # [ 8.667383] systemd[1]: Starting Virtual Console Setup... client # [ 8.790644] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 8.770553] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.607910] ACPI: button: Power Button [PWRF] lb # [ 8.634972] mousedev: PS/2 mouse device common for all mice lb # [ 8.710025] rtc_cmos 00:04: RTC can wake from S4 worker2 # [ 8.779312] Console: switching to colour frame buffer device 160x50 lb # [ 8.718890] rtc_cmos 00:04: registered as rtc0 lb # [ 8.718977] rtc_cmos 00:04: setting system clock to 2026-09-21T12:57:37 UTC (1789995457) lb # [ 8.719056] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 8.857585] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.680383] ACPI: button: Power Button [PWRF] worker1 # [ 8.705376] mousedev: PS/2 mouse device common for all mice worker2 # [ 8.742115] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.721780] systemd-journald[289]: Time jumped backwards, rotating. lb # [ 8.724629] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.724749] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 8.744191] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.776226] rtc_cmos 00:04: RTC can wake from S4 worker1 # [ 8.797737] rtc_cmos 00:04: registered as rtc0 client # [ 8.739435] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.797827] rtc_cmos 00:04: setting system clock to 2026-09-21T12:57:37 UTC (1789995457) worker2 # [ 8.752284] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.797918] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 8.741804] systemd[1]: Stopped Virtual Console Setup. client # [ 8.752333] systemd[1]: Starting Virtual Console Setup... lb # [ 8.768259] Console: switching to colour dummy device 80x25 lb # [ 8.771590] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 lb # [ 8.744800] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.798587] systemd-journald[287]: Time jumped backwards, rotating. lb # [ 8.745802] systemd[1]: Reached target System Initialization. worker1 # [ 8.801861] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.747154] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.748770] systemd[1]: Started niks3 garbage collection timer. lb # [ 8.749743] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 8.753280] systemd[1]: Reached target Timer Units. lb # [ 8.754199] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 8.801961] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.756454] systemd[1]: Listening on niks3 server socket. worker1 # [ 8.836297] Console: switching to colour dummy device 80x25 lb # [ 8.757410] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.758491] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.760142] systemd[1]: Reached target Socket Units. lb # [ 8.761230] systemd[1]: Reached target Basic System. lb # [ 8.765626] systemd[1]: Started backdoor.service. lb # [ 8.769959] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.862753] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.876735] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 lb # [ 8.778774] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.785881] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 8.907685] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 8.907806] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.922590] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.922595] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.792734] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.939553] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 8.939556] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 8.943292] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 8.944002] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.946686] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.947367] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.805471] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.979472] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.981850] ppdev: user-space parallel port driver lb # [ 8.814816] systemd[1]: Starting resolvconf update... client # [ 8.984745] kvm_amd: TSC scaling supported client # [ 8.985388] kvm_amd: Nested Virtualization enabled client # [ 8.985924] kvm_amd: Nested Paging enabled client # [ 8.986806] kvm_amd: LBR virtualization supported lb # [ 8.837285] systemd[1]: Started rustfs.service. client # [ 8.987908] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.988896] kvm_amd: Virtual GIF supported client # [ 8.989724] kvm_amd: Virtual NMI enabled worker2 # [ 9.010531] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.991126] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.861775] systemd[1]: Starting rustfs-bucket.service... lb # [ 8.887544] systemd[1]: Finished Post-Boot Actions. client # [ 9.039214] EDAC MC: Ver: 3.0.0 lb # [ 9.027016] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # connecting to host... worker1 # [ 8.905941] systemd[1]: Starting Virtual Console Setup... lb # [ 8.904481] nsncd[527]: Sep 21 12:57:37.813 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.908994] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.998350] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.945477] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.947165] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.949156] systemd[1]: Starting Virtual Console Setup... lb # [ 8.930885] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.935517] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.948370] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 8.998604] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 9.058825] Console: switching to colour frame buffer device 160x50 worker1 # [ 9.119071] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 9.108631] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 9.112484] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 8.984492] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.985850] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.983291] systemd[1]: Starting User Login Management... worker1 # [ 8.987714] systemd[1]: Starting Virtual Console Setup... lb # [ 8.991149] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 9.025481] systemd[1]: Finished register-nix-paths.service. worker1 # [ 9.184719] ppdev: user-space parallel port driver worker2 # [ 9.225199] kvm_amd: TSC scaling supported worker2 # [ 9.225776] kvm_amd: Nested Virtualization enabled worker2 # [ 9.226276] kvm_amd: Nested Paging enabled worker2 # [ 9.227005] kvm_amd: LBR virtualization supported worker2 # [ 9.227581] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 9.228258] kvm_amd: Virtual GIF supported worker2 # [ 9.228952] kvm_amd: Virtual NMI enabled worker2 # [ 9.111884] systemd[1]: Finished register-nix-paths.service. worker2 # [ 9.272320] EDAC MC: Ver: 3.0.0 worker1 # [ 9.254425] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.283465] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 9.155238] dbus-broker-launch[556]: Looking up NSS user entry for 'systemd-timesync'... client # [ 9.176158] systemd-vconsole-setup[424]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 9.179683] systemd[1]: Finished Virtual Console Setup. client # [ 9.181496] systemd[1]: Reached target System Initialization. client # [ 9.183096] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 9.170908] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 9.184023] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 9.185933] systemd[1]: Reached target Timer Units. client # [ 9.186636] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 9.187523] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 9.174786] systemd[1]: Stopped Virtual Console Setup. client # [ 9.188477] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 9.189582] systemd[1]: Reached target Socket Units. client # [ 9.190843] systemd[1]: Reached target Basic System. client # [ 9.193142] systemd[1]: Started backdoor.service. worker1 # [ 9.179252] systemd[1]: Starting Virtual Console Setup... client # [ 9.196727] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 9.199160] systemd[1]: Starting nftables firewall... client # [ 9.204409] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 9.212880] systemd[1]: Starting Post-Boot Actions... client # [ 9.222502] systemd[1]: Started Reset console on configuration changes. client # [ 9.233773] systemd[1]: Starting resolvconf update... client # [ 9.265566] systemd[1]: Starting D-Bus System Message Bus... client # [ 9.291533] systemd[1]: Finished Post-Boot Actions. client # connecting to host... client # [ 9.309292] nsncd[432]: Sep 21 12:57:37.606 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.312702] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 9.327163] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.328026] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.395550] Console: switching to colour frame buffer device 160x50 worker1 # [ 9.470738] kvm_amd: TSC scaling supported worker1 # [ 9.471198] kvm_amd: Nested Virtualization enabled client # [ 9.343599] systemd[1]: Starting User Login Management... worker1 # [ 9.472095] kvm_amd: Nested Paging enabled worker1 # [ 9.472870] kvm_amd: LBR virtualization supported worker1 # [ 9.473741] kvm_amd: Virtual VMLOAD VMSAVE supported client: Guest shell says: b'Spawning backdoor root shell...\n' worker1 # [ 9.474584] kvm_amd: Virtual GIF supported worker1 # [ 9.475061] kvm_amd: Virtual NMI enabled worker2 # [ 9.370226] systemd-vconsole-setup[523]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 9.374082] systemd[1]: Finished Virtual Console Setup. client # [ 9.359933] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 9.374799] systemd[1]: Reached target System Initialization. lb # [ 9.485673] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 9.359837] systemd[1]: Finished register-nix-paths.service. lb # [ 9.183987] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 9.521453] EDAC MC: Ver: 3.0.0 worker2 # [ 9.376463] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 9.355977] dbus-broker-launch[556]: NSS returned no entry for 'systemd-timesync' worker2 # [ 9.378211] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 9.379201] systemd[1]: Reached target Timer Units. client: connected to guest root shell worker2 # [ 9.379885] systemd[1]: Listening on D-Bus System Message Bus Socket. client: (connecting took 10.10 seconds) lb # [ 9.356902] dbus-broker-launch[556]: Invalid user-name in /nix/store/4f05js9lzfgnghkwcx7gl7iad82krcww-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client: (finished: waiting for the VM to finish booting, in 10.10 seconds) lb # [ 9.359906] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 9.381252] systemd[1]: Listening on Nix Daemon Socket. lb # [ 9.362901] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 9.385621] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 9.365948] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 9.386512] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 9.368447] nsncd[617]: Sep 21 12:57:38.250 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 9.387598] systemd[1]: Reached target Socket Units. lb # [ 9.371169] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.388397] systemd[1]: Reached target Basic System. lb # [ 9.371949] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.390343] systemd[1]: Started backdoor.service. lb # [ 9.374139] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 9.395794] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 9.374873] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 9.398072] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 9.376480] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.403458] systemd[1]: Starting Post-Boot Actions... lb # [ 9.378360] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 9.408633] systemd[1]: Started Reset console on configuration changes. lb # [ 9.380917] dbus-broker-launch[556]: Ready worker2 # [ 9.414621] systemd[1]: Starting resolvconf update... lb # [ 9.382118] systemd[1]: Finished resolvconf update. worker2 # [ 9.419962] systemd[1]: Starting D-Bus System Message Bus... lb # [ 9.382829] systemd[1]: Reached target Preparation for Network. lb # [ 9.385349] systemd[1]: Starting DHCP Client... lb # [ 9.387097] systemd[1]: Starting Address configuration of eth1... lb # [ 9.389328] systemd-logind[558]: New seat seat0. lb # [ 9.390319] systemd[1]: Starting Extra networking commands.... lb # [ 9.391609] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.393610] systemd-logind[558]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 9.395475] systemd-logind[558]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 9.396788] systemd[1]: Started User Login Management. lb # [ 9.398233] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.400145] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.414607] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.415474] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.424634] systemd[1]: Starting linger-users.service... lb # [ 9.438960] systemd[1]: Starting Virtual Console Setup... client # [ 9.455936] dbus-broker-launch[441]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 9.483952] systemd[1]: Finished Post-Boot Actions. client # [ 9.478219] systemd-logind[462]: New seat seat0. client # [ 9.481527] dbus-broker-launch[441]: NSS returned no entry for 'systemd-timesync' client # [ 9.483613] dbus-broker-launch[441]: Invalid user-name in /nix/store/8rd26vjfizqw5mjnswk36af94npr87nm-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 9.488801] systemd-logind[462]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 9.490462] systemd-logind[462]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 9.492990] systemd-logind[462]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 9.508890] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 9.510201] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.498420] systemd[1]: Started User Login Management. worker2 # [ 9.513329] systemd[1]: Reached target User and Group Name Lookups. client # [ 9.504174] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 9.505087] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 9.516547] nsncd[531]: Sep 21 12:57:38.569 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.505977] systemd[1]: Stopped target User and Group Name Lookups. client # [ 9.506839] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 9.521672] systemd[1]: Starting User Login Management... worker2 # connecting to host... client # [ 9.514417] systemd[1]: Starting linger-users.service... client # [ 9.515952] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.536090] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 9.524265] systemd[1]: nscd.service: Deactivated successfully. lb # [ 9.640306] ppdev: user-space parallel port driver client # [ 9.526860] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 9.526448] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.529934] systemd[1]: Finished linger-users.service. client # [ 9.549992] systemd[1]: Started D-Bus System Message Bus. lb # [ 9.547738] network-addresses-eth1-start[630]: adding address 192.168.1.2/24... done client # [ 9.578857] dbus-broker-launch[441]: Ready worker2 # [ 9.595706] dbus-broker-launch[535]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 9.572052] network-addresses-eth1-start[630]: adding address 2001:db8:1::2/64... done client # [ 9.595260] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.615075] dbus-broker-launch[535]: NSS returned no entry for 'systemd-timesync' worker2 # [ 9.616560] dbus-broker-launch[535]: Invalid user-name in /nix/store/r6c36z2ah39ibj29dsamba7qp92g9jbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 9.620331] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 9.621597] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 9.622752] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 9.624216] systemd[1]: Stopping User and Group Name Lookups... client # [ 9.613932] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 9.626308] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.629290] systemd[1]: nscd.service: Deactivated successfully. client # [ 9.618686] systemd[1]: Finished linger-users.service. worker2 # [ 9.631435] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 9.604841] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.639956] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 9.628929] systemd[1]: Finished resolvconf update. worker2 # [ 9.643540] systemd-logind[554]: New seat seat0. client # [ 9.636560] systemd[1]: Starting DHCP Client... worker2 # [ 9.651413] systemd-logind[554]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 9.756532] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 9.653581] systemd-logind[554]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 9.655646] systemd-logind[554]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 9.657914] systemd[1]: Started User Login Management. worker2 # [ 9.662617] systemd[1]: Starting linger-users.service... worker1 # [ 9.638783] systemd-vconsole-setup[522]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.643087] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.643901] systemd[1]: Reached target System Initialization. worker1 # [ 9.645284] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 9.646387] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 9.648156] systemd[1]: Reached target Timer Units. worker2 # [ 9.674649] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 9.649177] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 9.650159] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 9.653466] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 9.655626] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 9.670064] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.656808] systemd[1]: Reached target Socket Units. worker1 # [ 9.657559] systemd[1]: Reached target Basic System. client # [ 9.672804] nsncd[527]: Sep 21 12:57:37.971 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 9.660681] systemd[1]: Started backdoor.service. client # [ 9.674759] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.676281] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.663880] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 9.668090] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.672939] systemd[1]: Starting Post-Boot Actions... worker1 # [ 9.676533] systemd[1]: Started Reset console on configuration changes. worker1 # [ 9.685167] systemd[1]: Starting resolvconf update... worker1 # [ 9.692331] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 9.717983] dbus-broker-launch[535]: Ready lb # [ 9.823501] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 9.724705] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 9.727786] nsncd[602]: Sep 21 12:57:38.788 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 9.730288] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 9.731397] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.704145] systemd-logind[558]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 9.735571] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 9.737440] systemd[1]: Finished linger-users.service. worker2 # [ 9.749093] systemd[1]: Finished resolvconf update. worker2 # [ 9.749800] systemd[1]: Reached target Preparation for Network. worker2 # [ 9.754481] systemd[1]: Starting DHCP Client... worker2 # [ 9.757775] systemd[1]: Starting Address configuration of eth1... worker2 # [ 9.761386] systemd[1]: Starting Extra networking commands.... lb # [ 9.746871] systemd[1]: Finished Extra networking commands.. lb # [ 9.750125] systemd[1]: Reached target Network. client # [ 9.769354] dhcpcd[556]: dhcpcd-10.3.2 starting worker1 # [ 9.755847] systemd[1]: Finished Post-Boot Actions. lb # [ 9.756753] dhcpcd[660]: dhcpcd-10.3.2 starting client # [ 9.778363] dhcpcd[563]: dev: loaded udev lb # [ 9.761603] systemd[1]: Starting PostgreSQL Server... lb # [ 9.770362] dhcpcd[716]: dev: loaded udev lb # [ 9.772233] systemd[1]: Starting Permit User Sessions... client # [ 9.932529] 8021q: 802.1Q VLAN Support v1.8 worker1 # connecting to host... worker1 # [ 9.793304] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.795976] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 9.798563] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.802848] nsncd[530]: Sep 21 12:57:38.634 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 9.806220] systemd[1]: Starting User Login Management... worker1 # [ 9.809296] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 9.942181] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.942609] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 9.827055] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.819398] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.822863] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 9.863727] network-addresses-eth1-start[631]: adding address 192.168.1.4/24... done lb # [ 9.840835] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.880077] network-addresses-eth1-start[631]: adding address 2001:db8:1::4/64... done lb # [ 9.863302] systemd[1]: Finished Permit User Sessions. worker1 # [ 9.867873] dbus-broker-launch[534]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 9.899928] systemd[1]: Finished Address configuration of eth1. client # [ 10.020572] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 9.876401] systemd[1]: Started Getty on tty1. lb # [ 9.879970] systemd[1]: Reached target Login Prompts. worker1 # [ 9.887153] dbus-broker-launch[534]: NSS returned no entry for 'systemd-timesync' worker1 # [ 9.889102] dbus-broker-launch[534]: Invalid user-name in /nix/store/r6c36z2ah39ibj29dsamba7qp92g9jbb-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 9.920878] dhcpcd[638]: dhcpcd-10.3.2 starting worker1 # [ 9.894640] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 9.897463] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 9.899123] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 9.900437] systemd[1]: Stopping User and Group Name Lookups... client # [ 10.049616] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 9.903255] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 10.050652] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 9.930258] dhcpcd[692]: dev: loaded udev worker1 # [ 9.904321] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 9.905812] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 10.053538] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 10.054417] cfg80211: failed to load regulatory.db worker2 # [ 9.940845] systemd[1]: Finished Extra networking commands.. worker2 # [ 9.942343] systemd[1]: Reached target Network. worker1 # [ 9.916481] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.945860] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.926268] systemd-logind[555]: New seat seat0. lb # [ 9.924053] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 10.095045] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 10.095501] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.932894] systemd-logind[555]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 9.935410] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 9.938241] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 9.941301] systemd[1]: Started User Login Management. worker1 # [ 9.943156] systemd[1]: Starting linger-users.service... worker1 # [ 9.946566] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 9.975197] systemd[1]: Finished Permit User Sessions. worker2 # [ 9.982067] systemd[1]: Started Getty on tty1. client # [ 9.971146] systemd[1]: Finished nftables firewall. client # [ 9.971983] systemd[1]: Reached target Preparation for Network. worker2 # [ 9.984405] systemd[1]: Reached target Login Prompts. client # [ 9.976497] systemd[1]: Starting Address configuration of eth1... client # [ 9.981633] systemd[1]: Starting Extra networking commands.... worker2 # [ 9.995065] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 10.123654] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.992127] dhcpcd[563]: eth0: waiting for carrier client # [ 9.993233] dhcpcd[563]: eth0: carrier acquired client # [ 10.006180] dhcpcd[563]: DUID 00:01:00:01:32:43:e6:42:52:54:00:12:34:56 client # [ 10.007191] dhcpcd[563]: eth0: IAID 00:12:34:56 client # [ 10.007937] dhcpcd[563]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 9.996578] dbus-broker-launch[534]: Ready worker1 # [ 10.000218] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.002151] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.004265] nsncd[601]: Sep 21 12:57:38.844 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.007177] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.013233] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 10.014386] systemd[1]: Finished linger-users.service. worker2 # [ 10.187427] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 10.026299] systemd[1]: Finished resolvconf update. worker1 # [ 10.027067] systemd[1]: Reached target Preparation for Network. worker1 # [ 10.031375] systemd[1]: Starting DHCP Client... worker1 # [ 10.034089] systemd[1]: Starting Address configuration of eth1... worker1 # [ 10.038093] systemd[1]: Starting Extra networking commands.... client # [ 10.187175] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 10.178338] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 10.215707] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 10.216436] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 10.219346] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 10.069528] network-addresses-eth1-start[587]: adding address 192.168.1.1/24... done worker2 # [ 10.220212] cfg80211: failed to load regulatory.db client # [ 10.082554] network-addresses-eth1-start[587]: adding address 2001:db8:1::1/64... done lb # [ 10.208322] kvm_amd: TSC scaling supported lb # [ 10.209154] kvm_amd: Nested Virtualization enabled lb # [ 10.211589] kvm_amd: Nested Paging enabled lb # [ 10.213006] kvm_amd: LBR virtualization supported lb # [ 10.213532] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 10.098527] systemd[1]: Finished Address configuration of eth1. lb # [ 10.215067] kvm_amd: Virtual GIF supported lb # [ 10.215542] kvm_amd: Virtual NMI enabled lb # [ 10.229051] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 10.230972] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 10.271430] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 10.121675] systemd[1]: Finished Extra networking commands.. worker2 # [ 10.135045] dhcpcd[692]: eth0: waiting for carrier client # [ 10.123367] systemd[1]: Reached target Network. worker2 # [ 10.136100] dhcpcd[692]: eth0: carrier acquired lb # [ 10.240192] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 10.241093] cfg80211: failed to load regulatory.db client # [ 10.126476] systemd[1]: Starting Permit User Sessions... worker2 # [ 10.145272] dhcpcd[692]: DUID 00:01:00:01:32:43:e6:43:52:54:00:12:34:56 worker2 # [ 10.146294] dhcpcd[692]: eth0: IAID 00:12:34:56 worker2 # [ 10.146972] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 10.140548] network-addresses-eth1-start[630]: adding address 192.168.1.3/24... done client # [ 10.156991] systemd[1]: Finished Permit User Sessions. client # [ 10.161182] systemd[1]: Started Getty on tty1. client # [ 10.161858] systemd[1]: Reached target Login Prompts. worker1 # [ 10.158056] network-addresses-eth1-start[630]: adding address 2001:db8:1::3/64... done lb # [ 10.306102] EDAC MC: Ver: 3.0.0 worker1 # [ 10.177266] systemd[1]: Finished Address configuration of eth1. lb # [ 10.328113] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 10.200159] dhcpcd[637]: dhcpcd-10.3.2 starting lb # [ 10.197079] dhcpcd[716]: eth0: waiting for carrier lb # [ 10.199102] dhcpcd[716]: libudev: received NULL device lb # [ 10.199939] dhcpcd[716]: libudev: received NULL device lb # [ 10.202772] dhcpcd[716]: eth0: carrier acquired worker1 # [ 10.209763] dhcpcd[692]: dev: loaded udev lb # [ 10.214113] dhcpcd[716]: DUID 00:01:00:01:32:43:e6:43:52:54:00:12:34:56 worker1 # [ 10.218134] systemd[1]: Finished Extra networking commands.. lb # [ 10.215379] dhcpcd[716]: eth0: IAID 00:12:34:56 lb # [ 10.216256] dhcpcd[716]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 10.219828] systemd[1]: Reached target Network. worker1 # [ 10.223806] systemd[1]: Starting Permit User Sessions... lb # [ 10.228649] postgresql-pre-start[734]: The files belonging to this database system will be owned by user "postgres". lb # [ 10.230294] postgresql-pre-start[734]: This user must also own the server process. worker1 # [ 10.377003] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 10.377695] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 10.239857] postgresql-pre-start[734]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 10.241125] postgresql-pre-start[734]: The default database encoding has accordingly been set to "UTF8". lb # [ 10.242271] postgresql-pre-start[734]: The default text search configuration will be set to "english". lb # [ 10.244097] postgresql-pre-start[734]: Data page checksums are enabled. lb # [ 10.245062] postgresql-pre-start[734]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 10.246309] postgresql-pre-start[734]: creating subdirectories ... ok lb # [ 10.247772] postgresql-pre-start[734]: selecting dynamic shared memory implementation ... posix worker1 # [ 10.253894] systemd[1]: Finished Permit User Sessions. worker1 # [ 10.260144] systemd[1]: Started Getty on tty1. worker1 # [ 10.260890] systemd[1]: Reached target Login Prompts. worker1 # [ 10.275064] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 10.471112] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 10.499555] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 10.500221] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 10.355652] postgresql-pre-start[734]: selecting default "max_connections" ... 100 worker1 # [ 10.503412] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 10.504196] cfg80211: failed to load regulatory.db lb # [ 10.398562] systemd-vconsole-setup[726]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 10.404381] systemd[1]: Finished Virtual Console Setup. worker1 # [ 10.558101] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 10.418167] dhcpcd[692]: eth0: waiting for carrier worker1 # [ 10.418975] dhcpcd[692]: eth0: carrier acquired worker1 # [ 10.428622] dhcpcd[692]: DUID 00:01:00:01:32:43:e6:43:52:54:00:12:34:56 worker1 # [ 10.429666] dhcpcd[692]: eth0: IAID 00:12:34:56 worker1 # [ 10.430507] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 10.469072] dhcpcd[692]: eth0: soliciting a DHCP lease lb # [ 10.442218] postgresql-pre-start[734]: selecting default "shared_buffers" ... 128MB worker2 # [ 10.634515] NET: Registered PF_PACKET protocol family worker2 # [ 10.503955] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 10.509157] dhcpcd[692]: eth0: probing address 10.0.2.15/24 client # [ 10.503934] dhcpcd[563]: eth0: soliciting a DHCP lease client # [ 10.668685] NET: Registered PF_PACKET protocol family client # [ 10.542921] dhcpcd[563]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 10.547478] dhcpcd[563]: eth0: probing address 10.0.2.15/24 client: (finished: waiting for unit network-addresses-eth1.service, in 11.37 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit niks3.service worker1 # [ 11.195615] dhcpcd[692]: eth0: soliciting a DHCP lease worker1 # [ 11.363382] NET: Registered PF_PACKET protocol family worker1 # [ 11.229486] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 11.233378] dhcpcd[692]: eth0: probing address 10.0.2.15/24 worker2 # [ 11.827485] dhcpcd[692]: eth0: soliciting an IPv6 router worker2 # [ 11.830590] dhcpcd[692]: eth0: Router Advertisement from fe80::2 worker2 # [ 11.832874] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 11.835268] dhcpcd[692]: eth0: adding route to fec0::/64 worker2 # [ 11.837401] dhcpcd[692]: eth0: adding default route via fe80::2 client # [ 12.056574] dhcpcd[563]: eth0: soliciting an IPv6 router client # [ 12.059440] dhcpcd[563]: eth0: Router Advertisement from fe80::2 client # [ 12.061542] dhcpcd[563]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 12.063692] dhcpcd[563]: eth0: adding route to fec0::/64 client # [ 12.065633] dhcpcd[563]: eth0: adding default route via fe80::2 lb # [ 12.069623] dhcpcd[716]: eth0: soliciting a DHCP lease lb # [ 12.220020] NET: Registered PF_PACKET protocol family lb # [ 12.091459] dhcpcd[716]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 12.094150] dhcpcd[716]: eth0: probing address 10.0.2.15/24 worker1 # [ 12.367961] dhcpcd[692]: eth0: soliciting an IPv6 router worker1 # [ 12.370913] dhcpcd[692]: eth0: Router Advertisement from fe80::2 worker1 # [ 12.372986] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 12.375328] dhcpcd[692]: eth0: adding route to fec0::/64 worker1 # [ 12.377296] dhcpcd[692]: eth0: adding default route via fe80::2 lb # [ 12.489405] dhcpcd[716]: eth0: soliciting an IPv6 router lb # [ 12.490803] dhcpcd[716]: eth0: Router Advertisement from fe80::2 lb # [ 12.491710] dhcpcd[716]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 12.492580] dhcpcd[716]: eth0: adding route to fec0::/64 lb # [ 12.493400] dhcpcd[716]: eth0: adding default route via fe80::2 lb # [ 12.603297] postgresql-pre-start[734]: selecting default time zone ... UTC lb # [ 12.608625] postgresql-pre-start[734]: creating configuration files ... ok lb # [ 12.858119] postgresql-pre-start[734]: running bootstrap script ... ok lb # [ 13.507252] postgresql-pre-start[734]: performing post-bootstrap initialization ... ok lb # [ 13.643632] postgresql-pre-start[734]: syncing data to disk ... ok lb # [ 13.645330] postgresql-pre-start[734]: initdb: warning: enabling "trust" authentication for local connections lb # [ 13.646545] postgresql-pre-start[734]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 13.648506] postgresql-pre-start[734]: Success. You can now start the database server using: lb # [ 13.649542] postgresql-pre-start[734]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 13.780234] postgres[804]: [804] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 13.785840] postgres[804]: [804] LOG: listening on IPv6 address "::1", port 5432 lb # [ 13.786834] postgres[804]: [804] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 13.789769] postgres[804]: [804] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 13.805300] postgres[813]: [813] LOG: database system was shut down at 2026-09-21 12:57:42 GMT lb # [ 13.809932] postgres[804]: [804] LOG: database system is ready to accept connections lb # [ 13.817441] systemd[1]: Started PostgreSQL Server. lb # [ 13.822332] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 14.032178] postgresql-setup-start[824]: CREATE DATABASE lb # [ 14.087807] postgresql-setup-start[831]: CREATE ROLE lb # [ 14.109477] postgresql-setup-start[835]: ALTER DATABASE lb # [ 14.114993] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 14.116742] systemd[1]: Reached target PostgreSQL. worker2 # [ 15.688838] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 15.678506] dhcpcd[563]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 15.691600] dhcpcd[692]: eth0: adding route to 10.0.2.0/24 worker2 # [ 15.693821] dhcpcd[692]: eth0: adding default route via 10.0.2.2 client # [ 15.681240] dhcpcd[563]: eth0: adding route to 10.0.2.0/24 client # [ 15.683845] dhcpcd[563]: eth0: adding default route via 10.0.2.2 worker2 # [ 15.815739] systemd[1]: Started DHCP Client. worker2 # [ 15.817234] systemd[1]: Reached target Multi-User System. worker2 # [ 15.817965] systemd[1]: Startup finished in 880ms (kernel) + 4.098s (initrd) + 10.838s (userspace) = 15.816s. client # [ 15.810313] systemd[1]: Started DHCP Client. client # [ 15.811927] systemd[1]: Reached target Multi-User System. client # [ 15.813202] systemd[1]: Startup finished in 851ms (kernel) + 4.120s (initrd) + 10.840s (userspace) = 15.812s. worker1 # [ 16.470248] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 16.472909] dhcpcd[692]: eth0: adding route to 10.0.2.0/24 worker1 # [ 16.475082] dhcpcd[692]: eth0: adding default route via 10.0.2.2 worker1 # [ 16.597622] systemd[1]: Started DHCP Client. worker1 # [ 16.599181] systemd[1]: Reached target Multi-User System. worker1 # [ 16.599918] systemd[1]: Startup finished in 903ms (kernel) + 4.190s (initrd) + 11.504s (userspace) = 16.598s. lb # [ 17.063100] dhcpcd[716]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 17.065688] dhcpcd[716]: eth0: adding route to 10.0.2.0/24 lb # [ 17.067895] dhcpcd[716]: eth0: adding default route via 10.0.2.2 lb # [ 17.197312] systemd[1]: Started DHCP Client. lb # [ 17.198885] systemd[1]: Reached target Network is Online. lb # [ 17.203248] systemd[1]: Started Envoy reverse proxy. lb # [ 17.206751] systemd[1]: Started mock-oidc.service. lb # [ 17.307210] mock-oidc-server[923]: Mock OIDC Server running lb # [ 17.308570] mock-oidc-server[923]: OIDC Address: 192.168.1.2:8080 lb # [ 17.309626] mock-oidc-server[923]: Issue Address: 0.0.0.0:8081 lb # [ 17.310602] mock-oidc-server[923]: Issuer: http://192.168.1.2:8080/oidc lb # [ 17.311517] mock-oidc-server[923]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 17.312563] mock-oidc-server[923]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 17.313778] mock-oidc-server[923]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 17.859437] envoy[922]: [2026-09-21 12:57:46.772][922][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 17.861765] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 17.863317] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 17.865060] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 17.867633] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 17.883265] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 17.889260] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 17.891380] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 17.893549] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 17.895532] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 17.897326] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 17.900240] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 17.906486] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 17.908285] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 17.911210] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 17.912893] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 17.915731] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 17.918151] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 17.920668] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 17.923520] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 17.925138] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 17.932112] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 17.933958] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 17.938083] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 17.940134] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 17.943218] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 17.945450] envoy[922]: [2026-09-21 12:57:46.775][922][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 17.947139] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 17.949352] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 17.951269] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 17.953926] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 17.956225] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 17.957785] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 17.960070] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 17.962399] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 17.963970] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 17.968456] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 17.970265] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 17.972071] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 17.973896] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 17.976119] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 17.978100] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 17.980827] envoy[922]: [2026-09-21 12:57:46.787][922][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 17.983353] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 17.985048] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 17.986670] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 17.988263] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 17.991151] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 17.992792] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 17.994482] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 17.998512] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 18.001606] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 18.004180] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 18.008345] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 18.010135] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 18.012429] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.015081] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 18.017161] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 18.020079] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 18.021753] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 18.023286] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 18.024731] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 18.029335] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 18.030850] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 18.039825] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 18.045745] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 18.048420] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 18.050122] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 18.053772] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 18.056140] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 18.058069] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 18.059793] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 18.061751] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 18.063971] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 18.067047] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 18.071356] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 18.073890] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 18.075709] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 18.077651] envoy[922]: [2026-09-21 12:57:46.788][922][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 18.079344] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 18.082295] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.084410] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 18.086840] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 18.088463] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 18.090213] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 18.092101] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 18.094223] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 18.096781] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.098826] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 18.101842] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 18.103673] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 18.108183] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 18.119415] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 18.121156] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 18.123076] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 18.124987] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 18.126891] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 18.128715] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 18.131719] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 18.136954] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 18.139176] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 18.141590] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 18.143194] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 18.147208] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 18.153306] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 18.155218] envoy[922]: [2026-09-21 12:57:46.789][922][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 18.180343] envoy[922]: [2026-09-21 12:57:46.989][922][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 18.181676] envoy[922]: [2026-09-21 12:57:47.038][922][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 18.194653] envoy[922]: [2026-09-21 12:57:47.038][922][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 18.196192] envoy[922]: [2026-09-21 12:57:47.038][922][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 18.203735] envoy[922]: [2026-09-21 12:57:47.038][922][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 18.250819] envoy[922]: [2026-09-21 12:57:47.164][922][info][main] [source/server/server.cc:968] runtime: {} lb # [ 18.258917] envoy[922]: [2026-09-21 12:57:47.172][922][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 18.261162] envoy[922]: [2026-09-21 12:57:47.174][922][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 18.264280] envoy[922]: [2026-09-21 12:57:47.177][922][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 18.267394] envoy[922]: [2026-09-21 12:57:47.181][922][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 18.269086] envoy[922]: [2026-09-21 12:57:47.182][922][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 18.270561] envoy[922]: [2026-09-21 12:57:47.182][922][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 18.339440] envoy[922]: [2026-09-21 12:57:47.253][922][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 18.346383] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 18.372743] systemd[1]: Reached target Network is Online. worker2 # [ 18.380324] systemd[1]: Starting scheduler-token.service... lb # [ 18.366082] envoy[922]: [2026-09-21 12:57:47.279][922][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 18.368529] envoy[922]: [2026-09-21 12:57:47.282][922][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 18.371662] envoy[922]: [2026-09-21 12:57:47.282][922][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 18.493043] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 18.494732] systemd[1]: Finished scheduler-token.service. worker2 # [ 18.496220] systemd[1]: scheduler-token.service: Consumed 36ms CPU time over 114ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 18.501105] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 18.586318] nix-grpc-daemon[784]: ts=2026-09-21T12:57:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 18.597061] nix-grpc-daemon[784]: ts=2026-09-21T12:57:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 18.602286] nix-grpc-daemon[784]: ts=2026-09-21T12:57:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 18.655773] nix-grpc-daemon[788]: ts=2026-09-21T12:57:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 18.664114] nix-grpc-daemon[788]: ts=2026-09-21T12:57:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 18.640912] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 18.642429] nix-grpc-daemon[784]: E0000 00:00:1789995467.482959 784 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 18.669756] nix-grpc-daemon[788]: ts=2026-09-21T12:57:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 18.660080] nix-grpc-daemon[784]: E0000 00:00:1789995467.503404 784 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 18.663981] nix-grpc-daemon[784]: ts=2026-09-21T12:57:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 18.667392] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 18.695727] nix-grpc-daemon[788]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 18.697163] nix-grpc-daemon[788]: E0000 00:00:1789995467.758280 788 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 18.710336] nix-grpc-daemon[788]: E0000 00:00:1789995467.773860 788 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 18.713753] nix-grpc-daemon[788]: ts=2026-09-21T12:57:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 18.716459] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 18.700530] nix-grpc-daemon[784]: E0000 00:00:1789995467.543172 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 18.743073] nix-grpc-daemon[788]: E0000 00:00:1789995467.806423 830 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 18.723396] nix-grpc-daemon[784]: E0000 00:00:1789995467.566764 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 18.727062] nix-grpc-daemon[784]: E0000 00:00:1789995467.570406 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 18.763173] nix-grpc-daemon[788]: E0000 00:00:1789995467.826632 830 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 18.734633] envoy[922]: [2026-09-21 12:57:47.648][922][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker2 # [ 18.766124] nix-grpc-daemon[788]: E0000 00:00:1789995467.829669 830 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 18.742640] nix-grpc-daemon[784]: E0000 00:00:1789995467.586013 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 18.738943] envoy[922]: [2026-09-21 12:57:47.648][922][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 18.744355] envoy[922]: [2026-09-21 12:57:47.652][922][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 18.779399] nix-grpc-daemon[788]: E0000 00:00:1789995467.842943 830 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 18.754349] nix-grpc-daemon[784]: ts=2026-09-21T12:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 18.755593] envoy[922]: [2026-09-21 12:57:47.669][922][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 18.806802] nix-grpc-daemon[788]: ts=2026-09-21T12:57:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.817028] nix-grpc-daemon[788]: ts=2026-09-21T12:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.955904] nix-grpc-daemon[784]: ts=2026-09-21T12:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 19.019823] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.024135] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.224953] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.228822] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.356644] nix-grpc-daemon[784]: ts=2026-09-21T12:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 19.429931] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.433995] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.635499] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.639236] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.841386] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.844459] nix-grpc-daemon[788]: ts=2026-09-21T12:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.042702] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.046518] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.161668] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.166776] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.247730] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.251733] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.367997] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.371968] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.452767] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.456542] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.573520] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.577542] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.657862] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.661712] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.778379] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.782150] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.863882] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.866994] nix-grpc-daemon[788]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.982997] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.986861] nix-grpc-daemon[784]: ts=2026-09-21T12:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.065183] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.069446] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.188588] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.192405] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.270719] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.274825] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.393565] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.398570] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.476349] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.480535] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.599381] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.603408] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.681965] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.686536] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.804350] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.808251] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.888819] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.892488] nix-grpc-daemon[788]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.009400] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.013373] nix-grpc-daemon[784]: ts=2026-09-21T12:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.093583] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.097361] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.216099] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.219243] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.298577] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.302568] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.417181] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.421250] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.503660] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.507482] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.622226] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.626551] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.708669] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.712463] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.827329] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.831171] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.915382] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.918494] nix-grpc-daemon[788]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.032331] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.036307] nix-grpc-daemon[784]: ts=2026-09-21T12:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.115605] nix-grpc-daemon[788]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.119326] nix-grpc-daemon[788]: ts=2026-09-21T12:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.238899] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.240232] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.320443] nix-grpc-daemon[788]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.324177] nix-grpc-daemon[788]: ts=2026-09-21T12:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.439270] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.443268] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.525682] nix-grpc-daemon[788]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.529461] nix-grpc-daemon[788]: ts=2026-09-21T12:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.643921] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.647849] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.730474] nix-grpc-daemon[788]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.734211] nix-grpc-daemon[788]: ts=2026-09-21T12:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.848867] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.852733] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.936309] nix-grpc-daemon[788]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.939807] nix-grpc-daemon[788]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.053662] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.057528] nix-grpc-daemon[784]: ts=2026-09-21T12:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.140933] nix-grpc-daemon[788]: ts=2026-09-21T12:57:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.144732] nix-grpc-daemon[788]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.259918] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.263241] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.345983] nix-grpc-daemon[788]: ts=2026-09-21T12:57:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.349993] nix-grpc-daemon[788]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.460976] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.464922] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.551073] nix-grpc-daemon[788]: ts=2026-09-21T12:57:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.554829] nix-grpc-daemon[788]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.665878] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.670346] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.755933] nix-grpc-daemon[788]: ts=2026-09-21T12:57:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.759747] nix-grpc-daemon[788]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.871130] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.875075] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.961619] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.965286] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.075949] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.079823] nix-grpc-daemon[784]: ts=2026-09-21T12:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.166560] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.170697] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.281871] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.285722] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.371719] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.375623] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.486637] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.490734] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.576942] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.580759] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.691639] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.695477] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.781602] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.785501] nix-grpc-daemon[788]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.896439] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.900413] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.988282] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.991572] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.101434] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.105483] nix-grpc-daemon[784]: ts=2026-09-21T12:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.188888] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.190589] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.308415] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.311715] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.391971] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.395759] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.509370] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.513329] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.596658] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.600553] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.714190] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.718087] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.801576] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.805313] nix-grpc-daemon[788]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.919148] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.923110] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.007172] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.010706] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.123490] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.125417] nix-grpc-daemon[784]: ts=2026-09-21T12:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.212146] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.215806] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.327452] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.331183] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.416858] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.420604] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.529395] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.533444] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.621769] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.625468] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.734330] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.738192] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.825724] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.827366] nix-grpc-daemon[788]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.939121] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.942929] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.028476] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.030211] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.143883] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.147838] nix-grpc-daemon[784]: ts=2026-09-21T12:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.231564] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.235254] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.350303] nix-grpc-daemon[784]: ts=2026-09-21T12:57:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.353478] nix-grpc-daemon[784]: ts=2026-09-21T12:57:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.436474] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.440251] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.551521] nix-grpc-daemon[784]: ts=2026-09-21T12:57:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.555469] nix-grpc-daemon[784]: ts=2026-09-21T12:57:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.641335] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.645148] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.756457] nix-grpc-daemon[784]: ts=2026-09-21T12:57:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.762137] nix-grpc-daemon[784]: ts=2026-09-21T12:57:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.845893] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.849635] nix-grpc-daemon[788]: ts=2026-09-21T12:57:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.958118] nix-grpc-daemon[784]: ts=2026-09-21T12:57:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.962504] nix-grpc-daemon[784]: ts=2026-09-21T12:57:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.051864] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.054939] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.163504] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.167943] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.253258] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.256993] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.370341] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.373755] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.457984] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.461822] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.571105] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.576451] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.662833] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.666803] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.777150] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.781489] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.867580] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.871321] nix-grpc-daemon[788]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.982533] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.986973] nix-grpc-daemon[784]: ts=2026-09-21T12:57:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.073841] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.076908] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.187884] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.192396] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.275301] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.279156] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.394972] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.398669] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.480386] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.484242] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.596146] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.600576] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.685296] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.689141] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.801314] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.805569] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.890059] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.893809] nix-grpc-daemon[788]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.006599] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.011073] nix-grpc-daemon[784]: ts=2026-09-21T12:57:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.029976] rustfs-bucket-start[1060]: mb s3://farm lb # [ 31.035461] systemd[1]: Finished rustfs-bucket.service. lb # [ 31.041906] systemd[1]: Starting niks3 server... worker2 # [ 31.096102] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.099329] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.212076] nix-grpc-daemon[784]: ts=2026-09-21T12:58:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.216418] nix-grpc-daemon[784]: ts=2026-09-21T12:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.297126] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.301102] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.303706] postgres[1075]: [1075] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 31.304988] postgres[1075]: [1075] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 31.345151] niks3-server[1069]: 2026/09/21 12:58:00 OK 20241026095416_initial_model.sql (21.65ms) lb # [ 31.348833] niks3-server[1069]: 2026/09/21 12:58:00 OK 20251210153512_drop_unused_gin_index.sql (2.36ms) lb # [ 31.353968] niks3-server[1069]: 2026/09/21 12:58:00 OK 20251218171726_add_pins.sql (5.11ms) lb # [ 31.359149] niks3-server[1069]: 2026/09/21 12:58:00 OK 20260628120000_add_object_size_and_stats.sql (5.22ms) lb # [ 31.364263] niks3-server[1069]: 2026/09/21 12:58:00 OK 20260905000000_add_claims.sql (3.64ms) lb # [ 31.369032] niks3-server[1069]: 2026/09/21 12:58:00 OK 20260920000000_drop_claims.sql (4.68ms) lb # [ 31.370189] niks3-server[1069]: 2026/09/21 12:58:00 goose: successfully migrated database to version: 20260920000000 lb # [ 31.376110] niks3-server[1069]: 2026/09/21 12:58:00 OK 1_commit_pending_closure.sql (7.05ms) lb # [ 31.378703] niks3-server[1069]: 2026/09/21 12:58:00 OK 2_object_stats_trigger.sql (2.63ms) lb # [ 31.379918] niks3-server[1069]: 2026/09/21 12:58:00 goose: up to current file version: 2 lb # [ 31.387320] niks3-server[1069]: 2026/09/21 12:58:00 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key worker1 # [ 31.418810] nix-grpc-daemon[784]: ts=2026-09-21T12:58:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.422181] nix-grpc-daemon[784]: ts=2026-09-21T12:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.501860] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_connected addr=lb:50051 lb # [ 31.476064] niks3-server[1069]: 2026/09/21 12:58:00 INFO Read proxy enabled — serving cache objects from S3 lb # [ 31.477842] niks3-server[1069]: 2026/09/21 12:58:00 INFO Using socket-activated listener address=0.0.0.0:5751 worker2 # [ 31.505801] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.482372] niks3-server[1069]: 2026/09/21 12:58:00 INFO systemd watchdog enabled interval=15s lb # [ 31.483525] systemd[1]: Started niks3 server. lb # [ 31.484200] systemd[1]: Reached target Multi-User System. lb # [ 31.485903] systemd[1]: Startup finished in 843ms (kernel) + 4.160s (initrd) + 26.481s (userspace) = 31.485s. lb # [ 31.488123] niks3-server[1069]: 2026/09/21 12:58:00 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 31.494926] niks3-server[1069]: 2026/09/21 12:58:00 INFO lead: acquired remote=192.168.1.4:44480 worker2 # [ 31.530788] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_take_over worker1 # [ 31.619759] nix-grpc-daemon[784]: ts=2026-09-21T12:58:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.623833] nix-grpc-daemon[784]: ts=2026-09-21T12:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.706834] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.710788] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.824574] nix-grpc-daemon[784]: ts=2026-09-21T12:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.865738] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:44136 worker2 # [ 31.868445] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 31.911752] nix-grpc-daemon[788]: ts=2026-09-21T12:58:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.937636] nix-grpc-daemon[788]: ts=2026-09-21T12:58:01Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 31.942223] nix-grpc-daemon[788]: ts=2026-09-21T12:58:01Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:44136 worker2 # [ 31.946211] nix-grpc-daemon[788]: ts=2026-09-21T12:58:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: waiting for unit niks3.service, in 20.93 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.06 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 32.167942] envoy[922]: conn peer=[::1]:38628 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker2 # [ 32.332183] systemd[1]: Starting scheduler-token.service... worker2 # [ 32.400687] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 32.403523] systemd[1]: Finished scheduler-token.service. worker2 # [ 32.404929] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 70ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.65 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 33.528578] nix-grpc-daemon[784]: ts=2026-09-21T12:58:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 33.541826] systemd[1]: Started Nix Daemon. worker1 # [ 33.788747] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 33.821580] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5) worker1 # [ 33.840586] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 2/5) worker1 # [ 34.027110] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 142 ms (attempt 3/5) worker1 # [ 34.169704] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 4/5) worker1 # [ 34.357594] nix-grpc-daemon[784]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 34.362682] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 34.429498] nix-grpc-daemon[788]: ts=2026-09-21T12:58:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 34.436306] systemd[1]: Started Nix Daemon. worker2 # [ 34.630333] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) worker2 # [ 34.655457] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5) worker2 # [ 34.737049] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 2/5) worker2 # [ 34.792193] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 3/5) worker2 # [ 34.915463] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 797 ms (attempt 4/5) worker2 # [ 35.717342] nix-grpc-daemon[788]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 35.720142] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 35.738063] nix-grpc-daemon[788]: ts=2026-09-21T12:58:04Z level=debug event=path_info_miss path=lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test error="error: path '/nix/store/lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 35.748879] nix-grpc-daemon[788]: ts=2026-09-21T12:58:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 35.754226] nix-grpc-daemon[788]: ts=2026-09-21T12:58:04Z level=debug event=path_info_miss path=lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test error="error: path '/nix/store/lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds) client: must succeed: install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds) worker2 # [ 36.172662] nix-grpc-daemon[788]: ts=2026-09-21T12:58:05Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:54606 worker2 # [ 36.184540] nix-grpc-daemon[788]: ts=2026-09-21T12:58:05Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:54606 worker2 # [ 36.189317] nix-grpc-daemon[788]: ts=2026-09-21T12:58:05Z level=debug event=path_info_miss path=lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test error="error: path '/nix/store/lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 36.192924] nix-grpc-daemon[788]: ts=2026-09-21T12:58:05Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:54606 worker2 # [ 36.197717] nix-grpc-daemon[788]: ts=2026-09-21T12:58:05Z level=debug event=path_info_miss path=lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test error="error: path '/nix/store/lnpvxnhllsvr2ncl4v29x83d7qqqszn3-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds) lb # [ 38.352145] envoy[922]: conn peer=[2001:db8:1::1]:60130 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=406 ms=2255 lb # [ 38.355834] envoy[922]: conn peer=[2001:db8:1::1]:60136 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=362 ms=34 worker1 # [ 38.474890] nix-grpc-daemon[784]: ts=2026-09-21T12:58:07Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 38.798650] nix-grpc-daemon[788]: ts=2026-09-21T12:58:07Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.67 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 worker2 # [ 39.044204] nix-grpc-daemon[788]: ts=2026-09-21T12:58:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54606 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 39.058552] nix-grpc-daemon[788]: ts=2026-09-21T12:58:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 39.096773] nix-grpc-daemon[788]: ts=2026-09-21T12:58:08Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 39.101075] nix-grpc-daemon[788]: ts=2026-09-21T12:58:08Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 39.128318] nix-grpc-daemon[784]: ts=2026-09-21T12:58:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 39.156511] nix-grpc-daemon[784]: ts=2026-09-21T12:58:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 client # copying 1 paths to 'lb:50051'... worker1 # [ 39.167799] nix-grpc-daemon[784]: ts=2026-09-21T12:58:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 39.195308] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 39.221818] nix-grpc-daemon[784]: ts=2026-09-21T12:58:08Z level=info event=niks3_push_started pid=862 worker1 # [ 39.525196] nix-grpc-daemon[862]: time=2026-09-21T12:58:08.364Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 39.721227] nix-daemon[849]: accepted connection from pid 875, user nix-grpc-daemon (trusted) worker1 # [ 39.736931] nix-daemon[849]: reaped child process 878, status = succeeded worker1 # [ 39.913449] nix-daemon[849]: accepted connection from pid 881, user nix-grpc-daemon (trusted) worker1 # [ 39.925927] nix-daemon[849]: reaped child process 884, status = succeeded lb # [ 39.940406] niks3-server[1069]: 2026/09/21 12:58:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.970102] nix-grpc-daemon[862]: time=2026-09-21T12:58:08.813Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 39.972641] nix-grpc-daemon[862]: time=2026-09-21T12:58:08.816Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 40.020241] niks3-server[1069]: 2026/09/21 12:58:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 40.025249] niks3-server[1069]: 2026/09/21 12:58:08 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 40.044116] niks3-server[1069]: 2026/09/21 12:58:08 INFO Signed narinfos id=1 count=1 worker1 # [ 40.049115] nix-grpc-daemon[862]: time=2026-09-21T12:58:08.892Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.051320] niks3-server[1069]: 2026/09/21 12:58:08 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 40.057656] niks3-server[1069]: 2026/09/21 12:58:08 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 40.067039] niks3-server[1069]: 2026/09/21 12:58:08 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo lb # [ 40.072834] niks3-server[1069]: 2026/09/21 12:58:08 INFO Completed upload id=1 worker1 # [ 40.076412] nix-grpc-daemon[862]: time=2026-09-21T12:58:08.919Z level=INFO msg="Upload complete. (526ms)" worker1 # [ 40.081630] nix-grpc-daemon[784]: ts=2026-09-21T12:58:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 40.088739] nix-grpc-daemon[784]: ts=2026-09-21T12:58:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 40.100296] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 40.108650] nix-daemon[849]: reaped child process 860, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... worker1 # [ 40.117436] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 40.941564] nix-daemon[849]: reaped child process 888, status = succeeded worker1 # [ 41.085146] nix-daemon[849]: accepted connection from pid 904, user nix-grpc-daemon (trusted) worker1 # [ 41.097176] nix-daemon[849]: reaped child process 907, status = succeeded lb # [ 41.112805] niks3-server[1069]: 2026/09/21 12:58:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.127594] nix-grpc-daemon[862]: time=2026-09-21T12:58:09.970Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 41.129263] nix-grpc-daemon[862]: time=2026-09-21T12:58:09.972Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 41.157678] niks3-server[1069]: 2026/09/21 12:58:10 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 41.170255] niks3-server[1069]: 2026/09/21 12:58:10 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 41.181209] niks3-server[1069]: 2026/09/21 12:58:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 41.184582] niks3-server[1069]: 2026/09/21 12:58:10 INFO Signed narinfos id=2 count=1 worker1 # [ 41.191050] nix-grpc-daemon[862]: time=2026-09-21T12:58:10.033Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.188948] niks3-server[1069]: 2026/09/21 12:58:10 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 41.198696] niks3-server[1069]: 2026/09/21 12:58:10 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 41.203870] niks3-server[1069]: 2026/09/21 12:58:10 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 41.207094] niks3-server[1069]: 2026/09/21 12:58:10 INFO Completed upload id=2 worker1 # [ 41.210518] nix-grpc-daemon[862]: time=2026-09-21T12:58:10.053Z level=INFO msg="Upload complete. (282ms)" worker1 # [ 41.216974] nix-grpc-daemon[784]: ts=2026-09-21T12:58:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 41.229894] nix-daemon[849]: reaped child process 886, status = succeeded worker2 # [ 41.261806] nix-grpc-daemon[788]: ts=2026-09-21T12:58:10Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 41.266184] nix-grpc-daemon[788]: ts=2026-09-21T12:58:10Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 41.286384] nix-grpc-daemon[784]: ts=2026-09-21T12:58:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 41.299134] nix-grpc-daemon[784]: ts=2026-09-21T12:58:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 41.313203] nix-grpc-daemon[862]: time=2026-09-21T12:58:10.156Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 41.321650] nix-grpc-daemon[784]: ts=2026-09-21T12:58:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 41.342175] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 41.551566] nix-daemon[849]: accepted connection from pid 911, user nix-grpc-daemon (trusted) worker1 # [ 41.566175] nix-daemon[849]: reaped child process 914, status = succeeded worker1 # [ 41.752427] nix-daemon[849]: accepted connection from pid 916, user nix-grpc-daemon (trusted) worker1 # [ 41.765269] nix-daemon[849]: reaped child process 919, status = succeeded lb # [ 41.779444] niks3-server[1069]: 2026/09/21 12:58:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.795976] nix-grpc-daemon[862]: time=2026-09-21T12:58:10.638Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 41.797525] nix-grpc-daemon[862]: time=2026-09-21T12:58:10.638Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 41.816342] niks3-server[1069]: 2026/09/21 12:58:10 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 41.821542] niks3-server[1069]: 2026/09/21 12:58:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker1 # [ 41.832479] nix-grpc-daemon[862]: time=2026-09-21T12:58:10.675Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.829126] niks3-server[1069]: 2026/09/21 12:58:10 INFO Signed narinfos id=3 count=1 lb # [ 41.835224] niks3-server[1069]: 2026/09/21 12:58:10 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 41.845350] niks3-server[1069]: 2026/09/21 12:58:10 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 41.851899] niks3-server[1069]: 2026/09/21 12:58:10 INFO Completed upload id=3 worker1 # [ 41.855428] nix-grpc-daemon[862]: time=2026-09-21T12:58:10.698Z level=INFO msg="Upload complete. (499ms)" lb # [ 41.853551] niks3-server[1069]: 2026/09/21 12:58:10 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker1 # [ 41.859186] nix-grpc-daemon[784]: ts=2026-09-21T12:58:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 41.863849] nix-grpc-daemon[784]: ts=2026-09-21T12:58:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 41.875135] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 41.879254] nix-daemon[849]: reaped child process 909, status = succeeded worker1 # [ 41.884452] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 43.298169] nix-daemon[849]: reaped child process 923, status = succeeded worker1 # [ 43.463345] nix-daemon[849]: accepted connection from pid 940, user nix-grpc-daemon (trusted) worker1 # [ 43.477364] nix-daemon[849]: reaped child process 943, status = succeeded lb # [ 43.490616] niks3-server[1069]: 2026/09/21 12:58:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.502857] nix-grpc-daemon[862]: time=2026-09-21T12:58:12.346Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 43.504421] nix-grpc-daemon[862]: time=2026-09-21T12:58:12.347Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 43.523342] niks3-server[1069]: 2026/09/21 12:58:12 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 43.536677] niks3-server[1069]: 2026/09/21 12:58:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 43.542065] niks3-server[1069]: 2026/09/21 12:58:12 INFO Signed narinfos id=4 count=1 worker1 # [ 43.548548] nix-grpc-daemon[862]: time=2026-09-21T12:58:12.391Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.550062] niks3-server[1069]: 2026/09/21 12:58:12 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 43.557866] niks3-server[1069]: 2026/09/21 12:58:12 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 43.565501] niks3-server[1069]: 2026/09/21 12:58:12 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 43.571534] niks3-server[1069]: 2026/09/21 12:58:12 INFO Completed upload id=4 lb # [ 43.572787] niks3-server[1069]: 2026/09/21 12:58:12 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker1 # [ 43.575064] nix-grpc-daemon[862]: time=2026-09-21T12:58:12.418Z level=INFO msg="Upload complete. (281ms)" worker1 # [ 43.580654] nix-grpc-daemon[784]: ts=2026-09-21T12:58:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker2 # [ 43.613552] nix-grpc-daemon[788]: ts=2026-09-21T12:58:12Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 43.617543] nix-grpc-daemon[788]: ts=2026-09-21T12:58:12Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 43.596107] nix-daemon[849]: reaped child process 921, status = succeeded worker1 # [ 43.631612] nix-grpc-daemon[784]: ts=2026-09-21T12:58:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 43.644936] nix-grpc-daemon[784]: ts=2026-09-21T12:58:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 43.658402] nix-grpc-daemon[862]: time=2026-09-21T12:58:12.501Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 43.666955] nix-grpc-daemon[784]: ts=2026-09-21T12:58:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 43.687177] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 43.885160] nix-daemon[849]: accepted connection from pid 947, user nix-grpc-daemon (trusted) worker1 # [ 43.899704] nix-daemon[849]: reaped child process 950, status = succeeded worker1 # [ 44.079065] nix-daemon[849]: accepted connection from pid 952, user nix-grpc-daemon (trusted) worker1 # [ 44.093414] nix-daemon[849]: reaped child process 955, status = succeeded lb # [ 44.105762] niks3-server[1069]: 2026/09/21 12:58:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 44.118181] nix-grpc-daemon[862]: time=2026-09-21T12:58:12.961Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 44.119537] nix-grpc-daemon[862]: time=2026-09-21T12:58:12.961Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 44.135623] niks3-server[1069]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 44.143403] niks3-server[1069]: 2026/09/21 12:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 44.148484] niks3-server[1069]: 2026/09/21 12:58:13 INFO Signed narinfos id=5 count=1 worker1 # [ 44.154896] nix-grpc-daemon[862]: time=2026-09-21T12:58:12.998Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.154978] niks3-server[1069]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 44.168572] niks3-server[1069]: 2026/09/21 12:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 44.173802] niks3-server[1069]: 2026/09/21 12:58:13 INFO Completed upload id=5 worker1 # [ 44.177340] nix-grpc-daemon[862]: time=2026-09-21T12:58:13.020Z level=INFO msg="Upload complete. (476ms)" lb # [ 44.176961] niks3-server[1069]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 44.181484] nix-grpc-daemon[784]: ts=2026-09-21T12:58:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 44.187212] nix-grpc-daemon[784]: ts=2026-09-21T12:58:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 44.195986] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 44.201647] nix-daemon[849]: reaped child process 945, status = succeeded worker1 # [ 44.206973] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 45.019991] nix-daemon[849]: reaped child process 959, status = succeeded worker1 # [ 45.180859] nix-daemon[849]: accepted connection from pid 975, user nix-grpc-daemon (trusted) worker1 # [ 45.195404] nix-daemon[849]: reaped child process 978, status = succeeded lb # [ 45.208825] niks3-server[1069]: 2026/09/21 12:58:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.222205] nix-grpc-daemon[862]: time=2026-09-21T12:58:14.065Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 45.225293] nix-grpc-daemon[862]: time=2026-09-21T12:58:14.067Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 45.248782] niks3-server[1069]: 2026/09/21 12:58:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 45.257059] nix-grpc-daemon[862]: time=2026-09-21T12:58:14.100Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.253603] niks3-server[1069]: 2026/09/21 12:58:14 INFO Signed narinfos id=6 count=1 lb # [ 45.260360] niks3-server[1069]: 2026/09/21 12:58:14 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 45.268410] niks3-server[1069]: 2026/09/21 12:58:14 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 45.271634] niks3-server[1069]: 2026/09/21 12:58:14 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 45.275466] niks3-server[1069]: 2026/09/21 12:58:14 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 45.279316] niks3-server[1069]: 2026/09/21 12:58:14 INFO Completed upload id=6 worker1 # [ 45.282792] nix-grpc-daemon[862]: time=2026-09-21T12:58:14.126Z level=INFO msg="Upload complete. (269ms)" lb # [ 45.280808] niks3-server[1069]: 2026/09/21 12:58:14 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 45.288249] nix-grpc-daemon[784]: ts=2026-09-21T12:58:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 45.297471] nix-daemon[849]: reaped child process 957, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.53 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.19 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.12 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 46.740654] nix-grpc-daemon[788]: ts=2026-09-21T12:58:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54606 worker1 # [ 46.721422] nix-grpc-daemon[784]: ts=2026-09-21T12:58:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 46.727290] nix-grpc-daemon[862]: time=2026-09-21T12:58:15.570Z level=INFO msg="All 2 paths already cached" worker2 # [ 46.767874] nix-grpc-daemon[788]: ts=2026-09-21T12:58:15Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.30 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.30 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2 worker1 # [ 47.610625] nix-grpc-daemon[784]: ts=2026-09-21T12:58:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54422 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker1 # [ 47.619245] nix-grpc-daemon[784]: ts=2026-09-21T12:58:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 47.627840] nix-grpc-daemon[862]: time=2026-09-21T12:58:16.471Z level=INFO msg="All 2 paths already cached" worker2 # [ 47.666737] nix-grpc-daemon[788]: ts=2026-09-21T12:58:16Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 47.671215] nix-grpc-daemon[788]: ts=2026-09-21T12:58:16Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 47.685703] nix-grpc-daemon[784]: ts=2026-09-21T12:58:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 47.698672] nix-grpc-daemon[784]: ts=2026-09-21T12:58:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 47.711571] nix-grpc-daemon[862]: time=2026-09-21T12:58:16.554Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 47.720611] nix-grpc-daemon[784]: ts=2026-09-21T12:58:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 47.732877] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 47.924178] nix-daemon[849]: accepted connection from pid 995, user nix-grpc-daemon (trusted) worker1 # [ 47.938352] nix-daemon[849]: reaped child process 998, status = succeeded worker1 # [ 48.113125] nix-daemon[849]: accepted connection from pid 1000, user nix-grpc-daemon (trusted) worker1 # [ 48.126803] nix-daemon[849]: reaped child process 1003, status = succeeded lb # [ 48.140743] niks3-server[1069]: 2026/09/21 12:58:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.151807] nix-grpc-daemon[862]: time=2026-09-21T12:58:16.994Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 48.153368] nix-grpc-daemon[862]: time=2026-09-21T12:58:16.996Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 48.169614] niks3-server[1069]: 2026/09/21 12:58:17 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 48.179596] niks3-server[1069]: 2026/09/21 12:58:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 48.185081] niks3-server[1069]: 2026/09/21 12:58:17 INFO Signed narinfos id=7 count=1 worker1 # [ 48.191439] nix-grpc-daemon[862]: time=2026-09-21T12:58:17.034Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.191554] niks3-server[1069]: 2026/09/21 12:58:17 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 48.202095] niks3-server[1069]: 2026/09/21 12:58:17 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete worker1 # [ 48.212935] nix-grpc-daemon[862]: time=2026-09-21T12:58:17.056Z level=INFO msg="Upload complete. (467ms)" lb # [ 48.209775] niks3-server[1069]: 2026/09/21 12:58:17 INFO Completed upload id=7 lb # [ 48.213078] niks3-server[1069]: 2026/09/21 12:58:17 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 48.215778] nix-grpc-daemon[784]: ts=2026-09-21T12:58:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 48.220946] nix-grpc-daemon[784]: ts=2026-09-21T12:58:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 48.229577] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 48.235451] nix-daemon[849]: reaped child process 993, status = succeeded worker1 # [ 48.240932] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 48.353504] envoy[922]: conn peer=[2001:db8:1::1]:60138 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=17 lb # [ 48.357070] envoy[922]: conn peer=[2001:db8:1::1]:60148 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=9 lb # [ 48.360562] envoy[922]: conn peer=[2001:db8:1::1]:60160 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9481 tx=4049 ms=6309 lb # [ 48.364092] envoy[922]: conn peer=[2001:db8:1::1]:35802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=41 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 48.705103] nix-grpc-daemon[784]: E0000 00:00:1789995497.547182 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 48.718426] nix-grpc-daemon[784]: E0000 00:00:1789995497.561760 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 48.722479] nix-grpc-daemon[784]: E0000 00:00:1789995497.564042 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 48.734768] nix-grpc-daemon[784]: E0000 00:00:1789995497.578150 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. client # farm-top> LOG-farm-top-t1b worker1 # [ 48.863577] nix-daemon[849]: reaped child process 1007, status = succeeded worker1 # [ 49.029095] nix-daemon[849]: accepted connection from pid 1023, user nix-grpc-daemon (trusted) worker1 # [ 49.043760] nix-daemon[849]: reaped child process 1026, status = succeeded lb # [ 49.056718] niks3-server[1069]: 2026/09/21 12:58:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.067707] nix-grpc-daemon[862]: time=2026-09-21T12:58:17.911Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 49.069266] nix-grpc-daemon[862]: time=2026-09-21T12:58:17.912Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 49.093766] niks3-server[1069]: 2026/09/21 12:58:18 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 49.108271] niks3-server[1069]: 2026/09/21 12:58:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 49.113879] niks3-server[1069]: 2026/09/21 12:58:18 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 49.119100] niks3-server[1069]: 2026/09/21 12:58:18 INFO Signed narinfos id=8 count=1 worker1 # [ 49.125033] nix-grpc-daemon[862]: time=2026-09-21T12:58:17.968Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.128701] niks3-server[1069]: 2026/09/21 12:58:18 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 49.134486] niks3-server[1069]: 2026/09/21 12:58:18 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 49.145299] niks3-server[1069]: 2026/09/21 12:58:18 INFO Completed upload id=8 worker1 # [ 49.148257] nix-grpc-daemon[862]: time=2026-09-21T12:58:17.991Z level=INFO msg="Upload complete. (300ms)" lb # [ 49.150139] niks3-server[1069]: 2026/09/21 12:58:18 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 49.152896] nix-grpc-daemon[784]: ts=2026-09-21T12:58:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 49.167616] nix-daemon[849]: reaped child process 1005, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.81 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.18 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.32 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup client # [ 49.607144] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 493ba7c8955847449fe87f04f95c205f client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup client # [ 49.795473] nix[892]: don't know how to build these paths: client # [ 49.796400] nix[892]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 49.778962] nix-grpc-daemon[784]: ts=2026-09-21T12:58:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54422 worker2 # [ 49.817673] nix-grpc-daemon[788]: ts=2026-09-21T12:58:18Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 49.822193] nix-grpc-daemon[788]: ts=2026-09-21T12:58:18Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 49.827785] nix-grpc-daemon[788]: ts=2026-09-21T12:58:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 49.838650] nix-grpc-daemon[788]: ts=2026-09-21T12:58:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54606 client # [ 49.837077] nix[892]: copying 1 paths to 'lb:50051'... client # [ 49.838789] nix[892]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 49.849357] nix-grpc-daemon[788]: ts=2026-09-21T12:58:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 49.860895] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) worker2 # [ 49.879506] nix-grpc-daemon[788]: ts=2026-09-21T12:58:18Z level=info event=niks3_push_started pid=926 worker2 # [ 50.091971] nix-grpc-daemon[926]: time=2026-09-21T12:58:19.152Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 50.250356] nix-daemon[873]: accepted connection from pid 938, user nix-grpc-daemon (trusted) worker2 # [ 50.264502] nix-daemon[873]: reaped child process 941, status = succeeded worker2 # [ 50.397368] nix-daemon[873]: accepted connection from pid 943, user nix-grpc-daemon (trusted) worker2 # [ 50.409932] nix-daemon[873]: reaped child process 946, status = succeeded lb # [ 50.391898] niks3-server[1069]: 2026/09/21 12:58:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 50.432266] nix-grpc-daemon[926]: time=2026-09-21T12:58:19.495Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 50.434671] nix-grpc-daemon[926]: time=2026-09-21T12:58:19.498Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 50.429783] niks3-server[1069]: 2026/09/21 12:58:19 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 50.437208] niks3-server[1069]: 2026/09/21 12:58:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker2 # [ 50.471772] nix-grpc-daemon[926]: time=2026-09-21T12:58:19.535Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.442180] niks3-server[1069]: 2026/09/21 12:58:19 INFO Signed narinfos id=9 count=1 lb # [ 50.452553] niks3-server[1069]: 2026/09/21 12:58:19 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 50.459922] niks3-server[1069]: 2026/09/21 12:58:19 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete worker2 # [ 50.495880] nix-grpc-daemon[926]: time=2026-09-21T12:58:19.559Z level=INFO msg="Upload complete. (391ms)" lb # [ 50.466487] niks3-server[1069]: 2026/09/21 12:58:19 INFO Completed upload id=9 worker2 # [ 50.497848] nix-grpc-daemon[788]: ts=2026-09-21T12:58:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 50.501721] nix-grpc-daemon[788]: ts=2026-09-21T12:58:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 lb # [ 50.471931] niks3-server[1069]: 2026/09/21 12:58:19 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 50.508387] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) worker2 # [ 50.509632] nix-daemon[873]: reaped child process 924, status = succeeded worker2 # [ 50.514854] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) client # [ 50.501973] nix[892]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 50.680280] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: fda0610185bd46bb9356c4fc27912bc6 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds) worker1 # [ 50.910711] nix-grpc-daemon[784]: ts=2026-09-21T12:58:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54422 client # [ 50.930580] nix[908]: don't know how to build these paths: client # [ 50.931532] nix[908]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 50.950283] nix-grpc-daemon[788]: ts=2026-09-21T12:58:20Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 50.959081] nix-grpc-daemon[788]: ts=2026-09-21T12:58:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 client # [ 50.951986] nix[908]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.05 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 54.342880] nix-daemon[873]: reaped child process 950, status = succeeded worker2 # [ 54.482340] nix-daemon[873]: accepted connection from pid 983, user nix-grpc-daemon (trusted) worker2 # [ 54.493766] nix-daemon[873]: reaped child process 986, status = succeeded lb # [ 54.476754] niks3-server[1069]: 2026/09/21 12:58:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 54.514280] nix-grpc-daemon[926]: time=2026-09-21T12:58:23.577Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 54.515877] nix-grpc-daemon[926]: time=2026-09-21T12:58:23.579Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 54.521738] niks3-server[1069]: 2026/09/21 12:58:23 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 54.528164] niks3-server[1069]: 2026/09/21 12:58:23 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 54.536791] niks3-server[1069]: 2026/09/21 12:58:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker2 # [ 54.572738] nix-grpc-daemon[926]: time=2026-09-21T12:58:23.635Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.542830] niks3-server[1069]: 2026/09/21 12:58:23 INFO Signed narinfos id=10 count=1 lb # [ 54.546583] niks3-server[1069]: 2026/09/21 12:58:23 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 54.556088] niks3-server[1069]: 2026/09/21 12:58:23 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 54.562239] niks3-server[1069]: 2026/09/21 12:58:23 INFO Completed upload id=10 worker2 # [ 54.591499] nix-grpc-daemon[926]: time=2026-09-21T12:58:23.654Z level=INFO msg="Upload complete. (262ms)" lb # [ 54.564991] niks3-server[1069]: 2026/09/21 12:58:23 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 54.598351] nix-grpc-daemon[788]: ts=2026-09-21T12:58:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 54.604243] nix-grpc-daemon[788]: ts=2026-09-21T12:58:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 54.613686] nix-daemon[873]: reaped child process 948, status = succeeded client # [ 54.624482] systemd[1]: dedup2.service: Deactivated successfully. client # [ 54.628763] systemd[1]: dedup2.service: Consumed 138ms CPU time over 3.947s wall clock time, 35.1M memory peak, 5.9K incoming IP traffic, 5.6K outgoing IP traffic. client # [ 54.668960] systemd[1]: dedup1.service: Deactivated successfully. client # [ 54.670379] systemd[1]: dedup1.service: Consumed 119ms CPU time over 5.064s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.98 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 55.737522] systemd[1]: Started Nix Daemon. client # [ 55.915029] nix-daemon[950]: accepted connection from pid 947, user root (trusted) worker1 # [ 56.098612] nix-grpc-daemon[784]: ts=2026-09-21T12:58:24Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 56.103926] nix-grpc-daemon[784]: ts=2026-09-21T12:58:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker2 # [ 56.141398] nix-grpc-daemon[788]: ts=2026-09-21T12:58:25Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 56.145559] nix-grpc-daemon[788]: ts=2026-09-21T12:58:25Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 56.158991] nix-grpc-daemon[784]: ts=2026-09-21T12:58:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 56.171208] nix-grpc-daemon[784]: ts=2026-09-21T12:58:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 56.183428] nix-grpc-daemon[784]: ts=2026-09-21T12:58:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 56.195337] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 56.401934] nix-daemon[849]: accepted connection from pid 1051, user nix-grpc-daemon (trusted) worker1 # [ 56.417272] nix-daemon[849]: reaped child process 1054, status = succeeded worker1 # [ 56.607266] nix-daemon[849]: accepted connection from pid 1056, user nix-grpc-daemon (trusted) worker1 # [ 56.621169] nix-daemon[849]: reaped child process 1059, status = succeeded lb # [ 56.636354] niks3-server[1069]: 2026/09/21 12:58:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 56.647741] nix-grpc-daemon[862]: time=2026-09-21T12:58:25.490Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 56.649276] nix-grpc-daemon[862]: time=2026-09-21T12:58:25.492Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 56.673253] niks3-server[1069]: 2026/09/21 12:58:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 56.680379] niks3-server[1069]: 2026/09/21 12:58:25 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst worker1 # [ 56.690431] nix-grpc-daemon[862]: time=2026-09-21T12:58:25.533Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.686769] niks3-server[1069]: 2026/09/21 12:58:25 INFO Signed narinfos id=11 count=1 lb # [ 56.694583] niks3-server[1069]: 2026/09/21 12:58:25 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 56.704105] niks3-server[1069]: 2026/09/21 12:58:25 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 56.714637] niks3-server[1069]: 2026/09/21 12:58:25 INFO Completed upload id=11 worker1 # [ 56.717855] nix-grpc-daemon[862]: time=2026-09-21T12:58:25.561Z level=INFO msg="Upload complete. (510ms)" lb # [ 56.717433] niks3-server[1069]: 2026/09/21 12:58:25 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 56.721887] nix-grpc-daemon[784]: ts=2026-09-21T12:58:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 56.728345] nix-grpc-daemon[784]: ts=2026-09-21T12:58:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 56.739110] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 56.752544] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 56.754727] nix-daemon[849]: reaped child process 1049, status = succeeded worker1 # [ 57.568521] nix-daemon[849]: reaped child process 1063, status = succeeded worker1 # [ 57.731691] nix-daemon[849]: accepted connection from pid 1079, user nix-grpc-daemon (trusted) worker1 # [ 57.745468] nix-daemon[849]: reaped child process 1082, status = succeeded lb # [ 57.760299] niks3-server[1069]: 2026/09/21 12:58:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.772043] nix-grpc-daemon[862]: time=2026-09-21T12:58:26.615Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 57.775062] nix-grpc-daemon[862]: time=2026-09-21T12:58:26.617Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 57.802432] niks3-server[1069]: 2026/09/21 12:58:26 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 57.814580] niks3-server[1069]: 2026/09/21 12:58:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 57.820417] niks3-server[1069]: 2026/09/21 12:58:26 INFO Signed narinfos id=12 count=1 worker1 # [ 57.827040] nix-grpc-daemon[862]: time=2026-09-21T12:58:26.670Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.828286] niks3-server[1069]: 2026/09/21 12:58:26 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 57.834674] niks3-server[1069]: 2026/09/21 12:58:26 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 57.843742] niks3-server[1069]: 2026/09/21 12:58:26 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 57.848711] niks3-server[1069]: 2026/09/21 12:58:26 INFO Completed upload id=12 worker1 # [ 57.852183] nix-grpc-daemon[862]: time=2026-09-21T12:58:26.695Z level=INFO msg="Upload complete. (292ms)" lb # [ 57.850997] niks3-server[1069]: 2026/09/21 12:58:26 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 57.857595] nix-grpc-daemon[784]: ts=2026-09-21T12:58:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=1 worker1 # [ 57.865502] nix-grpc-daemon[784]: ts=2026-09-21T12:58:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 57.875767] nix-daemon[849]: reaped child process 1061, status = succeeded worker1 # [ 57.878707] nix-grpc-daemon[784]: ts=2026-09-21T12:58:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 57.883546] nix-grpc-daemon[784]: ts=2026-09-21T12:58:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 58.159249] nix-grpc-daemon[784]: ts=2026-09-21T12:58:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 58.165126] nix-grpc-daemon[784]: ts=2026-09-21T12:58:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 58.170088] nix-grpc-daemon[862]: time=2026-09-21T12:58:27.012Z level=INFO msg="All 1 paths already cached" worker2 # [ 58.207194] nix-grpc-daemon[788]: ts=2026-09-21T12:58:27Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 58.183217] nix-grpc-daemon[784]: ts=2026-09-21T12:58:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker2 # [ 58.211343] nix-grpc-daemon[788]: ts=2026-09-21T12:58:27Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 58.195101] nix-grpc-daemon[784]: ts=2026-09-21T12:58:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 58.206980] nix-grpc-daemon[862]: time=2026-09-21T12:58:27.050Z level=INFO msg="All 1 paths already cached" worker1 # [ 58.213468] nix-grpc-daemon[784]: ts=2026-09-21T12:58:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 58.223162] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) lb # [ 58.354177] envoy[922]: conn peer=[2001:db8:1::1]:35808 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4126 tx=1766 ms=1559 lb # [ 58.358060] envoy[922]: conn peer=[2001:db8:1::1]:35812 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=3681 lb # [ 58.361574] envoy[922]: conn peer=[2001:db8:1::1]:35810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2998 tx=1451 ms=4852 lb # [ 58.365150] envoy[922]: conn peer=[2001:db8:1::1]:51860 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1739 ms=1839 lb # [ 58.368630] envoy[922]: conn peer=[2001:db8:1::1]:51868 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=57 worker1 # [ 58.418459] nix-daemon[849]: accepted connection from pid 1086, user nix-grpc-daemon (trusted) worker1 # [ 58.433780] nix-daemon[849]: reaped child process 1089, status = succeeded worker1 # [ 58.604685] nix-daemon[849]: accepted connection from pid 1091, user nix-grpc-daemon (trusted) worker1 # [ 58.618513] nix-daemon[849]: reaped child process 1094, status = succeeded lb # [ 58.630551] niks3-server[1069]: 2026/09/21 12:58:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 58.641399] nix-grpc-daemon[862]: time=2026-09-21T12:58:27.484Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 58.642909] nix-grpc-daemon[862]: time=2026-09-21T12:58:27.486Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 58.657487] niks3-server[1069]: 2026/09/21 12:58:27 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 58.668771] niks3-server[1069]: 2026/09/21 12:58:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker1 # [ 58.677124] nix-grpc-daemon[862]: time=2026-09-21T12:58:27.520Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.673586] niks3-server[1069]: 2026/09/21 12:58:27 INFO Signed narinfos id=13 count=1 lb # [ 58.687561] niks3-server[1069]: 2026/09/21 12:58:27 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 58.693229] niks3-server[1069]: 2026/09/21 12:58:27 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 58.697587] niks3-server[1069]: 2026/09/21 12:58:27 INFO Completed upload id=13 worker1 # [ 58.700988] nix-grpc-daemon[862]: time=2026-09-21T12:58:27.544Z level=INFO msg="Upload complete. (464ms)" lb # [ 58.700254] niks3-server[1069]: 2026/09/21 12:58:27 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 58.704669] nix-grpc-daemon[784]: ts=2026-09-21T12:58:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 58.710329] nix-grpc-daemon[784]: ts=2026-09-21T12:58:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 58.719694] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 58.724557] nix-daemon[849]: reaped child process 1084, status = succeeded worker1 # [ 58.729252] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 59.758365] nix-daemon[849]: reaped child process 1098, status = succeeded worker1 # [ 59.924716] nix-daemon[849]: accepted connection from pid 1114, user nix-grpc-daemon (trusted) worker1 # [ 59.938748] nix-daemon[849]: reaped child process 1117, status = succeeded lb # [ 59.952249] niks3-server[1069]: 2026/09/21 12:58:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.963568] nix-grpc-daemon[862]: time=2026-09-21T12:58:28.806Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 59.966307] nix-grpc-daemon[862]: time=2026-09-21T12:58:28.808Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 59.988160] niks3-server[1069]: 2026/09/21 12:58:28 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 59.994821] niks3-server[1069]: 2026/09/21 12:58:28 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 60.006693] niks3-server[1069]: 2026/09/21 12:58:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 60.012587] niks3-server[1069]: 2026/09/21 12:58:28 INFO Signed narinfos id=14 count=1 worker1 # [ 60.019398] nix-grpc-daemon[862]: time=2026-09-21T12:58:28.862Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.015977] niks3-server[1069]: 2026/09/21 12:58:28 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 60.026269] niks3-server[1069]: 2026/09/21 12:58:28 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 60.031250] niks3-server[1069]: 2026/09/21 12:58:28 INFO Completed upload id=14 worker1 # [ 60.034724] nix-grpc-daemon[862]: time=2026-09-21T12:58:28.878Z level=INFO msg="Upload complete. (297ms)" lb # [ 60.034396] niks3-server[1069]: 2026/09/21 12:58:28 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 60.041592] nix-grpc-daemon[784]: ts=2026-09-21T12:58:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=1 worker2 # [ 60.072064] nix-grpc-daemon[788]: ts=2026-09-21T12:58:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54606 worker1 # [ 60.054364] nix-daemon[849]: reaped child process 1096, status = succeeded worker2 # [ 60.087076] nix-grpc-daemon[788]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 60.102297] nix-grpc-daemon[788]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker1 # [ 60.104154] nix-grpc-daemon[784]: ts=2026-09-21T12:58:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 60.108755] nix-grpc-daemon[784]: ts=2026-09-21T12:58:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 60.324315] nix-grpc-daemon[784]: ts=2026-09-21T12:58:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:54422 worker2 # [ 60.357718] nix-grpc-daemon[788]: ts=2026-09-21T12:58:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 60.367584] nix-grpc-daemon[926]: time=2026-09-21T12:58:29.430Z level=INFO msg="All 2 paths already cached" worker2 # [ 60.381226] nix-grpc-daemon[788]: ts=2026-09-21T12:58:29Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 60.385608] nix-grpc-daemon[788]: ts=2026-09-21T12:58:29Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 60.361848] nix-grpc-daemon[784]: ts=2026-09-21T12:58:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 60.373828] nix-grpc-daemon[784]: ts=2026-09-21T12:58:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 60.385696] nix-grpc-daemon[862]: time=2026-09-21T12:58:29.229Z level=INFO msg="All 2 paths already cached" worker1 # [ 60.393374] nix-grpc-daemon[784]: ts=2026-09-21T12:58:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 60.401734] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 60.582530] nix-daemon[849]: accepted connection from pid 1121, user nix-grpc-daemon (trusted) worker1 # [ 60.597119] nix-daemon[849]: reaped child process 1124, status = succeeded worker1 # [ 60.759863] nix-daemon[849]: accepted connection from pid 1126, user nix-grpc-daemon (trusted) worker1 # [ 60.773603] nix-daemon[849]: reaped child process 1129, status = succeeded lb # [ 60.784760] niks3-server[1069]: 2026/09/21 12:58:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.796313] nix-grpc-daemon[862]: time=2026-09-21T12:58:29.639Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 60.797850] nix-grpc-daemon[862]: time=2026-09-21T12:58:29.641Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 60.815494] niks3-server[1069]: 2026/09/21 12:58:29 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 60.826267] niks3-server[1069]: 2026/09/21 12:58:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 60.831816] niks3-server[1069]: 2026/09/21 12:58:29 INFO Signed narinfos id=15 count=1 worker1 # [ 60.838292] nix-grpc-daemon[862]: time=2026-09-21T12:58:29.681Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.838314] niks3-server[1069]: 2026/09/21 12:58:29 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 60.849388] niks3-server[1069]: 2026/09/21 12:58:29 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 60.855096] niks3-server[1069]: 2026/09/21 12:58:29 INFO Completed upload id=15 worker1 # [ 60.858543] nix-grpc-daemon[862]: time=2026-09-21T12:58:29.701Z level=INFO msg="Upload complete. (442ms)" worker1 # [ 60.861967] nix-grpc-daemon[784]: ts=2026-09-21T12:58:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 60.860093] niks3-server[1069]: 2026/09/21 12:58:29 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 60.867624] nix-grpc-daemon[784]: ts=2026-09-21T12:58:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 60.875554] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 60.882209] nix-daemon[849]: reaped child process 1119, status = succeeded worker1 # [ 60.886402] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 62.310513] nix-daemon[849]: reaped child process 1133, status = succeeded worker1 # [ 62.463376] nix-daemon[849]: accepted connection from pid 1149, user nix-grpc-daemon (trusted) worker1 # [ 62.477782] nix-daemon[849]: reaped child process 1152, status = succeeded lb # [ 62.491412] niks3-server[1069]: 2026/09/21 12:58:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 62.503881] nix-grpc-daemon[862]: time=2026-09-21T12:58:31.347Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 62.505578] nix-grpc-daemon[862]: time=2026-09-21T12:58:31.348Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 62.532072] niks3-server[1069]: 2026/09/21 12:58:31 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 62.541339] niks3-server[1069]: 2026/09/21 12:58:31 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 62.548253] niks3-server[1069]: 2026/09/21 12:58:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 62.552143] niks3-server[1069]: 2026/09/21 12:58:31 INFO Signed narinfos id=16 count=1 worker1 # [ 62.558247] nix-grpc-daemon[862]: time=2026-09-21T12:58:31.401Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.559257] niks3-server[1069]: 2026/09/21 12:58:31 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 62.563728] niks3-server[1069]: 2026/09/21 12:58:31 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 62.568095] niks3-server[1069]: 2026/09/21 12:58:31 INFO Completed upload id=16 worker1 # [ 62.571512] nix-grpc-daemon[862]: time=2026-09-21T12:58:31.414Z level=INFO msg="Upload complete. (277ms)" lb # [ 62.570410] niks3-server[1069]: 2026/09/21 12:58:31 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 62.575762] nix-grpc-daemon[784]: ts=2026-09-21T12:58:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=1 worker2 # [ 62.607438] nix-grpc-daemon[788]: ts=2026-09-21T12:58:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54606 worker1 # [ 62.587957] nix-daemon[849]: reaped child process 1131, status = succeeded worker2 # [ 62.616597] nix-grpc-daemon[788]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker1 # [ 62.614169] nix-grpc-daemon[784]: ts=2026-09-21T12:58:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 62.618407] nix-grpc-daemon[784]: ts=2026-09-21T12:58:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_out=232 client # [ 62.738522] nix-daemon[950]: reaped child process 952, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.21 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.30 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.50 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.19 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.23 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 63.999929] nix-daemon[950]: accepted connection from pid 1033, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 64.189888] nix-grpc-daemon[784]: ts=2026-09-21T12:58:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:54422 worker2 # [ 64.221072] nix-grpc-daemon[788]: ts=2026-09-21T12:58:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54606 client # copying 1 paths... client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 64.206102] nix-grpc-daemon[784]: ts=2026-09-21T12:58:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 64.217336] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 64.409475] nix-daemon[849]: accepted connection from pid 1161, user nix-grpc-daemon (trusted) worker1 # [ 64.423908] nix-daemon[849]: reaped child process 1164, status = succeeded lb # [ 64.437506] niks3-server[1069]: 2026/09/21 12:58:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.448821] nix-grpc-daemon[862]: time=2026-09-21T12:58:33.291Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 64.450683] nix-grpc-daemon[862]: time=2026-09-21T12:58:33.293Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 64.463805] niks3-server[1069]: 2026/09/21 12:58:33 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 64.476061] niks3-server[1069]: 2026/09/21 12:58:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 64.484339] nix-grpc-daemon[862]: time=2026-09-21T12:58:33.327Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.481141] niks3-server[1069]: 2026/09/21 12:58:33 INFO Signed narinfos id=17 count=1 lb # [ 64.487207] niks3-server[1069]: 2026/09/21 12:58:33 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 64.496818] niks3-server[1069]: 2026/09/21 12:58:33 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete worker1 # [ 64.506194] nix-grpc-daemon[862]: time=2026-09-21T12:58:33.349Z level=INFO msg="Upload complete. (279ms)" lb # [ 64.502890] niks3-server[1069]: 2026/09/21 12:58:33 INFO Completed upload id=17 worker1 # [ 64.508351] nix-grpc-daemon[784]: ts=2026-09-21T12:58:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=0 paths=1 nar_bytes_in=120 lb # [ 64.507902] niks3-server[1069]: 2026/09/21 12:58:33 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker1 # [ 64.517981] nix-daemon[849]: reaped child process 1159, status = succeeded worker2 # [ 64.549604] nix-grpc-daemon[788]: ts=2026-09-21T12:58:33Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 64.555161] nix-grpc-daemon[788]: ts=2026-09-21T12:58:33Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 64.593848] nix-grpc-daemon[788]: ts=2026-09-21T12:58:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 64.605638] nix-grpc-daemon[788]: ts=2026-09-21T12:58:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54606 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 64.622098] nix-grpc-daemon[788]: ts=2026-09-21T12:58:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54606 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 64.636500] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) worker2 # [ 64.832619] nix-daemon[873]: accepted connection from pid 1013, user nix-grpc-daemon (trusted) worker2 # [ 64.845528] nix-daemon[873]: reaped child process 1016, status = succeeded worker2 # [ 65.013688] nix-daemon[873]: accepted connection from pid 1018, user nix-grpc-daemon (trusted) worker2 # [ 65.023729] nix-daemon[873]: reaped child process 1021, status = succeeded lb # [ 65.010342] niks3-server[1069]: 2026/09/21 12:58:33 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 65.019436] niks3-server[1069]: 2026/09/21 12:58:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 65.057279] nix-grpc-daemon[926]: time=2026-09-21T12:58:34.120Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 65.059377] nix-grpc-daemon[926]: time=2026-09-21T12:58:34.122Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker2 # [ 65.061000] nix-grpc-daemon[926]: time=2026-09-21T12:58:34.122Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 65.049475] niks3-server[1069]: 2026/09/21 12:58:33 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 65.063887] niks3-server[1069]: 2026/09/21 12:58:33 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 65.075124] niks3-server[1069]: 2026/09/21 12:58:33 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 65.082454] niks3-server[1069]: 2026/09/21 12:58:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 65.086154] niks3-server[1069]: 2026/09/21 12:58:33 INFO Signed narinfos id=18 count=1 lb # [ 65.088368] niks3-server[1069]: 2026/09/21 12:58:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 65.090379] niks3-server[1069]: 2026/09/21 12:58:34 INFO Signed narinfos id=19 count=2 lb # [ 65.091723] niks3-server[1069]: 2026/09/21 12:58:34 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls worker2 # [ 65.122916] nix-grpc-daemon[926]: time=2026-09-21T12:58:34.184Z level=INFO msg="Uploading 3 narinfos" lb # [ 65.105773] niks3-server[1069]: 2026/09/21 12:58:34 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 65.107528] niks3-server[1069]: 2026/09/21 12:58:34 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 65.109646] niks3-server[1069]: 2026/09/21 12:58:34 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 65.112444] niks3-server[1069]: 2026/09/21 12:58:34 INFO Completed upload id=18 lb # [ 65.114772] niks3-server[1069]: 2026/09/21 12:58:34 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 65.116745] niks3-server[1069]: 2026/09/21 12:58:34 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo lb # [ 65.118821] niks3-server[1069]: 2026/09/21 12:58:34 INFO Completed upload id=19 worker2 # [ 65.149645] nix-grpc-daemon[926]: time=2026-09-21T12:58:34.213Z level=INFO msg="Upload complete. (499ms)" worker2 # [ 65.153997] nix-grpc-daemon[788]: ts=2026-09-21T12:58:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 65.160592] nix-grpc-daemon[788]: ts=2026-09-21T12:58:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 65.170937] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) worker2 # [ 65.178495] nix-daemon[873]: reaped child process 1011, status = succeeded worker2 # [ 65.187771] nix-grpc-daemon[788]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 65.196377] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 66.013987] nix-daemon[873]: reaped child process 1026, status = succeeded worker2 # [ 66.175736] nix-daemon[873]: accepted connection from pid 1042, user nix-grpc-daemon (trusted) worker2 # [ 66.187307] nix-daemon[873]: reaped child process 1045, status = succeeded lb # [ 66.174709] niks3-server[1069]: 2026/09/21 12:58:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 66.214314] nix-grpc-daemon[926]: time=2026-09-21T12:58:35.277Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 66.205350] niks3-server[1069]: 2026/09/21 12:58:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 66.209890] niks3-server[1069]: 2026/09/21 12:58:35 INFO Signed narinfos id=20 count=1 worker2 # [ 66.242160] nix-grpc-daemon[926]: time=2026-09-21T12:58:35.305Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.220471] niks3-server[1069]: 2026/09/21 12:58:35 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 66.226704] niks3-server[1069]: 2026/09/21 12:58:35 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 66.237574] niks3-server[1069]: 2026/09/21 12:58:35 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete worker2 # [ 66.273219] nix-grpc-daemon[926]: time=2026-09-21T12:58:35.336Z level=INFO msg="Upload complete. (269ms)" lb # [ 66.243805] niks3-server[1069]: 2026/09/21 12:58:35 INFO Completed upload id=20 lb # [ 66.245991] niks3-server[1069]: 2026/09/21 12:58:35 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 66.277501] nix-grpc-daemon[788]: ts=2026-09-21T12:58:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=1 client # copying 1 paths... worker2 # [ 66.287648] nix-grpc-daemon[788]: ts=2026-09-21T12:58:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54606 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 66.294762] nix-daemon[873]: reaped child process 1023, status = succeeded worker2 # [ 66.305529] nix-grpc-daemon[788]: ts=2026-09-21T12:58:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 66.307694] nix-grpc-daemon[788]: ts=2026-09-21T12:58:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=0 paths=1 nar_bytes_out=120 client # [ 66.400364] nix-daemon[950]: reaped child process 1036, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.63 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 66.586652] nix-daemon[950]: accepted connection from pid 1055, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 66.771868] nix-grpc-daemon[784]: ts=2026-09-21T12:58:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:54422 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 66.801163] nix-grpc-daemon[788]: ts=2026-09-21T12:58:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 66.810570] nix-grpc-daemon[926]: time=2026-09-21T12:58:35.874Z level=INFO msg="All 1 paths already cached" worker2 # [ 66.824629] nix-grpc-daemon[788]: ts=2026-09-21T12:58:35Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker1 # [ 66.801375] nix-grpc-daemon[784]: ts=2026-09-21T12:58:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 worker2 # [ 66.829491] nix-grpc-daemon[788]: ts=2026-09-21T12:58:35Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 66.813914] nix-grpc-daemon[784]: ts=2026-09-21T12:58:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 66.832930] nix-grpc-daemon[784]: ts=2026-09-21T12:58:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 66.845211] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 66.862309] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 1/5) worker1 # [ 66.881119] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 2/5) worker1 # [ 66.894422] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 224 ms (attempt 3/5) worker1 # [ 67.124402] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 735 ms (attempt 4/5) worker1 # [ 67.866694] nix-grpc-daemon[784]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 67.871145] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 67.876560] nix-grpc-daemon[784]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 68.072740] nix-daemon[849]: accepted connection from pid 1173, user nix-grpc-daemon (trusted) worker1 # [ 68.087081] nix-daemon[849]: reaped child process 1176, status = succeeded worker1 # [ 68.246206] nix-daemon[849]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) worker1 # [ 68.259888] nix-daemon[849]: reaped child process 1181, status = succeeded lb # [ 68.272446] niks3-server[1069]: 2026/09/21 12:58:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.284856] nix-grpc-daemon[862]: time=2026-09-21T12:58:37.128Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 68.286443] nix-grpc-daemon[862]: time=2026-09-21T12:58:37.129Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 68.305231] niks3-server[1069]: 2026/09/21 12:58:37 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 68.312929] niks3-server[1069]: 2026/09/21 12:58:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 68.318579] niks3-server[1069]: 2026/09/21 12:58:37 INFO Signed narinfos id=21 count=1 worker1 # [ 68.324777] nix-grpc-daemon[862]: time=2026-09-21T12:58:37.168Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.327312] niks3-server[1069]: 2026/09/21 12:58:37 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 68.336955] niks3-server[1069]: 2026/09/21 12:58:37 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 68.343048] niks3-server[1069]: 2026/09/21 12:58:37 INFO Completed upload id=21 worker1 # [ 68.346582] nix-grpc-daemon[862]: time=2026-09-21T12:58:37.189Z level=INFO msg="Upload complete. (447ms)" lb # [ 68.344539] niks3-server[1069]: 2026/09/21 12:58:37 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 68.350477] nix-grpc-daemon[784]: ts=2026-09-21T12:58:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=1 paths=1 nar_bytes_in=560 lb # [ 68.353554] envoy[922]: conn peer=[2001:db8:1::1]:51872 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3893 tx=2069 ms=1962 worker1 # [ 68.355449] nix-grpc-daemon[784]: ts=2026-09-21T12:58:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 lb # [ 68.354952] envoy[922]: conn peer=[2001:db8:1::1]:51876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=378 ms=18 lb # [ 68.356314] envoy[922]: conn peer=[2001:db8:1::1]:51888 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4326 tx=2301 ms=2341 lb # [ 68.357644] envoy[922]: conn peer=[2001:db8:1::1]:51900 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=51 lb # [ 68.359324] envoy[922]: conn peer=[2001:db8:1::1]:55628 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=54 lb # [ 68.360697] envoy[922]: conn peer=[2001:db8:1::1]:55624 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4197 tx=1827 ms=2146 worker1 # [ 68.364513] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) worker1 # [ 68.373449] nix-daemon[849]: reaped child process 1166, status = succeeded client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 68.376937] nix-daemon[849]: accepted connection from pid 784, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 69.405117] nix-daemon[849]: reaped child process 1185, status = succeeded worker1 # [ 69.571733] nix-daemon[849]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 69.584622] nix-daemon[849]: reaped child process 1204, status = succeeded lb # [ 69.597520] niks3-server[1069]: 2026/09/21 12:58:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.608746] nix-grpc-daemon[862]: time=2026-09-21T12:58:38.451Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 69.628951] niks3-server[1069]: 2026/09/21 12:58:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 69.633413] niks3-server[1069]: 2026/09/21 12:58:38 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls worker1 # [ 69.644195] nix-grpc-daemon[862]: time=2026-09-21T12:58:38.487Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.640914] niks3-server[1069]: 2026/09/21 12:58:38 INFO Signed narinfos id=22 count=1 lb # [ 69.645986] niks3-server[1069]: 2026/09/21 12:58:38 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 69.658714] niks3-server[1069]: 2026/09/21 12:58:38 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete worker1 # [ 69.667861] nix-grpc-daemon[862]: time=2026-09-21T12:58:38.511Z level=INFO msg="Upload complete. (283ms)" lb # [ 69.664493] niks3-server[1069]: 2026/09/21 12:58:38 INFO Completed upload id=22 worker1 # [ 69.670704] nix-grpc-daemon[784]: ts=2026-09-21T12:58:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54422 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=1 lb # [ 69.667238] niks3-server[1069]: 2026/09/21 12:58:38 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo client # copying 1 paths... worker1 # [ 69.678925] nix-daemon[849]: reaped child process 1183, status = succeeded worker2 # [ 69.707989] nix-grpc-daemon[788]: ts=2026-09-21T12:58:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 69.717962] nix-grpc-daemon[788]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 69.752167] nix-grpc-daemon[788]: ts=2026-09-21T12:58:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 69.756456] nix-grpc-daemon[788]: ts=2026-09-21T12:58:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=0 paths=1 nar_bytes_out=120 client # [ 69.842850] nix-daemon[950]: reaped child process 1058, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.44 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 70.030984] nix-daemon[950]: accepted connection from pid 1077, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 70.247070] nix-grpc-daemon[788]: ts=2026-09-21T12:58:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:54606 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 70.224118] nix-grpc-daemon[784]: ts=2026-09-21T12:58:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54422 worker1 # [ 70.233302] nix-grpc-daemon[862]: time=2026-09-21T12:58:39.076Z level=INFO msg="All 1 paths already cached" worker2 # [ 70.273996] nix-grpc-daemon[788]: ts=2026-09-21T12:58:39Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 70.280652] nix-grpc-daemon[788]: ts=2026-09-21T12:58:39Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 70.285641] nix-grpc-daemon[788]: ts=2026-09-21T12:58:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 70.296357] nix-grpc-daemon[788]: ts=2026-09-21T12:58:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 70.309402] nix-grpc-daemon[926]: time=2026-09-21T12:58:39.372Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 70.318150] nix-grpc-daemon[788]: ts=2026-09-21T12:58:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 70.329296] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) worker2 # [ 70.530146] nix-daemon[873]: accepted connection from pid 1054, user nix-grpc-daemon (trusted) worker2 # [ 70.542451] nix-daemon[873]: reaped child process 1057, status = succeeded worker2 # [ 70.732846] nix-daemon[873]: accepted connection from pid 1059, user nix-grpc-daemon (trusted) worker2 # [ 70.744537] nix-daemon[873]: reaped child process 1062, status = succeeded lb # [ 70.732073] niks3-server[1069]: 2026/09/21 12:58:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 70.771718] nix-grpc-daemon[926]: time=2026-09-21T12:58:39.834Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 70.773163] nix-grpc-daemon[926]: time=2026-09-21T12:58:39.835Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 70.759669] niks3-server[1069]: 2026/09/21 12:58:39 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 70.770909] niks3-server[1069]: 2026/09/21 12:58:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 70.774900] niks3-server[1069]: 2026/09/21 12:58:39 INFO Signed narinfos id=23 count=1 worker2 # [ 70.808364] nix-grpc-daemon[926]: time=2026-09-21T12:58:39.871Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.781996] niks3-server[1069]: 2026/09/21 12:58:39 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 70.790929] niks3-server[1069]: 2026/09/21 12:58:39 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker2 # [ 70.827255] nix-grpc-daemon[926]: time=2026-09-21T12:58:39.890Z level=INFO msg="Upload complete. (486ms)" lb # [ 70.798086] niks3-server[1069]: 2026/09/21 12:58:39 INFO Completed upload id=23 lb # [ 70.801079] niks3-server[1069]: 2026/09/21 12:58:39 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 70.830233] nix-grpc-daemon[788]: ts=2026-09-21T12:58:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=0 paths=1 nar_bytes_in=560 worker2 # [ 70.835774] nix-grpc-daemon[788]: ts=2026-09-21T12:58:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 70.845537] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) worker2 # [ 70.848416] nix-daemon[873]: reaped child process 1052, status = succeeded worker2 # [ 70.853537] nix-daemon[873]: accepted connection from pid 788, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 71.678607] nix-daemon[873]: reaped child process 1066, status = succeeded worker2 # [ 71.866339] nix-daemon[873]: accepted connection from pid 1082, user nix-grpc-daemon (trusted) worker2 # [ 71.877751] nix-daemon[873]: reaped child process 1085, status = succeeded lb # [ 71.867238] niks3-server[1069]: 2026/09/21 12:58:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.903365] nix-grpc-daemon[926]: time=2026-09-21T12:58:40.966Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 71.897115] niks3-server[1069]: 2026/09/21 12:58:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 71.900693] niks3-server[1069]: 2026/09/21 12:58:40 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 71.905903] niks3-server[1069]: 2026/09/21 12:58:40 INFO Signed narinfos id=24 count=1 worker2 # [ 71.938254] nix-grpc-daemon[926]: time=2026-09-21T12:58:41.001Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.914398] niks3-server[1069]: 2026/09/21 12:58:40 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 71.925443] niks3-server[1069]: 2026/09/21 12:58:40 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 71.931702] niks3-server[1069]: 2026/09/21 12:58:40 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo lb # [ 71.935604] niks3-server[1069]: 2026/09/21 12:58:40 INFO Completed upload id=24 worker2 # [ 71.965315] nix-grpc-daemon[926]: time=2026-09-21T12:58:41.028Z level=INFO msg="Upload complete. (304ms)" worker2 # [ 71.970646] nix-grpc-daemon[788]: ts=2026-09-21T12:58:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=1 client # copying 1 paths... worker2 # [ 71.980602] nix-grpc-daemon[788]: ts=2026-09-21T12:58:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54606 client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 71.987208] nix-daemon[873]: reaped child process 1064, status = succeeded worker2 # [ 72.003110] nix-grpc-daemon[788]: ts=2026-09-21T12:58:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54606 worker2 # [ 72.006537] nix-grpc-daemon[788]: ts=2026-09-21T12:58:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54606 duration_s=0 paths=1 nar_bytes_out=120 client # [ 72.099745] nix-daemon[950]: reaped child process 1080, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.26 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 9.27 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.42 seconds) client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.42 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds) worker2 # [ 73.463708] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 73.737669] nix-grpc-daemon[788]: ts=2026-09-21T12:58:42Z level=info event=signal_exit lb # [ 73.963756] niks3-server[1069]: 2026/09/21 12:58:42 INFO lead: released remote=192.168.1.4:44480 worker2 # [ 74.289873] nix-grpc-daemon[788]: ts=2026-09-21T12:58:43Z level=info event=scheduler_restarting worker2 # [ 74.297749] nix-grpc-daemon[788]: ts=2026-09-21T12:58:43Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 74.272622] nix-grpc-daemon[784]: ts=2026-09-21T12:58:43Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 74.303173] nix-grpc-daemon[788]: ts=2026-09-21T12:58:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44136 worker2 # [ 74.306986] nix-grpc-daemon[788]: ts=2026-09-21T12:58:43Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 74.310816] nix-grpc-daemon[788]: ts=2026-09-21T12:58:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44136 worker2 # [ 74.314293] nix-grpc-daemon[788]: ts=2026-09-21T12:58:43Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 74.333350] nix-daemon[873]: reaped child process 875, status = succeeded worker1 # [ 74.474172] nix-grpc-daemon[784]: ts=2026-09-21T12:58:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.477952] nix-grpc-daemon[784]: ts=2026-09-21T12:58:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.508438] nix-grpc-daemon[788]: ts=2026-09-21T12:58:43Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 74.679540] nix-grpc-daemon[784]: ts=2026-09-21T12:58:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.683605] nix-grpc-daemon[784]: ts=2026-09-21T12:58:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.848954] nix-grpc-daemon[788]: E0000 00:00:1789995523.911513 833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 74.889090] nix-grpc-daemon[788]: E0000 00:00:1789995523.952439 833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 74.884418] nix-grpc-daemon[784]: ts=2026-09-21T12:58:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.888369] nix-grpc-daemon[784]: ts=2026-09-21T12:58:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.089249] nix-grpc-daemon[784]: ts=2026-09-21T12:58:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.093320] nix-grpc-daemon[784]: ts=2026-09-21T12:58:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.295466] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.299155] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.500213] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.504312] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 75.612555] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 75.616182] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 75.620852] systemd[1]: nix-grpc-daemon.service: Consumed 1.454s CPU time over 57.111s wall clock time, 52.9M memory peak, 54.9K incoming IP traffic, 175.1K outgoing IP traffic. worker2 # [ 75.632158] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 75.635500] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 75.638188] systemd[1]: nix-grpc-daemon.socket: Consumed 290us CPU time over 1min 6.256s wall clock time, 256K memory peak, 75.9K incoming IP traffic, 64.4K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 75.705139] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.708997] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.909830] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.913902] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.953332] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54422 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker1 # [ 75.958930] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54422 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.29 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds) worker2 # [ 76.102669] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 76.114907] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.118960] nix-grpc-daemon[784]: ts=2026-09-21T12:58:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 76.149490] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 76.321450] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.324612] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 76.494667] niks3-server[1069]: 2026/09/21 12:58:45 INFO lead: acquired remote=192.168.1.3:54130 worker1 # [ 76.501566] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_take_over worker1 # [ 76.522547] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.526361] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 76.597153] systemd[1]: Starting scheduler-token.service... worker2 # [ 76.704587] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 76.707352] systemd[1]: Finished scheduler-token.service. worker2 # [ 76.709256] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 106ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 76.715268] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 76.692236] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=signal_exit worker1 # [ 76.727463] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.731433] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 76.900592] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:45Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 76.902361] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 76.905995] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 76.914066] nix-grpc-daemon[1109]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 76.915512] nix-grpc-daemon[1109]: E0000 00:00:1789995525.976726 1109 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 76.920843] nix-grpc-daemon[1109]: E0000 00:00:1789995525.981905 1109 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 76.924278] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 76.928312] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 76.936066] nix-grpc-daemon[1109]: E0000 00:00:1789995525.998696 1150 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 76.947111] nix-grpc-daemon[1109]: E0000 00:00:1789995526.010588 1150 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 76.950205] nix-grpc-daemon[1109]: E0000 00:00:1789995526.012714 1150 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 76.932557] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 76.960944] nix-grpc-daemon[1109]: E0000 00:00:1789995526.024445 1150 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 76.936564] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 76.969787] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 76.971345] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 76.958253] niks3-server[1069]: 2026/09/21 12:58:45 INFO lead: released remote=192.168.1.3:54130 worker1 # [ 77.137661] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.141635] nix-grpc-daemon[784]: ts=2026-09-21T12:58:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 77.172814] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.176603] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 77.260698] nix-grpc-daemon[784]: ts=2026-09-21T12:58:46Z level=info event=scheduler_restarting worker1 # [ 77.288500] nix-daemon[849]: reaped child process 851, status = succeeded worker2 # [ 77.377593] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.381487] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 77.359408] nix-grpc-daemon[784]: ts=2026-09-21T12:58:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 77.523861] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 77.526973] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 77.532197] systemd[1]: nix-grpc-daemon.service: Consumed 2.909s CPU time over 59.177s wall clock time, 62.3M memory peak, 86.8K incoming IP traffic, 166.9K outgoing IP traffic. worker1 # [ 77.542723] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 77.545964] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 77.548301] systemd[1]: nix-grpc-daemon.socket: Consumed 298us CPU time over 1min 7.896s wall clock time, 256K memory peak, 73.5K incoming IP traffic, 60.7K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 77.582599] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.586506] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 77.787698] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.791532] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 77.915786] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 77.927788] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 77.946954] nix-grpc-daemon[1109]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5) worker2 # [ 77.975785] nix-grpc-daemon[1109]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 70 ms (attempt 2/5) worker2 # [ 77.992334] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.996131] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.051796] nix-grpc-daemon[1109]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 3/5) worker2 # [ 78.123459] nix-grpc-daemon[1109]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 135 ms (attempt 4/5) worker2 # [ 78.197192] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.201253] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.264721] nix-grpc-daemon[1109]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 78.267555] nix-grpc-daemon[1109]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 78.297130] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 78.309466] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 78.331360] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=niks3_push_started pid=1169 lb # [ 78.355525] envoy[922]: conn peer=[2001:db8:1::1]:55638 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=55 lb # [ 78.359338] envoy[922]: conn peer=[2001:db8:1::1]:55634 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3744 tx=2013 ms=3008 lb # [ 78.362806] envoy[922]: conn peer=[2001:db8:1::1]:55666 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=56 lb # [ 78.366916] envoy[922]: conn peer=[2001:db8:1::1]:55652 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3733 tx=1899 ms=1812 worker2 # [ 78.401748] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_connected addr=lb:50051 lb # [ 78.370746] envoy[922]: conn peer=192.168.1.4:38410 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=54606 tx=2602 ms=55704 worker2 # [ 78.404887] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 78.375345] envoy[922]: conn peer=[2001:db8:1::1]:36766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=15 lb # [ 78.379652] envoy[922]: conn peer=192.168.1.3:38110 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=16245 tx=3244 ms=57619 worker2 # [ 78.571882] nix-grpc-daemon[1169]: time=2026-09-21T12:58:47.634Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 78.605497] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.607383] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.776634] nix-daemon[873]: accepted connection from pid 1182, user nix-grpc-daemon (trusted) worker2 # [ 78.787074] nix-daemon[873]: reaped child process 1185, status = succeeded worker2 # [ 78.807843] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.809863] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 78.781790] niks3-server[1069]: 2026/09/21 12:58:47 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 78.791507] niks3-server[1069]: 2026/09/21 12:58:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 78.828937] nix-grpc-daemon[1169]: time=2026-09-21T12:58:47.892Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 78.830938] nix-grpc-daemon[1169]: time=2026-09-21T12:58:47.892Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" worker2 # [ 78.832516] nix-grpc-daemon[1169]: time=2026-09-21T12:58:47.892Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" lb # [ 78.834173] niks3-server[1069]: 2026/09/21 12:58:47 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 78.840989] niks3-server[1069]: 2026/09/21 12:58:47 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 78.844801] niks3-server[1069]: 2026/09/21 12:58:47 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 78.850061] niks3-server[1069]: 2026/09/21 12:58:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 78.852366] niks3-server[1069]: 2026/09/21 12:58:47 INFO Signed narinfos id=26 count=2 lb # [ 78.854401] niks3-server[1069]: 2026/09/21 12:58:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 78.856430] niks3-server[1069]: 2026/09/21 12:58:47 INFO Signed narinfos id=25 count=1 worker2 # [ 78.887923] nix-grpc-daemon[1169]: time=2026-09-21T12:58:47.950Z level=INFO msg="Uploading 3 narinfos" lb # [ 78.860352] niks3-server[1069]: 2026/09/21 12:58:47 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 78.870796] niks3-server[1069]: 2026/09/21 12:58:47 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 78.877567] niks3-server[1069]: 2026/09/21 12:58:47 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 78.880643] niks3-server[1069]: 2026/09/21 12:58:47 INFO Completed upload id=25 lb # [ 78.882275] niks3-server[1069]: 2026/09/21 12:58:47 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 78.885428] niks3-server[1069]: 2026/09/21 12:58:47 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 78.888367] niks3-server[1069]: 2026/09/21 12:58:47 INFO Completed upload id=26 worker2 # [ 78.917973] nix-grpc-daemon[1169]: time=2026-09-21T12:58:47.981Z level=INFO msg="Upload complete. (342ms)" lb # [ 78.889918] niks3-server[1069]: 2026/09/21 12:58:47 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo worker2 # [ 78.922836] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 78.933547] nix-daemon[873]: reaped child process 1167, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.30 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.03 seconds) worker2 # [ 79.012554] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.015661] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.035806] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 79.042231] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 79.216990] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.220898] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.229951] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 79.231795] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 79.235858] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 79.243062] nix-grpc-daemon[1227]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 79.246108] nix-grpc-daemon[1227]: E0000 00:00:1789995528.086452 1227 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 79.250519] nix-grpc-daemon[1227]: E0000 00:00:1789995528.091873 1227 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 79.253650] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 79.257239] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb # [ 79.257631] niks3-server[1069]: 2026/09/21 12:58:48 INFO lead: acquired remote=192.168.1.3:38974 worker1 # [ 79.265070] nix-grpc-daemon[1227]: E0000 00:00:1789995528.107172 1268 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 79.268069] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=scheduler_take_over worker1 # [ 79.277171] nix-grpc-daemon[1227]: E0000 00:00:1789995528.120547 1268 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 79.281155] nix-grpc-daemon[1227]: E0000 00:00:1789995528.122821 1268 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 79.291241] nix-grpc-daemon[1227]: E0000 00:00:1789995528.134577 1268 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 79.301097] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.302740] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 79.422080] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.425895] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.504245] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.508414] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.626824] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.630655] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.709788] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.713786] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.831791] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.835637] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.914752] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 79.922912] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:49580 worker1 # [ 79.926926] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 80.037566] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.024841] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 80.028913] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:49580 worker1 # [ 80.033317] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:48Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.16 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 8.32 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb # [ 80.562403] niks3-server[1069]: 2026/09/21 12:58:49 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 80.566274] systemd[1]: Stopping niks3 server... lb # [ 80.566985] niks3-server[1069]: 2026/09/21 12:58:49 INFO lead: released remote=192.168.1.3:38974 worker2 # [ 80.595514] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:49Z level=info event=scheduler_lock_lost status=200 worker1 # [ 80.569975] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:49Z level=info event=scheduler_lock_lost status=200 lb # [ 80.576804] systemd[1]: niks3.service: Deactivated successfully. lb # [ 80.578394] systemd[1]: Stopped niks3 server. lb # [ 80.579257] systemd[1]: niks3.service: Consumed 584ms CPU time over 49.536s wall clock time, 20.3M memory peak, 68.1K incoming IP traffic, 98.3K outgoing IP traffic. lb # [ 80.587750] systemd[1]: Starting niks3 server... lb # [ 80.655582] niks3-server[1174]: 2026/09/21 12:58:49 goose: no migrations to run. current version: 20260920000000 lb # [ 80.662152] niks3-server[1174]: 2026/09/21 12:58:49 OK 1_commit_pending_closure.sql (4.63ms) lb # [ 80.665781] niks3-server[1174]: 2026/09/21 12:58:49 OK 2_object_stats_trigger.sql (3.24ms) lb # [ 80.666973] niks3-server[1174]: 2026/09/21 12:58:49 goose: up to current file version: 2 lb # [ 80.668757] niks3-server[1174]: 2026/09/21 12:58:49 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key lb # [ 80.680848] niks3-server[1174]: 2026/09/21 12:58:49 INFO Read proxy enabled — serving cache objects from S3 lb # [ 80.682420] niks3-server[1174]: 2026/09/21 12:58:49 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 80.684723] niks3-server[1174]: 2026/09/21 12:58:49 INFO systemd watchdog enabled interval=15s lb # [ 80.686041] niks3-server[1174]: 2026/09/21 12:58:49 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 80.687238] systemd[1]: Started niks3 server. lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb # [ 80.871079] niks3-server[1174]: 2026/09/21 12:58:49 INFO lead: acquired remote=192.168.1.3:38988 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart >&2 worker2 # [ 81.316638] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56370 client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker1 # [ 81.303451] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 81.316416] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) worker1 # [ 81.333908] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 1/5) worker1 # [ 81.373698] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5) worker1 # [ 81.464655] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 361 ms (attempt 3/5) worker1 # [ 81.832569] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 169 ms (attempt 4/5) worker1 # [ 82.002356] nix-grpc-daemon[1227]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 82.005346] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 82.046348] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:50Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker1 # [ 82.051377] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:50Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 82.096270] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 82.110560] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49590 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker1 # [ 82.124168] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 82.134365] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) worker1 # [ 82.156461] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:50Z level=info event=niks3_push_started pid=1299 worker1 # [ 82.376098] nix-grpc-daemon[1299]: time=2026-09-21T12:58:51.218Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 82.558095] nix-daemon[849]: accepted connection from pid 1312, user nix-grpc-daemon (trusted) worker1 # [ 82.570265] nix-daemon[849]: reaped child process 1315, status = succeeded worker1 # [ 82.752145] nix-daemon[849]: accepted connection from pid 1317, user nix-grpc-daemon (trusted) worker1 # [ 82.765669] nix-daemon[849]: reaped child process 1320, status = succeeded lb # [ 82.780666] niks3-server[1174]: 2026/09/21 12:58:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 82.798698] nix-grpc-daemon[1299]: time=2026-09-21T12:58:51.642Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 82.802131] nix-grpc-daemon[1299]: time=2026-09-21T12:58:51.643Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 82.833848] niks3-server[1174]: 2026/09/21 12:58:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 82.843691] niks3-server[1174]: 2026/09/21 12:58:51 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 82.865772] niks3-server[1174]: 2026/09/21 12:58:51 INFO Signed narinfos id=27 count=1 worker1 # [ 82.871926] nix-grpc-daemon[1299]: time=2026-09-21T12:58:51.714Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.876893] niks3-server[1174]: 2026/09/21 12:58:51 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 82.878844] niks3-server[1174]: 2026/09/21 12:58:51 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 82.885139] niks3-server[1174]: 2026/09/21 12:58:51 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo lb # [ 82.888944] niks3-server[1174]: 2026/09/21 12:58:51 INFO Completed upload id=27 worker1 # [ 82.892584] nix-grpc-daemon[1299]: time=2026-09-21T12:58:51.735Z level=INFO msg="Upload complete. (512ms)" worker1 # [ 82.897767] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49590 duration_s=0 paths=1 nar_bytes_in=536 worker1 # [ 82.904951] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 82.917116] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) worker1 # [ 82.927317] nix-daemon[849]: reaped child process 1297, status = succeeded worker1 # [ 82.933601] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> node-a: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker1 # [ 84.348164] nix-daemon[849]: reaped child process 1324, status = succeeded worker1 # [ 84.512902] nix-daemon[849]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker1 # [ 84.526622] nix-daemon[849]: reaped child process 1343, status = succeeded lb # [ 84.541693] niks3-server[1174]: 2026/09/21 12:58:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 84.557393] nix-grpc-daemon[1299]: time=2026-09-21T12:58:53.400Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 84.558939] nix-grpc-daemon[1299]: time=2026-09-21T12:58:53.402Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 84.581751] niks3-server[1174]: 2026/09/21 12:58:53 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 84.593482] niks3-server[1174]: 2026/09/21 12:58:53 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 84.605747] niks3-server[1174]: 2026/09/21 12:58:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 84.610104] niks3-server[1174]: 2026/09/21 12:58:53 INFO Signed narinfos id=28 count=1 worker1 # [ 84.614158] nix-grpc-daemon[1299]: time=2026-09-21T12:58:53.456Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.615448] niks3-server[1174]: 2026/09/21 12:58:53 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 84.623891] niks3-server[1174]: 2026/09/21 12:58:53 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 84.627748] niks3-server[1174]: 2026/09/21 12:58:53 INFO Completed upload id=28 worker1 # [ 84.631241] nix-grpc-daemon[1299]: time=2026-09-21T12:58:53.474Z level=INFO msg="Upload complete. (290ms)" lb # [ 84.630114] niks3-server[1174]: 2026/09/21 12:58:53 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker1 # [ 84.641759] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49590 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker1 # [ 84.656275] nix-daemon[849]: reaped child process 1322, status = succeeded worker1 # [ 84.659117] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:53Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker1 # [ 84.660965] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:53Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 84.706181] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 84.719819] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 84.734334] nix-grpc-daemon[1299]: time=2026-09-21T12:58:53.577Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker1 # [ 84.742609] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 84.753300] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) worker1 # [ 84.943973] nix-daemon[849]: accepted connection from pid 1349, user nix-grpc-daemon (trusted) worker1 # [ 84.958060] nix-daemon[849]: reaped child process 1352, status = succeeded worker1 # [ 85.137923] nix-daemon[849]: accepted connection from pid 1354, user nix-grpc-daemon (trusted) worker1 # [ 85.152378] nix-daemon[849]: reaped child process 1357, status = succeeded lb # [ 85.165165] niks3-server[1174]: 2026/09/21 12:58:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 85.178457] nix-grpc-daemon[1299]: time=2026-09-21T12:58:54.021Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 85.180075] nix-grpc-daemon[1299]: time=2026-09-21T12:58:54.023Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 85.195572] niks3-server[1174]: 2026/09/21 12:58:54 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 85.205236] niks3-server[1174]: 2026/09/21 12:58:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 85.209489] niks3-server[1174]: 2026/09/21 12:58:54 INFO Signed narinfos id=29 count=1 worker1 # [ 85.215662] nix-grpc-daemon[1299]: time=2026-09-21T12:58:54.059Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.217606] niks3-server[1174]: 2026/09/21 12:58:54 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 85.229458] niks3-server[1174]: 2026/09/21 12:58:54 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 85.237494] niks3-server[1174]: 2026/09/21 12:58:54 INFO Completed upload id=29 worker1 # [ 85.240851] nix-grpc-daemon[1299]: time=2026-09-21T12:58:54.084Z level=INFO msg="Upload complete. (475ms)" lb # [ 85.240586] niks3-server[1174]: 2026/09/21 12:58:54 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker1 # [ 85.245307] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49590 duration_s=0 paths=1 nar_bytes_in=656 worker1 # [ 85.249990] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 85.260248] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) worker1 # [ 85.267136] nix-daemon[849]: reaped child process 1347, status = succeeded worker1 # [ 85.270973] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> node-a: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker1 # [ 86.098890] nix-daemon[849]: reaped child process 1361, status = succeeded worker1 # [ 86.285630] nix-daemon[849]: accepted connection from pid 1377, user nix-grpc-daemon (trusted) worker1 # [ 86.297796] nix-daemon[849]: reaped child process 1380, status = succeeded lb # [ 86.313120] niks3-server[1174]: 2026/09/21 12:58:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 86.325039] nix-grpc-daemon[1299]: time=2026-09-21T12:58:55.168Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 86.326608] nix-grpc-daemon[1299]: time=2026-09-21T12:58:55.170Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 86.354285] niks3-server[1174]: 2026/09/21 12:58:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 86.361687] niks3-server[1174]: 2026/09/21 12:58:55 INFO Signed narinfos id=30 count=1 worker1 # [ 86.368106] nix-grpc-daemon[1299]: time=2026-09-21T12:58:55.211Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.376153] niks3-server[1174]: 2026/09/21 12:58:55 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 86.381730] niks3-server[1174]: 2026/09/21 12:58:55 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 86.386107] niks3-server[1174]: 2026/09/21 12:58:55 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 86.392851] niks3-server[1174]: 2026/09/21 12:58:55 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 86.401701] niks3-server[1174]: 2026/09/21 12:58:55 INFO Completed upload id=30 lb # [ 86.403567] niks3-server[1174]: 2026/09/21 12:58:55 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker1 # [ 86.405319] nix-grpc-daemon[1299]: time=2026-09-21T12:58:55.248Z level=INFO msg="Upload complete. (327ms)" worker1 # [ 86.413861] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49590 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker1 # [ 86.425132] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:55Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker1 # [ 86.429213] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:55Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 86.438664] nix-daemon[849]: reaped child process 1359, status = succeeded worker1 # [ 86.468579] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 86.481726] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 86.495708] nix-grpc-daemon[1299]: time=2026-09-21T12:58:55.339Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker1 # [ 86.504754] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 86.513617] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) worker1 # [ 86.702232] nix-daemon[849]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker1 # [ 86.716367] nix-daemon[849]: reaped child process 1389, status = succeeded worker1 # [ 86.898192] nix-daemon[849]: accepted connection from pid 1391, user nix-grpc-daemon (trusted) worker1 # [ 86.912164] nix-daemon[849]: reaped child process 1394, status = succeeded lb # [ 86.924922] niks3-server[1174]: 2026/09/21 12:58:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 86.937242] nix-grpc-daemon[1299]: time=2026-09-21T12:58:55.780Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 86.938662] nix-grpc-daemon[1299]: time=2026-09-21T12:58:55.780Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 86.952309] niks3-server[1174]: 2026/09/21 12:58:55 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 86.959975] niks3-server[1174]: 2026/09/21 12:58:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker1 # [ 86.970720] nix-grpc-daemon[1299]: time=2026-09-21T12:58:55.813Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.967143] niks3-server[1174]: 2026/09/21 12:58:55 INFO Signed narinfos id=31 count=1 lb # [ 86.971631] niks3-server[1174]: 2026/09/21 12:58:55 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 86.984969] niks3-server[1174]: 2026/09/21 12:58:55 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 86.989460] niks3-server[1174]: 2026/09/21 12:58:55 INFO Completed upload id=31 worker1 # [ 86.995342] nix-grpc-daemon[1299]: time=2026-09-21T12:58:55.838Z level=INFO msg="Upload complete. (468ms)" lb # [ 86.992669] niks3-server[1174]: 2026/09/21 12:58:55 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker1 # [ 86.998265] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49590 duration_s=0 paths=1 nar_bytes_in=784 worker1 # [ 87.003296] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49590 worker1 # [ 87.012298] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) worker1 # [ 87.018416] nix-daemon[849]: reaped child process 1384, status = succeeded worker1 # [ 87.023841] nix-daemon[849]: accepted connection from pid 1227, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> node-a: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker1 # [ 88.252219] nix-daemon[849]: reaped child process 1398, status = succeeded lb # [ 88.356075] envoy[922]: conn peer=[2001:db8:1::1]:36774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1006 tx=305 ms=1021 worker1 # [ 88.438396] nix-daemon[849]: accepted connection from pid 1414, user nix-grpc-daemon (trusted) worker1 # [ 88.452484] nix-daemon[849]: reaped child process 1417, status = succeeded lb # [ 88.467462] niks3-server[1174]: 2026/09/21 12:58:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 88.479237] nix-grpc-daemon[1299]: time=2026-09-21T12:58:57.322Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 88.480759] nix-grpc-daemon[1299]: time=2026-09-21T12:58:57.324Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 88.505399] niks3-server[1174]: 2026/09/21 12:58:57 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 88.512516] niks3-server[1174]: 2026/09/21 12:58:57 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 88.524842] niks3-server[1174]: 2026/09/21 12:58:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker1 # [ 88.534745] nix-grpc-daemon[1299]: time=2026-09-21T12:58:57.377Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.531247] niks3-server[1174]: 2026/09/21 12:58:57 INFO Signed narinfos id=32 count=1 lb # [ 88.534531] niks3-server[1174]: 2026/09/21 12:58:57 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 88.544118] niks3-server[1174]: 2026/09/21 12:58:57 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 88.550484] niks3-server[1174]: 2026/09/21 12:58:57 INFO Completed upload id=32 worker1 # [ 88.553981] nix-grpc-daemon[1299]: time=2026-09-21T12:58:57.397Z level=INFO msg="Upload complete. (321ms)" lb # [ 88.552393] niks3-server[1174]: 2026/09/21 12:58:57 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker1 # [ 88.562225] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49590 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker1 # [ 88.575364] nix-daemon[849]: reaped child process 1396, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart >&2, in 7.59 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag after-niks3-restart outPath, in 0.23 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 8.42 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 89.117614] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 89.256107] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:58Z level=info event=signal_exit lb # [ 90.083915] niks3-server[1174]: 2026/09/21 12:58:58 INFO lead: released remote=192.168.1.3:38988 worker2 # [ 90.415649] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:59Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 90.393791] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:59Z level=info event=scheduler_restarting worker1 # [ 90.397601] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:59Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 90.400828] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:49580 worker1 # [ 90.404423] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:59Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 90.407714] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:49580 worker1 # [ 90.411740] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:59Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 90.427248] nix-daemon[849]: reaped child process 1289, status = succeeded worker2 # [ 90.615810] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.619850] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.604564] nix-grpc-daemon[1227]: ts=2026-09-21T12:58:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 90.821141] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.825097] nix-grpc-daemon[1109]: ts=2026-09-21T12:58:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.897652] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 90.900952] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 90.905308] systemd[1]: nix-grpc-daemon.service: Consumed 1.106s CPU time over 11.854s wall clock time, 35.2M memory peak, 36.6K incoming IP traffic, 59.7K outgoing IP traffic. worker1 # [ 90.915964] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 90.919331] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 90.922142] systemd[1]: nix-grpc-daemon.socket: Consumed 564us CPU time over 11.891s wall clock time, 256K memory peak, 34.7K incoming IP traffic, 25.5K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 91.025629] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.027281] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 91.228532] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.232460] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.434327] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.438090] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.639354] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.643268] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.844290] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.848259] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.049329] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.053261] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2 # [ 92.254088] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.257950] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.459677] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.463463] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.664592] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.668472] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.869673] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.873568] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.074601] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.078480] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2 # [ 93.279570] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.283453] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.485386] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.488855] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 93.573571] niks3-server[1174]: 2026/09/21 12:59:02 INFO lead: acquired remote=192.168.1.4:54210 worker2 # [ 93.606199] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_take_over worker2 # [ 93.689874] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.693785] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.894255] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.895951] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.097234] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.114137] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 94.118375] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:36696 worker2 # [ 94.122274] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 94.533858] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 94.539526] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 94.561281] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker2 # [ 94.565950] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 94.610349] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 94.622371] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56370 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker2 # [ 94.634466] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 94.645141] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 94.839828] nix-daemon[873]: accepted connection from pid 1214, user nix-grpc-daemon (trusted) worker2 # [ 94.851577] nix-daemon[873]: reaped child process 1217, status = succeeded worker2 # [ 95.042599] nix-daemon[873]: accepted connection from pid 1219, user nix-grpc-daemon (trusted) worker2 # [ 95.054111] nix-daemon[873]: reaped child process 1222, status = succeeded lb # [ 95.036776] niks3-server[1174]: 2026/09/21 12:59:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.075654] nix-grpc-daemon[1169]: time=2026-09-21T12:59:04.138Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 95.076990] nix-grpc-daemon[1169]: time=2026-09-21T12:59:04.138Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 95.062954] niks3-server[1174]: 2026/09/21 12:59:03 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 95.071910] niks3-server[1174]: 2026/09/21 12:59:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker2 # [ 95.109837] nix-grpc-daemon[1169]: time=2026-09-21T12:59:04.173Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.080193] niks3-server[1174]: 2026/09/21 12:59:03 INFO Signed narinfos id=33 count=1 lb # [ 95.093233] niks3-server[1174]: 2026/09/21 12:59:04 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 95.096759] niks3-server[1174]: 2026/09/21 12:59:04 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 95.104217] niks3-server[1174]: 2026/09/21 12:59:04 INFO Completed upload id=33 worker2 # [ 95.136175] nix-grpc-daemon[1169]: time=2026-09-21T12:59:04.199Z level=INFO msg="Upload complete. (479ms)" lb # [ 95.107484] niks3-server[1174]: 2026/09/21 12:59:04 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker2 # [ 95.140325] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 95.144847] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 95.154261] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 95.156989] nix-daemon[873]: reaped child process 1212, status = succeeded worker2 # [ 95.162117] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 95.989822] nix-daemon[873]: reaped child process 1226, status = succeeded worker2 # [ 96.142809] nix-daemon[873]: accepted connection from pid 1242, user nix-grpc-daemon (trusted) worker2 # [ 96.154633] nix-daemon[873]: reaped child process 1245, status = succeeded lb # [ 96.142548] niks3-server[1174]: 2026/09/21 12:59:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 96.180312] nix-grpc-daemon[1169]: time=2026-09-21T12:59:05.243Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 96.181965] nix-grpc-daemon[1169]: time=2026-09-21T12:59:05.245Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 96.177580] niks3-server[1174]: 2026/09/21 12:59:05 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 96.186630] niks3-server[1174]: 2026/09/21 12:59:05 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker2 # [ 96.226149] nix-grpc-daemon[1169]: time=2026-09-21T12:59:05.289Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.197154] niks3-server[1174]: 2026/09/21 12:59:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 96.200729] niks3-server[1174]: 2026/09/21 12:59:05 INFO Signed narinfos id=34 count=1 lb # [ 96.207270] niks3-server[1174]: 2026/09/21 12:59:05 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 96.216260] niks3-server[1174]: 2026/09/21 12:59:05 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 96.224108] niks3-server[1174]: 2026/09/21 12:59:05 INFO Completed upload id=34 worker2 # [ 96.253642] nix-grpc-daemon[1169]: time=2026-09-21T12:59:05.317Z level=INFO msg="Upload complete. (284ms)" lb # [ 96.226772] niks3-server[1174]: 2026/09/21 12:59:05 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker2 # [ 96.264235] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker2 # [ 96.273778] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:05Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker2 # [ 96.277458] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:05Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 96.286151] nix-daemon[873]: reaped child process 1224, status = succeeded worker2 # [ 96.318484] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 96.329870] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 96.408518] nix-grpc-daemon[1169]: time=2026-09-21T12:59:05.471Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker2 # [ 96.417226] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 96.427165] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 96.632650] nix-daemon[873]: accepted connection from pid 1251, user nix-grpc-daemon (trusted) worker2 # [ 96.644306] nix-daemon[873]: reaped child process 1254, status = succeeded worker2 # [ 96.831510] nix-daemon[873]: accepted connection from pid 1256, user nix-grpc-daemon (trusted) worker2 # [ 96.842905] nix-daemon[873]: reaped child process 1259, status = succeeded lb # [ 96.831380] niks3-server[1174]: 2026/09/21 12:59:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 96.869890] nix-grpc-daemon[1169]: time=2026-09-21T12:59:05.933Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 96.871475] nix-grpc-daemon[1169]: time=2026-09-21T12:59:05.934Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 96.861529] niks3-server[1174]: 2026/09/21 12:59:05 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 96.871235] niks3-server[1174]: 2026/09/21 12:59:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 96.876149] niks3-server[1174]: 2026/09/21 12:59:05 INFO Signed narinfos id=35 count=1 worker2 # [ 96.908540] nix-grpc-daemon[1169]: time=2026-09-21T12:59:05.971Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.882947] niks3-server[1174]: 2026/09/21 12:59:05 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 96.892466] niks3-server[1174]: 2026/09/21 12:59:05 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 96.899542] niks3-server[1174]: 2026/09/21 12:59:05 INFO Completed upload id=35 worker2 # [ 96.929173] nix-grpc-daemon[1169]: time=2026-09-21T12:59:05.992Z level=INFO msg="Upload complete. (489ms)" lb # [ 96.902160] niks3-server[1174]: 2026/09/21 12:59:05 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker2 # [ 96.933184] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 96.938204] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 96.947121] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 96.951877] nix-daemon[873]: reaped child process 1249, status = succeeded worker2 # [ 96.956797] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 97.779973] nix-daemon[873]: reaped child process 1263, status = succeeded worker2 # [ 97.932087] nix-daemon[873]: accepted connection from pid 1279, user nix-grpc-daemon (trusted) worker2 # [ 97.943048] nix-daemon[873]: reaped child process 1282, status = succeeded lb # [ 97.923732] niks3-server[1174]: 2026/09/21 12:59:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.961407] nix-grpc-daemon[1169]: time=2026-09-21T12:59:07.024Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 97.963392] nix-grpc-daemon[1169]: time=2026-09-21T12:59:07.026Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 97.959223] niks3-server[1174]: 2026/09/21 12:59:06 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 97.969850] niks3-server[1174]: 2026/09/21 12:59:06 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 97.975863] niks3-server[1174]: 2026/09/21 12:59:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 97.981062] niks3-server[1174]: 2026/09/21 12:59:06 INFO Signed narinfos id=36 count=1 worker2 # [ 98.013356] nix-grpc-daemon[1169]: time=2026-09-21T12:59:07.076Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.987530] niks3-server[1174]: 2026/09/21 12:59:06 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 97.996522] niks3-server[1174]: 2026/09/21 12:59:06 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 98.003207] niks3-server[1174]: 2026/09/21 12:59:06 INFO Completed upload id=36 worker2 # [ 98.032585] nix-grpc-daemon[1169]: time=2026-09-21T12:59:07.095Z level=INFO msg="Upload complete. (267ms)" lb # [ 98.006105] niks3-server[1174]: 2026/09/21 12:59:06 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker2 # [ 98.039335] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker2 # [ 98.049842] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:07Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker2 # [ 98.054229] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:07Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 98.062149] nix-daemon[873]: reaped child process 1261, status = succeeded worker2 # [ 98.093345] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 98.105508] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 98.118095] nix-grpc-daemon[1169]: time=2026-09-21T12:59:07.181Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker2 # [ 98.126278] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 98.134218] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 98.274112] nix-daemon[873]: accepted connection from pid 1288, user nix-grpc-daemon (trusted) worker2 # [ 98.285768] nix-daemon[873]: reaped child process 1291, status = succeeded lb # [ 98.356525] envoy[922]: conn peer=[2001:db8:1::1]:36786 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9726 tx=4120 ms=7281 lb # [ 98.360473] envoy[922]: conn peer=[2001:db8:1::3]:57882 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1726 tx=592 ms=11296 worker2 # [ 98.415954] nix-daemon[873]: accepted connection from pid 1293, user nix-grpc-daemon (trusted) worker2 # [ 98.427434] nix-daemon[873]: reaped child process 1296, status = succeeded lb # [ 98.408932] niks3-server[1174]: 2026/09/21 12:59:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.447442] nix-grpc-daemon[1169]: time=2026-09-21T12:59:07.510Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 98.448817] nix-grpc-daemon[1169]: time=2026-09-21T12:59:07.510Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 98.434227] niks3-server[1174]: 2026/09/21 12:59:07 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 98.447392] niks3-server[1174]: 2026/09/21 12:59:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 98.453553] niks3-server[1174]: 2026/09/21 12:59:07 INFO Signed narinfos id=37 count=1 worker2 # [ 98.485185] nix-grpc-daemon[1169]: time=2026-09-21T12:59:07.548Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.456963] niks3-server[1174]: 2026/09/21 12:59:07 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 98.466590] niks3-server[1174]: 2026/09/21 12:59:07 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 98.470589] niks3-server[1174]: 2026/09/21 12:59:07 INFO Completed upload id=37 worker2 # [ 98.501174] nix-grpc-daemon[1169]: time=2026-09-21T12:59:07.564Z level=INFO msg="Upload complete. (354ms)" lb # [ 98.472813] niks3-server[1174]: 2026/09/21 12:59:07 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker2 # [ 98.503032] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 98.506532] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 98.512277] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 98.515154] nix-daemon[873]: reaped child process 1286, status = succeeded client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 98.520078] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 99.946265] nix-daemon[873]: reaped child process 1300, status = succeeded worker2 # [ 100.111569] nix-daemon[873]: accepted connection from pid 1316, user nix-grpc-daemon (trusted) worker2 # [ 100.123224] nix-daemon[873]: reaped child process 1319, status = succeeded lb # [ 100.109784] niks3-server[1174]: 2026/09/21 12:59:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.146904] nix-grpc-daemon[1169]: time=2026-09-21T12:59:09.210Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 100.148355] nix-grpc-daemon[1169]: time=2026-09-21T12:59:09.211Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 100.144813] niks3-server[1174]: 2026/09/21 12:59:09 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 100.156895] niks3-server[1174]: 2026/09/21 12:59:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 100.161992] niks3-server[1174]: 2026/09/21 12:59:09 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls worker2 # [ 100.197723] nix-grpc-daemon[1169]: time=2026-09-21T12:59:09.261Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.168124] niks3-server[1174]: 2026/09/21 12:59:09 INFO Signed narinfos id=38 count=1 lb # [ 100.174872] niks3-server[1174]: 2026/09/21 12:59:09 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 100.184343] niks3-server[1174]: 2026/09/21 12:59:09 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 100.190463] niks3-server[1174]: 2026/09/21 12:59:09 INFO Completed upload id=38 worker2 # [ 100.220189] nix-grpc-daemon[1169]: time=2026-09-21T12:59:09.283Z level=INFO msg="Upload complete. (292ms)" lb # [ 100.192399] niks3-server[1174]: 2026/09/21 12:59:09 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker2 # [ 100.226069] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker2 # [ 100.237998] nix-daemon[873]: reaped child process 1298, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 5.96 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.17 seconds) worker1 # [ 100.475594] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 100.483719] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 100.663626] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 100.665538] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 100.669311] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 100.677065] nix-grpc-daemon[1435]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 100.679178] nix-grpc-daemon[1435]: E0000 00:00:1789995549.519789 1435 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 100.684042] nix-grpc-daemon[1435]: E0000 00:00:1789995549.524984 1435 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 100.687991] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 100.690922] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 100.697136] nix-grpc-daemon[1435]: E0000 00:00:1789995549.540569 1475 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 100.709327] nix-grpc-daemon[1435]: E0000 00:00:1789995549.552683 1475 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 100.713129] nix-grpc-daemon[1435]: E0000 00:00:1789995549.554878 1475 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 100.723443] nix-grpc-daemon[1435]: E0000 00:00:1789995549.566818 1475 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 100.734476] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 100.762386] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:09Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:36696 worker2 # [ 100.766233] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.16 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs client # [ 101.068474] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: df4080453e694b10a657e36e8054920b client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds) worker1 # [ 101.286621] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45970 worker1 # [ 101.295933] nix-daemon[849]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) client # [ 101.324667] nix[1202]: don't know how to build these paths: client # [ 101.325561] nix[1202]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 101.345884] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:10Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker2 # [ 101.349786] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:10Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 101.388434] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 101.400545] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56370 client # [ 101.398213] nix[1202]: copying 1 paths to 'lb:50051'... worker2 # [ 101.411665] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 client # [ 101.400350] nix[1202]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 101.423978] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 101.598943] nix-daemon[873]: accepted connection from pid 1332, user nix-grpc-daemon (trusted) worker2 # [ 101.610716] nix-daemon[873]: reaped child process 1335, status = succeeded worker2 # [ 101.767428] nix-daemon[873]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker2 # [ 101.778903] nix-daemon[873]: reaped child process 1340, status = succeeded lb # [ 101.761288] niks3-server[1174]: 2026/09/21 12:59:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.801063] nix-grpc-daemon[1169]: time=2026-09-21T12:59:10.864Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 101.802473] nix-grpc-daemon[1169]: time=2026-09-21T12:59:10.864Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 101.787537] niks3-server[1174]: 2026/09/21 12:59:10 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 101.799598] niks3-server[1174]: 2026/09/21 12:59:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 101.804737] niks3-server[1174]: 2026/09/21 12:59:10 INFO Signed narinfos id=39 count=1 worker2 # [ 101.836855] nix-grpc-daemon[1169]: time=2026-09-21T12:59:10.900Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.811731] niks3-server[1174]: 2026/09/21 12:59:10 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 101.822905] niks3-server[1174]: 2026/09/21 12:59:10 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 101.829476] niks3-server[1174]: 2026/09/21 12:59:10 INFO Completed upload id=39 worker2 # [ 101.859123] nix-grpc-daemon[1169]: time=2026-09-21T12:59:10.922Z level=INFO msg="Upload complete. (423ms)" lb # [ 101.832499] niks3-server[1174]: 2026/09/21 12:59:10 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker2 # [ 101.863147] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56370 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 101.868208] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 worker2 # [ 101.880155] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 101.882126] nix-daemon[873]: reaped child process 1330, status = succeeded client # [ 101.873652] nix[1202]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... worker2 # [ 101.886807] nix-daemon[873]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 103.975161] systemd-journald[287]: Received client request to rotate journal, rotating. worker1 # [ 103.993595] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ca8526a882954ca5a423ea0baee0d16a. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 103.930651] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 103.932460] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:12Z level=info event=draining worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds) client: must succeed: sleep 5.0 lb # [ 108.356907] envoy[922]: conn peer=[2001:db8:1::1]:35552 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9590 tx=4079 ms=5704 client: (finished: must succeed: sleep 5.0, in 5.04 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 109.307451] nix-daemon[873]: reaped child process 1344, status = succeeded worker2 # [ 109.456675] nix-daemon[873]: accepted connection from pid 1385, user nix-grpc-daemon (trusted) worker2 # [ 109.467255] nix-daemon[873]: reaped child process 1388, status = succeeded lb # [ 109.453685] niks3-server[1174]: 2026/09/21 12:59:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 109.493234] nix-grpc-daemon[1169]: time=2026-09-21T12:59:18.556Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 109.494817] nix-grpc-daemon[1169]: time=2026-09-21T12:59:18.558Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 109.491951] niks3-server[1174]: 2026/09/21 12:59:18 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 109.500156] niks3-server[1174]: 2026/09/21 12:59:18 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 109.511640] niks3-server[1174]: 2026/09/21 12:59:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker2 # [ 109.546514] nix-grpc-daemon[1169]: time=2026-09-21T12:59:18.609Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.517174] niks3-server[1174]: 2026/09/21 12:59:18 INFO Signed narinfos id=40 count=1 lb # [ 109.523261] niks3-server[1174]: 2026/09/21 12:59:18 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 109.532848] niks3-server[1174]: 2026/09/21 12:59:18 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 109.538824] niks3-server[1174]: 2026/09/21 12:59:18 INFO Completed upload id=40 lb # [ 109.541443] niks3-server[1174]: 2026/09/21 12:59:18 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker2 # [ 109.569999] nix-grpc-daemon[1169]: time=2026-09-21T12:59:18.633Z level=INFO msg="Upload complete. (269ms)" worker2 # [ 109.577899] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56370 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 109.591159] nix-daemon[873]: reaped child process 1342, status = succeeded client # [ 109.607426] systemd[1]: rs.service: Deactivated successfully. client # [ 109.611823] systemd[1]: rs.service: Consumed 126ms CPU time over 8.541s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. worker2 # [ 109.932500] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:18Z level=info event=signal_exit lb # [ 110.803862] niks3-server[1174]: 2026/09/21 12:59:19 INFO lead: released remote=192.168.1.4:54210 worker1 # [ 111.109736] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:19Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 111.136867] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:20Z level=info event=scheduler_restarting worker2 # [ 111.141847] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:20Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 111.144844] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36696 worker2 # [ 111.148828] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:20Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 111.151920] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36696 worker2 # [ 111.155339] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:20Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 111.173490] nix-daemon[873]: reaped child process 1161, status = succeeded worker1 # [ 111.310553] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.314676] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.348196] nix-grpc-daemon[1109]: ts=2026-09-21T12:59:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.20 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker1 # [ 111.515560] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.519597] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 111.720603] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.724667] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.925618] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.929611] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.996645] nix-grpc-daemon[1109]: E0000 00:00:1789995561.059946 1154 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 112.001452] nix-grpc-daemon[1109]: E0000 00:00:1789995561.060095 1154 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 112.132412] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.135557] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.333812] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.337806] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.538948] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.543231] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1 # [ 112.744853] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.748690] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.905825] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 112.909747] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 112.911917] systemd[1]: nix-grpc-daemon.service: Consumed 1.449s CPU time over 36.189s wall clock time, 35.1M memory peak, 62.3K incoming IP traffic, 162.9K outgoing IP traffic. worker2 # [ 112.927228] systemd[1]: Starting scheduler-token.service... worker1 # [ 112.946814] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.950905] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.005858] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 113.006922] systemd[1]: Finished scheduler-token.service. worker2 # [ 113.008327] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 79ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 113.013282] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 113.177712] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 113.180265] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 113.153548] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.183775] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 113.156696] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.191062] nix-grpc-daemon[1398]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 113.193096] nix-grpc-daemon[1398]: E0000 00:00:1789995562.254120 1398 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 113.197594] nix-grpc-daemon[1398]: E0000 00:00:1789995562.259267 1398 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 113.200729] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 113.202652] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 113.177655] niks3-server[1174]: 2026/09/21 12:59:22 INFO lead: acquired remote=192.168.1.4:55500 worker2 # [ 113.209066] nix-grpc-daemon[1398]: E0000 00:00:1789995562.271524 1440 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 113.212512] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=scheduler_take_over worker2 # [ 113.221455] nix-grpc-daemon[1398]: E0000 00:00:1789995562.284946 1440 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 113.226055] nix-grpc-daemon[1398]: E0000 00:00:1789995562.287142 1440 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 113.235430] nix-grpc-daemon[1398]: E0000 00:00:1789995562.298927 1440 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 113.244376] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.245900] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.354634] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.358786] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.447371] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.451149] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.559805] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.563914] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.652294] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.656163] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 113.764914] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.768979] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 113.857311] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.861236] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.970238] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.002339] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:23Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:58136 worker2 # [ 114.006495] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 114.062111] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.071132] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:23Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 114.075239] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:23Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:58136 worker2 # [ 114.079079] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.94 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid client # [ 115.007980] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 3e4594c5896a493c91d956088d40bc94 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds) client # [ 115.248039] nix[1238]: don't know how to build these paths: client # [ 115.249423] nix[1238]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 115.233381] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45970 worker2 # [ 115.271524] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:24Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 115.275944] nix-grpc-daemon[1398]: ts=2026-09-21T12:59:24Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 115.288913] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45970 worker1 # [ 115.301708] nix-grpc-daemon[1435]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 1/5) worker1 # [ 115.366544] nix-grpc-daemon[1435]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 2/5) worker1 # [ 115.407478] nix-grpc-daemon[1435]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 3/5) worker1 # [ 115.578755] nix-grpc-daemon[1435]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 4/5) worker1 # [ 115.765583] nix-grpc-daemon[1435]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 115.769395] nix-grpc-daemon[1435]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 115.787206] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45970 client # [ 115.810285] nix[1238]: copying 1 paths to 'lb:50051'... client # [ 115.813941] nix[1238]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 115.800552] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45970 worker1 # [ 115.812524] nix-daemon[849]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) worker1 # [ 115.833582] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:24Z level=info event=niks3_push_started pid=1549 worker1 # [ 116.057233] nix-grpc-daemon[1549]: time=2026-09-21T12:59:24.899Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 116.240607] nix-daemon[849]: accepted connection from pid 1562, user nix-grpc-daemon (trusted) worker1 # [ 116.254604] nix-daemon[849]: reaped child process 1569, status = succeeded worker1 # [ 116.435649] nix-daemon[849]: accepted connection from pid 1571, user nix-grpc-daemon (trusted) worker1 # [ 116.449080] nix-daemon[849]: reaped child process 1574, status = succeeded lb # [ 116.462311] niks3-server[1174]: 2026/09/21 12:59:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 116.473555] nix-grpc-daemon[1549]: time=2026-09-21T12:59:25.316Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 116.475139] nix-grpc-daemon[1549]: time=2026-09-21T12:59:25.318Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 116.494576] niks3-server[1174]: 2026/09/21 12:59:25 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 116.501796] niks3-server[1174]: 2026/09/21 12:59:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 116.507230] niks3-server[1174]: 2026/09/21 12:59:25 INFO Signed narinfos id=41 count=1 worker1 # [ 116.513636] nix-grpc-daemon[1549]: time=2026-09-21T12:59:25.356Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.519495] niks3-server[1174]: 2026/09/21 12:59:25 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 116.528087] niks3-server[1174]: 2026/09/21 12:59:25 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete worker1 # [ 116.536120] nix-grpc-daemon[1549]: time=2026-09-21T12:59:25.379Z level=INFO msg="Upload complete. (475ms)" lb # [ 116.532752] niks3-server[1174]: 2026/09/21 12:59:25 INFO Completed upload id=41 worker1 # [ 116.538627] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45970 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 116.542664] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45970 worker1 # [ 116.547596] nix-daemon[849]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) lb # [ 116.548291] niks3-server[1174]: 2026/09/21 12:59:25 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 116.554083] nix-daemon[849]: reaped child process 1547, status = succeeded worker1 # [ 116.559197] nix-daemon[849]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) client # [ 116.573307] nix[1238]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb # [ 118.357414] envoy[922]: conn peer=[2001:db8:1::1]:35560 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2960 tx=1430 ms=8277 lb # [ 118.361179] envoy[922]: conn peer=[2001:db8:1::4]:36950 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=29248 tx=1697 ms=34372 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 118.827881] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1398 (nix-grpc-daemon) on client request. worker2 # [ 118.839662] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 118.815611] niks3-server[1174]: 2026/09/21 12:59:27 INFO lead: released remote=192.168.1.4:55500 client # [ 118.842127] nix[1238]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 118.827894] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:27Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))" worker2 # [ 118.861434] systemd[1]: Starting scheduler-token.service... worker2 # [ 118.869542] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 118.871585] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 118.874228] systemd[1]: nix-grpc-daemon.service: Consumed 153ms CPU time over 5.856s wall clock time, 13.3M memory peak, 10.1K incoming IP traffic, 16.8K outgoing IP traffic. worker2 # [ 118.932099] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 118.933203] systemd[1]: Finished scheduler-token.service. worker2 # [ 118.934919] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 71ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 118.937073] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 118.941492] systemd[1]: Starting scheduler-token.service... worker2 # [ 119.002834] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 119.003917] systemd[1]: Finished scheduler-token.service. worker2 # [ 119.005295] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 61ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 119.010317] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 119.028164] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.157313] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 119.159257] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 119.162938] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 119.170066] nix-grpc-daemon[1488]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 119.172095] nix-grpc-daemon[1488]: E0000 00:00:1789995568.233101 1488 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 119.177746] nix-grpc-daemon[1488]: E0000 00:00:1789995568.238554 1488 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 119.182725] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 119.186134] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 119.191528] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=scheduler_take_over worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.40 seconds) client: must succeed: sleep 5.0 lb # [ 119.163219] niks3-server[1174]: 2026/09/21 12:59:28 INFO lead: acquired remote=192.168.1.4:55520 worker2 # [ 119.195063] nix-grpc-daemon[1488]: E0000 00:00:1789995568.258566 1529 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 119.200825] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:58170 worker2 # [ 119.206209] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=1 worker2 # [ 119.215599] nix-grpc-daemon[1488]: E0000 00:00:1789995568.279038 1529 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 119.220059] nix-grpc-daemon[1488]: E0000 00:00:1789995568.281532 1529 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 119.230356] nix-grpc-daemon[1488]: E0000 00:00:1789995568.293818 1529 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 119.239520] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.241145] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 119.344433] nix[1238]: scheduler at lb:50051: no healthy upstream, reconnecting worker2 # [ 119.442650] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.446503] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.646957] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.648774] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.849351] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.851858] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 120.052926] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 120.056809] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 120.260566] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 120.268175] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:29Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 120.272490] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:29Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:58170 worker2 # [ 120.276437] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 client: (finished: must succeed: sleep 5.0, in 5.05 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 124.595345] nix-daemon[849]: reaped child process 1578, status = succeeded worker1 # [ 124.778659] nix-daemon[849]: accepted connection from pid 1615, user nix-grpc-daemon (trusted) worker1 # [ 124.792260] nix-daemon[849]: reaped child process 1618, status = succeeded lb # [ 124.807593] niks3-server[1174]: 2026/09/21 12:59:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 124.820357] nix-grpc-daemon[1549]: time=2026-09-21T12:59:33.662Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 124.821707] nix-grpc-daemon[1549]: time=2026-09-21T12:59:33.662Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 124.844672] niks3-server[1174]: 2026/09/21 12:59:33 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 124.854152] niks3-server[1174]: 2026/09/21 12:59:33 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 124.863778] niks3-server[1174]: 2026/09/21 12:59:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker1 # [ 124.872200] nix-grpc-daemon[1549]: time=2026-09-21T12:59:33.714Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.868570] niks3-server[1174]: 2026/09/21 12:59:33 INFO Signed narinfos id=42 count=1 lb # [ 124.873701] niks3-server[1174]: 2026/09/21 12:59:33 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 124.883719] niks3-server[1174]: 2026/09/21 12:59:33 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 124.889153] niks3-server[1174]: 2026/09/21 12:59:33 INFO Completed upload id=42 worker1 # [ 124.892512] nix-grpc-daemon[1549]: time=2026-09-21T12:59:33.735Z level=INFO msg="Upload complete. (315ms)" worker1 # [ 124.897265] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45970 duration_s=8 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 lb # [ 124.900508] niks3-server[1174]: 2026/09/21 12:59:33 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 124.909850] nix-daemon[849]: reaped child process 1576, status = succeeded client # [ 124.951932] systemd[1]: mid.service: Deactivated successfully. client # [ 124.955497] systemd[1]: mid.service: Consumed 129ms CPU time over 9.946s wall clock time, 41.4M memory peak, 7.9K incoming IP traffic, 9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.68 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr client # [ 125.661975] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 6962470666764ca3a3c6f06e63472cc6 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds) worker1 # [ 125.854332] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45970 client # [ 125.874453] nix[1274]: don't know how to build these paths: client # [ 125.875352] nix[1274]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker2 # [ 125.898298] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:34Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker2 # [ 125.902881] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:34Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 125.943151] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 125.954287] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 125.970230] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5) worker2 # [ 126.065958] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 2/5) worker2 # [ 126.264888] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 118 ms (attempt 3/5) worker2 # [ 126.388705] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 258 ms (attempt 4/5) worker2 # [ 126.652708] nix-grpc-daemon[1488]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 126.656274] nix-grpc-daemon[1488]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 126.672803] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 client # [ 126.671128] nix[1274]: copying 1 paths to 'lb:50051'... client # [ 126.674180] nix[1274]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 126.687675] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 126.695577] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 126.715823] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:35Z level=info event=niks3_push_started pid=1562 worker2 # [ 126.874597] nix-grpc-daemon[1562]: time=2026-09-21T12:59:35.937Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker2.key ca="" worker2 # [ 127.012126] nix-daemon[873]: accepted connection from pid 1575, user nix-grpc-daemon (trusted) worker2 # [ 127.022449] nix-daemon[873]: reaped child process 1582, status = succeeded worker2 # [ 127.182637] nix-daemon[873]: accepted connection from pid 1584, user nix-grpc-daemon (trusted) worker2 # [ 127.194395] nix-daemon[873]: reaped child process 1587, status = succeeded lb # [ 127.183291] niks3-server[1174]: 2026/09/21 12:59:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 127.225659] nix-grpc-daemon[1562]: time=2026-09-21T12:59:36.288Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 127.227156] nix-grpc-daemon[1562]: time=2026-09-21T12:59:36.288Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 127.222597] niks3-server[1174]: 2026/09/21 12:59:36 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 127.229584] niks3-server[1174]: 2026/09/21 12:59:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 127.238355] niks3-server[1174]: 2026/09/21 12:59:36 INFO Signed narinfos id=43 count=1 worker2 # [ 127.271255] nix-grpc-daemon[1562]: time=2026-09-21T12:59:36.334Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.244707] niks3-server[1174]: 2026/09/21 12:59:36 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 127.255213] niks3-server[1174]: 2026/09/21 12:59:36 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 127.261817] niks3-server[1174]: 2026/09/21 12:59:36 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo lb # [ 127.264893] niks3-server[1174]: 2026/09/21 12:59:36 INFO Completed upload id=43 worker2 # [ 127.294596] nix-grpc-daemon[1562]: time=2026-09-21T12:59:36.358Z level=INFO msg="Upload complete. (416ms)" worker2 # [ 127.300514] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 127.305350] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 127.313479] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 127.319866] nix-daemon[873]: reaped child process 1560, status = succeeded worker2 # [ 127.324768] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) client # [ 127.312743] nix[1274]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... lb # [ 128.357972] envoy[922]: conn peer=[2001:db8:1::4]:52904 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4422 tx=385 ms=5613 lb # [ 128.361777] envoy[922]: conn peer=[2001:db8:1::1]:52912 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3135 tx=1589 ms=9677 client: must succeed: systemctl kill -s INT intr client # [ 129.237448] systemd[1]: intr.service: Sent signal SIGINT to main process 1274 (nix) on client request. worker2 # [ 129.251778] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:38Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 129.244556] nix[1274]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 129.250101] nix[1274]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.06 seconds) client # [ 129.291333] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 129.292780] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 129.294684] systemd[1]: intr.service: Consumed 117ms CPU time over 3.632s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.4K outgoing IP traffic. worker2 # [ 129.346266] nix-daemon[873]: reaped child process 1589, status = succeeded worker2 # [ 129.351515] nix-daemon[1591]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 129.356557] nix-daemon[873]: reaped child process 1591, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.74 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw client # [ 129.413644] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 11728fa6c2b1474e9164fa6b44b1d548 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.06 seconds) client # [ 129.632669] nix[1295]: don't know how to build these paths: client # [ 129.633566] nix[1295]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 129.616087] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45970 worker2 # [ 129.653273] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:38Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 129.657190] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:38Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 129.680501] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45970 worker1 # [ 129.694417] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45970 client # [ 129.719196] nix[1295]: copying 1 paths to 'lb:50051'... worker1 # [ 129.706913] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45970 client # [ 129.722161] nix[1295]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 129.721275] nix-daemon[849]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) worker1 # [ 129.930236] nix-daemon[849]: accepted connection from pid 1646, user nix-grpc-daemon (trusted) worker1 # [ 129.944649] nix-daemon[849]: reaped child process 1649, status = succeeded worker1 # [ 130.144134] nix-daemon[849]: accepted connection from pid 1651, user nix-grpc-daemon (trusted) worker1 # [ 130.158303] nix-daemon[849]: reaped child process 1654, status = succeeded lb # [ 130.174346] niks3-server[1174]: 2026/09/21 12:59:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 130.187644] nix-grpc-daemon[1549]: time=2026-09-21T12:59:39.030Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 130.189250] nix-grpc-daemon[1549]: time=2026-09-21T12:59:39.032Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 130.206165] niks3-server[1174]: 2026/09/21 12:59:39 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 130.219679] niks3-server[1174]: 2026/09/21 12:59:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 130.225831] niks3-server[1174]: 2026/09/21 12:59:39 INFO Signed narinfos id=44 count=1 worker1 # [ 130.232103] nix-grpc-daemon[1549]: time=2026-09-21T12:59:39.075Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.229280] niks3-server[1174]: 2026/09/21 12:59:39 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 130.242670] niks3-server[1174]: 2026/09/21 12:59:39 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 130.248218] niks3-server[1174]: 2026/09/21 12:59:39 INFO Completed upload id=44 worker1 # [ 130.251517] nix-grpc-daemon[1549]: time=2026-09-21T12:59:39.094Z level=INFO msg="Upload complete. (516ms)" lb # [ 130.252557] niks3-server[1174]: 2026/09/21 12:59:39 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 130.255458] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45970 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 130.261138] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45970 worker1 # [ 130.269504] nix-daemon[849]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) worker1 # [ 130.277369] nix-daemon[849]: reaped child process 1644, status = succeeded worker1 # [ 130.282559] nix-daemon[849]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) client # [ 130.295982] nix[1295]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 133.117302] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 133.166071] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.09 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2 worker1 # [ 133.473301] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45970 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 133.507589] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 133.529464] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:42Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker2 # [ 133.534614] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:42Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 133.579222] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 133.591257] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 client # copying 1 paths to 'lb:50051'... worker2 # [ 133.603503] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 133.624198] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker1 # [ 133.702052] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:42Z level=info event=draining worker2 # [ 133.809114] nix-daemon[873]: accepted connection from pid 1646, user nix-grpc-daemon (trusted) worker2 # [ 133.820583] nix-daemon[873]: reaped child process 1649, status = succeeded worker2 # [ 133.996113] nix-daemon[873]: accepted connection from pid 1651, user nix-grpc-daemon (trusted) worker2 # [ 134.008111] nix-daemon[873]: reaped child process 1654, status = succeeded lb # [ 133.997684] niks3-server[1174]: 2026/09/21 12:59:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 134.037252] nix-grpc-daemon[1562]: time=2026-09-21T12:59:43.100Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 134.038870] nix-grpc-daemon[1562]: time=2026-09-21T12:59:43.100Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 134.023156] niks3-server[1174]: 2026/09/21 12:59:42 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 134.035431] niks3-server[1174]: 2026/09/21 12:59:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 134.040486] niks3-server[1174]: 2026/09/21 12:59:42 INFO Signed narinfos id=45 count=1 worker2 # [ 134.072957] nix-grpc-daemon[1562]: time=2026-09-21T12:59:43.136Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.047899] niks3-server[1174]: 2026/09/21 12:59:42 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 134.053055] niks3-server[1174]: 2026/09/21 12:59:42 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 134.057248] niks3-server[1174]: 2026/09/21 12:59:42 INFO Completed upload id=45 worker2 # [ 134.086671] nix-grpc-daemon[1562]: time=2026-09-21T12:59:43.150Z level=INFO msg="Upload complete. (451ms)" lb # [ 134.058897] niks3-server[1174]: 2026/09/21 12:59:42 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 134.089473] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 134.094456] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 134.102949] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 134.105241] nix-daemon[873]: reaped child process 1644, status = succeeded worker2 # [ 134.110561] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 135.324743] nix-daemon[873]: reaped child process 1658, status = succeeded worker2 # [ 135.474920] nix-daemon[873]: accepted connection from pid 1674, user nix-grpc-daemon (trusted) worker2 # [ 135.486857] nix-daemon[873]: reaped child process 1677, status = succeeded lb # [ 135.474221] niks3-server[1174]: 2026/09/21 12:59:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 135.512663] nix-grpc-daemon[1562]: time=2026-09-21T12:59:44.575Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 135.514316] nix-grpc-daemon[1562]: time=2026-09-21T12:59:44.577Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 135.519833] niks3-server[1174]: 2026/09/21 12:59:44 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 135.527413] niks3-server[1174]: 2026/09/21 12:59:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 135.535385] niks3-server[1174]: 2026/09/21 12:59:44 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 135.542389] niks3-server[1174]: 2026/09/21 12:59:44 INFO Signed narinfos id=46 count=1 worker2 # [ 135.572220] nix-grpc-daemon[1562]: time=2026-09-21T12:59:44.635Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.556785] niks3-server[1174]: 2026/09/21 12:59:44 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 135.562214] niks3-server[1174]: 2026/09/21 12:59:44 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 135.565110] niks3-server[1174]: 2026/09/21 12:59:44 INFO Completed upload id=46 worker2 # [ 135.594806] nix-grpc-daemon[1562]: time=2026-09-21T12:59:44.658Z level=INFO msg="Upload complete. (276ms)" lb # [ 135.567324] niks3-server[1174]: 2026/09/21 12:59:44 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 135.602634] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=1 worker2 # [ 135.612613] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:44Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 135.616453] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:44Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 135.625088] nix-daemon[873]: reaped child process 1656, status = succeeded worker2 # [ 135.657335] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 135.669873] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 135.684814] nix-grpc-daemon[1562]: time=2026-09-21T12:59:44.748Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 135.693248] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 135.712145] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 135.888751] nix-daemon[873]: accepted connection from pid 1683, user nix-grpc-daemon (trusted) worker2 # [ 135.901269] nix-daemon[873]: reaped child process 1686, status = succeeded worker2 # [ 136.071215] nix-daemon[873]: accepted connection from pid 1688, user nix-grpc-daemon (trusted) worker2 # [ 136.082817] nix-daemon[873]: reaped child process 1691, status = succeeded lb # [ 136.071153] niks3-server[1174]: 2026/09/21 12:59:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.108633] nix-grpc-daemon[1562]: time=2026-09-21T12:59:45.172Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 136.110768] nix-grpc-daemon[1562]: time=2026-09-21T12:59:45.173Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 136.099559] niks3-server[1174]: 2026/09/21 12:59:45 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 136.109364] niks3-server[1174]: 2026/09/21 12:59:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 136.113625] niks3-server[1174]: 2026/09/21 12:59:45 INFO Signed narinfos id=47 count=1 worker2 # [ 136.146187] nix-grpc-daemon[1562]: time=2026-09-21T12:59:45.209Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.133291] niks3-server[1174]: 2026/09/21 12:59:45 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 136.136259] niks3-server[1174]: 2026/09/21 12:59:45 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 136.140496] niks3-server[1174]: 2026/09/21 12:59:45 INFO Completed upload id=47 worker2 # [ 136.170196] nix-grpc-daemon[1562]: time=2026-09-21T12:59:45.233Z level=INFO msg="Upload complete. (446ms)" lb # [ 136.142176] niks3-server[1174]: 2026/09/21 12:59:45 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 136.175147] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 136.179666] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 136.187957] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 136.192943] nix-daemon[873]: reaped child process 1681, status = succeeded worker2 # [ 136.197761] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 137.622665] nix-daemon[873]: reaped child process 1695, status = succeeded worker2 # [ 137.788167] nix-daemon[873]: accepted connection from pid 1711, user nix-grpc-daemon (trusted) worker2 # [ 137.799981] nix-daemon[873]: reaped child process 1714, status = succeeded lb # [ 137.789376] niks3-server[1174]: 2026/09/21 12:59:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.830735] nix-grpc-daemon[1562]: time=2026-09-21T12:59:46.894Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 137.832795] nix-grpc-daemon[1562]: time=2026-09-21T12:59:46.895Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 137.830724] niks3-server[1174]: 2026/09/21 12:59:46 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 137.837694] niks3-server[1174]: 2026/09/21 12:59:46 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 137.851259] niks3-server[1174]: 2026/09/21 12:59:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 137.856509] niks3-server[1174]: 2026/09/21 12:59:46 INFO Signed narinfos id=48 count=1 worker2 # [ 137.889825] nix-grpc-daemon[1562]: time=2026-09-21T12:59:46.952Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.861653] niks3-server[1174]: 2026/09/21 12:59:46 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 137.872220] niks3-server[1174]: 2026/09/21 12:59:46 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 137.878721] niks3-server[1174]: 2026/09/21 12:59:46 INFO Completed upload id=48 worker2 # [ 137.908338] nix-grpc-daemon[1562]: time=2026-09-21T12:59:46.971Z level=INFO msg="Upload complete. (302ms)" lb # [ 137.881112] niks3-server[1174]: 2026/09/21 12:59:46 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 137.915933] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=1 worker2 # [ 137.927102] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:46Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker2 # [ 137.932251] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:46Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 137.941053] nix-daemon[873]: reaped child process 1693, status = succeeded worker2 # [ 137.970080] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 137.982661] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 137.995201] nix-grpc-daemon[1562]: time=2026-09-21T12:59:47.058Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 138.003522] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 138.023162] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 138.199570] nix-daemon[873]: accepted connection from pid 1720, user nix-grpc-daemon (trusted) worker2 # [ 138.211500] nix-daemon[873]: reaped child process 1723, status = succeeded worker2 # [ 138.381885] nix-daemon[873]: accepted connection from pid 1725, user nix-grpc-daemon (trusted) lb # [ 138.357896] envoy[922]: conn peer=[2001:db8:1::1]:44268 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2993 tx=829 ms=3392 worker2 # [ 138.393630] nix-daemon[873]: reaped child process 1728, status = succeeded lb # [ 138.381378] niks3-server[1174]: 2026/09/21 12:59:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 138.418308] nix-grpc-daemon[1562]: time=2026-09-21T12:59:47.481Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 138.419901] nix-grpc-daemon[1562]: time=2026-09-21T12:59:47.483Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 138.409103] niks3-server[1174]: 2026/09/21 12:59:47 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 138.420740] niks3-server[1174]: 2026/09/21 12:59:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker2 # [ 138.455213] nix-grpc-daemon[1562]: time=2026-09-21T12:59:47.518Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.426123] niks3-server[1174]: 2026/09/21 12:59:47 INFO Signed narinfos id=49 count=1 lb # [ 138.432170] niks3-server[1174]: 2026/09/21 12:59:47 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 138.441335] niks3-server[1174]: 2026/09/21 12:59:47 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 138.447389] niks3-server[1174]: 2026/09/21 12:59:47 INFO Completed upload id=49 worker2 # [ 138.476960] nix-grpc-daemon[1562]: time=2026-09-21T12:59:47.540Z level=INFO msg="Upload complete. (441ms)" lb # [ 138.452175] niks3-server[1174]: 2026/09/21 12:59:47 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 138.481128] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 138.485921] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 138.496103] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 138.499389] nix-daemon[873]: reaped child process 1718, status = succeeded worker2 # [ 138.504483] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 139.528728] nix-daemon[873]: reaped child process 1732, status = succeeded worker2 # [ 139.698347] nix-daemon[873]: accepted connection from pid 1748, user nix-grpc-daemon (trusted) worker2 # [ 139.710250] nix-daemon[873]: reaped child process 1751, status = succeeded lb # [ 139.698922] niks3-server[1174]: 2026/09/21 12:59:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 139.737788] nix-grpc-daemon[1562]: time=2026-09-21T12:59:48.801Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 139.739619] nix-grpc-daemon[1562]: time=2026-09-21T12:59:48.802Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 139.734794] niks3-server[1174]: 2026/09/21 12:59:48 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 139.741954] niks3-server[1174]: 2026/09/21 12:59:48 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 139.753217] niks3-server[1174]: 2026/09/21 12:59:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 139.759052] niks3-server[1174]: 2026/09/21 12:59:48 INFO Signed narinfos id=50 count=1 worker2 # [ 139.791052] nix-grpc-daemon[1562]: time=2026-09-21T12:59:48.854Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.762767] niks3-server[1174]: 2026/09/21 12:59:48 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 139.767362] niks3-server[1174]: 2026/09/21 12:59:48 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 139.771038] niks3-server[1174]: 2026/09/21 12:59:48 INFO Completed upload id=50 lb # [ 139.772880] niks3-server[1174]: 2026/09/21 12:59:48 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 139.801993] nix-grpc-daemon[1562]: time=2026-09-21T12:59:48.865Z level=INFO msg="Upload complete. (290ms)" worker2 # [ 139.808414] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=1 worker2 # [ 139.819120] nix-daemon[873]: reaped child process 1730, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.61 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.22 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 140.321856] nix-daemon[849]: reaped child process 1658, status = succeeded worker1 # [ 140.515102] nix-daemon[849]: accepted connection from pid 1704, user nix-grpc-daemon (trusted) worker1 # [ 140.527607] nix-daemon[849]: reaped child process 1707, status = succeeded lb # [ 140.544417] niks3-server[1174]: 2026/09/21 12:59:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 140.556393] nix-grpc-daemon[1549]: time=2026-09-21T12:59:49.399Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 140.558734] nix-grpc-daemon[1549]: time=2026-09-21T12:59:49.401Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 140.576787] niks3-server[1174]: 2026/09/21 12:59:49 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 140.588139] niks3-server[1174]: 2026/09/21 12:59:49 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 140.598109] niks3-server[1174]: 2026/09/21 12:59:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 140.606049] nix-grpc-daemon[1549]: time=2026-09-21T12:59:49.449Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.603070] niks3-server[1174]: 2026/09/21 12:59:49 INFO Signed narinfos id=51 count=1 lb # [ 140.608472] niks3-server[1174]: 2026/09/21 12:59:49 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 140.617245] niks3-server[1174]: 2026/09/21 12:59:49 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 140.622096] niks3-server[1174]: 2026/09/21 12:59:49 INFO Completed upload id=51 worker1 # [ 140.626982] nix-grpc-daemon[1549]: time=2026-09-21T12:59:49.470Z level=INFO msg="Upload complete. (325ms)" lb # [ 140.625298] niks3-server[1174]: 2026/09/21 12:59:49 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 140.633681] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45970 duration_s=10 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=1 worker1 # [ 140.647271] nix-daemon[849]: reaped child process 1656, status = succeeded client # [ 140.687482] systemd[1]: sw.service: Deactivated successfully. client # [ 140.691748] systemd[1]: sw.service: Consumed 122ms CPU time over 11.275s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 140.704956] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:49Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.10 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 143.967779] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:58170 worker2 # [ 143.971904] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:53Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 143.942803] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:52Z level=info event=scheduler_restarting worker1 # [ 143.956395] nix-grpc-daemon[1435]: ts=2026-09-21T12:59:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 143.974206] nix-daemon[849]: reaped child process 1494, status = succeeded worker1 # [ 144.024961] nix-grpc-daemon[1435]: E0000 00:00:1789995592.868153 1480 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 144.029839] nix-grpc-daemon[1435]: E0000 00:00:1789995592.868295 1480 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 145.086747] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 145.090694] systemd[1]: nix-grpc-daemon.service: Consumed 1.003s CPU time over 44.603s wall clock time, 33.1M memory peak, 27.3K incoming IP traffic, 40.9K outgoing IP traffic. worker1 # [ 145.107519] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 145.297885] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 145.300295] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 145.304408] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 145.312065] nix-grpc-daemon[1721]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 145.314186] nix-grpc-daemon[1721]: E0000 00:00:1789995594.155136 1721 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 145.318110] nix-grpc-daemon[1721]: E0000 00:00:1789995594.160306 1721 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 145.320570] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 145.326208] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 145.333077] nix-grpc-daemon[1721]: E0000 00:00:1789995594.175319 1761 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 4.10 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 145.347127] nix-grpc-daemon[1721]: E0000 00:00:1789995594.188813 1761 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 145.350156] nix-grpc-daemon[1721]: E0000 00:00:1789995594.188961 1761 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 145.360055] nix-grpc-daemon[1721]: E0000 00:00:1789995594.203439 1761 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 145.370820] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.400355] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:54Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:58170 worker2 # [ 145.404598] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.16 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.25 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 146.881216] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 146.885320] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 146.920661] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:55Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 146.922516] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:55Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 146.924392] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:55Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 146.925959] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:55Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 146.943728] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 146.955865] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 146.973870] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 1/5) worker1 # [ 147.067985] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 2/5) worker1 # [ 147.173780] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 258 ms (attempt 3/5) worker1 # [ 147.437806] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 346 ms (attempt 4/5) worker1 # [ 147.790059] nix-grpc-daemon[1721]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 147.794167] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 147.811534] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 147.824706] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 147.833461] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 147.857456] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:56Z level=info event=niks3_push_started pid=1781 worker1 # [ 148.091555] nix-grpc-daemon[1781]: time=2026-09-21T12:59:56.934Z level=INFO msg="Configuring client TLS" cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.pem key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/worker1.key ca="" worker1 # [ 148.290828] nix-daemon[849]: accepted connection from pid 1794, user nix-grpc-daemon (trusted) worker1 # [ 148.303221] nix-daemon[849]: reaped child process 1797, status = succeeded lb # [ 148.358417] envoy[922]: conn peer=[2001:db8:1::1]:56786 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9585 tx=4066 ms=6324 lb # [ 148.362268] envoy[922]: conn peer=[2001:db8:1::1]:44270 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2975 tx=1405 ms=11030 lb # [ 148.365932] envoy[922]: conn peer=[2001:db8:1::3]:34528 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4007 tx=901 ms=43213 worker1 # [ 148.508381] nix-daemon[849]: accepted connection from pid 1799, user nix-grpc-daemon (trusted) worker1 # [ 148.522115] nix-daemon[849]: reaped child process 1802, status = succeeded lb # [ 148.541115] niks3-server[1174]: 2026/09/21 12:59:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.552639] nix-grpc-daemon[1781]: time=2026-09-21T12:59:57.396Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.555995] nix-grpc-daemon[1781]: time=2026-09-21T12:59:57.397Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 148.572172] niks3-server[1174]: 2026/09/21 12:59:57 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 148.581828] niks3-server[1174]: 2026/09/21 12:59:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 148.586618] niks3-server[1174]: 2026/09/21 12:59:57 INFO Signed narinfos id=52 count=1 worker1 # [ 148.592991] nix-grpc-daemon[1781]: time=2026-09-21T12:59:57.436Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.601571] niks3-server[1174]: 2026/09/21 12:59:57 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 148.605489] niks3-server[1174]: 2026/09/21 12:59:57 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete worker1 # [ 148.615299] nix-grpc-daemon[1781]: time=2026-09-21T12:59:57.458Z level=INFO msg="Upload complete. (519ms)" lb # [ 148.612181] niks3-server[1174]: 2026/09/21 12:59:57 INFO Completed upload id=52 worker1 # [ 148.617783] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 148.621653] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 lb # [ 148.618107] niks3-server[1174]: 2026/09/21 12:59:57 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 148.629417] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 148.632173] nix-daemon[849]: reaped child process 1779, status = succeeded worker1 # [ 148.637469] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 149.461409] nix-daemon[849]: reaped child process 1806, status = succeeded worker1 # [ 149.647863] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 149.660282] nix-daemon[849]: reaped child process 1825, status = succeeded lb # [ 149.677623] niks3-server[1174]: 2026/09/21 12:59:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.689336] nix-grpc-daemon[1781]: time=2026-09-21T12:59:58.532Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.690912] nix-grpc-daemon[1781]: time=2026-09-21T12:59:58.534Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 149.713794] niks3-server[1174]: 2026/09/21 12:59:58 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 149.724680] niks3-server[1174]: 2026/09/21 12:59:58 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 149.735218] niks3-server[1174]: 2026/09/21 12:59:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 149.740202] niks3-server[1174]: 2026/09/21 12:59:58 INFO Signed narinfos id=53 count=1 worker1 # [ 149.744161] nix-grpc-daemon[1781]: time=2026-09-21T12:59:58.586Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.744743] niks3-server[1174]: 2026/09/21 12:59:58 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 149.753211] niks3-server[1174]: 2026/09/21 12:59:58 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 149.758968] niks3-server[1174]: 2026/09/21 12:59:58 INFO Completed upload id=53 worker1 # [ 149.762145] nix-grpc-daemon[1781]: time=2026-09-21T12:59:58.605Z level=INFO msg="Upload complete. (317ms)" lb # [ 149.761142] niks3-server[1174]: 2026/09/21 12:59:58 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker2 # [ 149.793978] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:58Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 149.767343] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=1 worker2 # [ 149.799331] nix-grpc-daemon[1488]: ts=2026-09-21T12:59:58Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 149.775455] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 149.785369] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 149.789052] nix-daemon[849]: reaped child process 1804, status = succeeded worker1 # [ 149.790857] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 149.795112] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 149.983140] nix-daemon[849]: accepted connection from pid 1829, user nix-grpc-daemon (trusted) worker1 # [ 149.997268] nix-daemon[849]: reaped child process 1832, status = succeeded worker1 # [ 150.193361] nix-daemon[849]: accepted connection from pid 1834, user nix-grpc-daemon (trusted) worker1 # [ 150.206902] nix-daemon[849]: reaped child process 1837, status = succeeded lb # [ 150.222333] niks3-server[1174]: 2026/09/21 12:59:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.234249] nix-grpc-daemon[1781]: time=2026-09-21T12:59:59.077Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.235769] nix-grpc-daemon[1781]: time=2026-09-21T12:59:59.079Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 150.255898] niks3-server[1174]: 2026/09/21 12:59:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 150.260901] niks3-server[1174]: 2026/09/21 12:59:59 INFO Signed narinfos id=54 count=1 worker1 # [ 150.267267] nix-grpc-daemon[1781]: time=2026-09-21T12:59:59.110Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.270145] niks3-server[1174]: 2026/09/21 12:59:59 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 150.276158] niks3-server[1174]: 2026/09/21 12:59:59 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 150.286319] niks3-server[1174]: 2026/09/21 12:59:59 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 150.295828] nix-grpc-daemon[1781]: time=2026-09-21T12:59:59.139Z level=INFO msg="Upload complete. (494ms)" lb # [ 150.292858] niks3-server[1174]: 2026/09/21 12:59:59 INFO Completed upload id=54 worker1 # [ 150.298135] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 150.296480] niks3-server[1174]: 2026/09/21 12:59:59 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 150.303686] nix-grpc-daemon[1721]: ts=2026-09-21T12:59:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 150.309697] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 150.312166] nix-daemon[849]: reaped child process 1827, status = succeeded worker1 # [ 150.317794] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 151.142975] nix-daemon[849]: reaped child process 1841, status = succeeded worker1 # [ 151.322818] nix-daemon[849]: accepted connection from pid 1857, user nix-grpc-daemon (trusted) worker1 # [ 151.335589] nix-daemon[849]: reaped child process 1860, status = succeeded lb # [ 151.352348] niks3-server[1174]: 2026/09/21 13:00:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.365630] nix-grpc-daemon[1781]: time=2026-09-21T13:00:00.208Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.367312] nix-grpc-daemon[1781]: time=2026-09-21T13:00:00.210Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 151.385622] niks3-server[1174]: 2026/09/21 13:00:00 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 151.399533] niks3-server[1174]: 2026/09/21 13:00:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 151.405115] niks3-server[1174]: 2026/09/21 13:00:00 INFO Signed narinfos id=55 count=1 worker1 # [ 151.411492] nix-grpc-daemon[1781]: time=2026-09-21T13:00:00.254Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.411230] niks3-server[1174]: 2026/09/21 13:00:00 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 151.419713] niks3-server[1174]: 2026/09/21 13:00:00 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 151.426334] niks3-server[1174]: 2026/09/21 13:00:00 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 151.430719] niks3-server[1174]: 2026/09/21 13:00:00 INFO Completed upload id=55 worker1 # [ 151.434340] nix-grpc-daemon[1781]: time=2026-09-21T13:00:00.277Z level=INFO msg="Upload complete. (309ms)" lb # [ 151.433173] niks3-server[1174]: 2026/09/21 13:00:00 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 151.440593] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=1 worker2 # [ 151.466544] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:00Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 151.446549] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker2 # [ 151.475854] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:00Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 151.456370] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 151.461920] nix-daemon[849]: reaped child process 1839, status = succeeded worker1 # [ 151.463655] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 151.467658] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 151.643230] nix-daemon[849]: accepted connection from pid 1864, user nix-grpc-daemon (trusted) worker1 # [ 151.658376] nix-daemon[849]: reaped child process 1867, status = succeeded worker1 # [ 151.841101] nix-daemon[849]: accepted connection from pid 1869, user nix-grpc-daemon (trusted) worker1 # [ 151.853440] nix-daemon[849]: reaped child process 1872, status = succeeded lb # [ 151.867696] niks3-server[1174]: 2026/09/21 13:00:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.879160] nix-grpc-daemon[1781]: time=2026-09-21T13:00:00.722Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.880730] nix-grpc-daemon[1781]: time=2026-09-21T13:00:00.724Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 151.895907] niks3-server[1174]: 2026/09/21 13:00:00 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 151.906920] niks3-server[1174]: 2026/09/21 13:00:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 151.911097] niks3-server[1174]: 2026/09/21 13:00:00 INFO Signed narinfos id=56 count=1 worker1 # [ 151.917251] nix-grpc-daemon[1781]: time=2026-09-21T13:00:00.760Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.920356] niks3-server[1174]: 2026/09/21 13:00:00 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 151.929386] niks3-server[1174]: 2026/09/21 13:00:00 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 151.934589] niks3-server[1174]: 2026/09/21 13:00:00 INFO Completed upload id=56 worker1 # [ 151.937506] nix-grpc-daemon[1781]: time=2026-09-21T13:00:00.780Z level=INFO msg="Upload complete. (463ms)" worker1 # [ 151.940997] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 151.940072] niks3-server[1174]: 2026/09/21 13:00:00 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 151.947560] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 151.956903] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 151.960587] nix-daemon[849]: reaped child process 1862, status = succeeded worker1 # [ 151.965639] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 152.995726] nix-daemon[849]: reaped child process 1876, status = succeeded worker1 # [ 153.172992] nix-daemon[849]: accepted connection from pid 1892, user nix-grpc-daemon (trusted) worker1 # [ 153.187188] nix-daemon[849]: reaped child process 1895, status = succeeded lb # [ 153.201740] niks3-server[1174]: 2026/09/21 13:00:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.213385] nix-grpc-daemon[1781]: time=2026-09-21T13:00:02.056Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 153.214920] nix-grpc-daemon[1781]: time=2026-09-21T13:00:02.058Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 153.229329] niks3-server[1174]: 2026/09/21 13:00:02 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 153.249218] niks3-server[1174]: 2026/09/21 13:00:02 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 153.258072] niks3-server[1174]: 2026/09/21 13:00:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 153.265973] nix-grpc-daemon[1781]: time=2026-09-21T13:00:02.109Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.262819] niks3-server[1174]: 2026/09/21 13:00:02 INFO Signed narinfos id=57 count=1 lb # [ 153.267792] niks3-server[1174]: 2026/09/21 13:00:02 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 153.275562] niks3-server[1174]: 2026/09/21 13:00:02 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 153.281250] niks3-server[1174]: 2026/09/21 13:00:02 INFO Completed upload id=57 worker1 # [ 153.284689] nix-grpc-daemon[1781]: time=2026-09-21T13:00:02.128Z level=INFO msg="Upload complete. (311ms)" lb # [ 153.283617] niks3-server[1174]: 2026/09/21 13:00:02 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 153.290478] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=1 worker2 # [ 153.316807] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:02Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 153.326910] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:02Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 153.305596] nix-daemon[849]: reaped child process 1874, status = succeeded worker1 # [ 153.340154] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 153.352684] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 153.365239] nix-grpc-daemon[1781]: time=2026-09-21T13:00:02.208Z level=INFO msg="All 1 paths already cached" worker1 # [ 153.372349] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 153.382364] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 153.573345] nix-daemon[849]: accepted connection from pid 1899, user nix-grpc-daemon (trusted) worker1 # [ 153.587663] nix-daemon[849]: reaped child process 1902, status = succeeded worker1 # [ 153.762513] nix-daemon[849]: accepted connection from pid 1904, user nix-grpc-daemon (trusted) worker1 # [ 153.776697] nix-daemon[849]: reaped child process 1907, status = succeeded lb # [ 153.790486] niks3-server[1174]: 2026/09/21 13:00:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.801638] nix-grpc-daemon[1781]: time=2026-09-21T13:00:02.645Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 153.803149] nix-grpc-daemon[1781]: time=2026-09-21T13:00:02.646Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 153.818314] niks3-server[1174]: 2026/09/21 13:00:02 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 153.829768] niks3-server[1174]: 2026/09/21 13:00:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker1 # [ 153.837821] nix-grpc-daemon[1781]: time=2026-09-21T13:00:02.681Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.834895] niks3-server[1174]: 2026/09/21 13:00:02 INFO Signed narinfos id=58 count=1 lb # [ 153.840687] niks3-server[1174]: 2026/09/21 13:00:02 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 153.851833] niks3-server[1174]: 2026/09/21 13:00:02 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 153.860957] nix-grpc-daemon[1781]: time=2026-09-21T13:00:02.704Z level=INFO msg="Upload complete. (466ms)" lb # [ 153.857716] niks3-server[1174]: 2026/09/21 13:00:02 INFO Completed upload id=58 worker1 # [ 153.863212] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 153.860736] niks3-server[1174]: 2026/09/21 13:00:02 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 153.868059] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 153.874850] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 153.877295] nix-daemon[849]: reaped child process 1897, status = succeeded worker1 # [ 153.883139] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 155.100893] nix-daemon[849]: reaped child process 1911, status = succeeded worker1 # [ 155.275704] nix-daemon[849]: accepted connection from pid 1927, user nix-grpc-daemon (trusted) worker1 # [ 155.288260] nix-daemon[849]: reaped child process 1930, status = succeeded lb # [ 155.304664] niks3-server[1174]: 2026/09/21 13:00:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.318158] nix-grpc-daemon[1781]: time=2026-09-21T13:00:04.161Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 155.319745] nix-grpc-daemon[1781]: time=2026-09-21T13:00:04.163Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 155.348690] niks3-server[1174]: 2026/09/21 13:00:04 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 155.359214] niks3-server[1174]: 2026/09/21 13:00:04 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 155.366393] niks3-server[1174]: 2026/09/21 13:00:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker1 # [ 155.375447] nix-grpc-daemon[1781]: time=2026-09-21T13:00:04.218Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.371726] niks3-server[1174]: 2026/09/21 13:00:04 INFO Signed narinfos id=59 count=1 lb # [ 155.377718] niks3-server[1174]: 2026/09/21 13:00:04 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 155.386736] niks3-server[1174]: 2026/09/21 13:00:04 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 155.392185] niks3-server[1174]: 2026/09/21 13:00:04 INFO Completed upload id=59 worker1 # [ 155.395660] nix-grpc-daemon[1781]: time=2026-09-21T13:00:04.239Z level=INFO msg="Upload complete. (303ms)" lb # [ 155.393927] niks3-server[1174]: 2026/09/21 13:00:04 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 155.401540] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=1 worker2 # [ 155.428824] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:04Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 155.438896] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:04Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 155.416676] nix-daemon[849]: reaped child process 1909, status = succeeded worker1 # [ 155.446418] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 155.459267] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 155.472123] nix-grpc-daemon[1781]: time=2026-09-21T13:00:04.315Z level=INFO msg="All 1 paths already cached" worker1 # [ 155.479781] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 155.487565] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 155.684182] nix-daemon[849]: accepted connection from pid 1934, user nix-grpc-daemon (trusted) worker1 # [ 155.698354] nix-daemon[849]: reaped child process 1937, status = succeeded worker1 # [ 155.890514] nix-daemon[849]: accepted connection from pid 1939, user nix-grpc-daemon (trusted) worker1 # [ 155.904437] nix-daemon[849]: reaped child process 1942, status = succeeded lb # [ 155.918970] niks3-server[1174]: 2026/09/21 13:00:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.930105] nix-grpc-daemon[1781]: time=2026-09-21T13:00:04.773Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 155.931628] nix-grpc-daemon[1781]: time=2026-09-21T13:00:04.775Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 155.950611] niks3-server[1174]: 2026/09/21 13:00:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 155.955363] niks3-server[1174]: 2026/09/21 13:00:04 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst worker1 # [ 155.965873] nix-grpc-daemon[1781]: time=2026-09-21T13:00:04.809Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.962587] niks3-server[1174]: 2026/09/21 13:00:04 INFO Signed narinfos id=60 count=1 lb # [ 155.970391] niks3-server[1174]: 2026/09/21 13:00:04 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 155.981475] niks3-server[1174]: 2026/09/21 13:00:04 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 155.993620] nix-grpc-daemon[1781]: time=2026-09-21T13:00:04.837Z level=INFO msg="Upload complete. (492ms)" lb # [ 155.990428] niks3-server[1174]: 2026/09/21 13:00:04 INFO Completed upload id=60 lb # [ 155.992837] niks3-server[1174]: 2026/09/21 13:00:04 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 155.996583] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 156.002566] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 156.013500] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 156.017831] nix-daemon[849]: reaped child process 1932, status = succeeded worker1 # [ 156.024140] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 157.238035] nix-daemon[849]: reaped child process 1946, status = succeeded worker1 # [ 157.413410] nix-daemon[849]: accepted connection from pid 1962, user nix-grpc-daemon (trusted) worker1 # [ 157.427418] nix-daemon[849]: reaped child process 1965, status = succeeded lb # [ 157.443254] niks3-server[1174]: 2026/09/21 13:00:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.457350] nix-grpc-daemon[1781]: time=2026-09-21T13:00:06.298Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 157.458734] nix-grpc-daemon[1781]: time=2026-09-21T13:00:06.298Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 157.484891] niks3-server[1174]: 2026/09/21 13:00:06 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 157.494248] niks3-server[1174]: 2026/09/21 13:00:06 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 157.501828] niks3-server[1174]: 2026/09/21 13:00:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 157.506690] niks3-server[1174]: 2026/09/21 13:00:06 INFO Signed narinfos id=61 count=1 worker1 # [ 157.512476] nix-grpc-daemon[1781]: time=2026-09-21T13:00:06.355Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.513364] niks3-server[1174]: 2026/09/21 13:00:06 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 157.522325] niks3-server[1174]: 2026/09/21 13:00:06 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 157.526901] niks3-server[1174]: 2026/09/21 13:00:06 INFO Completed upload id=61 worker1 # [ 157.530503] nix-grpc-daemon[1781]: time=2026-09-21T13:00:06.373Z level=INFO msg="Upload complete. (298ms)" lb # [ 157.529707] niks3-server[1174]: 2026/09/21 13:00:06 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker2 # [ 157.565867] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:06Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 157.536597] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=1 worker2 # [ 157.572622] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:06Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 157.551365] nix-daemon[849]: reaped child process 1944, status = succeeded worker1 # [ 157.583186] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 157.595645] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 157.608685] nix-grpc-daemon[1781]: time=2026-09-21T13:00:06.452Z level=INFO msg="All 1 paths already cached" worker1 # [ 157.615740] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 157.624354] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 157.810957] nix-daemon[849]: accepted connection from pid 1969, user nix-grpc-daemon (trusted) worker1 # [ 157.826134] nix-daemon[849]: reaped child process 1972, status = succeeded worker1 # [ 158.005485] nix-daemon[849]: accepted connection from pid 1974, user nix-grpc-daemon (trusted) worker1 # [ 158.020861] nix-daemon[849]: reaped child process 1977, status = succeeded lb # [ 158.033377] niks3-server[1174]: 2026/09/21 13:00:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.047288] nix-grpc-daemon[1781]: time=2026-09-21T13:00:06.890Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.048819] nix-grpc-daemon[1781]: time=2026-09-21T13:00:06.892Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 158.066443] niks3-server[1174]: 2026/09/21 13:00:06 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 158.076799] niks3-server[1174]: 2026/09/21 13:00:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 158.084479] nix-grpc-daemon[1781]: time=2026-09-21T13:00:06.927Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.081711] niks3-server[1174]: 2026/09/21 13:00:06 INFO Signed narinfos id=62 count=1 lb # [ 158.089384] niks3-server[1174]: 2026/09/21 13:00:07 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 158.098544] niks3-server[1174]: 2026/09/21 13:00:07 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 158.106416] niks3-server[1174]: 2026/09/21 13:00:07 INFO Completed upload id=62 worker1 # [ 158.109262] nix-grpc-daemon[1781]: time=2026-09-21T13:00:06.952Z level=INFO msg="Upload complete. (472ms)" lb # [ 158.109947] niks3-server[1174]: 2026/09/21 13:00:07 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 158.112738] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 158.118294] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 158.126287] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 158.132652] nix-daemon[849]: reaped child process 1967, status = succeeded worker1 # [ 158.138218] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 159.567319] nix-daemon[849]: reaped child process 1981, status = succeeded worker1 # [ 159.749767] nix-daemon[849]: accepted connection from pid 1997, user nix-grpc-daemon (trusted) worker1 # [ 159.763833] nix-daemon[849]: reaped child process 2000, status = succeeded lb # [ 159.780121] niks3-server[1174]: 2026/09/21 13:00:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.789719] nix-grpc-daemon[1781]: time=2026-09-21T13:00:08.632Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 159.791260] nix-grpc-daemon[1781]: time=2026-09-21T13:00:08.634Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 159.814246] niks3-server[1174]: 2026/09/21 13:00:08 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 159.824244] niks3-server[1174]: 2026/09/21 13:00:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 159.829112] niks3-server[1174]: 2026/09/21 13:00:08 INFO Signed narinfos id=63 count=1 worker1 # [ 159.835359] nix-grpc-daemon[1781]: time=2026-09-21T13:00:08.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.836210] niks3-server[1174]: 2026/09/21 13:00:08 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 159.844684] niks3-server[1174]: 2026/09/21 13:00:08 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 159.852789] niks3-server[1174]: 2026/09/21 13:00:08 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 159.858363] niks3-server[1174]: 2026/09/21 13:00:08 INFO Completed upload id=63 lb # [ 159.860565] niks3-server[1174]: 2026/09/21 13:00:08 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 159.863458] nix-grpc-daemon[1781]: time=2026-09-21T13:00:08.706Z level=INFO msg="Upload complete. (316ms)" worker2 # [ 159.897664] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:08Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.872098] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=1 worker1 # [ 159.878447] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker2 # [ 159.904880] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:08Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 159.890576] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 159.898062] nix-daemon[849]: reaped child process 1979, status = succeeded worker1 # [ 159.900577] nix-grpc-daemon[1781]: time=2026-09-21T13:00:08.744Z level=INFO msg="All 2 paths already cached" worker1 # [ 159.905291] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 159.909370] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 160.087448] nix-daemon[849]: accepted connection from pid 2004, user nix-grpc-daemon (trusted) worker1 # [ 160.101543] nix-daemon[849]: reaped child process 2007, status = succeeded worker1 # [ 160.282801] nix-daemon[849]: accepted connection from pid 2009, user nix-grpc-daemon (trusted) worker1 # [ 160.296933] nix-daemon[849]: reaped child process 2012, status = succeeded lb # [ 160.311573] niks3-server[1174]: 2026/09/21 13:00:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.322595] nix-grpc-daemon[1781]: time=2026-09-21T13:00:09.166Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 160.324474] nix-grpc-daemon[1781]: time=2026-09-21T13:00:09.167Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 160.340597] niks3-server[1174]: 2026/09/21 13:00:09 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 160.352089] niks3-server[1174]: 2026/09/21 13:00:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker1 # [ 160.360720] nix-grpc-daemon[1781]: time=2026-09-21T13:00:09.204Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.357194] niks3-server[1174]: 2026/09/21 13:00:09 INFO Signed narinfos id=64 count=1 lb # [ 160.363274] niks3-server[1174]: 2026/09/21 13:00:09 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 160.374268] niks3-server[1174]: 2026/09/21 13:00:09 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 160.379494] niks3-server[1174]: 2026/09/21 13:00:09 INFO Completed upload id=64 worker1 # [ 160.385184] nix-grpc-daemon[1781]: time=2026-09-21T13:00:09.228Z level=INFO msg="Upload complete. (469ms)" worker1 # [ 160.386784] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 160.382862] niks3-server[1174]: 2026/09/21 13:00:09 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 160.392721] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 160.402265] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 160.404782] nix-daemon[849]: reaped child process 2002, status = succeeded worker1 # [ 160.410546] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 161.032777] nix-daemon[849]: reaped child process 2016, status = succeeded worker1 # [ 161.207094] nix-daemon[849]: accepted connection from pid 2032, user nix-grpc-daemon (trusted) worker1 # [ 161.218364] nix-daemon[849]: reaped child process 2035, status = succeeded lb # [ 161.234399] niks3-server[1174]: 2026/09/21 13:00:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.246030] nix-grpc-daemon[1781]: time=2026-09-21T13:00:10.089Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.247578] nix-grpc-daemon[1781]: time=2026-09-21T13:00:10.091Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 161.279178] niks3-server[1174]: 2026/09/21 13:00:10 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 161.286376] niks3-server[1174]: 2026/09/21 13:00:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker1 # [ 161.294275] nix-grpc-daemon[1781]: time=2026-09-21T13:00:10.137Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.290859] niks3-server[1174]: 2026/09/21 13:00:10 INFO Signed narinfos id=65 count=1 lb # [ 161.294235] niks3-server[1174]: 2026/09/21 13:00:10 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 161.298640] niks3-server[1174]: 2026/09/21 13:00:10 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 161.310659] niks3-server[1174]: 2026/09/21 13:00:10 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 161.313305] niks3-server[1174]: 2026/09/21 13:00:10 INFO Completed upload id=65 lb # [ 161.315124] niks3-server[1174]: 2026/09/21 13:00:10 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 161.317926] nix-grpc-daemon[1781]: time=2026-09-21T13:00:10.161Z level=INFO msg="Upload complete. (300ms)" worker2 # [ 161.350477] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:10Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.325461] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=1 worker1 # [ 161.337523] nix-daemon[849]: reaped child process 2014, status = succeeded worker1 # [ 161.367874] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 161.380366] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 161.392943] nix-grpc-daemon[1781]: time=2026-09-21T13:00:10.236Z level=INFO msg="All 2 paths already cached" worker1 # [ 161.400219] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 161.408478] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 161.603235] nix-daemon[849]: accepted connection from pid 2039, user nix-grpc-daemon (trusted) worker1 # [ 161.618672] nix-daemon[849]: reaped child process 2042, status = succeeded worker1 # [ 161.800645] nix-daemon[849]: accepted connection from pid 2044, user nix-grpc-daemon (trusted) worker1 # [ 161.814419] nix-daemon[849]: reaped child process 2047, status = succeeded lb # [ 161.828154] niks3-server[1174]: 2026/09/21 13:00:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.838981] nix-grpc-daemon[1781]: time=2026-09-21T13:00:10.682Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.840946] nix-grpc-daemon[1781]: time=2026-09-21T13:00:10.683Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 161.854600] niks3-server[1174]: 2026/09/21 13:00:10 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 161.865158] niks3-server[1174]: 2026/09/21 13:00:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker1 # [ 161.873251] nix-grpc-daemon[1781]: time=2026-09-21T13:00:10.716Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.870248] niks3-server[1174]: 2026/09/21 13:00:10 INFO Signed narinfos id=66 count=1 lb # [ 161.876647] niks3-server[1174]: 2026/09/21 13:00:10 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 161.887786] niks3-server[1174]: 2026/09/21 13:00:10 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete worker1 # [ 161.897289] nix-grpc-daemon[1781]: time=2026-09-21T13:00:10.740Z level=INFO msg="Upload complete. (472ms)" lb # [ 161.894150] niks3-server[1174]: 2026/09/21 13:00:10 INFO Completed upload id=66 lb # [ 161.897096] niks3-server[1174]: 2026/09/21 13:00:10 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 161.899787] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 161.905112] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 161.915793] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 161.919142] nix-daemon[849]: reaped child process 2037, status = succeeded worker1 # [ 161.924440] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 162.938360] nix-daemon[849]: reaped child process 2051, status = succeeded worker1 # [ 163.093503] nix-daemon[849]: accepted connection from pid 2067, user nix-grpc-daemon (trusted) worker1 # [ 163.108129] nix-daemon[849]: reaped child process 2070, status = succeeded lb # [ 163.123847] niks3-server[1174]: 2026/09/21 13:00:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.136076] nix-grpc-daemon[1781]: time=2026-09-21T13:00:11.979Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.137637] nix-grpc-daemon[1781]: time=2026-09-21T13:00:11.981Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 163.156336] niks3-server[1174]: 2026/09/21 13:00:12 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 163.167634] niks3-server[1174]: 2026/09/21 13:00:12 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 163.180246] niks3-server[1174]: 2026/09/21 13:00:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker1 # [ 163.188703] nix-grpc-daemon[1781]: time=2026-09-21T13:00:12.032Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.185261] niks3-server[1174]: 2026/09/21 13:00:12 INFO Signed narinfos id=67 count=1 lb # [ 163.190222] niks3-server[1174]: 2026/09/21 13:00:12 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 163.199887] niks3-server[1174]: 2026/09/21 13:00:12 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 163.205404] niks3-server[1174]: 2026/09/21 13:00:12 INFO Completed upload id=67 worker1 # [ 163.208838] nix-grpc-daemon[1781]: time=2026-09-21T13:00:12.052Z level=INFO msg="Upload complete. (276ms)" lb # [ 163.207184] niks3-server[1174]: 2026/09/21 13:00:12 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker2 # [ 163.241656] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:12Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.214681] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=1 worker1 # [ 163.229692] nix-daemon[849]: reaped child process 2049, status = succeeded worker1 # [ 163.259471] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 163.272128] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 163.284716] nix-grpc-daemon[1781]: time=2026-09-21T13:00:12.128Z level=INFO msg="All 2 paths already cached" worker1 # [ 163.291871] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 163.300400] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 163.478063] nix-daemon[849]: accepted connection from pid 2074, user nix-grpc-daemon (trusted) worker1 # [ 163.491791] nix-daemon[849]: reaped child process 2077, status = succeeded worker1 # [ 163.666101] nix-daemon[849]: accepted connection from pid 2079, user nix-grpc-daemon (trusted) worker1 # [ 163.678398] nix-daemon[849]: reaped child process 2082, status = succeeded lb # [ 163.692260] niks3-server[1174]: 2026/09/21 13:00:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.703229] nix-grpc-daemon[1781]: time=2026-09-21T13:00:12.546Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.704778] nix-grpc-daemon[1781]: time=2026-09-21T13:00:12.548Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 163.721684] niks3-server[1174]: 2026/09/21 13:00:12 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 163.730633] niks3-server[1174]: 2026/09/21 13:00:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 163.736114] niks3-server[1174]: 2026/09/21 13:00:12 INFO Signed narinfos id=68 count=1 worker1 # [ 163.742457] nix-grpc-daemon[1781]: time=2026-09-21T13:00:12.585Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.742604] niks3-server[1174]: 2026/09/21 13:00:12 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 163.755280] niks3-server[1174]: 2026/09/21 13:00:12 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 163.761302] niks3-server[1174]: 2026/09/21 13:00:12 INFO Completed upload id=68 worker1 # [ 163.766849] nix-grpc-daemon[1781]: time=2026-09-21T13:00:12.610Z level=INFO msg="Upload complete. (452ms)" lb # [ 163.763758] niks3-server[1174]: 2026/09/21 13:00:12 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 163.769916] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 163.775274] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 worker1 # [ 163.783489] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 163.791655] nix-daemon[849]: reaped child process 2072, status = succeeded worker1 # [ 163.797062] nix-daemon[849]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 164.423172] nix-daemon[849]: reaped child process 2086, status = succeeded worker1 # [ 164.601160] nix-daemon[849]: accepted connection from pid 2102, user nix-grpc-daemon (trusted) worker1 # [ 164.615247] nix-daemon[849]: reaped child process 2105, status = succeeded lb # [ 164.631182] niks3-server[1174]: 2026/09/21 13:00:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.643407] nix-grpc-daemon[1781]: time=2026-09-21T13:00:13.486Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 164.644906] nix-grpc-daemon[1781]: time=2026-09-21T13:00:13.488Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 164.667314] niks3-server[1174]: 2026/09/21 13:00:13 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 164.678803] niks3-server[1174]: 2026/09/21 13:00:13 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 164.686704] niks3-server[1174]: 2026/09/21 13:00:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 164.692061] niks3-server[1174]: 2026/09/21 13:00:13 INFO Signed narinfos id=69 count=1 worker1 # [ 164.698250] nix-grpc-daemon[1781]: time=2026-09-21T13:00:13.541Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.697962] niks3-server[1174]: 2026/09/21 13:00:13 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 164.706517] niks3-server[1174]: 2026/09/21 13:00:13 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 164.712406] niks3-server[1174]: 2026/09/21 13:00:13 INFO Completed upload id=69 worker1 # [ 164.715402] nix-grpc-daemon[1781]: time=2026-09-21T13:00:13.558Z level=INFO msg="Upload complete. (311ms)" lb # [ 164.715609] niks3-server[1174]: 2026/09/21 13:00:13 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 164.722391] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57238 duration_s=0 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=1 worker1 # [ 164.734982] nix-daemon[849]: reaped child process 2084, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.18 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 164.919273] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 216d29a15a794e7d8026f7477a95a6db client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client # [ 165.154341] nix[1374]: don't know how to build these paths: client # [ 165.155262] nix[1374]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 165.139235] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57238 worker2 # [ 165.168850] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 165.183338] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:14Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 client # [ 165.171664] nix[1374]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 168.359693] envoy[922]: conn peer=[2001:db8:1::1]:46186 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27128 tx=11447 ms=17886 client # [ 195.174404] nix[1374]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu} client # [ 195.181169] nix[1374]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 195.212978] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 195.216134] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 195.219658] systemd[1]: gpu.service: Consumed 145ms CPU time over 30.299s wall clock time, 37.4M memory peak, 5K incoming IP traffic, 4.9K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.82 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 49.71 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.94 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 197.341338] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:46Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.10 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2 lb # [ 198.362227] envoy[922]: conn peer=[2001:db8:1::1]:44590 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=497 ms=30035 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 198.626132] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 198.631836] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 198.651937] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:47Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 198.657163] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:47Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 198.701370] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 198.713724] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 198.727567] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 198.739275] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 198.938755] nix-daemon[873]: accepted connection from pid 1785, user nix-grpc-daemon (trusted) worker2 # [ 198.950667] nix-daemon[873]: reaped child process 1788, status = succeeded worker2 # [ 199.119284] nix-daemon[873]: accepted connection from pid 1790, user nix-grpc-daemon (trusted) worker2 # [ 199.130494] nix-daemon[873]: reaped child process 1793, status = succeeded lb # [ 199.117502] niks3-server[1174]: 2026/09/21 13:00:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.155565] nix-grpc-daemon[1562]: time=2026-09-21T13:00:48.218Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 199.156928] nix-grpc-daemon[1562]: time=2026-09-21T13:00:48.218Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 199.143206] niks3-server[1174]: 2026/09/21 13:00:48 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 199.153842] niks3-server[1174]: 2026/09/21 13:00:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker2 # [ 199.188226] nix-grpc-daemon[1562]: time=2026-09-21T13:00:48.251Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.159247] niks3-server[1174]: 2026/09/21 13:00:48 INFO Signed narinfos id=70 count=1 lb # [ 199.165990] niks3-server[1174]: 2026/09/21 13:00:48 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 199.178107] niks3-server[1174]: 2026/09/21 13:00:48 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 199.182223] niks3-server[1174]: 2026/09/21 13:00:48 INFO Completed upload id=70 worker2 # [ 199.213853] nix-grpc-daemon[1562]: time=2026-09-21T13:00:48.277Z level=INFO msg="Upload complete. (461ms)" lb # [ 199.185909] niks3-server[1174]: 2026/09/21 13:00:48 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 199.216149] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 199.221966] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 199.230873] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 199.233364] nix-daemon[873]: reaped child process 1783, status = succeeded worker2 # [ 199.238395] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 200.050840] nix-daemon[873]: reaped child process 1797, status = succeeded client # farm-a> LOG-farm-a-drain worker2 # [ 200.205627] nix-daemon[873]: accepted connection from pid 1813, user nix-grpc-daemon (trusted) worker2 # [ 200.217578] nix-daemon[873]: reaped child process 1816, status = succeeded lb # [ 200.203545] niks3-server[1174]: 2026/09/21 13:00:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.241298] nix-grpc-daemon[1562]: time=2026-09-21T13:00:49.304Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 200.242796] nix-grpc-daemon[1562]: time=2026-09-21T13:00:49.306Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 200.241270] niks3-server[1174]: 2026/09/21 13:00:49 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 200.253552] niks3-server[1174]: 2026/09/21 13:00:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 200.260399] niks3-server[1174]: 2026/09/21 13:00:49 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker2 # [ 200.295868] nix-grpc-daemon[1562]: time=2026-09-21T13:00:49.359Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.266300] niks3-server[1174]: 2026/09/21 13:00:49 INFO Signed narinfos id=71 count=1 lb # [ 200.271488] niks3-server[1174]: 2026/09/21 13:00:49 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 200.281060] niks3-server[1174]: 2026/09/21 13:00:49 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 200.287364] niks3-server[1174]: 2026/09/21 13:00:49 INFO Completed upload id=71 lb # [ 200.289125] niks3-server[1174]: 2026/09/21 13:00:49 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 200.317211] nix-grpc-daemon[1562]: time=2026-09-21T13:00:49.380Z level=INFO msg="Upload complete. (272ms)" worker2 # [ 200.325912] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=1 worker2 # [ 200.335872] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:49Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 200.339151] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:49Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 200.347810] nix-daemon[873]: reaped child process 1795, status = succeeded worker2 # [ 200.379125] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 200.391682] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 200.404545] nix-grpc-daemon[1562]: time=2026-09-21T13:00:49.468Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 200.412594] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 200.420800] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 200.604444] nix-daemon[873]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker2 # [ 200.617202] nix-daemon[873]: reaped child process 1825, status = succeeded worker2 # [ 200.786271] nix-daemon[873]: accepted connection from pid 1827, user nix-grpc-daemon (trusted) worker2 # [ 200.797683] nix-daemon[873]: reaped child process 1830, status = succeeded lb # [ 200.784400] niks3-server[1174]: 2026/09/21 13:00:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.821476] nix-grpc-daemon[1562]: time=2026-09-21T13:00:49.885Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 200.823338] nix-grpc-daemon[1562]: time=2026-09-21T13:00:49.886Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 200.811160] niks3-server[1174]: 2026/09/21 13:00:49 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 200.821887] niks3-server[1174]: 2026/09/21 13:00:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 200.826766] niks3-server[1174]: 2026/09/21 13:00:49 INFO Signed narinfos id=72 count=1 worker2 # [ 200.859104] nix-grpc-daemon[1562]: time=2026-09-21T13:00:49.922Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.833850] niks3-server[1174]: 2026/09/21 13:00:49 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 200.846496] niks3-server[1174]: 2026/09/21 13:00:49 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete worker2 # [ 200.881105] nix-grpc-daemon[1562]: time=2026-09-21T13:00:49.944Z level=INFO msg="Upload complete. (448ms)" lb # [ 200.851678] niks3-server[1174]: 2026/09/21 13:00:49 INFO Completed upload id=72 lb # [ 200.854898] niks3-server[1174]: 2026/09/21 13:00:49 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 200.883471] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 200.888713] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 200.897362] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 200.906136] nix-daemon[873]: reaped child process 1820, status = succeeded worker2 # [ 200.909806] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 202.736689] nix-daemon[873]: reaped child process 1834, status = succeeded worker2 # [ 202.920778] nix-daemon[873]: accepted connection from pid 1850, user nix-grpc-daemon (trusted) worker2 # [ 202.931218] nix-daemon[873]: reaped child process 1853, status = succeeded lb # [ 202.921457] niks3-server[1174]: 2026/09/21 13:00:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 202.959806] nix-grpc-daemon[1562]: time=2026-09-21T13:00:52.023Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 202.961326] nix-grpc-daemon[1562]: time=2026-09-21T13:00:52.024Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 202.956180] niks3-server[1174]: 2026/09/21 13:00:51 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 202.970126] niks3-server[1174]: 2026/09/21 13:00:51 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 202.980494] niks3-server[1174]: 2026/09/21 13:00:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 202.987463] niks3-server[1174]: 2026/09/21 13:00:51 INFO Signed narinfos id=73 count=1 worker2 # [ 203.019745] nix-grpc-daemon[1562]: time=2026-09-21T13:00:52.083Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.990333] niks3-server[1174]: 2026/09/21 13:00:51 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 203.001149] niks3-server[1174]: 2026/09/21 13:00:51 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 203.007429] niks3-server[1174]: 2026/09/21 13:00:51 INFO Completed upload id=73 worker2 # [ 203.036952] nix-grpc-daemon[1562]: time=2026-09-21T13:00:52.100Z level=INFO msg="Upload complete. (318ms)" lb # [ 203.009175] niks3-server[1174]: 2026/09/21 13:00:51 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 203.045328] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=2 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=1 worker2 # [ 203.056156] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:52Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 203.059224] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:52Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 203.067336] nix-daemon[873]: reaped child process 1832, status = succeeded worker2 # [ 203.098337] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 203.110622] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 203.123395] nix-grpc-daemon[1562]: time=2026-09-21T13:00:52.186Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 203.131601] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 203.142133] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 203.324768] nix-daemon[873]: accepted connection from pid 1859, user nix-grpc-daemon (trusted) worker2 # [ 203.336656] nix-daemon[873]: reaped child process 1862, status = succeeded worker2 # [ 203.516300] nix-daemon[873]: accepted connection from pid 1864, user nix-grpc-daemon (trusted) worker2 # [ 203.527616] nix-daemon[873]: reaped child process 1867, status = succeeded lb # [ 203.516972] niks3-server[1174]: 2026/09/21 13:00:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.554522] nix-grpc-daemon[1562]: time=2026-09-21T13:00:52.618Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 203.556436] nix-grpc-daemon[1562]: time=2026-09-21T13:00:52.619Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 203.550913] niks3-server[1174]: 2026/09/21 13:00:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 203.554538] niks3-server[1174]: 2026/09/21 13:00:52 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 203.560062] niks3-server[1174]: 2026/09/21 13:00:52 INFO Signed narinfos id=74 count=1 worker2 # [ 203.592586] nix-grpc-daemon[1562]: time=2026-09-21T13:00:52.655Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.567384] niks3-server[1174]: 2026/09/21 13:00:52 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 203.578258] niks3-server[1174]: 2026/09/21 13:00:52 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 203.584703] niks3-server[1174]: 2026/09/21 13:00:52 INFO Completed upload id=74 worker2 # [ 203.614255] nix-grpc-daemon[1562]: time=2026-09-21T13:00:52.677Z level=INFO msg="Upload complete. (460ms)" lb # [ 203.587050] niks3-server[1174]: 2026/09/21 13:00:52 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 203.617755] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 203.622778] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 worker2 # [ 203.632076] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 203.636672] nix-daemon[873]: reaped child process 1857, status = succeeded worker2 # [ 203.641840] nix-daemon[873]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 204.866735] nix-daemon[873]: reaped child process 1871, status = succeeded worker2 # [ 205.041566] nix-daemon[873]: accepted connection from pid 1887, user nix-grpc-daemon (trusted) worker2 # [ 205.053108] nix-daemon[873]: reaped child process 1890, status = succeeded lb # [ 205.042698] niks3-server[1174]: 2026/09/21 13:00:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.081216] nix-grpc-daemon[1562]: time=2026-09-21T13:00:54.143Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 205.082570] nix-grpc-daemon[1562]: time=2026-09-21T13:00:54.143Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 205.078554] niks3-server[1174]: 2026/09/21 13:00:53 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 205.084115] niks3-server[1174]: 2026/09/21 13:00:53 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 205.093681] niks3-server[1174]: 2026/09/21 13:00:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign lb # [ 205.098992] niks3-server[1174]: 2026/09/21 13:00:54 INFO Signed narinfos id=75 count=1 worker2 # [ 205.131305] nix-grpc-daemon[1562]: time=2026-09-21T13:00:54.194Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.104335] niks3-server[1174]: 2026/09/21 13:00:54 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 205.113532] niks3-server[1174]: 2026/09/21 13:00:54 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 205.118858] niks3-server[1174]: 2026/09/21 13:00:54 INFO Completed upload id=75 worker2 # [ 205.148392] nix-grpc-daemon[1562]: time=2026-09-21T13:00:54.211Z level=INFO msg="Upload complete. (298ms)" lb # [ 205.121800] niks3-server[1174]: 2026/09/21 13:00:54 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 205.154587] nix-grpc-daemon[1488]: ts=2026-09-21T13:00:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43674 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=1 worker2 # [ 205.167989] nix-daemon[873]: reaped child process 1869, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.pem&client-key=/nix/store/gg5dnjqvsbzhmrc2lb82r8kx0z2r1xcp-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.81 seconds) client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 206.345534] nix-grpc-daemon[1721]: ts=2026-09-21T13:00:55Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.40 seconds) (finished: run the VM test script, in 207.63 seconds) test script finished in 207.87s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.02 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh