tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2 # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 50) worker2: QEMU running (pid 52) worker2 # Formatting '/build/vm-state-worker2/tmp.5xL1UdMjoq', fmt=raw size=1073741824 client # Formatting '/build/vm-state-client/tmp.vsbAiIClpa', fmt=raw size=1073741824 worker1: QEMU running (pid 51) worker1 # Disk image does not exist, creating the virtualisation disk image... worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Formatting '/build/vm-state-worker1/tmp.X0DmeJ0X8P', fmt=raw size=1073741824 worker2 # Discarding device blocks: 0/262144 done worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done worker2 # Filesystem UUID: 78394f41-ae5c-4963-aa17-efd9a46f8c98 client # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Superblock backups stored on blocks: client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: 749003ec-1f8a-4a32-8885-235776741a32 worker2 # 32768, 98304, 163840, 229376 client # Filesystem UUID: b53245e3-6b86-47fc-b41e-54356a1bd522 worker1 # Superblock backups stored on blocks: worker2 # client # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker2 # Allocating group tables: 0/8 done client # 32768, 98304, 163840, 229376 worker1 # worker2 # Writing inode tables: 0/8 done client # worker1 # Allocating group tables: 0/8 done worker2 # Creating journal (8192 blocks): done client # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker2 # client # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Virtualisation disk image created. client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker2 # Starting virtiofs daemons... client # worker1 # Virtualisation disk image created. worker2 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Virtualisation disk image created. worker1 # Starting virtiofs daemons... worker2 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Starting virtiofs daemons... worker1 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests lb # Disk image does not exist, creating the virtualisation disk image... client # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests lb: QEMU running (pid 49) client # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests lb # Formatting '/build/vm-state-lb/tmp.QgEsWheLAc', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 0.23 seconds) lb # Discarding device blocks: 0/262144 done client: waiting for unit network-addresses-eth1.service lb # Creating filesystem with 262144 4k blocks and 65536 inodes client: waiting for the VM to finish booting lb # Filesystem UUID: 56d2c6fc-ea8a-4853-899a-4071f2ffa212 lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 lb # lb # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. lb # Starting virtiofs daemons... lb # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T16:42:01Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T16:42:01Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T16:42:01Z INFO virtiofsd] Client connected, servicing requests lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # worker2 # worker2 # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # client # client # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # worker1 # worker1 # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # client # worker1 # client # worker1 # worker1 # lb # Booting from ROM... worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # worker2 # Booting from ROM... client # Booting from ROM... worker1 # Booting from ROM... lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/s4xy56bm0laswf8yp0lnzgg5gvcgz255-nixos-system-lb-test/init regInfo=/nix/store/0s0ch772hqi51yn9bhq64hlzcbl1z3ka-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.000000] kvm-clock: using sched offset of 453636791 cycles lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000005] tsc: Detected 2400.012 MHz processor lb # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.002733] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002744] Using GB pages for direct mapping lb # [ 0.002845] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qir84w600srafs16f9kikb4gknc3p104-nixos-system-worker2-test/init regInfo=/nix/store/5cdi1aq72z624lzk19yyg9mqb18j8azk-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.002854] ACPI: Early table checksum verification disabled worker2 # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.002857] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.002861] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.002865] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.002871] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002873] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.002875] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.002876] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.002878] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.002879] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.002880] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test/init regInfo=/nix/store/9mbchw87wm67kspwy4r01ypax3r3mych-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.002881] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.002882] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.002882] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.002883] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.002883] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.002884] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.000000] kvm-clock: using sched offset of 472785306 cycles lb # [ 0.003104] No NUMA configuration found client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.003105] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.003108] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.005399] Zone ranges: worker2 # [ 0.000869] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.005400] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000897] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.005402] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved lb # [ 0.005403] Normal empty client # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.005404] Device empty worker2 # [ 0.000900] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000000] APIC: Static calls initialized lb # [ 0.005405] Movable zone start for each node worker2 # [ 0.002788] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.005405] Early memory node ranges worker2 # [ 0.002799] Using GB pages for direct mapping lb # [ 0.005406] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.002937] RAMDISK: [mem 0x5e36f000-0x5ffcffff] client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.005407] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.002946] ACPI: Early table checksum verification disabled client # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] Hypervisor detected: KVM lb # [ 0.005408] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.002949] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.005428] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.005692] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.002952] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] kvm-clock: using sched offset of 482085409 cycles worker2 # [ 0.002956] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.033015] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.033475] ACPI: PM-Timer IO Port: 0x608 client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.002963] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.033486] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.002965] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.033512] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/mdpl287kr399rvszyfvd3fa6h47a12dq-nixos-system-worker1-test/init regInfo=/nix/store/76664a5z5p7jsx3wsqacr084ngmgfx5j-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.002967] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.033515] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.033517] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.002968] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.033518] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.002726] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.002970] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.002737] Using GB pages for direct mapping lb # [ 0.033519] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.002971] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002818] RAMDISK: [mem 0x5e370000-0x5ffcffff] lb # [ 0.033519] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.002826] ACPI: Early table checksum verification disabled worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.002973] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.033522] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.002829] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.002973] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.033523] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.033527] TSC deadline timer available client # [ 0.002832] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.002974] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.033531] CPU topo: Max. logical packages: 1 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.033531] CPU topo: Max. logical dies: 1 client # [ 0.002836] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002974] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.033532] CPU topo: Max. dies per package: 1 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.033535] CPU topo: Max. threads per core: 1 worker2 # [ 0.002975] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.002843] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.033536] CPU topo: Num. cores per package: 1 client # [ 0.002845] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.002975] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.033536] CPU topo: Num. threads per package: 1 worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.002976] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.002847] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.033536] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.003214] No NUMA configuration found worker1 # [ 0.000000] APIC: Static calls initialized client # [ 0.002849] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.033554] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.003215] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.003218] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.002850] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.033582] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.005668] Zone ranges: lb # [ 0.033584] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.002852] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.005669] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.033585] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.005670] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.002853] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.005671] Normal empty lb # [ 0.033586] Booting paravirtualized kernel on KVM worker2 # [ 0.005672] Device empty worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.002854] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.005673] Movable zone start for each node worker1 # [ 0.000000] kvm-clock: using sched offset of 516919546 cycles lb # [ 0.033589] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.005674] Early memory node ranges client # [ 0.002855] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.005674] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.038056] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.002855] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.005675] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.040226] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.002855] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.040270] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.005676] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002856] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.005696] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002857] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.005972] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.003077] No NUMA configuration found worker1 # [ 0.000833] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.034180] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.003078] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.002724] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.034655] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.002735] Using GB pages for direct mapping client # [ 0.003081] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.034667] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.005391] Zone ranges: lb # [ 0.040271] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/s4xy56bm0laswf8yp0lnzgg5gvcgz255-nixos-system-lb-test/init regInfo=/nix/store/0s0ch772hqi51yn9bhq64hlzcbl1z3ka-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.002829] RAMDISK: [mem 0x5e370000-0x5ffcffff] client # [ 0.005393] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.034696] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.002838] ACPI: Early table checksum verification disabled client # [ 0.005394] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.034699] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.002841] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.005395] Normal empty lb # [ 0.040362] Unknown kernel command line parameters "regInfo=/nix/store/0s0ch772hqi51yn9bhq64hlzcbl1z3ka-closure-info/registration", will be passed to user space. client # [ 0.005396] Device empty worker2 # [ 0.034700] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.040375] random: crng init done worker1 # [ 0.002845] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005397] Movable zone start for each node worker2 # [ 0.034702] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.005397] Early memory node ranges lb # [ 0.040375] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.002849] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.034703] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.005398] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.042424] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.005399] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.002857] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.034703] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.043638] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.002859] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.005400] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.043669] Fallback order for Node 0: 0 worker2 # [ 0.034706] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.005419] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.034707] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.002860] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.043672] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.034710] TSC deadline timer available lb # [ 0.043673] Policy zone: DMA32 client # [ 0.005684] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.034715] CPU topo: Max. logical packages: 1 worker1 # [ 0.002862] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.046071] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.031409] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.034716] CPU topo: Max. logical dies: 1 client # [ 0.031863] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.034716] CPU topo: Max. dies per package: 1 lb # [ 0.049108] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.002863] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.031874] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.034719] CPU topo: Max. threads per core: 1 lb # [ 0.052333] allocated 3145728 bytes of page_ext worker1 # [ 0.002865] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.034720] CPU topo: Num. cores per package: 1 lb # [ 0.062186] ftrace: allocating 48787 entries in 192 pages client # [ 0.031899] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.062188] ftrace: allocated 192 pages with 2 groups worker2 # [ 0.034720] CPU topo: Num. threads per package: 1 worker1 # [ 0.002866] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.031902] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.062998] Dynamic Preempt: lazy worker2 # [ 0.034721] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.002867] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.063129] rcu: Preemptible hierarchical RCU implementation. client # [ 0.031904] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.034740] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.063130] rcu: RCU event tracing is enabled. worker1 # [ 0.002868] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.031905] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.063131] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.034774] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.002868] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.031906] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.063132] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.034776] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.031906] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.002869] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.063133] Rude variant of Tasks RCU enabled. lb # [ 0.063133] Tracing variant of Tasks RCU enabled. worker2 # [ 0.034777] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.031909] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.002869] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.034779] Booting paravirtualized kernel on KVM client # [ 0.031910] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.063134] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.002870] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] client # [ 0.031913] TSC deadline timer available worker1 # [ 0.003110] No NUMA configuration found lb # [ 0.063134] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.031917] CPU topo: Max. logical packages: 1 worker2 # [ 0.034782] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.031918] CPU topo: Max. logical dies: 1 worker1 # [ 0.003111] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.039276] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.063155] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.031918] CPU topo: Max. dies per package: 1 worker1 # [ 0.003114] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.031922] CPU topo: Max. threads per core: 1 worker1 # [ 0.005545] Zone ranges: worker2 # [ 0.041579] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.063157] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.031922] CPU topo: Num. cores per package: 1 worker1 # [ 0.005545] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.041634] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.031923] CPU topo: Num. threads per package: 1 worker1 # [ 0.005547] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.063158] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.005548] Normal empty client # [ 0.031923] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.005549] Device empty lb # [ 0.067758] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.005549] Movable zone start for each node client # [ 0.031941] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() lb # [ 0.068045] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.005550] Early memory node ranges client # [ 0.031969] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.005551] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.068052] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.005552] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.031971] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.041635] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qir84w600srafs16f9kikb4gknc3p104-nixos-system-worker2-test/init regInfo=/nix/store/5cdi1aq72z624lzk19yyg9mqb18j8azk-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.031972] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.068151] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.005553] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.071656] Console: colour VGA+ 80x25 client # [ 0.031974] Booting paravirtualized kernel on KVM worker1 # [ 0.005574] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.041729] Unknown kernel command line parameters "regInfo=/nix/store/5cdi1aq72z624lzk19yyg9mqb18j8azk-closure-info/registration", will be passed to user space. lb # [ 0.071659] printk: legacy console [tty0] enabled worker1 # [ 0.005850] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.041741] random: crng init done lb # [ 0.101055] printk: legacy console [ttyS0] enabled client # [ 0.031976] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.032706] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.041741] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.199142] ACPI: Core revision 20250807 worker1 # [ 0.033176] ACPI: PM-Timer IO Port: 0x608 client # [ 0.036451] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.043989] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.033188] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.038542] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.199986] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.038583] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.033217] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.045114] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.045145] Fallback order for Node 0: 0 lb # [ 0.201451] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.033220] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.045147] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.202381] x2apic enabled worker1 # [ 0.033222] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.045148] Policy zone: DMA32 worker1 # [ 0.033223] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.203101] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.047794] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.033224] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.051044] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.038584] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test/init regInfo=/nix/store/9mbchw87wm67kspwy4r01ypax3r3mych-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.054339] allocated 3145728 bytes of page_ext worker1 # [ 0.033224] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.204865] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.064423] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.033227] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.064425] ftrace: allocated 192 pages with 2 groups client # [ 0.038675] Unknown kernel command line parameters "regInfo=/nix/store/9mbchw87wm67kspwy4r01ypax3r3mych-closure-info/registration", will be passed to user space. worker1 # [ 0.033228] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.065271] Dynamic Preempt: lazy worker1 # [ 0.033231] TSC deadline timer available client # [ 0.038687] random: crng init done lb # [ 0.205816] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.065420] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.033235] CPU topo: Max. logical packages: 1 client # [ 0.038688] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.065421] rcu: RCU event tracing is enabled. worker1 # [ 0.033236] CPU topo: Max. logical dies: 1 lb # [ 0.207394] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.033236] CPU topo: Max. dies per package: 1 client # [ 0.040740] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.065422] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.033240] CPU topo: Max. threads per core: 1 worker2 # [ 0.065423] Trampoline variant of Tasks RCU enabled. lb # [ 0.209478] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.041941] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.033240] CPU topo: Num. cores per package: 1 worker2 # [ 0.065424] Rude variant of Tasks RCU enabled. client # [ 0.041971] Fallback order for Node 0: 0 worker1 # [ 0.033241] CPU topo: Num. threads per package: 1 worker2 # [ 0.065424] Tracing variant of Tasks RCU enabled. lb # [ 0.210534] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.041974] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.033241] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.041975] Policy zone: DMA32 worker2 # [ 0.065424] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.211392] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.033260] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.044372] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.065425] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.033291] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.047340] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.065441] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.050533] allocated 3145728 bytes of page_ext lb # [ 0.212395] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.033292] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.060277] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.065443] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.033294] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.060278] ftrace: allocated 192 pages with 2 groups lb # [ 0.213392] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.033295] Booting paravirtualized kernel on KVM client # [ 0.061102] Dynamic Preempt: lazy worker2 # [ 0.065444] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.215392] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.061266] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.033299] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.069820] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.061267] rcu: RCU event tracing is enabled. lb # [ 0.216392] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.070109] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.061267] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.037786] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.217392] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.061269] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.039933] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.070117] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.061269] Rude variant of Tasks RCU enabled. worker1 # [ 0.039986] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.061269] Tracing variant of Tasks RCU enabled. worker2 # [ 0.070220] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.061270] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.073844] Console: colour VGA+ 80x25 worker2 # [ 0.073847] printk: legacy console [tty0] enabled client # [ 0.061271] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.103712] printk: legacy console [ttyS0] enabled client # [ 0.061292] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.218391] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.201319] ACPI: Core revision 20250807 lb # [ 0.220398] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.039987] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/mdpl287kr399rvszyfvd3fa6h47a12dq-nixos-system-worker1-test/init regInfo=/nix/store/76664a5z5p7jsx3wsqacr084ngmgfx5j-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.061294] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.202187] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.221903] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.061294] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.040082] Unknown kernel command line parameters "regInfo=/nix/store/76664a5z5p7jsx3wsqacr084ngmgfx5j-closure-info/registration", will be passed to user space. worker2 # [ 0.203703] APIC: Switch to symmetric I/O mode setup client # [ 0.065922] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.040094] random: crng init done lb # [ 0.222392] active return thunk: srso_alias_return_thunk worker2 # [ 0.204691] x2apic enabled client # [ 0.066203] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.040095] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.224014] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.205430] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.042185] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.066210] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.225251] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.043408] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.066313] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.226110] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.043440] Fallback order for Node 0: 0 client # [ 0.069805] Console: colour VGA+ 80x25 worker2 # [ 0.207574] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.043443] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.227111] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.069808] printk: legacy console [tty0] enabled worker1 # [ 0.043444] Policy zone: DMA32 client # [ 0.099220] printk: legacy console [ttyS0] enabled lb # [ 0.228113] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.044691] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.194803] ACPI: Core revision 20250807 worker2 # [ 0.208524] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.047939] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.228391] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.051217] allocated 3145728 bytes of page_ext worker2 # [ 0.210149] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.195670] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.061193] ftrace: allocating 48787 entries in 192 pages lb # [ 0.229391] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.061195] ftrace: allocated 192 pages with 2 groups client # [ 0.197224] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.211237] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.062044] Dynamic Preempt: lazy lb # [ 0.231277] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.198151] x2apic enabled worker1 # [ 0.062211] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.213172] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.232089] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.062211] rcu: RCU event tracing is enabled. client # [ 0.198896] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.214058] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.062212] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.233088] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.062214] Trampoline variant of Tasks RCU enabled. lb # [ 0.233392] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.062214] Rude variant of Tasks RCU enabled. client # [ 0.200665] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.214885] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.062215] Tracing variant of Tasks RCU enabled. lb # [ 0.234391] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.062215] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.201612] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.216146] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.235391] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.062216] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.217146] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.203215] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.062231] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.218864] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.204299] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.062232] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.219840] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.205402] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.062233] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.066594] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.206212] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.066872] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.207215] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.066879] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.220893] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.222153] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.066989] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.208212] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.070551] Console: colour VGA+ 80x25 worker1 # [ 0.070554] printk: legacy console [tty0] enabled client # [ 0.209212] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.223147] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.100132] printk: legacy console [ttyS0] enabled client # [ 0.210212] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.224146] active return thunk: srso_alias_return_thunk worker1 # [ 0.196175] ACPI: Core revision 20250807 client # [ 0.211212] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.225167] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.197077] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.226146] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.198647] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.227921] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.199625] x2apic enabled worker2 # [ 0.228927] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.200386] APIC: Switched APIC routing to: physical x2apic client # [ 0.212212] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.229914] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.214219] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.230915] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.202175] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.215213] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.231941] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' client # [ 0.216213] active return thunk: srso_alias_return_thunk worker1 # [ 0.203138] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.233146] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.217233] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.204767] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.234146] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.218212] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.205852] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.235145] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.219212] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.236145] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.206882] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.220212] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.237145] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.207764] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.221211] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.222212] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.238146] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.208768] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.223212] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.210764] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.224212] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.211764] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.225976] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.212763] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.226955] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.213764] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.227968] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.228974] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.229999] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.214763] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.216771] Spectre V2 : Enabling IBPB for BPF lb # [ 0.269014] Freeing SMP alternatives memory: 44K worker1 # [ 0.217765] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier lb # [ 0.269395] pid_max: default: 32768 minimum: 301 worker1 # [ 0.218764] active return thunk: srso_alias_return_thunk lb # [ 0.270475] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.271496] landlock: Up and running. worker1 # [ 0.219785] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.272392] Yama: becoming mindful. worker1 # [ 0.220764] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.273207] LSM support for eBPF active worker1 # [ 0.222541] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.273968] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.223561] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.274434] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.224547] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.225537] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker1 # [ 0.226620] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.277570] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.227764] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.278994] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.228764] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.279401] ... version: 2 worker1 # [ 0.229764] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.280139] ... bit width: 48 lb # [ 0.280394] ... generic counters: 6 worker1 # [ 0.230763] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.281099] ... generic bitmap: 000000000000003f worker1 # [ 0.231764] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.281394] ... fixed-purpose counters: 0 lb # [ 0.282131] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.232764] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.282394] ... value mask: 0000ffffffffffff lb # [ 0.283331] ... max period: 00007fffffffffff lb # [ 0.284106] ... global_ctrl mask: 000000000000003f lb # [ 0.284490] signal: max sigframe size: 3376 lb # [ 0.285304] rcu: Hierarchical SRCU implementation. lb # [ 0.286023] rcu: Max phase no-delay instances is 400. worker2 # [ 0.273132] Freeing SMP alternatives memory: 44K worker2 # [ 0.273964] pid_max: default: 32768 minimum: 301 lb # [ 0.291065] smp: Bringing up secondary CPUs ... worker2 # [ 0.274821] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.291408] smp: Brought up 1 node, 1 CPU worker2 # [ 0.275261] landlock: Up and running. worker2 # [ 0.276146] Yama: becoming mindful. lb # [ 0.292109] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.277300] LSM support for eBPF active worker2 # [ 0.278087] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.292548] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) lb # [ 0.293637] devtmpfs: initialized client # [ 0.264643] Freeing SMP alternatives memory: 44K worker2 # [ 0.279186] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.265215] pid_max: default: 32768 minimum: 301 lb # [ 0.294414] x86/mm: Memory block size: 128MB client # [ 0.266301] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.267321] landlock: Up and running. worker2 # [ 0.281697] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.296145] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.267919] Yama: becoming mindful. client # [ 0.268859] LSM support for eBPF active lb # [ 0.297263] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.282682] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.283150] ... version: 2 lb # [ 0.298484] pinctrl core: initialized pinctrl subsystem client # [ 0.269337] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.283869] ... bit width: 48 lb # [ 0.299635] PM: RTC time: 16:42:01, date: 2026-09-22 worker2 # [ 0.284148] ... generic counters: 6 client # [ 0.270252] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.284831] ... generic bitmap: 000000000000003f worker2 # [ 0.285201] ... fixed-purpose counters: 0 client # [ 0.273123] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.285930] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.286148] ... value mask: 0000ffffffffffff lb # [ 0.303080] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.273771] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.287059] ... max period: 00007fffffffffff client # [ 0.274217] ... version: 2 lb # [ 0.303879] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.287844] ... global_ctrl mask: 000000000000003f client # [ 0.274906] ... bit width: 48 worker2 # [ 0.288272] signal: max sigframe size: 3376 client # [ 0.275215] ... generic counters: 6 lb # [ 0.304422] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.289078] rcu: Hierarchical SRCU implementation. client # [ 0.275945] ... generic bitmap: 000000000000003f worker2 # [ 0.289737] rcu: Max phase no-delay instances is 400. lb # [ 0.305661] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.276226] ... fixed-purpose counters: 0 lb # [ 0.306404] audit: initializing netlink subsys (disabled) client # [ 0.276897] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.277214] ... value mask: 0000ffffffffffff lb # [ 0.307568] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.278136] ... max period: 00007fffffffffff lb # [ 0.307570] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.278930] ... global_ctrl mask: 000000000000003f worker1 # [ 0.267905] Freeing SMP alternatives memory: 44K lb # [ 0.308395] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.279326] signal: max sigframe size: 3376 worker1 # [ 0.268687] pid_max: default: 32768 minimum: 301 lb # [ 0.309360] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.294797] smp: Bringing up secondary CPUs ... client # [ 0.280153] rcu: Hierarchical SRCU implementation. worker1 # [ 0.269410] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.295162] smp: Brought up 1 node, 1 CPU client # [ 0.280793] rcu: Max phase no-delay instances is 400. worker1 # [ 0.269871] landlock: Up and running. lb # [ 0.310137] audit: type=2000 audit(1790095322.086:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.271184] Yama: becoming mindful. worker2 # [ 0.295810] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.311397] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.271978] LSM support for eBPF active lb # [ 0.311423] cpuidle: using governor menu worker1 # [ 0.272713] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.296370] Memory: 1454628K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) lb # [ 0.313609] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.297407] devtmpfs: initialized worker1 # [ 0.273801] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.298220] x86/mm: Memory block size: 128MB lb # [ 0.314620] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.285834] smp: Bringing up secondary CPUs ... client # [ 0.286229] smp: Brought up 1 node, 1 CPU lb # [ 0.315397] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.276241] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.316403] PCI: Using configuration type 1 for base access client # [ 0.286900] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.300018] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.277670] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.317453] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.301039] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.278500] ... version: 2 client # [ 0.287388] Memory: 1454632K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.302237] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.278766] ... bit width: 48 client # [ 0.288448] devtmpfs: initialized worker1 # [ 0.279462] ... generic counters: 6 worker2 # [ 0.303320] PM: RTC time: 16:42:01, date: 2026-09-22 client # [ 0.289286] x86/mm: Memory block size: 128MB worker1 # [ 0.279816] ... generic bitmap: 000000000000003f worker1 # [ 0.280667] ... fixed-purpose counters: 0 worker1 # [ 0.281279] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.291078] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.281766] ... value mask: 0000ffffffffffff lb # [ 0.322672] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.282627] ... max period: 00007fffffffffff client # [ 0.292142] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.307296] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.323395] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.283401] ... global_ctrl mask: 000000000000003f client # [ 0.293302] pinctrl core: initialized pinctrl subsystem lb # [ 0.324375] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.283881] signal: max sigframe size: 3376 worker2 # [ 0.308670] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.294406] PM: RTC time: 16:42:01, date: 2026-09-22 worker1 # [ 0.284648] rcu: Hierarchical SRCU implementation. worker2 # [ 0.309173] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.285346] rcu: Max phase no-delay instances is 400. worker2 # [ 0.310442] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.311157] audit: initializing netlink subsys (disabled) client # [ 0.297927] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.329394] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.312150] audit: type=2000 audit(1790095322.111:1): state=initialized audit_enabled=0 res=1 client # [ 0.298727] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.313364] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.290386] smp: Bringing up secondary CPUs ... client # [ 0.299237] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.313366] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.290779] smp: Brought up 1 node, 1 CPU worker2 # [ 0.314150] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.300484] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.291464] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.315098] thermal_sys: Registered thermal governor 'user_space' client # [ 0.301224] audit: initializing netlink subsys (disabled) worker2 # [ 0.315864] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.302372] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.292010] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.316170] cpuidle: using governor menu client # [ 0.302374] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.293030] devtmpfs: initialized client # [ 0.303215] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.318385] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.293778] x86/mm: Memory block size: 128MB lb # [ 0.337764] ACPI: Added _OSI(Module Device) lb # [ 0.338396] ACPI: Added _OSI(Processor Device) client # [ 0.304193] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.319379] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.339124] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.304940] audit: type=2000 audit(1790095322.118:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.295596] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.320151] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.306218] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.321160] PCI: Using configuration type 1 for base access worker1 # [ 0.296659] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.306244] cpuidle: using governor menu worker1 # [ 0.297851] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.322288] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.308428] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.298941] PM: RTC time: 16:42:01, date: 2026-09-22 client # [ 0.309457] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.310217] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.311227] PCI: Using configuration type 1 for base access worker1 # [ 0.302647] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.347275] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.312343] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.303954] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.304790] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.329171] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.330149] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.306054] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.306776] audit: initializing netlink subsys (disabled) worker1 # [ 0.307768] audit: type=2000 audit(1790095322.138:1): state=initialized audit_enabled=0 res=1 lb # [ 0.353649] ACPI: Interpreter enabled worker1 # [ 0.308979] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.354314] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.319445] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.354916] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.308982] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.335149] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.309767] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.320215] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.336149] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.355456] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.310663] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.356394] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.311447] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.311779] cpuidle: using governor menu worker1 # [ 0.314053] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.359516] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.325216] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.315001] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.326215] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.315770] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker1 # [ 0.316778] PCI: Using configuration type 1 for base access worker1 # [ 0.317911] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.347425] ACPI: Added _OSI(Module Device) worker2 # [ 0.348149] ACPI: Added _OSI(Processor Device) worker2 # [ 0.348929] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.368214] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.334842] ACPI: Added _OSI(Module Device) lb # [ 0.369165] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.323022] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.335216] ACPI: Added _OSI(Processor Device) worker1 # [ 0.323767] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.335915] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.370938] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.371523] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.372755] PCI host bridge to bus 0000:00 worker2 # [ 0.354499] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.373399] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.328767] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.374395] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.329766] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.375394] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.376395] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.358563] ACPI: Interpreter enabled client # [ 0.342836] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.359163] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.377394] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.359882] ACPI: Using IOAPIC for interrupt routing lb # [ 0.378394] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.379399] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.346140] ACPI: Interpreter enabled client # [ 0.346697] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.380453] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.362184] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.347215] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.363148] PCI: Using E820 reservations for host bridge windows lb # [ 0.381838] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.348106] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.340117] ACPI: Added _OSI(Module Device) worker1 # [ 0.340768] ACPI: Added _OSI(Processor Device) worker2 # [ 0.366286] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.341505] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.353214] PCI: Using E820 reservations for host bridge windows client # [ 0.354346] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.384463] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.385407] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.373780] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.386410] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.374159] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.349239] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.387547] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.375227] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.376271] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.389122] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.362989] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.377520] PCI host bridge to bus 0000:00 worker1 # [ 0.353165] ACPI: Interpreter enabled worker2 # [ 0.378153] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.353783] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.391413] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.364502] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.354465] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.379148] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.392247] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.365295] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.380148] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.393131] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.366339] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.381148] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.393401] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.367576] PCI host bridge to bus 0000:00 worker1 # [ 0.356830] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.382148] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.368219] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.357767] PCI: Using E820 reservations for host bridge windows lb # [ 0.394904] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.383148] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.369215] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.384149] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.370215] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.360803] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.397410] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.385171] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.371214] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.398300] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.372215] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.386620] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.399157] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.373215] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.399934] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.374216] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.375255] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.376649] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.402411] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.368818] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.403401] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.369771] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.404384] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.370845] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.389337] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.405860] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.390162] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.371889] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.373150] PCI host bridge to bus 0000:00 worker2 # [ 0.391143] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.407412] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.373771] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.408273] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.392489] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.374767] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.409121] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.379336] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.375750] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.409400] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] client # [ 0.380227] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.393883] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.376647] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.381160] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.377637] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.411385] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.378677] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.382460] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.397189] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.379677] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.413203] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.398070] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.414137] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.380543] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.398928] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.384145] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.399980] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.382210] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.414963] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.387233] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.401687] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.416395] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.388082] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.417334] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.388990] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.403186] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.390099] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.418837] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.404013] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.404900] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.421160] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.391756] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.421417] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.406574] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.384908] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.394156] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.385781] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.422949] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.394846] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.386692] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.424395] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.395237] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.409156] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.388140] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.425345] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.409964] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.396798] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.410869] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.389491] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.426748] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.411748] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.428402] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.400205] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.392811] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.429292] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.401086] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.413187] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.393654] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.430098] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.414047] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.401930] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.394482] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.394773] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.430945] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.414885] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.402768] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.415155] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.432410] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.396961] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.405105] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.433273] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.416711] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.405853] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.434118] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.399806] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.418196] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.406237] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.400690] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.419170] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.435804] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.407222] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.401529] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.436947] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.420706] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.408745] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.402349] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.437615] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.438909] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.422161] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.410228] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.439598] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.423172] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.411237] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.404775] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.440932] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.405669] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.424747] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.412798] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.406462] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.426161] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.407368] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.427170] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.414228] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.415911] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.428697] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.409729] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.416829] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.410438] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.430162] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.418241] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.410788] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.431171] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.419196] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.412608] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.432721] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.420588] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.414153] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.441901] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.434198] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.415779] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.435028] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.422657] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.416766] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.435879] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.423942] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.444962] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.418363] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.424752] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.445663] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.436736] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.446693] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.420558] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.427059] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.438156] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.447651] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.421499] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.427813] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.438957] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.428236] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.439891] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.422382] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.449440] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.440749] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.450283] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.429779] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.423808] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.441825] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.451747] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.424788] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.442359] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.431870] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.453023] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.432222] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.426318] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.433175] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.444054] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.434647] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.445067] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.428169] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.456382] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.457188] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.429511] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.435940] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.446829] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.458193] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.436421] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.430331] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.459245] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.460229] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.461283] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.438721] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.432651] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.462235] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.433458] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.439416] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.463230] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.433788] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.464176] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.440932] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.464409] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.465394] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.435307] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.466379] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.467186] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.437488] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.468198] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.437773] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.447375] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.469157] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.438748] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.470183] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.449810] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.440250] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.472198] iommu: Default domain type: Translated worker2 # [ 0.450542] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.473029] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.441536] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.473658] ACPI: bus type USB registered worker2 # [ 0.451434] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.474414] usbcore: registered new interface driver usbfs lb # [ 0.475327] usbcore: registered new interface driver hub worker2 # [ 0.452450] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.441970] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.441459] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.476046] usbcore: registered new device driver usb worker1 # [ 0.443637] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.454177] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] lb # [ 0.477245] NetLabel: Initializing client # [ 0.443963] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.455045] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.477808] NetLabel: domain hash size = 128 worker1 # [ 0.444625] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.478394] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.444512] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.456194] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.479373] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.446481] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.480073] PCI: Using ACPI for IRQ routing client # [ 0.445504] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.457796] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.446465] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.448244] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.449151] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.461804] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.462258] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.450284] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.463250] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.452020] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.464249] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker2 # [ 0.465249] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.466246] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.467249] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.446981] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.456511] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker2 # [ 0.468254] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.457353] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.449552] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.469194] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.458319] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.470163] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.459315] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.451041] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.471161] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.460315] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.472161] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.452053] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.461314] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.473139] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.453075] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.473934] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.462318] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker2 # [ 0.474895] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.463323] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.475164] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.454826] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] client # [ 0.464258] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.455639] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.465233] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.477137] iommu: Default domain type: Translated client # [ 0.466233] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.456843] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.477978] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.467196] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.479175] ACPI: bus type USB registered client # [ 0.467963] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.479977] usbcore: registered new interface driver usbfs worker1 # [ 0.458460] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.468228] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.480851] usbcore: registered new interface driver hub client # [ 0.469186] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.481159] usbcore: registered new device driver usb client # [ 0.469970] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.482958] NetLabel: Initializing worker2 # [ 0.483599] NetLabel: domain hash size = 128 worker1 # [ 0.462622] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.472019] iommu: Default domain type: Translated worker2 # [ 0.484148] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.472778] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.463611] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.485112] NetLabel: unlabeled traffic allowed by default client # [ 0.473480] ACPI: bus type USB registered worker1 # [ 0.464614] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.485864] PCI: Using ACPI for IRQ routing client # [ 0.474230] usbcore: registered new interface driver usbfs worker1 # [ 0.465611] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.475147] usbcore: registered new interface driver hub worker1 # [ 0.466666] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.475905] usbcore: registered new device driver usb worker1 # [ 0.467658] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.477186] NetLabel: Initializing worker1 # [ 0.468876] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.477649] NetLabel: domain hash size = 128 client # [ 0.478214] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker1 # [ 0.469916] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.479165] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.470807] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.479934] PCI: Using ACPI for IRQ routing worker1 # [ 0.471780] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.472779] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.473778] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.474782] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.522754] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.475779] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.523390] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.523390] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.523400] vgaarb: loaded worker1 # [ 0.476760] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.524154] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.477792] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.524397] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.479888] iommu: Default domain type: Translated worker1 # [ 0.480774] iommu: DMA domain TLB invalidation policy: lazy mode worker1 # [ 0.482043] ACPI: bus type USB registered worker1 # [ 0.482834] usbcore: registered new interface driver usbfs lb # [ 0.528478] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.483745] usbcore: registered new interface driver hub worker1 # [ 0.484490] usbcore: registered new device driver usb worker1 # [ 0.485712] NetLabel: Initializing lb # [ 0.532036] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.486197] NetLabel: domain hash size = 128 lb # [ 0.532744] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.486766] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.534075] pnp: PnP ACPI init worker1 # [ 0.487819] NetLabel: unlabeled traffic allowed by default lb # [ 0.534875] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.488781] PCI: Using ACPI for IRQ routing lb # [ 0.535813] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.537410] pnp: PnP ACPI: found 5 devices lb # [ 0.545024] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.546509] clocksource: Switched to clocksource acpi_pm lb # [ 0.547513] NET: Registered PF_INET protocol family lb # [ 0.548706] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.529834] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.530144] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.530144] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.530153] vgaarb: loaded worker2 # [ 0.530911] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.531148] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.523057] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.523210] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.523210] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.523220] vgaarb: loaded client # [ 0.523972] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.536245] clocksource: Switched to clocksource kvm-clock client # [ 0.524215] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.537988] VFS: Disk quotas dquot_6.6.0 lb # [ 0.565481] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.567003] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.540535] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.568361] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.541917] pnp: PnP ACPI init client # [ 0.528302] clocksource: Switched to clocksource kvm-clock lb # [ 0.569723] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.542782] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.570965] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.543819] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.572088] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.545441] pnp: PnP ACPI: found 5 devices client # [ 0.531913] VFS: Disk quotas dquot_6.6.0 lb # [ 0.573391] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.532639] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.574457] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.534029] pnp: PnP ACPI init lb # [ 0.575678] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.534865] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.576639] NET: Registered PF_XDP protocol family lb # [ 0.577504] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.535869] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.578517] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.537424] pnp: PnP ACPI: found 5 devices lb # [ 0.579541] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.533165] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.580665] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.533763] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.553083] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.581733] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.554521] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.533763] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.533771] vgaarb: loaded lb # [ 0.582807] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.555477] NET: Registered PF_INET protocol family worker1 # [ 0.534541] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.584521] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.556625] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.534766] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.586657] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.545070] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.546575] clocksource: Switched to clocksource acpi_pm lb # [ 0.588749] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.547608] NET: Registered PF_INET protocol family worker1 # [ 0.538859] clocksource: Switched to clocksource kvm-clock client # [ 0.548776] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.590826] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.592488] PCI: CLS 0 bytes, default 64 lb # [ 0.593457] Trying to unpack rootfs image as initramfs... worker1 # [ 0.542436] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.543135] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.544612] pnp: PnP ACPI init worker1 # [ 0.545439] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.546437] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.548043] pnp: PnP ACPI: found 5 devices lb # [ 0.599685] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.573478] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.575101] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.576468] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.577936] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.579272] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.565495] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.555623] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.557102] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.580360] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.566977] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.558077] NET: Registered PF_INET protocol family worker2 # [ 0.581661] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.568260] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.582745] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.559225] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.569615] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.583936] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.570816] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.584930] NET: Registered PF_XDP protocol family worker2 # [ 0.585827] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.571961] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.586848] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.573240] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.587876] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.574331] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.588999] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.575571] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.576536] NET: Registered PF_XDP protocol family worker2 # [ 0.590141] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.577366] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.591276] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.578381] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.592975] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.579400] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.580519] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.581659] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.595702] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.582804] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.597750] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.584587] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.600149] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.575847] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.587273] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.577471] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.601833] PCI: CLS 0 bytes, default 64 client # [ 0.589242] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.578787] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.602738] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.580130] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.604514] Trying to unpack rootfs image as initramfs... client # [ 0.591215] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.581425] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.592856] PCI: CLS 0 bytes, default 64 worker1 # [ 0.582591] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.583905] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.593744] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.584998] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.595479] Trying to unpack rootfs image as initramfs... worker1 # [ 0.586224] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.587251] NET: Registered PF_XDP protocol family worker1 # [ 0.588118] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.640264] Initialise system trusted keyrings worker1 # [ 0.589213] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.590246] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.642417] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.591399] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.592535] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.593754] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.595624] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker1 # [ 0.598274] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.600224] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker1 # [ 0.602183] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.603811] PCI: CLS 0 bytes, default 64 worker1 # [ 0.604780] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.606615] Trying to unpack rootfs image as initramfs... lb # [ 0.666437] Key type asymmetric registered lb # [ 0.667170] Asymmetric key parser 'x509' registered lb # [ 0.668057] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.671621] io scheduler mq-deadline registered lb # [ 0.674374] io scheduler kyber registered lb # [ 0.675665] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.648932] Initialise system trusted keyrings lb # [ 0.677208] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.652108] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.640410] Initialise system trusted keyrings lb # [ 0.683171] Linux agpgart interface v0.103 lb # [ 0.683947] ACPI: bus type drm_connector registered client # [ 0.643083] workingset: timestamp_bits=40 max_order=19 bucket_order=0 lb # [ 0.688479] usbcore: registered new interface driver usbserial_generic lb # [ 0.689648] usbserial: USB Serial support registered for generic lb # [ 0.692387] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.692387] Please enable it if your BIOS has the CPPC option. lb # [ 0.694712] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.699500] drop_monitor: Initializing network drop monitor service lb # [ 0.700758] NET: Registered PF_INET6 protocol family worker2 # [ 0.673416] Key type asymmetric registered worker1 # [ 0.650062] Initialise system trusted keyrings worker2 # [ 0.674140] Asymmetric key parser 'x509' registered worker2 # [ 0.674970] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.703807] Segment Routing with IPv6 worker1 # [ 0.652961] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.664334] Key type asymmetric registered lb # [ 0.706372] In-situ OAM (IOAM) with IPv6 lb # [ 0.707397] IPI shorthand broadcast: enabled worker2 # [ 0.680165] io scheduler mq-deadline registered client # [ 0.667033] Asymmetric key parser 'x509' registered worker2 # [ 0.680974] io scheduler kyber registered client # [ 0.667876] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.671165] io scheduler mq-deadline registered worker2 # [ 0.684608] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.671913] io scheduler kyber registered worker2 # [ 0.685909] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.715575] sched_clock: Marking stable (580015967, 135339343)->(785675321, -70320011) client # [ 0.674541] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.689834] Linux agpgart interface v0.103 client # [ 0.675780] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.690618] ACPI: bus type drm_connector registered lb # [ 0.720442] registered taskstats version 1 lb # [ 0.721449] Loading compiled-in X.509 certificates worker2 # [ 0.693504] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.694672] usbserial: USB Serial support registered for generic client # [ 0.681642] Linux agpgart interface v0.103 client # [ 0.682404] ACPI: bus type drm_connector registered worker2 # [ 0.698069] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.685473] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.675992] Key type asymmetric registered worker2 # [ 0.698069] Please enable it if your BIOS has the CPPC option. client # [ 0.686531] usbserial: USB Serial support registered for generic worker1 # [ 0.676696] Asymmetric key parser 'x509' registered worker2 # [ 0.700441] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.677557] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.689040] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.689040] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.704238] drop_monitor: Initializing network drop monitor service worker2 # [ 0.705427] NET: Registered PF_INET6 protocol family client # [ 0.691289] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.683013] io scheduler mq-deadline registered worker1 # [ 0.683810] io scheduler kyber registered worker2 # [ 0.708960] Segment Routing with IPv6 client # [ 0.695205] drop_monitor: Initializing network drop monitor service worker2 # [ 0.709723] In-situ OAM (IOAM) with IPv6 lb # [ 0.737782] Demotion targets for Node 0: null client # [ 0.696392] NET: Registered PF_INET6 protocol family worker1 # [ 0.686501] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.687800] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.740408] Key type .fscrypt registered client # [ 0.699472] Segment Routing with IPv6 worker2 # [ 0.713342] IPI shorthand broadcast: enabled lb # [ 0.741094] Key type fscrypt-provisioning registered lb # [ 0.742030] ima: No TPM chip found, activating TPM-bypass! client # [ 0.702053] In-situ OAM (IOAM) with IPv6 lb # [ 0.744372] ima: Allocated hash algorithm: sha1 client # [ 0.703151] IPI shorthand broadcast: enabled lb # [ 0.745147] ima: No architecture policies found worker1 # [ 0.693711] Linux agpgart interface v0.103 worker1 # [ 0.694658] ACPI: bus type drm_connector registered lb # [ 0.749381] PM: Magic number: 10:55:743 worker2 # [ 0.721765] sched_clock: Marking stable (586014048, 135028280)->(799535762, -78493434) lb # [ 0.750979] RAS: Correctable Errors collector initialized. worker1 # [ 0.699393] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.700514] usbserial: USB Serial support registered for generic worker2 # [ 0.725270] registered taskstats version 1 client # [ 0.711457] sched_clock: Marking stable (579013959, 132001185)->(788772646, -77757502) worker2 # [ 0.726210] Loading compiled-in X.509 certificates worker1 # [ 0.703922] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.715272] registered taskstats version 1 worker1 # [ 0.703922] Please enable it if your BIOS has the CPPC option. client # [ 0.716227] Loading compiled-in X.509 certificates worker1 # [ 0.706202] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.759063] clk: Disabling unused clocks worker1 # [ 0.709042] drop_monitor: Initializing network drop monitor service worker1 # [ 0.710217] NET: Registered PF_INET6 protocol family lb # [ 0.763373] PM: genpd: Disabling unused power domains worker1 # [ 0.713434] Segment Routing with IPv6 worker1 # [ 0.716924] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.718040] IPI shorthand broadcast: enabled worker2 # [ 0.742752] Demotion targets for Node 0: null worker2 # [ 0.746087] Key type .fscrypt registered worker2 # [ 0.746781] Key type fscrypt-provisioning registered client # [ 0.734035] Demotion targets for Node 0: null worker2 # [ 0.747783] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.750055] ima: Allocated hash algorithm: sha1 worker1 # [ 0.726377] sched_clock: Marking stable (592014087, 133883591)->(797381233, -71483555) client # [ 0.737062] Key type .fscrypt registered worker2 # [ 0.750802] ima: No architecture policies found client # [ 0.737733] Key type fscrypt-provisioning registered client # [ 0.738765] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.731109] registered taskstats version 1 client # [ 0.741035] ima: Allocated hash algorithm: sha1 worker2 # [ 0.755086] PM: Magic number: 10:55:743 client # [ 0.741911] ima: No architecture policies found worker1 # [ 0.732059] Loading compiled-in X.509 certificates worker2 # [ 0.756736] RAS: Correctable Errors collector initialized. client # [ 0.746032] PM: Magic number: 10:55:743 client # [ 0.747950] RAS: Correctable Errors collector initialized. worker2 # [ 0.764709] clk: Disabling unused clocks worker2 # [ 0.768069] PM: genpd: Disabling unused power domains client # [ 0.759692] clk: Disabling unused clocks worker1 # [ 0.749911] Demotion targets for Node 0: null client # [ 0.760498] PM: genpd: Disabling unused power domains worker1 # [ 0.750806] Key type .fscrypt registered worker1 # [ 0.753902] Key type fscrypt-provisioning registered worker1 # [ 0.754842] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.755736] ima: Allocated hash algorithm: sha1 worker1 # [ 0.757933] ima: No architecture policies found worker1 # [ 0.758928] PM: Magic number: 10:55:743 worker1 # [ 0.760539] RAS: Correctable Errors collector initialized. worker1 # [ 0.769626] clk: Disabling unused clocks worker1 # [ 0.773932] PM: genpd: Disabling unused power domains lb # [ 0.919164] Freeing initrd memory: 29064K lb # [ 0.922287] Freeing unused decrypted memory: 2028K lb # [ 0.924915] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.925984] Write protecting the kernel read-only data: 32768k lb # [ 0.927796] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.929267] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.934263] Freeing initrd memory: 29060K worker2 # [ 0.937506] Freeing unused decrypted memory: 2028K worker2 # [ 0.940298] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.941444] Write protecting the kernel read-only data: 32768k worker2 # [ 0.943379] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.944928] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.931766] Freeing initrd memory: 29056K client # [ 0.935059] Freeing unused decrypted memory: 2028K client # [ 0.937715] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.980065] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.938811] Write protecting the kernel read-only data: 32768k lb # [ 0.981088] Run /init as init process client # [ 0.940649] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.942188] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.937660] Freeing initrd memory: 29056K lb # [ 0.991937] systemd[1]: Inserted module 'autofs4' worker1 # [ 0.940949] Freeing unused decrypted memory: 2028K worker1 # [ 0.943640] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.944713] Write protecting the kernel read-only data: 32768k worker1 # [ 0.946566] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.948047] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 1.011729] fuse: init (API version 7.45) lb # [ 1.019044] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.021394] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 0.995798] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.024397] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 0.996935] Run /init as init process lb # [ 1.026309] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.031406] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.032957] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 0.992774] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.993873] Run /init as init process worker2 # [ 1.007728] systemd[1]: Inserted module 'autofs4' lb # [ 1.039608] virtiofs virtio6: discovered new tag: shared lb # [ 1.041092] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.044403] virtiofs virtio7: discovered new tag: xchg client # [ 1.004382] systemd[1]: Inserted module 'autofs4' lb # [ 1.045914] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 0.999071] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 1.000116] Run /init as init process worker2 # [ 1.027626] fuse: init (API version 7.45) worker1 # [ 1.011207] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.035178] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.024158] fuse: init (API version 7.45) worker2 # [ 1.037781] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.067108] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.041125] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.043356] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.031526] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.034167] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.049297] virtiofs virtio5: discovered new tag: nix-store client # [ 1.037377] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.050889] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.039324] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.031099] fuse: init (API version 7.45) client # [ 1.044608] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.058692] virtiofs virtio6: discovered new tag: shared client # [ 1.046188] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.060375] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.038439] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.063808] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.041218] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.065326] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.053426] virtiofs virtio6: discovered new tag: shared worker1 # [ 1.044419] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.055253] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.046628] ACPI: \_SB_.GSIF: Enabled at IRQ 21 client # [ 1.058580] virtiofs virtio7: discovered new tag: xchg client # [ 1.060082] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.052670] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.054268] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.062083] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.087156] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.063545] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.067173] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.068638] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.081692] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.090979] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.403710] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.415690] systemd[1]: Detected virtualization kvm. lb # [ 1.417785] systemd[1]: Detected architecture x86-64. lb # [ 1.419964] systemd[1]: Running in initrd. lb # [ 1.422467] systemd[1]: Initializing machine ID from random generator. lb # [ 1.425276] systemd[1]: Hostname set to . worker2 # [ 1.422779] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.427566] systemd[1]: Detected virtualization kvm. worker2 # [ 1.428417] systemd[1]: Detected architecture x86-64. worker2 # [ 1.429263] systemd[1]: Running in initrd. worker2 # [ 1.430410] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.431559] systemd[1]: Hostname set to . client # [ 1.417203] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.422355] systemd[1]: Detected virtualization kvm. client # [ 1.423223] systemd[1]: Detected architecture x86-64. client # [ 1.424198] systemd[1]: Running in initrd. client # [ 1.425295] systemd[1]: Initializing machine ID from random generator. client # [ 1.426502] systemd[1]: Hostname set to . worker1 # [ 1.427498] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.439431] systemd[1]: Detected virtualization kvm. worker1 # [ 1.441575] systemd[1]: Detected architecture x86-64. worker1 # [ 1.443708] systemd[1]: Running in initrd. worker1 # [ 1.446243] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.449135] systemd[1]: Hostname set to . lb # [ 1.644583] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.617337] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.638543] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.654694] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.697208] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.659273] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.701628] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.660413] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.702788] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.661823] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.662883] systemd[1]: Reached target Path Units. lb # [ 1.704151] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.663732] systemd[1]: Reached target Slice Units. lb # [ 1.705217] systemd[1]: Reached target Path Units. client # [ 1.664598] systemd[1]: Reached target Swaps. lb # [ 1.706041] systemd[1]: Reached target Slice Units. client # [ 1.665348] systemd[1]: Reached target Timer Units. lb # [ 1.706866] systemd[1]: Reached target Swaps. lb # [ 1.707727] systemd[1]: Reached target Timer Units. client # [ 1.666260] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.708671] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.667435] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.668548] systemd[1]: Listening on Journal Sockets. lb # [ 1.709847] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.710967] systemd[1]: Listening on Journal Sockets. client # [ 1.669497] systemd[1]: Listening on udev Control Socket. client # [ 1.670497] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.711912] systemd[1]: Listening on udev Control Socket. client # [ 1.671401] systemd[1]: Reached target Socket Units. lb # [ 1.712911] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.713849] systemd[1]: Reached target Socket Units. client # [ 1.673173] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.715575] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.676816] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.719151] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.691854] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.696502] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.697701] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.699149] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.700291] systemd[1]: Reached target Path Units. worker2 # [ 1.701203] systemd[1]: Reached target Slice Units. worker2 # [ 1.702069] systemd[1]: Reached target Swaps. worker1 # [ 1.676848] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.702851] systemd[1]: Reached target Timer Units. worker2 # [ 1.703839] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.705107] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.706289] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.707335] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.708386] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.709372] systemd[1]: Reached target Socket Units. worker2 # [ 1.711270] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.686456] systemd[1]: Starting Journal Service... lb # [ 1.728789] systemd[1]: Starting Journal Service... worker2 # [ 1.715125] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.711225] systemd[1]: Starting Load Kernel Modules... lb # [ 1.752927] systemd[1]: Starting Load Kernel Modules... client # [ 1.715112] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.757481] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.722196] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.724712] systemd[1]: Starting Journal Service... lb # [ 1.764564] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.734722] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.777024] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.749661] systemd[1]: Starting Load Kernel Modules... lb # [ 1.778412] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.738292] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.740636] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.754185] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.782920] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.732613] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.747452] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.737330] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.762123] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.738698] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.790708] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.740154] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.741367] systemd[1]: Reached target Path Units. worker1 # [ 1.742310] systemd[1]: Reached target Slice Units. worker1 # [ 1.743236] systemd[1]: Reached target Swaps. worker1 # [ 1.744070] systemd[1]: Reached target Timer Units. lb # [ 1.794789] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.753455] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.745224] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.746529] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.747730] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.748790] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.749869] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.750902] systemd[1]: Reached target Socket Units. worker2 # [ 1.775450] systemd-journald[66]: Collecting audit messages is disabled. worker1 # [ 1.752917] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.776776] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.765101] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.807420] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.758981] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.782700] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.790496] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.776376] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.818426] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.796543] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.785210] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.827501] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.766810] systemd[1]: Starting Journal Service... worker2 # [ 1.808256] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.791136] systemd[1]: Starting Load Kernel Modules... lb # [ 1.845454] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.805575] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.818699] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.798004] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.852615] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.812219] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.828249] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.805713] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.865905] systemd[1]: Finished Load Kernel Modules. client # [ 1.826112] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.817588] systemd-journald[66]: Collecting audit messages is disabled. worker1 # [ 1.822013] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.873659] systemd[1]: Starting Apply Kernel Variables... client # [ 1.833217] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.826616] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.855154] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.834362] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.839402] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.892243] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.864485] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.855184] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.898807] systemd[1]: Started Journal Service. client # [ 1.857215] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.726801] systemd-modules-load[67]: Inserted module 'dm_mod' worker2 # [ 1.875119] systemd[1]: Finished Load Kernel Modules. client # [ 1.729944] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.762906] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.769911] systemd-modules-load[67]: Inserted module 'virtio_balloon' client # [ 1.732107] systemd-modules-load[67]: Inserted module 'virtio_gpu' lb # [ 1.770901] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker1 # [ 1.854115] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.865097] systemd[1]: Reached target Local File Systems. lb # [ 1.771883] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.772967] systemd[1]: Reached target Local File Systems. lb # [ 1.774399] systemd[1]: Starting Create System Files and Directories... client # [ 1.870203] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.884121] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.859587] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.780046] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.877208] systemd[1]: Started Journal Service. lb # [ 1.786929] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.872092] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.751893] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.900152] systemd[1]: Started Journal Service. worker2 # [ 1.761856] systemd-modules-load[67]: Inserted module 'dm_mod' worker2 # [ 1.767975] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker2 # [ 1.770140] systemd-modules-load[67]: Inserted module 'virtio_gpu' client # [ 1.762272] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.779262] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.781912] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.810629] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.785937] systemd[1]: Reached target Local File Systems. worker2 # [ 1.790115] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.901598] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.794655] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.788368] systemd[1]: Finished Create System Files and Directories. worker1 # [ 1.911192] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.802163] systemd[1]: Finished Apply Kernel Variables. client # [ 1.795605] systemd-udevd[74]: Using default interface naming scheme 'v261'. lb # [ 1.837237] systemd-udevd[75]: Using default interface naming scheme 'v261'. worker1 # [ 1.922968] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.932639] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.821597] systemd[1]: Finished Create System Files and Directories. client # [ 1.820068] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.860206] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.810157] systemd-modules-load[67]: Inserted module 'dm_mod' worker1 # [ 1.813279] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker1 # [ 1.815356] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker1 # [ 1.953175] systemd[1]: Started Journal Service. worker1 # [ 1.823206] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.847276] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 1.831947] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.835990] systemd[1]: Reached target Local File Systems. worker1 # [ 1.840065] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.846161] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.870811] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.853660] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.912324] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.913737] systemd[1]: Reached target System Initialization. lb # [ 1.914585] systemd[1]: Reached target Basic System. client # [ 1.877136] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.877991] systemd[1]: Reached target System Initialization. client # [ 1.878898] systemd[1]: Reached target Basic System. worker1 # [ 1.878410] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.922221] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.900375] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.923492] systemd[1]: Reached target System Initialization. worker2 # [ 1.925403] systemd[1]: Reached target Basic System. worker1 # [ 1.923328] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.977127] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.977980] systemd[1]: Reached target System Initialization. worker1 # [ 1.978833] systemd[1]: Reached target Basic System. client # [ 2.152245] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.153849] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.238559] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.240461] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.201486] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.251930] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 2.254369] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.255043] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.215705] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.263239] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.264096] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.265859] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.225435] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.228143] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.228940] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.230717] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.275437] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.276307] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.278090] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.238045] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.279742] usb usb1: Product: EHCI Host Controller lb # [ 2.281389] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd client # [ 2.239838] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.282100] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.254408] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.241620] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.284549] hub 1-0:1.0: USB hub found client # [ 2.244021] usb usb1: Product: EHCI Host Controller lb # [ 2.285648] hub 1-0:1.0: 6 ports detected client # [ 2.244720] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.259721] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.246862] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.248257] hub 1-0:1.0: USB hub found worker2 # [ 2.261939] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.290584] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.291318] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.251018] hub 1-0:1.0: 6 ports detected client # [ 2.254832] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.271734] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.300386] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.301180] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.278233] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.265044] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker2 # [ 2.280608] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.281380] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.283123] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 lb # [ 2.314256] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.289157] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.275817] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.290245] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.277569] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.294044] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.295008] usb usb1: Product: EHCI Host Controller worker2 # [ 2.295866] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.325518] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.298450] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.299682] hub 1-0:1.0: USB hub found worker2 # [ 2.301066] hub 1-0:1.0: 6 ports detected client # [ 2.289607] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.290797] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.304826] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.333036] SCSI subsystem initialized worker2 # [ 2.305619] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.336625] usb usb2: Product: UHCI Host Controller lb # [ 2.337316] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.338052] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.212435] systemd[1]: Starting Virtual Console Setup... client # [ 2.174229] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.321625] uhci_hcd 0000:00:1d.0: detected 2 ports lb # [ 2.215239] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.178512] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.301434] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.315214] usb usb2: Product: UHCI Host Controller lb # [ 2.356542] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.315979] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.330083] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.310517] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.191929] (udev-worker)[86]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.315748] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.194124] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.340107] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.341292] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.328494] SCSI subsystem initialized lb # [ 2.238433] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.325121] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.241076] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.336062] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.325838] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.327572] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.352701] SCSI subsystem initialized worker1 # [ 2.329297] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.384115] hub 2-0:1.0: USB hub found lb # [ 2.249627] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.335925] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.336868] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.361203] usb usb2: Product: UHCI Host Controller lb # [ 2.253975] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.361929] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.338333] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.390933] hub 2-0:1.0: 2 ports detected worker1 # [ 2.339784] usb usb1: Product: EHCI Host Controller worker1 # [ 2.340902] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.341724] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.230361] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.343111] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.344494] hub 1-0:1.0: USB hub found client # [ 2.222369] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.346921] hub 1-0:1.0: 6 ports detected lb # [ 2.399260] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.226593] systemd[1]: Finished Virtual Console Setup. lb # [ 2.400092] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.240068] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.362209] hub 2-0:1.0: USB hub found worker2 # [ 2.377503] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.357416] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.358278] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.370064] hub 2-0:1.0: 2 ports detected lb # [ 2.416441] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.417219] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.367745] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.379134] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.288455] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.289343] systemd[1]: Reached target Initrd Root Device. lb # [ 2.291093] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.262843] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.265036] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.427794] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.378668] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.388885] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.389652] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.258773] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.432932] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.405726] hub 2-0:1.0: USB hub found lb # [ 2.434108] usb usb3: Product: UHCI Host Controller worker1 # [ 2.382557] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.261068] systemd[1]: Reached target Initrd Root Device. lb # [ 2.434905] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.383699] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.272305] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.262243] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.411152] hub 2-0:1.0: 2 ports detected lb # [ 2.442366] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.444422] hub 3-0:1.0: USB hub found client # [ 2.403304] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.445747] hub 3-0:1.0: 2 ports detected worker1 # [ 2.394664] SCSI subsystem initialized worker2 # [ 2.285101] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.396809] usb usb2: Product: UHCI Host Controller worker2 # [ 2.421627] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.450548] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.409289] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.425529] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.453391] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.402910] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.412642] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.403708] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.413821] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.456443] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.457207] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.460617] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.424070] usb usb3: Product: UHCI Host Controller client # [ 2.424789] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.425873] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.332741] systemd-fsck[108]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.427803] hub 3-0:1.0: USB hub found worker2 # [ 2.441744] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.419086] hub 2-0:1.0: USB hub found client # [ 2.429065] hub 3-0:1.0: 2 ports detected worker1 # [ 2.419736] hub 2-0:1.0: 2 ports detected worker2 # [ 2.443480] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.471390] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.289241] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.447261] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.476072] usb usb4: Product: UHCI Host Controller lb # [ 2.476913] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.304493] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.343452] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.438682] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.294077] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.480881] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.318105] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 2.319038] systemd[1]: Reached target Initrd Root Device. lb # [ 2.483604] hub 4-0:1.0: USB hub found worker2 # [ 2.321072] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.299060] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.485027] hub 4-0:1.0: 2 ports detected worker2 # [ 2.457279] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.300954] systemd[1]: Starting Virtual Console Setup... client # [ 2.312969] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.446698] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.447830] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.462633] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.463917] usb usb3: Product: UHCI Host Controller lb # [ 2.492057] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.464778] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.493230] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.452313] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.453783] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.456053] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.472129] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.474326] hub 3-0:1.0: USB hub found lb # [ 2.503366] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.476283] hub 3-0:1.0: 2 ports detected client # [ 2.463528] usb usb4: Product: UHCI Host Controller worker1 # [ 2.455294] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.467498] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.470175] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.484127] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.472830] hub 4-0:1.0: USB hub found worker2 # [ 2.486334] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.514704] scsi host0: ahci worker1 # [ 2.463935] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.474609] hub 4-0:1.0: 2 ports detected worker1 # [ 2.464665] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.518462] scsi host1: ahci worker2 # [ 2.491315] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.521395] scsi host2: ahci worker2 # [ 2.494310] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.337304] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.360413] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.524372] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.497198] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.341312] systemd[1]: Finished Virtual Console Setup. lb # [ 2.527576] scsi host3: ahci client # [ 2.487069] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.367468] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.531025] scsi host4: ahci worker2 # [ 2.505191] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.533686] scsi host5: ahci worker1 # [ 2.483173] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.534274] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.493662] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.536640] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.509550] usb usb4: Product: UHCI Host Controller lb # [ 2.537854] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.487328] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.538975] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.512102] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.540097] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.512913] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.541267] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.515374] hub 4-0:1.0: USB hub found worker2 # [ 2.516007] hub 4-0:1.0: 2 ports detected client # [ 2.502923] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.503825] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.361738] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.363138] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.365830] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.501976] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.503106] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.514111] scsi host0: ahci client # [ 2.514824] scsi host1: ahci client # [ 2.516852] scsi host2: ahci client # [ 2.518090] scsi host3: ahci client # [ 2.520059] scsi host4: ahci client # [ 2.522173] scsi host5: ahci client # [ 2.522780] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.514718] usb usb3: Product: UHCI Host Controller worker1 # [ 2.515533] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.525412] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.526688] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.517910] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.527863] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.529043] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.543013] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.520219] hub 3-0:1.0: USB hub found client # [ 2.530237] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.547245] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.524261] hub 3-0:1.0: 2 ports detected worker2 # [ 2.552071] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.552882] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.531090] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.531834] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.533645] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.559451] scsi host0: ahci worker2 # [ 2.561155] scsi host1: ahci worker1 # [ 2.538301] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.562745] scsi host2: ahci worker1 # [ 2.406345] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.564416] scsi host3: ahci worker2 # [ 2.566100] scsi host4: ahci worker1 # [ 2.543034] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.567774] scsi host5: ahci worker1 # [ 2.544367] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.568879] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.570514] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.571730] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.415464] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.572923] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.574130] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.550951] usb usb4: Product: UHCI Host Controller worker1 # [ 2.551673] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.575427] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker1 # [ 2.553855] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.558118] hub 4-0:1.0: USB hub found worker1 # [ 2.561002] hub 4-0:1.0: 2 ports detected worker1 # [ 2.586925] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.591503] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.598532] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.599910] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.603928] scsi host0: ahci lb # [ 2.653665] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.605636] scsi host1: ahci lb # [ 2.656580] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.607369] scsi host2: ahci worker1 # [ 2.609108] scsi host3: ahci client # [ 2.617127] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.660006] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.610771] scsi host4: ahci lb # [ 2.661887] usb 1-1: Manufacturer: QEMU client # [ 2.619964] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.612431] scsi host5: ahci lb # [ 2.663555] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.613527] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.623412] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.615188] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.625375] usb 1-1: Manufacturer: QEMU worker1 # [ 2.616324] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.617547] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.627125] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.618727] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.619955] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.694702] hid: raw HID events driver (C) Jiri Kosina client # [ 2.654167] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.674132] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.677101] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.680296] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.682136] usb 1-1: Manufacturer: QEMU worker2 # [ 2.683767] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.715924] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.716247] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.719109] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.722358] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.724226] usb 1-1: Manufacturer: QEMU client # [ 2.602240] systemd[1]: Mounting /sysroot... lb # [ 2.640486] systemd[1]: Mounting /sysroot... worker1 # [ 2.725835] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.637494] systemd[1]: Mounting /sysroot... worker1 # [ 2.753930] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.853620] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.855996] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.858251] ata3.00: applying bridge limits lb # [ 2.860211] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.862548] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.864682] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.867044] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.869403] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.685533] systemd[1]: Mounting /sysroot... lb # [ 2.871818] ata3.00: configured for UDMA/100 lb # [ 2.873946] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.837287] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.839780] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.842733] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.845320] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.847811] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.850885] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.853872] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.856461] ata3.00: applying bridge limits client # [ 2.858691] ata3.00: configured for UDMA/100 client # [ 2.861277] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.887780] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.889646] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.891611] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.893587] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.895909] ata3.00: applying bridge limits worker2 # [ 2.897484] ata3.00: configured for UDMA/100 worker2 # [ 2.899141] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.901009] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.902880] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.905478] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.950454] usbcore: registered new interface driver usbhid lb # [ 2.951232] usbhid: USB HID core driver lb # [ 2.953509] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.970422] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.978547] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.928859] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.931332] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.943269] usbcore: registered new interface driver usbhid client # [ 2.944512] usbhid: USB HID core driver worker1 # [ 2.934089] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.986994] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.936428] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.938736] ata3.00: applying bridge limits worker1 # [ 2.940732] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.943098] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.945318] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.997391] EXT4-fs (vda): mounted filesystem 56d2c6fc-ea8a-4853-899a-4071f2ffa212 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.947767] ata3.00: configured for UDMA/100 lb # [ 2.868085] systemd[1]: Mounted /sysroot. worker1 # [ 2.950326] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.962747] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 2.870850] systemd[1]: Reached target Initrd Root File System. client # [ 2.964624] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.871908] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.982288] usbcore: registered new interface driver usbhid worker2 # [ 2.985449] usbhid: USB HID core driver client # [ 2.971643] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.996384] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.888657] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.892915] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.894350] systemd[1]: Reloading... client # [ 2.989141] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 3.012281] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 3.014100] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 3.000931] EXT4-fs (vda): mounted filesystem b53245e3-6b86-47fc-b41e-54356a1bd522 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.016391] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.874400] systemd[1]: Mounted /sysroot. client # [ 2.875838] systemd[1]: Reached target Initrd Root File System. client # [ 2.877911] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.032185] EXT4-fs (vda): mounted filesystem 78394f41-ae5c-4963-aa17-efd9a46f8c98 r/w with ordered data mode. Quota mode: none. client # [ 2.891397] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.902879] systemd[1]: Mounted /sysroot. worker2 # [ 2.904955] systemd[1]: Reached target Initrd Root File System. client # [ 2.894459] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.896056] systemd[1]: Reloading... worker2 # [ 2.909076] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.029141] usbcore: registered new interface driver usbhid worker1 # [ 3.032640] usbhid: USB HID core driver worker2 # [ 2.925526] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.928655] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.932062] systemd[1]: Reloading... worker1 # [ 3.046043] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 3.048534] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 3.052187] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.970332] systemd[1]: Reloading finished in 75 ms. lb # [ 2.977776] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.062996] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.980128] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... lb # [ 2.986118] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 2.987206] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 2.988287] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.085379] EXT4-fs (vda): mounted filesystem 749003ec-1f8a-4a32-8885-235776741a32 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.957779] systemd[1]: Mounted /sysroot. worker1 # [ 2.959632] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.962942] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.978948] systemd[1]: Reloading finished in 81 ms. client # [ 2.987268] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... worker1 # [ 2.975657] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.992146] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker1 # [ 2.980266] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.982143] systemd[1]: Reloading... client # [ 2.996228] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 2.997637] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 2.998652] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.012910] systemd[1]: Reloading finished in 81 ms. worker2 # [ 3.020765] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.026159] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... worker2 # [ 3.028890] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.030363] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.032143] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.062867] systemd[1]: Reloading finished in 80 ms. worker1 # [ 3.070412] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.075168] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker1 # [ 3.079471] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.080853] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.081898] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.603346] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.642349] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.649164] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.611174] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.618317] systemd[1]: Mounting /sysroot/run... lb # [ 3.657151] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.638909] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.667292] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.630336] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.646208] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.678679] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.652300] systemd[1]: Mounting /sysroot/run... client # [ 3.642679] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.664325] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.675372] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.712415] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.715644] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.680965] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.722553] systemd[1]: Mounted /sysroot/run. client # [ 3.684513] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.723976] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.686746] systemd[1]: Mounted /sysroot/run. lb # [ 3.726131] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.688179] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.690238] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.728721] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.694160] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.685113] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.687757] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.739157] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.740565] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.692784] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.716064] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.705702] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.695132] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.707242] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.720173] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.720962] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.721646] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.700268] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.723392] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.727749] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.738299] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.739760] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.742088] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.728870] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.733665] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.736262] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.736916] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.737772] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.741481] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.767087] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.768270] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.769978] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.772831] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.752446] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.754072] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.756249] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.794603] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 3.777865] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.800727] systemd[1]: Finished Find NixOS closure. worker1 # [ 3.779062] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.780681] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.803177] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.804679] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 3.784138] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.820963] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.822373] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.800777] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.823635] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.824542] systemd[1]: Stopped target Basic System. worker2 # [ 3.826163] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.826868] systemd[1]: Stopped target Path Units. worker2 # [ 3.827587] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.828591] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.829627] systemd[1]: Stopped target Slice Units. worker2 # [ 3.831061] systemd[1]: Stopped target Socket Units. worker1 # [ 3.809078] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.831800] systemd[1]: Stopped target System Initialization. worker2 # [ 3.832634] systemd[1]: Stopped target Swaps. worker1 # [ 3.810468] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.833321] systemd[1]: Stopped target Timer Units. worker2 # [ 3.834189] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.835112] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.813150] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.836120] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.838155] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.838820] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.839663] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.840686] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.841521] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.842567] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.844079] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 3.845142] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.846175] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.847638] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.825915] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.848805] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.826893] systemd[1]: Stopped target Basic System. worker2 # [ 3.850143] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.827885] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.851424] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.852404] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.830188] systemd[1]: Stopped target Path Units. worker1 # [ 3.830886] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 3.831865] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.854691] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.832876] systemd[1]: Stopped target Slice Units. worker2 # [ 3.855790] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.833598] systemd[1]: Stopped target Socket Units. worker2 # [ 3.856764] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.834477] systemd[1]: Stopped target System Initialization. worker1 # [ 3.835253] systemd[1]: Stopped target Swaps. worker1 # [ 3.835884] systemd[1]: Stopped target Timer Units. worker1 # [ 3.836628] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 3.837417] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 3.838761] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.839766] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.840830] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.842129] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.865612] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.843372] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.844415] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.867833] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.846244] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 3.847215] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 3.871192] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.848940] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.872237] systemd[1]: Closed udev Control Socket. worker1 # [ 3.849989] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.851139] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.873794] systemd[1]: Starting Cleanup udev Database... worker2 # [ 3.874649] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.852651] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.853452] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.876154] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 3.876957] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.855495] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.856468] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.879049] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.880047] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 3.880953] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.859655] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.882479] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.860685] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.883558] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.861637] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.868735] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.872807] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.875805] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.899506] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.879118] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 3.902062] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.880181] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 3.902943] systemd[1]: Reached target Switch Root. worker1 # [ 3.881210] systemd[1]: Closed udev Control Socket. worker2 # [ 3.904563] systemd[1]: Starting NixOS Activation... worker1 # [ 3.885107] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.886127] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.887160] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.889056] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.890127] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.891304] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 3.892231] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.893379] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.895794] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.911447] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.913099] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.914273] systemd[1]: Reached target Switch Root. worker1 # [ 3.915926] systemd[1]: Starting NixOS Activation... worker2 # [ 3.974427] initrd-nixos-activation-start[189]: booting system configuration /nix/store/qir84w600srafs16f9kikb4gknc3p104-nixos-system-worker2-test worker1 # [ 3.976904] initrd-nixos-activation-start[191]: booting system configuration /nix/store/mdpl287kr399rvszyfvd3fa6h47a12dq-nixos-system-worker1-test worker2 # [ 4.000423] initrd-nixos-activation-start[189]: running activation script... worker1 # [ 4.001490] initrd-nixos-activation-start[191]: running activation script... worker2 # [ 4.178846] initrd-nixos-activation-start[212]: setting up /etc... worker1 # [ 4.175862] initrd-nixos-activation-start[214]: setting up /etc... worker2 # [ 4.281763] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.283419] systemd[1]: Finished NixOS Activation. worker2 # [ 4.286146] systemd[1]: Starting Switch Root... worker1 # [ 4.271927] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.273607] systemd[1]: Finished NixOS Activation. worker2 # [ 4.296805] systemd[1]: Switching root. worker1 # [ 4.275562] systemd[1]: Starting Switch Root... worker1 # [ 4.288449] systemd[1]: Switching root. worker2 # [ 4.553974] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.549236] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.666197] NET: Registered PF_VSOCK protocol family worker2 # [ 4.691804] NET: Registered PF_VSOCK protocol family lb # [ 4.641392] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.603563] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.688810] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.690615] systemd[1]: Reached target Initrd File Systems. client # [ 4.652962] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.654856] systemd[1]: Reached target Initrd File Systems. lb # [ 4.693070] systemd[1]: Starting Find NixOS closure... client # [ 4.656609] systemd[1]: Starting Find NixOS closure... lb # [ 4.695301] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.661105] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.714734] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.718066] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.724421] systemd[1]: Finished Find NixOS closure. client # [ 4.686370] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.725562] systemd[1]: Reached target Initrd Default Target. lb # [ 4.727305] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.690291] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.696719] systemd[1]: Finished Find NixOS closure. client # [ 4.698162] systemd[1]: Reached target Initrd Default Target. client # [ 4.699674] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.740122] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.742228] systemd[1]: Stopped target Basic System. lb # [ 4.742967] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.743749] systemd[1]: Stopped target Path Units. lb # [ 4.744441] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.745469] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.746537] systemd[1]: Stopped target Slice Units. lb # [ 4.747305] systemd[1]: Stopped target Socket Units. lb # [ 4.748082] systemd[1]: Stopped target System Initialization. lb # [ 4.749104] systemd[1]: Stopped target Swaps. lb # [ 4.749935] systemd[1]: Stopped target Timer Units. lb # [ 4.751132] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.713293] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.751937] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.714715] systemd[1]: Stopped target Basic System. lb # [ 4.752901] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.715626] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.754124] systemd[1]: Stopped Find NixOS closure. client # [ 4.716592] systemd[1]: Stopped target Path Units. lb # [ 4.755380] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.718106] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.756386] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.719128] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.758239] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.720272] systemd[1]: Stopped target Slice Units. client # [ 4.720995] systemd[1]: Stopped target Socket Units. lb # [ 4.759247] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.721753] systemd[1]: Stopped target System Initialization. client # [ 4.722892] systemd[1]: Stopped target Swaps. lb # [ 4.761580] systemd[1]: Stopped Load Kernel Modules. client # [ 4.723909] systemd[1]: Stopped target Timer Units. client # [ 4.724830] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.762670] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.763751] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.725972] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.765034] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.727215] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.728244] systemd[1]: Stopped Find NixOS closure. lb # [ 4.766322] systemd[1]: Stopped Create System Files and Directories. client # [ 4.729860] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.768614] systemd[1]: Stopped target Local File Systems. client # [ 4.731133] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.769424] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.732204] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.770364] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.771307] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.733143] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.734339] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.773401] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.774473] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.736318] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.775474] systemd[1]: Stopped Virtual Console Setup. client # [ 4.738730] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.739789] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.740835] systemd[1]: Stopped Create System Files and Directories. client # [ 4.742279] systemd[1]: Stopped target Local File Systems. client # [ 4.744116] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.782467] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 4.745078] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.746099] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.785490] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 4.748093] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.788394] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 4.750664] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.751621] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.790085] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.795080] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.796085] systemd[1]: Closed udev Control Socket. client # [ 4.757838] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.797734] systemd[1]: Starting Cleanup udev Database... lb # [ 4.799137] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.800210] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 4.762182] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.801065] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.802100] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 4.765493] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.804113] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.805097] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.806101] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.768593] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.807468] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.770473] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 4.772146] systemd[1]: Closed udev Control Socket. client # [ 4.774782] systemd[1]: Starting Cleanup udev Database... client # [ 4.775640] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 4.777082] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 4.778158] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 4.780128] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 4.781097] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 4.781995] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 4.783219] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.822398] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 4.785106] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.825091] systemd[1]: Finished Cleanup udev Database. lb # [ 4.825816] systemd[1]: Reached target Switch Root. lb # [ 4.827324] systemd[1]: Starting NixOS Activation... client # [ 4.801903] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 4.803297] systemd[1]: Finished Cleanup udev Database. client # [ 4.804473] systemd[1]: Reached target Switch Root. client # [ 4.806124] systemd[1]: Starting NixOS Activation... lb # [ 4.895677] initrd-nixos-activation-start[191]: booting system configuration /nix/store/s4xy56bm0laswf8yp0lnzgg5gvcgz255-nixos-system-lb-test client # [ 4.878603] initrd-nixos-activation-start[192]: booting system configuration /nix/store/nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test lb # [ 4.921866] initrd-nixos-activation-start[191]: running activation script... client # [ 4.905538] initrd-nixos-activation-start[192]: running activation script... worker1 # [ 5.025021] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.028918] systemd[1]: Detected virtualization kvm. worker1 # [ 5.029592] systemd[1]: Detected architecture x86-64. worker1 # [ 5.030348] systemd[1]: Detected first boot. worker1 # [ 5.032743] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.050850] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.060660] systemd[1]: Detected virtualization kvm. worker2 # [ 5.062506] systemd[1]: Detected architecture x86-64. worker2 # [ 5.064461] systemd[1]: Detected first boot. worker2 # [ 5.068240] systemd[1]: Initializing machine ID from random generator. lb # [ 5.107556] initrd-nixos-activation-start[214]: setting up /etc... client # [ 5.110358] initrd-nixos-activation-start[215]: setting up /etc... worker1 # [ 5.235711] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 5.310978] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.207934] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.210069] systemd[1]: Finished NixOS Activation. lb # [ 5.212149] systemd[1]: Starting Switch Root... lb # [ 5.222462] systemd[1]: Switching root. worker1 # [ 5.320009] systemd[1]: Applying preset policy. client # [ 5.213341] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.215067] systemd[1]: Finished NixOS Activation. client # [ 5.216877] systemd[1]: Starting Switch Root... client # [ 5.229598] systemd[1]: Switching root. worker2 # [ 5.423178] systemd[1]: Applying preset policy. lb # [ 5.480301] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). client # [ 5.483103] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.495948] systemd[1]: Populated /etc with preset unit settings. lb # [ 5.553353] NET: Registered PF_VSOCK protocol family client # [ 5.563132] NET: Registered PF_VSOCK protocol family worker2 # [ 5.586270] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.691677] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 5.693195] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.695344] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 5.697493] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.698924] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.699809] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.701028] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.702077] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 5.702782] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.703788] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 5.704802] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 5.705650] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 5.706472] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 5.707349] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 5.708270] systemd[1]: Reached target Path Units. worker1 # [ 5.708964] systemd[1]: Reached target Remote File Systems. worker1 # [ 5.709713] systemd[1]: Reached target Slice Units. worker1 # [ 5.710445] systemd[1]: Reached target Swaps. worker1 # [ 5.712311] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.714933] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.716691] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.718586] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.731304] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.734480] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.735727] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.738363] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.739899] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 5.741022] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.742332] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.746366] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 5.747472] systemd[1]: Listening on udev Control Socket. worker1 # [ 5.748391] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.750516] systemd[1]: Mounting Huge Pages File System... worker1 # [ 5.753295] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.777669] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.779225] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.781402] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 5.783445] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.784803] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.761954] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.785763] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.786967] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.788067] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.788745] systemd[1]: Expecting device /dev/ttyS0... worker2 # [ 5.789531] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.790380] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.791141] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 5.768316] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.791933] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.792812] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.793732] systemd[1]: Reached target Path Units. worker2 # [ 5.794473] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.795288] systemd[1]: Reached target Slice Units. worker2 # [ 5.795955] systemd[1]: Reached target Swaps. worker2 # [ 5.797834] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.800375] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.778019] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 5.802120] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.786952] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.787801] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.803941] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.816596] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.794166] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.819507] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.820884] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.798425] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 5.823263] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 5.824716] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.825845] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.827154] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.831289] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.832304] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.833149] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 5.835295] systemd[1]: Mounting Huge Pages File System... worker1 # [ 5.813039] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.838479] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.846200] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 5.821356] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 5.852162] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.860231] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.841776] systemd[1]: Starting Journal Service... worker2 # [ 5.868950] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.871441] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.849983] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.876414] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 5.858074] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.883170] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.864508] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 5.865504] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 5.911098] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 5.920771] systemd[1]: Detected virtualization kvm. worker1 # [ 5.870941] systemd[1]: Starting Coldplug All udev Devices... lb # [ 5.922542] systemd[1]: Detected architecture x86-64. lb # [ 5.924486] systemd[1]: Detected first boot. worker2 # [ 5.898130] systemd[1]: Mounting FUSE Control File System... worker1 # [ 5.876493] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.898969] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 5.878042] systemd[1]: Mounted Huge Pages File System. lb # [ 5.928157] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.880120] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 5.882277] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 5.885079] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 5.887055] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 5.889365] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.916130] systemd[1]: Starting Journal Service... worker1 # [ 5.895376] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 5.920819] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.927326] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.904785] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 5.906627] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.933416] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.936123] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.913966] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.940655] systemd[1]: Starting Coldplug All udev Devices... client # [ 5.923395] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.931343] systemd[1]: Detected virtualization kvm. worker2 # [ 5.946884] systemd[1]: Listening on Journal Log Access Socket. client # [ 5.932784] systemd[1]: Detected architecture x86-64. client # [ 5.934346] systemd[1]: Detected first boot. worker2 # [ 5.949257] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.951156] systemd[1]: Mounted POSIX Message Queue File System. client # [ 5.937861] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.953262] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 5.955649] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 5.932107] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 5.958287] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.968589] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 5.972303] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 5.966977] systemd-journald[284]: Collecting audit messages is enabled. worker1 # [ 5.967956] EXT4-fs (vda): re-mounted 749003ec-1f8a-4a32-8885-235776741a32. worker2 # [ 6.000379] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 6.002884] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 5.980725] loop: module loaded worker1 # [ 5.981996] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 5.983137] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 6.007489] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 5.985051] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 5.990643] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 5.992449] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.996958] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.001467] systemd[1]: Starting Firewall... worker2 # [ 6.025707] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 6.029305] EXT4-fs (vda): re-mounted 78394f41-ae5c-4963-aa17-efd9a46f8c98. worker1 # [ 6.006679] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 6.042270] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.044351] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 6.046162] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.052853] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.031567] systemd[1]: Started Journal Service. worker2 # [ 6.054850] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.901397] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 6.061369] systemd-journald[282]: Collecting audit messages is enabled. worker1 # [ 5.904868] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 6.062879] loop: module loaded worker1 # [ 5.911134] systemd-modules-load[285]: Inserted module 'loop' worker2 # [ 6.070799] systemd[1]: Finished Load Kernel Modules. worker1 # [ 5.915365] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 6.074616] systemd[1]: Starting Firewall... worker1 # [ 5.922519] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.080565] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 5.941087] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 5.963229] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 5.964223] systemd[1]: Reached target First Boot Complete. worker2 # [ 6.126309] systemd[1]: Started Journal Service. worker2 # [ 5.996146] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.997389] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 6.001843] systemd-modules-load[283]: Inserted module 'loop' lb # [ 6.165385] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.010769] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 6.015302] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.018541] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.021318] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.002733] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 6.028073] systemd[1]: Reached target First Boot Complete. worker1 # [ 6.139721] systemd-journald[284]: Received client request to flush runtime journal. client # [ 6.176502] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.061908] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.072361] systemd-oomd[284]: No swap; memory pressure usage will be degraded worker2 # [ 6.082391] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.221191] systemd-journald[282]: Received client request to flush runtime journal. lb # [ 6.262763] systemd[1]: Applying preset policy. worker1 # [ 6.107259] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 6.113296] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.114241] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 6.115213] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.118262] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.119262] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.283657] systemd[1]: Applying preset policy. worker1 # [ 6.199688] systemd-udevd[317]: Using default interface naming scheme 'v261'. worker2 # [ 6.226344] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.231237] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 6.233197] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.234432] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.403571] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.262193] systemd-udevd[316]: Using default interface naming scheme 'v261'. worker1 # [ 6.274330] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 6.334310] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.314663] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.459874] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.566374] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.567694] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.569886] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.571775] systemd[1]: Created slice Slice /system/getty. lb # [ 6.573098] systemd[1]: Created slice User and Session Slice. lb # [ 6.574040] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.575250] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.576381] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.577063] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.577854] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.578719] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.579515] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 6.580402] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 6.581258] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 6.582190] systemd[1]: Reached target Path Units. lb # [ 6.582889] systemd[1]: Reached target Remote File Systems. lb # [ 6.583688] systemd[1]: Reached target Slice Units. lb # [ 6.584430] systemd[1]: Reached target Swaps. lb # [ 6.586122] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.425226] systemd[1]: Finished Coldplug All udev Devices. lb # [ 6.588556] systemd[1]: Listening on Process Core Dump Socket. lb # [ 6.590301] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.603789] systemd[1]: Listening on Factory Reset Management. lb # [ 6.604738] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.607684] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.421930] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.608860] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.611225] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.612689] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.613839] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.615110] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.618992] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.619996] systemd[1]: Listening on udev Control Socket. lb # [ 6.620867] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.622969] systemd[1]: Mounting Huge Pages File System... lb # [ 6.625151] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 6.631498] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.637829] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.646714] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 6.655647] systemd[1]: Starting Load Kernel Module configfs... lb # [ 6.661098] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.505825] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.672860] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.683126] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.510906] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 6.697988] systemd[1]: Mounting FUSE Control File System... client # [ 6.661751] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.663109] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.704665] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.665359] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 6.522349] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.667355] systemd[1]: Created slice Slice /system/getty. client # [ 6.668651] systemd[1]: Created slice User and Session Slice. client # [ 6.669547] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.670741] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.671873] systemd[1]: Expecting device /dev/hvc0... client # [ 6.672615] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.673353] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.715142] systemd[1]: Starting Journal Service... client # [ 6.674162] systemd[1]: Stopped target initrd-fs.target. client # [ 6.674887] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.675687] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.676530] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.677398] systemd[1]: Reached target Path Units. client # [ 6.678100] systemd[1]: Reached target Remote File Systems. client # [ 6.678863] systemd[1]: Reached target Slice Units. lb # [ 6.721393] systemd[1]: Starting Load Kernel Modules... lb # [ 6.730633] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.679593] systemd[1]: Reached target Swaps. client # [ 6.692770] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.695318] systemd[1]: Listening on Process Core Dump Socket. lb # [ 6.737107] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.697094] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.699052] systemd[1]: Listening on Factory Reset Management. client # [ 6.699935] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.741074] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.702620] systemd[1]: Starting Journal Log Access Socket... client # [ 6.703915] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 6.582993] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 6.561461] systemd[1]: Mounting /run/wrappers... client # [ 6.706251] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.707352] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.708832] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.566266] (udev-worker)[357]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.710135] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.755290] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.714212] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.715224] systemd[1]: Listening on udev Control Socket. client # [ 6.716099] systemd[1]: Listening on udev Varlink Socket. client # [ 6.718152] systemd[1]: Mounting Huge Pages File System... client # [ 6.720530] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.578667] (udev-worker)[359]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 6.581713] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.727463] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.770231] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.608037] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 6.772542] systemd-journald[284]: Collecting audit messages is enabled. client # [ 6.734141] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.779017] systemd[1]: Mounted Huge Pages File System. client # [ 6.740173] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 6.782092] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.786521] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.791520] systemd[1]: Mounted Kernel Trace File System. client # [ 6.750644] systemd[1]: Starting Load Kernel Module configfs... lb # [ 6.796551] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.755801] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.614201] systemd[1]: Mounted /run/wrappers. lb # [ 6.664982] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 6.637054] (udev-worker)[345]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.666440] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.802882] systemd[1]: Started Journal Service. worker1 # [ 6.618564] systemd[1]: Reached target Local File Systems. worker2 # [ 6.641345] (udev-worker)[345]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.623057] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.673059] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 6.646148] systemd[1]: Mounting /run/wrappers... lb # [ 6.674907] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.769742] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.677545] systemd[1]: Mounted FUSE Control File System. worker1 # [ 6.628072] systemd[1]: Starting register-nix-paths.service... worker2 # [ 6.653349] (udev-worker)[343]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.632169] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.778090] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.636542] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.640231] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 6.786137] systemd[1]: Mounting FUSE Control File System... lb # [ 6.830066] loop: module loaded client # [ 6.788613] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.646609] systemd[1]: Starting Create System Files and Directories... lb # [ 6.832364] EXT4-fs (vda): re-mounted 56d2c6fc-ea8a-4853-899a-4071f2ffa212. lb # [ 6.699424] systemd-modules-load[285]: Inserted module 'loop' lb # [ 6.704094] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.708414] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.805276] systemd[1]: Starting Journal Service... lb # [ 6.719093] systemd[1]: Finished Load Kernel Modules. client # [ 6.814250] systemd[1]: Starting Load Kernel Modules... lb # [ 6.720281] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.696059] systemd[1]: Mounted /run/wrappers. worker2 # [ 6.697898] systemd[1]: Reached target Local File Systems. worker2 # [ 6.701129] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.823847] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.731493] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 6.705212] systemd[1]: Starting register-nix-paths.service... worker2 # [ 6.707435] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 6.708885] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 6.711760] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 6.739615] systemd-oomd[287]: No swap; memory pressure usage will be degraded lb # [ 6.742266] systemd[1]: Starting Firewall... client # [ 6.836242] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.716138] systemd[1]: Starting Create System Files and Directories... lb # [ 6.748339] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.842153] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.749346] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.759189] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.853793] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.863358] systemd-journald[285]: Collecting audit messages is enabled. lb # [ 6.772096] systemd[1]: Starting Apply Kernel Variables... lb # [ 6.773024] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.869269] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.779553] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.879913] systemd[1]: Mounted Huge Pages File System. worker1 # [ 6.736819] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 6.880808] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 6.741644] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.886277] systemd[1]: Mounted Kernel Debug File System. client # [ 6.890361] systemd[1]: Mounted Kernel Trace File System. client # [ 6.898123] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.770764] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.904671] systemd[1]: Started Journal Service. client # [ 6.773640] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 6.907027] loop: module loaded worker2 # [ 6.790198] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 6.792837] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.782553] systemd-modules-load[286]: Inserted module 'loop' client # [ 6.783554] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.787235] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.791336] systemd[1]: Mounted FUSE Control File System. client # [ 6.796161] systemd[1]: Finished Load Kernel Modules. lb # [ 6.971851] systemd-journald[284]: Received client request to flush runtime journal. worker1 # [ 6.790306] systemd[1]: Finished Create System Files and Directories. client # [ 6.935270] EXT4-fs (vda): re-mounted b53245e3-6b86-47fc-b41e-54356a1bd522. worker1 # [ 6.795294] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 6.798033] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.810065] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.813166] systemd[1]: Starting Apply Kernel Variables... client # [ 6.819091] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.821121] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.827108] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.841971] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.842890] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.857070] systemd[1]: Finished Create System Files and Directories. client # [ 6.848958] systemd-oomd[287]: No swap; memory pressure usage will be degraded worker2 # [ 6.862511] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.864620] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 6.857154] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.857992] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.861970] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 6.930693] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 6.882453] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 6.936081] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.936881] systemd[1]: Reached target First Boot Complete. lb # [ 6.937685] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.939232] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.943703] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.946109] systemd[1]: Finished Apply Kernel Variables. client # [ 7.048346] systemd-journald[285]: Received client request to flush runtime journal. worker2 # [ 6.942714] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 6.959929] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 6.938869] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.961982] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.964879] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.943392] systemd[1]: Starting Update is Completed... worker2 # [ 6.966880] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 6.970691] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.972678] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.974793] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.029850] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 7.005881] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 7.007729] systemd[1]: Starting Update is Completed... client # [ 6.998453] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.999380] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.000644] systemd[1]: Reached target First Boot Complete. lb # [ 7.039419] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.002395] systemd[1]: Finished Apply Kernel Variables. lb # [ 7.040642] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 7.043146] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 7.006122] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.997762] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 6.998977] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.000532] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.005470] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.007638] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.010135] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.012735] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.014718] systemd[1]: Finished Update is Completed. client # [ 7.038707] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.042460] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 7.085606] systemd-udevd[321]: Using default interface naming scheme 'v261'. client # [ 7.078865] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 7.090416] systemd[1]: Finished Update is Completed. client # [ 7.093471] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 7.132651] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.095147] systemd[1]: Reached target Preparation for Local File Systems. client # [ 7.097124] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 7.127051] systemd-udevd[317]: Using default interface naming scheme 'v261'. client # [ 7.159071] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 7.318958] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 7.163702] systemd[1]: Finished Firewall. lb # [ 7.248048] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.345518] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker1 # [ 7.359015] ACPI: button: Power Button [PWRF] client # [ 7.237143] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.253196] systemd[1]: Finished Firewall. worker2 # [ 7.393537] ACPI: button: Power Button [PWRF] worker1 # [ 7.411689] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.289902] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.331263] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 7.294688] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 7.307519] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.297090] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 7.439359] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.359839] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.444582] mousedev: PS/2 mouse device common for all mice client # [ 7.321641] (udev-worker)[328]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.325724] (udev-worker)[328]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.327571] (udev-worker)[322]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.450844] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.453008] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T16:42:09 UTC (1790095329) worker2 # [ 7.347132] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.348397] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 7.376290] (udev-worker)[348]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.462734] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.487413] mousedev: PS/2 mouse device common for all mice worker1 # [ 7.468312] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker2 # [ 7.493878] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 7.471502] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 7.387309] (udev-worker)[352]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.389678] (udev-worker)[352]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.475527] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 7.509955] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.517711] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.521497] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T16:42:09 UTC (1790095329) worker2 # [ 7.536662] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 7.538904] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.541855] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 7.434949] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.544500] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 7.399424] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 7.400796] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.402866] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.404803] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.406654] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.407887] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.468395] systemd[1]: Mounted /run/wrappers. lb # [ 7.470408] systemd[1]: Reached target Local File Systems. lb # [ 7.474222] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.478177] systemd[1]: Starting register-nix-paths.service... lb # [ 7.483339] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 7.484848] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.499302] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 7.597884] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.506708] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.541330] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 7.604762] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 7.607031] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.594737] Console: switching to colour dummy device 80x25 worker1 # [ 7.648078] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.532499] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.648196] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.598195] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.684587] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 7.604327] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 7.689001] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 7.567963] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.610075] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 7.613404] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.615279] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.578494] systemd[1]: Mounted /run/wrappers. client # [ 7.579249] systemd[1]: Reached target Local File Systems. lb # [ 7.617464] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.582175] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.713982] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 7.619983] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.714192] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 7.584129] systemd[1]: Starting register-nix-paths.service... lb # [ 7.622242] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.623542] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.587913] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 7.588800] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.712160] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 7.712903] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.598327] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.715773] Console: switching to colour dummy device 80x25 worker2 # [ 7.752738] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.752740] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.609357] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.735950] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 7.738054] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.661465] systemd[1]: Finished Create System Files and Directories. worker2 # [ 7.769482] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 7.770855] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 7.626615] ACPI: button: Power Button [PWRF] worker2 # [ 7.776154] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 7.776817] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 7.669987] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 7.675035] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 7.636125] mousedev: PS/2 mouse device common for all mice client # [ 7.652499] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.672644] rtc_cmos PNP0B00:00: registered as rtc0 client # [ 7.672711] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T16:42:09 UTC (1790095329) worker1 # [ 7.630242] systemd[1]: Starting Virtual Console Setup... worker1 # [ 7.653632] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.682861] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.683907] systemd[1]: Reached target System Initialization. worker2 # [ 7.685410] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 7.688306] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.689340] systemd[1]: Reached target Timer Units. client # [ 7.678588] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.691140] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.692176] systemd[1]: Listening on Nix Daemon Socket. client # [ 7.683319] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.694057] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 7.697132] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.698569] systemd[1]: Reached target Socket Units. worker2 # [ 7.699346] systemd[1]: Reached target Basic System. worker2 # [ 7.701064] systemd[1]: Started backdoor.service. worker2 # [ 7.704968] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 7.708273] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.714066] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.716225] systemd[1]: Started Reset console on configuration changes. client # [ 7.672780] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 7.708820] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 7.722849] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.728819] systemd[1]: Starting resolvconf update... client # [ 7.722231] systemd[1]: Finished Create System Files and Directories. worker2 # [ 7.735652] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.728072] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 7.768521] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.731623] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.742498] systemd[1]: Starting Virtual Console Setup... lb # [ 7.807464] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.879751] Console: switching to colour frame buffer device 160x50 lb # [ 7.815112] systemd[1]: Starting Update is Completed... worker1 # [ 7.886799] ppdev: user-space parallel port driver worker1 # [ 7.903893] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 7.955924] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 7.722931] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 7.757643] Console: switching to colour dummy device 80x25 client # [ 7.916275] [drm] Found bochs VGA, ID 0xb0c5. client # [ 7.916277] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.776481] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 7.777557] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 7.778936] systemd[1]: Starting Virtual Console Setup... client # [ 7.800739] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.821512] systemd[1]: Finished Post-Boot Actions. lb # [ 7.989834] ACPI: button: Power Button [PWRF] client # [ 7.955394] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 7.956097] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.998195] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.815493] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 7.819637] systemd[1]: Stopped Virtual Console Setup. client # [ 7.831508] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.964668] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.965354] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.835691] systemd[1]: Starting Update is Completed... worker1 # [ 7.824228] systemd[1]: Starting Virtual Console Setup... lb # [ 7.884330] systemd[1]: Finished Update is Completed. worker1 # [ 7.970074] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 7.981415] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 7.878584] systemd[1]: Finished Update is Completed. worker1 # [ 8.062930] kvm_amd: TSC scaling supported worker1 # [ 8.063378] kvm_amd: Nested Virtualization enabled worker1 # [ 8.063814] kvm_amd: Nested Paging enabled worker1 # [ 8.064766] kvm_amd: LBR virtualization supported worker1 # [ 8.065382] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.066042] kvm_amd: Virtual GIF supported worker1 # [ 8.066441] kvm_amd: Virtual NMI enabled worker1 # [ 8.103650] EDAC MC: Ver: 3.0.0 client # [ 8.017918] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.156986] Console: switching to colour frame buffer device 160x50 worker1 # [ 8.020874] systemd-vconsole-setup[519]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.024786] systemd[1]: Finished Virtual Console Setup. worker1 # [ 8.026163] systemd[1]: Reached target System Initialization. worker1 # [ 8.027416] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 8.029193] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 8.031127] systemd[1]: Reached target Timer Units. worker1 # [ 8.031892] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 8.032794] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 8.035472] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 8.036642] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 8.037859] systemd[1]: Reached target Socket Units. worker1 # [ 8.039135] systemd[1]: Reached target Basic System. worker1 # [ 8.041980] systemd[1]: Started backdoor.service. worker1 # [ 8.044082] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 8.177813] ppdev: user-space parallel port driver worker1 # [ 8.049154] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.206718] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.050734] systemd[1]: Starting Post-Boot Actions... worker2 # [ 7.863973] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # connecting to host... worker1 # [ 8.056192] systemd[1]: Started Reset console on configuration changes. client # [ 8.089130] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.080368] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.060605] systemd[1]: Starting resolvconf update... worker1 # [ 8.066177] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 8.084243] nsncd[512]: Sep 22 16:42:09.980 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.082559] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.093418] dbus-broker-launch[516]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.085899] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.096469] dbus-broker-launch[516]: NSS returned no entry for 'systemd-timesync' client # [ 8.091280] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.102124] dbus-broker-launch[516]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 8.106317] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.089378] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 8.175950] Console: switching to colour frame buffer device 160x50 client # [ 8.234387] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 8.114413] systemd[1]: Starting User Login Management... worker2 # [ 8.115676] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.121343] nsncd[584]: Sep 22 16:42:10.163 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.125641] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 8.128408] dbus-broker-launch[516]: Ready worker2 # [ 8.136206] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 8.137157] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 8.137922] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 8.140140] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 8.140891] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 8.144105] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 8.144890] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 8.149202] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.157389] systemd-logind[527]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 8.158546] systemd-logind[527]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.137059] systemd[1]: Finished Post-Boot Actions. lb # [ 8.057637] mousedev: PS/2 mouse device common for all mice worker2 # [ 8.162814] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.163832] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.167181] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.167961] systemd[1]: Finished resolvconf update. worker2 # [ 8.171475] systemd[1]: Reached target Preparation for Network. lb # [ 8.199474] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.096990] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 8.173314] systemd[1]: Starting DHCP Client... lb # [ 8.127389] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 8.173944] systemd[1]: Starting Address configuration of eth1... lb # [ 8.127455] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T16:42:09 UTC (1790095329) worker2 # [ 8.174767] systemd-logind[527]: New seat seat0. worker2 # [ 8.175448] systemd[1]: Starting Extra networking commands.... lb # [ 8.204678] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.169328] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 8.182153] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.183125] systemd[1]: Stopped Virtual Console Setup. client # [ 8.172974] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.183809] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.184541] systemd[1]: Started User Login Management. worker2 # [ 8.185268] systemd[1]: Starting linger-users.service... worker1 # connecting to host... worker1 # [ 8.164777] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.165639] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.169278] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.316697] ppdev: user-space parallel port driver worker1 # [ 8.173672] nsncd[526]: Sep 22 16:42:10.352 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.176605] systemd[1]: Starting User Login Management... worker2 # [ 8.200654] systemd-logind[527]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.127545] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 8.128599] systemd-journald[284]: Time jumped backwards, rotating. lb # [ 8.152055] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 8.195917] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 8.341204] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.224809] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 8.226645] systemd[1]: Finished linger-users.service. worker1 # [ 8.213609] dbus-broker-launch[530]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 8.220174] dbus-broker-launch[530]: NSS returned no entry for 'systemd-timesync' client # [ 8.366675] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.221702] dbus-broker-launch[530]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.273355] systemd[1]: Finished Firewall. lb # [ 8.152158] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.192841] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 8.279288] systemd[1]: Finished register-nix-paths.service. lb # [ 8.281611] systemd[1]: Reached target System Initialization. worker1 # [ 8.233732] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.284194] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.285268] systemd[1]: Started niks3 garbage collection timer. lb # [ 8.286120] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 8.286976] systemd[1]: Reached target Timer Units. lb # [ 8.287655] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 8.291658] systemd[1]: Listening on niks3 server socket. lb # [ 8.292463] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.293294] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.294458] systemd[1]: Reached target Socket Units. client # [ 8.256738] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.295207] systemd[1]: Reached target Basic System. client # [ 8.257964] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.403495] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 8.297253] systemd[1]: Started backdoor.service. lb # [ 8.299067] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.264736] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.256217] dbus-broker-launch[530]: Ready worker2 # [ 8.279464] network-addresses-eth1-start[610]: adding address 192.168.1.4/24... done lb # [ 8.309888] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.208289] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 8.322740] Console: switching to colour dummy device 80x25 lb # [ 8.399590] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 8.323115] systemd[1]: Starting Post-Boot Actions... worker2 # [ 8.297277] network-addresses-eth1-start[610]: adding address 2001:db8:1::4/64... done lb # [ 8.327986] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.282108] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 8.284320] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 8.288195] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 8.290207] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 8.292072] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 8.292986] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 8.294564] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 8.345176] systemd[1]: Starting resolvconf update... worker1 # [ 8.296941] systemd-logind[549]: New seat seat0. worker2 # [ 8.320138] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.301298] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.460596] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.307075] systemd-logind[549]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 8.308900] systemd-logind[549]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 8.310123] systemd-logind[549]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.312109] systemd[1]: Started User Login Management. lb # [ 8.366117] systemd[1]: Started rustfs.service. worker1 # [ 8.316235] systemd[1]: Starting linger-users.service... lb # [ 8.379351] systemd[1]: Starting rustfs-bucket.service... lb # [ 8.399692] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.499822] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 8.500083] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 8.489174] kvm_amd: TSC scaling supported client # [ 8.489605] kvm_amd: Nested Virtualization enabled client # [ 8.490492] kvm_amd: Nested Paging enabled client # [ 8.491155] kvm_amd: LBR virtualization supported client # [ 8.491621] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.492307] kvm_amd: Virtual GIF supported client # [ 8.492723] kvm_amd: Virtual NMI enabled lb # [ 8.411914] nsncd[521]: Sep 22 16:42:09.919 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.363640] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 8.387584] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.388679] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.390149] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.367840] systemd[1]: Finished linger-users.service. worker1 # [ 8.369291] nsncd[597]: Sep 22 16:42:10.546 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # connecting to host... worker1 # [ 8.371611] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.373050] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.373915] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.385228] systemd[1]: Finished resolvconf update. worker1 # [ 8.387410] systemd[1]: Reached target Preparation for Network. lb # [ 8.438427] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 8.390071] systemd[1]: Starting DHCP Client... lb # [ 8.440677] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.538814] EDAC MC: Ver: 3.0.0 worker1 # [ 8.395226] systemd[1]: Starting Address configuration of eth1... lb # [ 8.447284] systemd[1]: Finished Post-Boot Actions. worker1 # [ 8.399291] systemd[1]: Starting Extra networking commands.... worker2 # [ 8.433128] dhcpcd[626]: dhcpcd-10.3.2 starting worker2 # [ 8.440235] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.441135] systemd[1]: Reached target Network. lb # [ 8.469701] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.443368] systemd[1]: Starting Permit User Sessions... lb # [ 8.470659] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.450632] dhcpcd[686]: dev: loaded udev lb # [ 8.614115] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.614117] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.619547] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.620243] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 8.494150] systemd[1]: Starting User Login Management... lb # [ 8.507079] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.620535] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.620973] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 8.471928] network-addresses-eth1-start[626]: adding address 192.168.1.3/24... done worker1 # [ 8.486211] network-addresses-eth1-start[626]: adding address 2001:db8:1::3/64... done worker1 # [ 8.501609] systemd[1]: Finished Address configuration of eth1. client # [ 8.514297] systemd[1]: Finished register-nix-paths.service. lb # [ 8.555971] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.532330] systemd[1]: Finished Permit User Sessions. client # [ 8.529167] systemd-vconsole-setup[420]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 8.533069] systemd[1]: Finished Virtual Console Setup. client # [ 8.534268] systemd[1]: Reached target System Initialization. client # [ 8.535597] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.536814] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.538178] systemd[1]: Reached target Timer Units. client # [ 8.539683] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.540581] systemd[1]: Listening on Nix Daemon Socket. client # [ 8.541452] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 8.543139] systemd[1]: Reached target Socket Units. client # [ 8.543858] systemd[1]: Reached target Basic System. worker2 # [ 8.555076] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 8.545909] systemd[1]: Started backdoor.service. client # [ 8.548231] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.552797] systemd[1]: Starting nftables firewall... worker1 # [ 8.543280] dhcpcd[634]: dhcpcd-10.3.2 starting client # [ 8.558499] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.569438] systemd[1]: Started Getty on tty1. worker1 # [ 8.549121] dhcpcd[688]: dev: loaded udev worker2 # [ 8.573132] systemd[1]: Reached target Login Prompts. worker1 # [ 8.556787] systemd[1]: Finished Extra networking commands.. worker1 # [ 8.558627] systemd[1]: Reached target Network. client # [ 8.572265] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.561692] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.701840] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.725589] kvm_amd: TSC scaling supported worker1 # [ 8.702313] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 8.581108] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.728046] kvm_amd: Nested Virtualization enabled worker2 # [ 8.728553] kvm_amd: Nested Paging enabled worker2 # [ 8.728928] kvm_amd: LBR virtualization supported worker2 # [ 8.730447] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 8.730912] kvm_amd: Virtual GIF supported worker2 # [ 8.733125] kvm_amd: Virtual NMI enabled lb # [ 8.628348] dbus-broker-launch[544]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 8.633979] dbus-broker-launch[544]: NSS returned no entry for 'systemd-timesync' client # [ 8.597726] systemd[1]: Starting resolvconf update... lb # [ 8.634983] dbus-broker-launch[544]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # connecting to host... worker2 # [ 8.764766] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 8.612976] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 8.621926] systemd[1]: Finished Permit User Sessions. worker2 # [ 8.781225] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.781867] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.783345] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.784159] cfg80211: failed to load regulatory.db client # [ 8.637480] nsncd[428]: Sep 22 16:42:10.595 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.626824] systemd[1]: Started Getty on tty1. worker1 # [ 8.628419] systemd[1]: Reached target Login Prompts. client # [ 8.642067] systemd[1]: Started Name Service Cache Daemon (nsncd). client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 8.650978] systemd[1]: Finished Post-Boot Actions. worker2 # [ 8.805677] EDAC MC: Ver: 3.0.0 lb # [ 8.702274] systemd[1]: Started D-Bus System Message Bus. client # [ 8.664240] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.665114] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.794753] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 8.825765] 8021q: adding VLAN 0 to HW filter on device eth0 client: connected to guest root shell worker1 # [ 8.805620] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.692580] dhcpcd[686]: eth0: waiting for carrier client: (connecting took 9.37 seconds) worker1 # [ 8.806323] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.694394] dhcpcd[686]: libudev: received NULL device client: (finished: waiting for the VM to finish booting, in 9.37 seconds) worker1 # [ 8.808370] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.695542] dhcpcd[686]: libudev: received NULL device client # [ 8.673482] systemd[1]: Starting D-Bus System Message Bus... lb # [ 8.726953] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 8.809345] cfg80211: failed to load regulatory.db worker2 # [ 8.696936] dhcpcd[686]: eth0: carrier acquired client # [ 8.681098] systemd[1]: Starting User Login Management... worker2 # [ 8.701612] dhcpcd[686]: DUID 00:01:00:01:32:45:6c:62:52:54:00:12:34:56 client # [ 8.688359] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.702830] dhcpcd[686]: eth0: IAID 00:12:34:56 lb # [ 8.727862] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 8.703633] dhcpcd[686]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.728630] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 8.729458] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.730252] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 8.738532] systemd[1]: nscd.service: Deactivated successfully. lb # [ 8.745076] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 8.835101] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 8.702841] dhcpcd[688]: eth0: waiting for carrier worker1 # [ 8.703664] dhcpcd[688]: eth0: carrier acquired worker1 # [ 8.708605] dhcpcd[688]: DUID 00:01:00:01:32:45:6c:62:52:54:00:12:34:56 worker1 # [ 8.709827] dhcpcd[688]: eth0: IAID 00:12:34:56 worker1 # [ 8.710611] dhcpcd[688]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 8.744175] systemd-vconsole-setup[675]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.747259] systemd[1]: Finished Virtual Console Setup. client # [ 8.822365] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 8.828980] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.829908] systemd[1]: Stopped target User and Group Name Lookups. client # [ 8.830940] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.834113] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.839265] systemd-logind[458]: New seat seat0. client # [ 8.840135] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.840930] systemd-logind[458]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.842043] systemd-logind[458]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 8.844290] systemd-logind[458]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 8.845490] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 8.853466] systemd[1]: Started User Login Management. client # [ 8.854412] dbus-broker-launch[456]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.862954] dbus-broker-launch[456]: NSS returned no entry for 'systemd-timesync' client # [ 8.863976] dbus-broker-launch[456]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 9.005515] ppdev: user-space parallel port driver client # [ 8.870444] systemd[1]: Starting linger-users.service... client # [ 8.878170] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.902474] systemd[1]: Started D-Bus System Message Bus. lb # [ 9.042457] Console: switching to colour frame buffer device 160x50 lb # [ 9.086793] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 8.747965] systemd-logind[549]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 8.954308] systemd-logind[549]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 8.955951] dbus-broker-launch[544]: Ready lb # [ 8.961805] nsncd[609]: Sep 22 16:42:10.359 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.963770] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.967516] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.970552] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.972230] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.935246] dbus-broker-launch[456]: Ready lb # [ 8.973809] systemd[1]: Finished resolvconf update. lb # [ 8.975125] systemd[1]: Reached target Preparation for Network. lb # [ 8.976886] systemd[1]: Starting DHCP Client... lb # [ 8.979122] systemd[1]: Starting Address configuration of eth1... lb # [ 8.979961] systemd[1]: Starting Extra networking commands.... lb # [ 8.982647] systemd-logind[549]: New seat seat0. lb # [ 8.983418] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.984438] systemd[1]: Stopped Virtual Console Setup. lb # [ 8.985187] systemd-logind[549]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.986306] systemd[1]: Started User Login Management. client # [ 8.949133] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.951224] systemd[1]: Finished linger-users.service. lb # [ 8.994067] systemd[1]: Starting linger-users.service... client # [ 8.956246] systemd[1]: Finished resolvconf update. lb # [ 8.999971] systemd[1]: Starting Virtual Console Setup... client # [ 8.962500] nsncd[518]: Sep 22 16:42:10.921 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.137116] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.965569] systemd[1]: Starting DHCP Client... client # [ 8.966464] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.967909] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.969361] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.210149] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 9.059509] dhcpcd[553]: dhcpcd-10.3.2 starting lb # [ 9.097384] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.100141] systemd[1]: Finished linger-users.service. client # [ 9.064605] dhcpcd[560]: dev: loaded udev lb # [ 9.102794] network-addresses-eth1-start[637]: adding address 192.168.1.2/24... done lb # [ 9.105786] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.107907] systemd[1]: Stopped Virtual Console Setup. client # [ 9.205041] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.129679] systemd[1]: Starting Virtual Console Setup... lb # [ 9.136571] network-addresses-eth1-start[637]: adding address 2001:db8:1::2/64... done client # [ 9.114105] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.178490] systemd[1]: Finished Address configuration of eth1. client # [ 9.277708] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 9.289661] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.290426] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 9.292483] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.293282] cfg80211: failed to load regulatory.db client # [ 9.333931] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.203426] dhcpcd[560]: eth0: waiting for carrier client # [ 9.204473] dhcpcd[560]: eth0: carrier acquired client # [ 9.210165] systemd[1]: Finished nftables firewall. client # [ 9.212763] systemd[1]: Reached target Preparation for Network. client # [ 9.215304] dhcpcd[560]: DUID 00:01:00:01:32:45:6c:63:52:54:00:12:34:56 client # [ 9.216220] dhcpcd[560]: eth0: IAID 00:12:34:56 client # [ 9.216930] dhcpcd[560]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 9.219148] systemd[1]: Starting Address configuration of eth1... client # [ 9.221183] systemd[1]: Starting Extra networking commands.... lb # [ 9.289120] dhcpcd[657]: dhcpcd-10.3.2 starting client # [ 9.392693] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.307040] dhcpcd[714]: dev: loaded udev client # [ 9.271736] network-addresses-eth1-start[585]: adding address 192.168.1.1/24... done client # [ 9.281143] network-addresses-eth1-start[585]: adding address 2001:db8:1::1/64... done client # [ 9.292792] systemd[1]: Finished Address configuration of eth1. lb # [ 9.331246] systemd[1]: Finished Extra networking commands.. lb # [ 9.334844] systemd[1]: Reached target Network. lb # [ 9.344522] systemd[1]: Starting PostgreSQL Server... lb # [ 9.482033] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.348524] systemd[1]: Starting Permit User Sessions... client # [ 9.313560] systemd[1]: Finished Extra networking commands.. lb # [ 9.487815] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 9.315139] systemd[1]: Reached target Network. client # [ 9.317483] systemd[1]: Starting Permit User Sessions... lb # [ 9.501177] kvm_amd: TSC scaling supported lb # [ 9.502553] kvm_amd: Nested Virtualization enabled lb # [ 9.503073] kvm_amd: Nested Paging enabled client # [ 9.331912] systemd[1]: Finished Permit User Sessions. lb # [ 9.506327] kvm_amd: LBR virtualization supported lb # [ 9.506771] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 9.507255] kvm_amd: Virtual GIF supported client # [ 9.334934] systemd[1]: Started Getty on tty1. client # [ 9.336113] systemd[1]: Reached target Login Prompts. lb # [ 9.513459] kvm_amd: Virtual NMI enabled client # [ 9.344121] dhcpcd[560]: eth0: soliciting a DHCP lease client # [ 9.483921] NET: Registered PF_PACKET protocol family client # [ 9.355495] dhcpcd[560]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 9.357148] dhcpcd[560]: eth0: probing address 10.0.2.15/24 lb # [ 9.442961] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.445364] systemd[1]: Finished Permit User Sessions. lb # [ 9.453552] systemd[1]: Started Getty on tty1. lb # [ 9.454306] systemd[1]: Reached target Login Prompts. lb # [ 9.628543] EDAC MC: Ver: 3.0.0 lb # [ 9.681591] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 9.721668] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 9.723467] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 9.725821] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 9.726669] cfg80211: failed to load regulatory.db lb # [ 9.660226] postgresql-pre-start[733]: The files belonging to this database system will be owned by user "postgres". lb # [ 9.661595] postgresql-pre-start[733]: This user must also own the server process. lb # [ 9.802729] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 9.671386] dhcpcd[714]: eth0: waiting for carrier lb # [ 9.672114] dhcpcd[714]: eth0: carrier acquired lb # [ 9.674250] postgresql-pre-start[733]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 9.675454] postgresql-pre-start[733]: The default database encoding has accordingly been set to "UTF8". lb # [ 9.676626] postgresql-pre-start[733]: The default text search configuration will be set to "english". lb # [ 9.677781] postgresql-pre-start[733]: Data page checksums are enabled. lb # [ 9.678709] postgresql-pre-start[733]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 9.679912] postgresql-pre-start[733]: creating subdirectories ... ok lb # [ 9.680674] postgresql-pre-start[733]: selecting dynamic shared memory implementation ... posix lb # [ 9.690980] dhcpcd[714]: DUID 00:01:00:01:32:45:6c:63:52:54:00:12:34:56 lb # [ 9.692357] dhcpcd[714]: eth0: IAID 00:12:34:56 lb # [ 9.693409] dhcpcd[714]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.762244] postgresql-pre-start[733]: selecting default "max_connections" ... 100 lb # [ 9.836944] systemd-vconsole-setup[671]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.841764] systemd[1]: Finished Virtual Console Setup. lb # [ 9.843217] postgresql-pre-start[733]: selecting default "shared_buffers" ... 128MB lb # [ 9.888705] dhcpcd[714]: eth0: soliciting a DHCP lease lb # [ 10.043909] NET: Registered PF_PACKET protocol family lb # [ 9.913470] dhcpcd[714]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 9.915154] dhcpcd[714]: eth0: probing address 10.0.2.15/24 client: (finished: waiting for unit network-addresses-eth1.service, in 10.65 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb: (finished: waiting for unit network-addresses-eth1.service, in 0.04 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.02 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1 # [ 10.101882] dhcpcd[688]: eth0: soliciting a DHCP lease worker1 # [ 10.251794] NET: Registered PF_PACKET protocol family worker1 # [ 10.126457] dhcpcd[688]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 10.129629] dhcpcd[688]: eth0: probing address 10.0.2.15/24 worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2 # [ 10.186072] dhcpcd[686]: eth0: soliciting a DHCP lease worker2 # [ 10.344764] NET: Registered PF_PACKET protocol family worker2 # [ 10.222224] dhcpcd[686]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 10.224361] dhcpcd[686]: eth0: probing address 10.0.2.15/24 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit niks3.service lb # [ 10.466243] postgresql-pre-start[733]: selecting default time zone ... UTC lb # [ 10.468993] postgresql-pre-start[733]: creating configuration files ... ok lb # [ 10.630522] postgresql-pre-start[733]: running bootstrap script ... ok worker1 # [ 10.761828] dhcpcd[688]: eth0: soliciting an IPv6 router worker1 # [ 10.764674] dhcpcd[688]: eth0: Router Advertisement from fe80::2 worker1 # [ 10.766839] dhcpcd[688]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 10.769165] dhcpcd[688]: eth0: adding route to fec0::/64 worker1 # [ 10.771151] dhcpcd[688]: eth0: adding default route via fe80::2 lb # [ 10.998941] postgresql-pre-start[733]: performing post-bootstrap initialization ... ok lb # [ 11.130762] postgresql-pre-start[733]: syncing data to disk ... ok lb # [ 11.132469] postgresql-pre-start[733]: initdb: warning: enabling "trust" authentication for local connections lb # [ 11.133670] postgresql-pre-start[733]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 11.135523] postgresql-pre-start[733]: Success. You can now start the database server using: lb # [ 11.136558] postgresql-pre-start[733]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 11.204931] postgres[777]: [777] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 11.207458] postgres[777]: [777] LOG: listening on IPv6 address "::1", port 5432 lb # [ 11.208596] postgres[777]: [777] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 11.212558] postgres[777]: [777] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 11.222047] postgres[786]: [786] LOG: database system was shut down at 2026-09-22 16:42:12 GMT lb # [ 11.228278] postgres[777]: [777] LOG: database system is ready to accept connections lb # [ 11.232413] systemd[1]: Started PostgreSQL Server. lb # [ 11.238356] systemd[1]: Starting PostgreSQL Setup Scripts... client # [ 11.272881] dhcpcd[560]: eth0: soliciting an IPv6 router client # [ 11.276159] dhcpcd[560]: eth0: Router Advertisement from fe80::2 client # [ 11.278307] dhcpcd[560]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 11.280482] dhcpcd[560]: eth0: adding route to fec0::/64 client # [ 11.282373] dhcpcd[560]: eth0: adding default route via fe80::2 lb # [ 11.362077] postgresql-setup-start[797]: CREATE DATABASE lb # [ 11.408216] postgresql-setup-start[806]: CREATE ROLE lb # [ 11.428593] postgresql-setup-start[812]: ALTER DATABASE lb # [ 11.432947] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 11.434625] systemd[1]: Reached target PostgreSQL. worker2 # [ 11.442243] dhcpcd[686]: eth0: soliciting an IPv6 router worker2 # [ 11.444365] dhcpcd[686]: eth0: Router Advertisement from fe80::2 worker2 # [ 11.446482] dhcpcd[686]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 11.448658] dhcpcd[686]: eth0: adding route to fec0::/64 worker2 # [ 11.450425] dhcpcd[686]: eth0: adding default route via fe80::2 lb # [ 12.302522] dhcpcd[714]: eth0: soliciting an IPv6 router lb # [ 12.305367] dhcpcd[714]: eth0: Router Advertisement from fe80::2 lb # [ 12.307459] dhcpcd[714]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 12.309639] dhcpcd[714]: eth0: adding route to fec0::/64 lb # [ 12.311472] dhcpcd[714]: eth0: adding default route via fe80::2 client # [ 13.911658] dhcpcd[560]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 13.913796] dhcpcd[560]: eth0: adding route to 10.0.2.0/24 client # [ 13.917995] dhcpcd[560]: eth0: adding default route via 10.0.2.2 client # [ 13.997306] systemd[1]: Started DHCP Client. client # [ 13.998853] systemd[1]: Reached target Multi-User System. client # [ 14.000065] systemd[1]: Startup finished in 865ms (kernel) + 4.542s (initrd) + 8.592s (userspace) = 13.999s. lb # [ 14.777192] dhcpcd[714]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 14.779350] dhcpcd[714]: eth0: adding route to 10.0.2.0/24 lb # [ 14.781927] dhcpcd[714]: eth0: adding default route via 10.0.2.2 lb # [ 14.860304] systemd[1]: Started DHCP Client. lb # [ 14.862240] systemd[1]: Reached target Network is Online. lb # [ 14.865391] systemd[1]: Started Envoy reverse proxy. lb # [ 14.869192] systemd[1]: Started mock-oidc.service. lb # [ 15.103794] mock-oidc-server[905]: Mock OIDC Server running lb # [ 15.106097] mock-oidc-server[905]: OIDC Address: 192.168.1.2:8080 lb # [ 15.106925] mock-oidc-server[905]: Issue Address: 0.0.0.0:8081 lb # [ 15.107890] mock-oidc-server[905]: Issuer: http://192.168.1.2:8080/oidc lb # [ 15.108923] mock-oidc-server[905]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 15.109960] mock-oidc-server[905]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 15.111436] mock-oidc-server[905]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 15.182349] envoy[904]: [2026-09-22 16:42:16.689][904][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 15.185055] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 15.186457] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 15.188132] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 15.190915] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 15.201776] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 15.207836] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 15.209838] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 15.211945] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 15.214834] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 15.216651] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 15.219371] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 15.225150] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 15.226794] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 15.229434] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 15.230995] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 15.233497] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 15.235711] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 15.238253] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 15.240555] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 15.242272] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 15.249232] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 15.251514] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 15.255377] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 15.257425] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 15.260899] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 15.263211] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 15.264907] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 15.267121] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 15.269464] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 15.272908] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 15.274806] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 15.276293] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 15.278518] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 15.280804] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 15.282396] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 15.286877] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 15.288702] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 15.291131] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 15.292820] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 15.294850] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 15.296635] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 15.298755] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 15.301171] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 15.302785] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default worker1 # [ 15.252534] dhcpcd[688]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 15.304547] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind worker1 # [ 15.255307] dhcpcd[688]: eth0: adding route to 10.0.2.0/24 lb # [ 15.306408] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift worker1 # [ 15.257818] dhcpcd[688]: eth0: adding default route via 10.0.2.2 lb # [ 15.309520] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 15.312081] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 15.313769] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 15.317773] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 15.320780] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 15.322595] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 15.326674] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 15.328340] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 15.330444] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 15.332731] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 15.334782] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 15.338042] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 15.339715] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 15.341292] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 15.342753] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 15.347336] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 15.348864] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 15.357914] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 15.363705] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 15.366499] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 15.368776] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 15.373094] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 15.375440] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 15.377359] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 15.379415] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 15.381273] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 15.383369] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme worker1 # [ 15.338952] systemd[1]: Started DHCP Client. lb # [ 15.386223] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap worker1 # [ 15.341078] systemd[1]: Reached target Multi-User System. lb # [ 15.390289] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy worker1 # [ 15.341818] systemd[1]: Startup finished in 869ms (kernel) + 3.639s (initrd) + 10.831s (userspace) = 15.340s. lb # [ 15.392640] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 15.394287] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 15.397184] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 15.398761] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 15.401597] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.403491] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 15.405781] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 15.407195] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 15.408794] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 15.412083] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 15.414121] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 15.416566] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 15.418401] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 15.421287] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 15.422908] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 15.427355] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 15.438365] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 15.439960] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 15.441693] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 15.445122] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 15.446950] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 15.448559] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 15.450970] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 15.456145] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 15.458235] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 15.460590] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 15.462229] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 15.466279] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 15.472307] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 15.474141] envoy[904]: [2026-09-22 16:42:16.692][904][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 15.499244] envoy[904]: [2026-09-22 16:42:16.722][904][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 15.500638] envoy[904]: [2026-09-22 16:42:16.749][904][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 15.513415] envoy[904]: [2026-09-22 16:42:16.749][904][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 15.514774] envoy[904]: [2026-09-22 16:42:16.749][904][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 15.523050] envoy[904]: [2026-09-22 16:42:16.749][904][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 15.526308] envoy[904]: [2026-09-22 16:42:17.034][904][info][main] [source/server/server.cc:968] runtime: {} lb # [ 15.529575] envoy[904]: [2026-09-22 16:42:17.037][904][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 15.531318] envoy[904]: [2026-09-22 16:42:17.039][904][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 15.533197] envoy[904]: [2026-09-22 16:42:17.040][904][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 15.535160] envoy[904]: [2026-09-22 16:42:17.042][904][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 15.536904] envoy[904]: [2026-09-22 16:42:17.044][904][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 15.538361] envoy[904]: [2026-09-22 16:42:17.044][904][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 15.556451] envoy[904]: [2026-09-22 16:42:17.064][904][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 15.531330] dhcpcd[686]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 15.532634] dhcpcd[686]: eth0: adding route to 10.0.2.0/24 worker2 # [ 15.533622] dhcpcd[686]: eth0: adding default route via 10.0.2.2 lb # [ 15.560808] envoy[904]: [2026-09-22 16:42:17.068][904][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 15.562813] envoy[904]: [2026-09-22 16:42:17.070][904][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 15.565690] envoy[904]: [2026-09-22 16:42:17.070][904][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 15.515195] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 15.588395] systemd[1]: Started DHCP Client. worker2 # [ 15.591331] systemd[1]: Reached target Multi-User System. worker2 # [ 15.592113] systemd[1]: Reached target Network is Online. worker2 # [ 15.593919] systemd[1]: Starting scheduler-token.service... worker2 # [ 15.629284] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 15.630813] systemd[1]: Finished scheduler-token.service. worker2 # [ 15.632166] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 36ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 15.636128] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 15.638422] nix-grpc-daemon[780]: ts=2026-09-22T16:42:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 15.648643] nix-grpc-daemon[780]: ts=2026-09-22T16:42:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 15.650882] nix-grpc-daemon[780]: ts=2026-09-22T16:42:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 15.664065] nix-grpc-daemon[780]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 15.665484] nix-grpc-daemon[780]: E0000 00:00:1790095337.844601 780 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 15.672357] nix-grpc-daemon[780]: E0000 00:00:1790095337.852839 780 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 15.675171] nix-grpc-daemon[780]: ts=2026-09-22T16:42:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 15.678478] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 15.693068] nix-grpc-daemon[780]: E0000 00:00:1790095337.873455 821 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.721276] nix-grpc-daemon[781]: ts=2026-09-22T16:42:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 15.733565] nix-grpc-daemon[781]: ts=2026-09-22T16:42:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc lb # [ 15.758831] envoy[904]: [2026-09-22 16:42:17.266][904][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker1 # [ 15.711901] nix-grpc-daemon[780]: E0000 00:00:1790095337.892621 821 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.735834] nix-grpc-daemon[781]: ts=2026-09-22T16:42:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 15.762665] envoy[904]: [2026-09-22 16:42:17.266][904][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 15.716152] nix-grpc-daemon[780]: E0000 00:00:1790095337.894827 821 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 15.766650] envoy[904]: [2026-09-22 16:42:17.266][904][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 15.744212] nix-grpc-daemon[781]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 15.745763] nix-grpc-daemon[781]: E0000 00:00:1790095337.857331 781 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 15.773113] envoy[904]: [2026-09-22 16:42:17.280][904][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 15.727278] nix-grpc-daemon[780]: E0000 00:00:1790095337.908033 821 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.751338] nix-grpc-daemon[781]: E0000 00:00:1790095337.864573 781 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.753910] nix-grpc-daemon[781]: ts=2026-09-22T16:42:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 15.758194] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 15.739072] nix-grpc-daemon[780]: ts=2026-09-22T16:42:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.761598] systemd[1]: Startup finished in 865ms (kernel) + 3.669s (initrd) + 11.222s (userspace) = 15.757s. worker1 # [ 15.741091] nix-grpc-daemon[780]: ts=2026-09-22T16:42:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 15.772824] nix-grpc-daemon[781]: E0000 00:00:1790095337.885188 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.791117] nix-grpc-daemon[781]: E0000 00:00:1790095337.903973 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.793215] nix-grpc-daemon[781]: E0000 00:00:1790095337.904122 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 15.805729] nix-grpc-daemon[781]: E0000 00:00:1790095337.919116 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 15.816498] nix-grpc-daemon[781]: ts=2026-09-22T16:42:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 15.818159] nix-grpc-daemon[781]: ts=2026-09-22T16:42:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 15.942377] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 15.946396] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.019663] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.023643] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.147153] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.151084] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.225074] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.228896] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.351980] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.355925] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.429995] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.433918] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.556731] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.560699] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.634578] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.636436] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.762855] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.765984] nix-grpc-daemon[780]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 16.837490] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 16.839256] nix-grpc-daemon[781]: ts=2026-09-22T16:42:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 16.963703] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 16.967685] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.040160] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.041917] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.168657] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.172686] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.242672] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.244414] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.373533] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.377610] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.445198] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.446853] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.578677] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.582635] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.648173] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.652181] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.784732] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.787814] nix-grpc-daemon[780]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.854499] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.857586] nix-grpc-daemon[781]: ts=2026-09-22T16:42:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 17.985524] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.989386] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.055781] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.059617] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.189901] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.191669] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.260357] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.262298] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.392385] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.394209] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.463545] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.467402] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.595307] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.599345] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.668061] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.673467] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.801770] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.805152] nix-grpc-daemon[780]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.876317] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.879550] nix-grpc-daemon[781]: ts=2026-09-22T16:42:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.002786] nix-grpc-daemon[780]: ts=2026-09-22T16:42:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.006773] nix-grpc-daemon[780]: ts=2026-09-22T16:42:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.077402] nix-grpc-daemon[781]: ts=2026-09-22T16:42:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.081511] nix-grpc-daemon[781]: ts=2026-09-22T16:42:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.207782] nix-grpc-daemon[780]: ts=2026-09-22T16:42:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.211685] nix-grpc-daemon[780]: ts=2026-09-22T16:42:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.282904] nix-grpc-daemon[781]: ts=2026-09-22T16:42:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.286829] nix-grpc-daemon[781]: ts=2026-09-22T16:42:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.412556] nix-grpc-daemon[780]: ts=2026-09-22T16:42:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.416568] nix-grpc-daemon[780]: ts=2026-09-22T16:42:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.488431] nix-grpc-daemon[781]: ts=2026-09-22T16:42:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.492211] nix-grpc-daemon[781]: ts=2026-09-22T16:42:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.617646] nix-grpc-daemon[780]: ts=2026-09-22T16:42:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.621817] nix-grpc-daemon[780]: ts=2026-09-22T16:42:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.693430] nix-grpc-daemon[781]: ts=2026-09-22T16:42:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.697329] nix-grpc-daemon[781]: ts=2026-09-22T16:42:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 19.785691] rustfs-bucket-start[959]: mb s3://farm lb # [ 19.795554] systemd[1]: Finished rustfs-bucket.service. lb # [ 19.801203] systemd[1]: Starting niks3 server... worker1 # [ 19.822764] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.824708] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.899979] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 lb # [ 19.929983] postgres[977]: [977] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 19.932185] postgres[977]: [977] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker2 # [ 19.903337] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 19.952178] niks3-server[966]: 2026/09/22 16:42:21 OK 20241026095416_initial_model.sql (12.16ms) lb # [ 19.955715] niks3-server[966]: 2026/09/22 16:42:21 OK 20251210153512_drop_unused_gin_index.sql (3.75ms) lb # [ 19.960837] niks3-server[966]: 2026/09/22 16:42:21 OK 20251218171726_add_pins.sql (5.05ms) lb # [ 19.964809] niks3-server[966]: 2026/09/22 16:42:21 OK 20260628120000_add_object_size_and_stats.sql (3.92ms) lb # [ 19.969273] niks3-server[966]: 2026/09/22 16:42:21 OK 20260905000000_add_claims.sql (4.43ms) lb # [ 19.972692] niks3-server[966]: 2026/09/22 16:42:21 OK 20260920000000_drop_claims.sql (3.47ms) lb # [ 19.974178] niks3-server[966]: 2026/09/22 16:42:21 goose: successfully migrated database to version: 20260920000000 lb # [ 19.978150] niks3-server[966]: 2026/09/22 16:42:21 OK 1_commit_pending_closure.sql (3.97ms) lb # [ 19.980781] niks3-server[966]: 2026/09/22 16:42:21 OK 2_object_stats_trigger.sql (2.67ms) lb # [ 19.981991] niks3-server[966]: 2026/09/22 16:42:21 goose: up to current file version: 2 lb # [ 19.984809] niks3-server[966]: 2026/09/22 16:42:21 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 20.013026] niks3-server[966]: 2026/09/22 16:42:21 INFO Read proxy enabled — serving cache objects from S3 lb # [ 20.014540] niks3-server[966]: 2026/09/22 16:42:21 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 20.017275] niks3-server[966]: 2026/09/22 16:42:21 INFO systemd watchdog enabled interval=15s lb # [ 20.018423] systemd[1]: Started niks3 server. lb # [ 20.019098] systemd[1]: Reached target Multi-User System. lb # [ 20.021061] niks3-server[966]: 2026/09/22 16:42:21 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 20.022776] systemd[1]: Startup finished in 849ms (kernel) + 4.547s (initrd) + 14.626s (userspace) = 20.022s. worker1 # [ 20.025439] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.027346] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.100933] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.104869] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.227959] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.229703] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.306400] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.310235] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.430220] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.432031] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.511877] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.516127] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.632502] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.634280] nix-grpc-daemon[780]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.716810] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.718680] nix-grpc-daemon[781]: ts=2026-09-22T16:42:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.836629] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.839778] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.920190] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.922333] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 10.68 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.04 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 21.059387] envoy[904]: conn peer=[::1]:34082 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker1 # [ 21.037537] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.042328] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.123563] systemd[1]: Starting scheduler-token.service... worker2 # [ 21.128069] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.129324] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.165906] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 21.168355] systemd[1]: Finished scheduler-token.service. worker2 # [ 21.169123] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 45ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.05 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 21.242121] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.246097] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.325790] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.327757] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.446909] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.450846] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.529476] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.533360] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.651529] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.655459] nix-grpc-daemon[780]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.734619] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.738685] nix-grpc-daemon[781]: ts=2026-09-22T16:42:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.857493] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.860852] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.941547] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.944976] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.061676] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.065571] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.142353] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.144233] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 22.266545] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.270443] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 22.345172] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.347229] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.470845] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.474567] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.548849] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.552807] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.675362] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.679317] nix-grpc-daemon[780]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.754254] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.757989] nix-grpc-daemon[781]: ts=2026-09-22T16:42:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.880216] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.883937] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.960665] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.964386] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.084774] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.088691] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.165681] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.169617] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 23.289628] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.293607] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 23.370992] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.375068] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.494351] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.498221] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.576479] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.580503] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.698902] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.702929] nix-grpc-daemon[780]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.781171] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.783264] nix-grpc-daemon[781]: ts=2026-09-22T16:42:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.904691] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.908280] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.986483] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.989706] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.109156] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.112952] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.187496] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.191456] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.313677] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.317498] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 24.392850] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.396658] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.518251] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.522124] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.597992] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.601916] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.722398] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.726965] nix-grpc-daemon[780]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.803590] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.806789] nix-grpc-daemon[781]: ts=2026-09-22T16:42:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.927849] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.931184] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.006289] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.009614] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.132253] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.135982] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.207944] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.211232] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.336836] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.340787] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 25.409518] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 25.413339] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.541635] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.545565] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.611905] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.615945] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.746177] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.750116] nix-grpc-daemon[780]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.816822] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.820687] nix-grpc-daemon[781]: ts=2026-09-22T16:42:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.951769] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.955541] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.023575] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.026684] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.156455] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.160280] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.224635] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.228665] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.361243] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.364996] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 26.429484] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.431327] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 26.565970] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.569998] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.632309] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.634262] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.770487] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.774353] nix-grpc-daemon[780]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.835046] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.837358] nix-grpc-daemon[781]: ts=2026-09-22T16:42:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.975918] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.979841] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.038733] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.040537] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.180531] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.184498] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.241685] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.243485] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.385469] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.389329] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.444494] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.446604] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 27.590176] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.594198] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.647604] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.649442] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.794824] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.797486] nix-grpc-daemon[780]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.851233] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.854606] nix-grpc-daemon[781]: ts=2026-09-22T16:42:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.998994] nix-grpc-daemon[780]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.002789] nix-grpc-daemon[780]: ts=2026-09-22T16:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.054054] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.055601] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.203887] nix-grpc-daemon[780]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.207803] nix-grpc-daemon[780]: ts=2026-09-22T16:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.255040] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.256852] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.408736] nix-grpc-daemon[780]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.412635] nix-grpc-daemon[780]: ts=2026-09-22T16:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.457822] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.459631] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 28.613535] nix-grpc-daemon[780]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.617469] nix-grpc-daemon[780]: ts=2026-09-22T16:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.660538] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.662370] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.818129] nix-grpc-daemon[780]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.821886] nix-grpc-daemon[780]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.863213] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.864888] nix-grpc-daemon[781]: ts=2026-09-22T16:42:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.023418] nix-grpc-daemon[780]: ts=2026-09-22T16:42:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.026934] nix-grpc-daemon[780]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.066208] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.067868] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.227878] nix-grpc-daemon[780]: ts=2026-09-22T16:42:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.231862] nix-grpc-daemon[780]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.268857] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.270616] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.432590] nix-grpc-daemon[780]: ts=2026-09-22T16:42:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.436337] nix-grpc-daemon[780]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.471508] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.473400] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 29.637172] nix-grpc-daemon[780]: ts=2026-09-22T16:42:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.641263] nix-grpc-daemon[780]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.674455] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.676327] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.842212] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.846289] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.877149] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.878837] nix-grpc-daemon[781]: ts=2026-09-22T16:42:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.001588] nix-grpc-daemon[781]: ts=2026-09-22T16:42:32Z level=info event=scheduler_take_over lb # [ 30.028876] niks3-server[966]: 2026/09/22 16:42:31 INFO lead: acquired remote=192.168.1.4:50168 worker1 # [ 30.047036] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.048666] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.081430] nix-grpc-daemon[781]: ts=2026-09-22T16:42:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.084526] nix-grpc-daemon[781]: ts=2026-09-22T16:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.249638] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.253363] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.282507] nix-grpc-daemon[781]: ts=2026-09-22T16:42:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.286368] nix-grpc-daemon[781]: ts=2026-09-22T16:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.454215] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.458061] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.487527] nix-grpc-daemon[781]: ts=2026-09-22T16:42:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.491394] nix-grpc-daemon[781]: ts=2026-09-22T16:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 30.658837] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.662744] nix-grpc-daemon[780]: ts=2026-09-22T16:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.693218] nix-grpc-daemon[781]: ts=2026-09-22T16:42:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.696364] nix-grpc-daemon[781]: ts=2026-09-22T16:42:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.863567] nix-grpc-daemon[780]: ts=2026-09-22T16:42:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.892935] nix-grpc-daemon[781]: ts=2026-09-22T16:42:33Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56654 worker2 # [ 30.898398] nix-grpc-daemon[781]: ts=2026-09-22T16:42:33Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 30.905875] nix-grpc-daemon[781]: ts=2026-09-22T16:42:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.914173] nix-grpc-daemon[781]: ts=2026-09-22T16:42:33Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 30.917627] nix-grpc-daemon[781]: ts=2026-09-22T16:42:33Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56654 worker2 # [ 30.921479] nix-grpc-daemon[781]: ts=2026-09-22T16:42:33Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.92 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 32.319745] nix-grpc-daemon[780]: ts=2026-09-22T16:42:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 32.331240] systemd[1]: Started Nix Daemon. worker1 # [ 32.447093] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 32.461935] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 1/5) worker1 # [ 32.474107] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 2/5) worker1 # [ 32.669529] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 329 ms (attempt 3/5) worker1 # [ 33.000569] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 250 ms (attempt 4/5) worker1 # [ 33.259263] nix-grpc-daemon[780]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 33.268270] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 33.287183] nix-grpc-daemon[780]: ts=2026-09-22T16:42:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 33.297157] nix-grpc-daemon[780]: ts=2026-09-22T16:42:35Z level=debug event=path_info_miss path=nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test error="error: path '/nix/store/nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 33.305940] nix-grpc-daemon[780]: ts=2026-09-22T16:42:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 33.314227] nix-grpc-daemon[780]: ts=2026-09-22T16:42:35Z level=debug event=path_info_miss path=nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test error="error: path '/nix/store/nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.05 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker1 # [ 33.535722] nix-grpc-daemon[780]: ts=2026-09-22T16:42:35Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 33.539946] nix-grpc-daemon[780]: ts=2026-09-22T16:42:35Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:59320 worker1 # [ 33.548721] nix-grpc-daemon[780]: ts=2026-09-22T16:42:35Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:59320 worker1 # [ 33.557783] nix-grpc-daemon[780]: ts=2026-09-22T16:42:35Z level=debug event=path_info_miss path=nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test error="error: path '/nix/store/nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 33.599565] nix-grpc-daemon[781]: ts=2026-09-22T16:42:35Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:40992 worker2 # [ 33.608539] systemd[1]: Started Nix Daemon. worker2 # [ 33.725531] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 33.751628] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 1/5) worker2 # [ 33.845198] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 2/5) worker2 # [ 33.869873] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 217 ms (attempt 3/5) worker2 # [ 34.088327] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 377 ms (attempt 4/5) worker2 # [ 34.467253] nix-grpc-daemon[781]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 34.468803] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 34.477067] nix-grpc-daemon[781]: ts=2026-09-22T16:42:36Z level=debug event=path_info_miss path=nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test error="error: path '/nix/store/nwrxkcyq2rabn5jfqyww8chp4fbw12l7-nixos-system-client-test' is required, but there is no substituter that can build it" lb # [ 35.559436] envoy[904]: conn peer=[2001:db8:1::1]:35466 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=1031 lb # [ 35.563161] envoy[904]: conn peer=[2001:db8:1::1]:53694 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2630 tx=399 ms=940 client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker1 # [ 36.630601] nix-grpc-daemon[780]: ts=2026-09-22T16:42:38Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 36.759794] nix-grpc-daemon[780]: ts=2026-09-22T16:42:38Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.65 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 36.894445] nix-grpc-daemon[780]: ts=2026-09-22T16:42:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59320 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 36.903474] nix-grpc-daemon[780]: ts=2026-09-22T16:42:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker2 # [ 36.957325] nix-grpc-daemon[781]: ts=2026-09-22T16:42:39Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 36.961635] nix-grpc-daemon[781]: ts=2026-09-22T16:42:39Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 36.981794] nix-grpc-daemon[780]: ts=2026-09-22T16:42:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 36.995495] nix-grpc-daemon[780]: ts=2026-09-22T16:42:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 client # copying 1 paths to 'lb:50051'... worker1 # [ 37.008787] nix-grpc-daemon[780]: ts=2026-09-22T16:42:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker1 # [ 37.030190] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 37.061246] nix-grpc-daemon[780]: ts=2026-09-22T16:42:39Z level=info event=niks3_push_started pid=858 worker1 # [ 37.224733] nix-grpc-daemon[858]: time=2026-09-22T16:42:39.404Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 37.317085] nix-daemon[845]: accepted connection from pid 870, user nix-grpc-daemon (trusted) worker1 # [ 37.333684] nix-daemon[845]: reaped child process 873, status = succeeded lb # [ 37.391423] niks3-server[966]: 2026/09/22 16:42:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.354774] nix-grpc-daemon[858]: time=2026-09-22T16:42:39.535Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 37.356310] nix-grpc-daemon[858]: time=2026-09-22T16:42:39.537Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 37.441082] niks3-server[966]: 2026/09/22 16:42:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 37.466298] niks3-server[966]: 2026/09/22 16:42:38 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 37.476251] niks3-server[966]: 2026/09/22 16:42:38 INFO Signed narinfos id=1 count=1 worker1 # [ 37.426819] nix-grpc-daemon[858]: time=2026-09-22T16:42:39.607Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.482851] niks3-server[966]: 2026/09/22 16:42:38 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 37.488843] niks3-server[966]: 2026/09/22 16:42:38 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 37.496834] niks3-server[966]: 2026/09/22 16:42:39 INFO Completed upload id=1 worker1 # [ 37.447202] nix-grpc-daemon[858]: time=2026-09-22T16:42:39.627Z level=INFO msg="Upload complete. (218ms)" worker1 # [ 37.450858] nix-grpc-daemon[780]: ts=2026-09-22T16:42:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 37.502208] niks3-server[966]: 2026/09/22 16:42:39 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo worker1 # [ 37.455433] nix-grpc-daemon[780]: ts=2026-09-22T16:42:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 37.462665] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 37.465189] nix-daemon[845]: reaped child process 856, status = succeeded worker1 # [ 37.471068] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 38.288215] nix-daemon[845]: reaped child process 877, status = succeeded worker1 # [ 38.369676] nix-daemon[845]: accepted connection from pid 894, user nix-grpc-daemon (trusted) worker1 # [ 38.384094] nix-daemon[845]: reaped child process 897, status = succeeded lb # [ 38.441322] niks3-server[966]: 2026/09/22 16:42:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 38.399072] nix-grpc-daemon[858]: time=2026-09-22T16:42:40.579Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 38.401470] nix-grpc-daemon[858]: time=2026-09-22T16:42:40.581Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 38.470826] niks3-server[966]: 2026/09/22 16:42:39 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 38.473810] niks3-server[966]: 2026/09/22 16:42:39 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 38.475827] niks3-server[966]: 2026/09/22 16:42:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 38.478200] niks3-server[966]: 2026/09/22 16:42:39 INFO Signed narinfos id=2 count=1 worker1 # [ 38.428704] nix-grpc-daemon[858]: time=2026-09-22T16:42:40.609Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.482836] niks3-server[966]: 2026/09/22 16:42:39 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete worker1 # [ 38.439473] nix-grpc-daemon[858]: time=2026-09-22T16:42:40.620Z level=INFO msg="Upload complete. (161ms)" lb # [ 38.489317] niks3-server[966]: 2026/09/22 16:42:39 INFO Completed upload id=2 lb # [ 38.490964] niks3-server[966]: 2026/09/22 16:42:39 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls worker1 # [ 38.442422] nix-grpc-daemon[780]: ts=2026-09-22T16:42:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 lb # [ 38.493425] niks3-server[966]: 2026/09/22 16:42:40 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker1 # [ 38.451734] nix-daemon[845]: reaped child process 875, status = succeeded worker2 # [ 38.473187] nix-grpc-daemon[781]: ts=2026-09-22T16:42:40Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 38.475513] nix-grpc-daemon[781]: ts=2026-09-22T16:42:40Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 38.495188] nix-grpc-daemon[780]: ts=2026-09-22T16:42:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 38.506207] nix-grpc-daemon[780]: ts=2026-09-22T16:42:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 38.517816] nix-grpc-daemon[858]: time=2026-09-22T16:42:40.698Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 38.526064] nix-grpc-daemon[780]: ts=2026-09-22T16:42:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker1 # [ 38.544355] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 38.648102] nix-daemon[845]: accepted connection from pid 901, user nix-grpc-daemon (trusted) worker1 # [ 38.664464] nix-daemon[845]: reaped child process 904, status = succeeded lb # [ 38.719850] niks3-server[966]: 2026/09/22 16:42:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 38.674341] nix-grpc-daemon[858]: time=2026-09-22T16:42:40.855Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 38.676505] nix-grpc-daemon[858]: time=2026-09-22T16:42:40.856Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 38.735089] niks3-server[966]: 2026/09/22 16:42:40 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 38.738162] niks3-server[966]: 2026/09/22 16:42:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 38.740957] niks3-server[966]: 2026/09/22 16:42:40 INFO Signed narinfos id=3 count=1 worker1 # [ 38.691574] nix-grpc-daemon[858]: time=2026-09-22T16:42:40.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.746256] niks3-server[966]: 2026/09/22 16:42:40 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 38.750363] niks3-server[966]: 2026/09/22 16:42:40 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 38.756161] niks3-server[966]: 2026/09/22 16:42:40 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo lb # [ 38.758586] niks3-server[966]: 2026/09/22 16:42:40 INFO Completed upload id=3 worker1 # [ 38.708932] nix-grpc-daemon[858]: time=2026-09-22T16:42:40.889Z level=INFO msg="Upload complete. (153ms)" worker1 # [ 38.711751] nix-grpc-daemon[780]: ts=2026-09-22T16:42:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 38.714965] nix-grpc-daemon[780]: ts=2026-09-22T16:42:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 38.724759] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 38.728079] nix-daemon[845]: reaped child process 899, status = succeeded worker1 # [ 38.732486] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 39.347083] nix-daemon[845]: reaped child process 908, status = succeeded worker1 # [ 39.427226] nix-daemon[845]: accepted connection from pid 924, user nix-grpc-daemon (trusted) worker1 # [ 39.442449] nix-daemon[845]: reaped child process 927, status = succeeded lb # [ 39.498922] niks3-server[966]: 2026/09/22 16:42:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.458956] nix-grpc-daemon[858]: time=2026-09-22T16:42:41.639Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 39.461435] nix-grpc-daemon[858]: time=2026-09-22T16:42:41.641Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 39.543577] niks3-server[966]: 2026/09/22 16:42:41 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 39.551893] niks3-server[966]: 2026/09/22 16:42:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 39.558283] niks3-server[966]: 2026/09/22 16:42:41 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls worker1 # [ 39.515055] nix-grpc-daemon[858]: time=2026-09-22T16:42:41.695Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.564556] niks3-server[966]: 2026/09/22 16:42:41 INFO Signed narinfos id=4 count=1 lb # [ 39.573340] niks3-server[966]: 2026/09/22 16:42:41 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 39.581532] niks3-server[966]: 2026/09/22 16:42:41 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 39.585823] niks3-server[966]: 2026/09/22 16:42:41 INFO Completed upload id=4 worker1 # [ 39.536174] nix-grpc-daemon[858]: time=2026-09-22T16:42:41.716Z level=INFO msg="Upload complete. (196ms)" lb # [ 39.587912] niks3-server[966]: 2026/09/22 16:42:41 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker1 # [ 39.539267] nix-grpc-daemon[780]: ts=2026-09-22T16:42:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker1 # [ 39.547362] nix-daemon[845]: reaped child process 906, status = succeeded worker2 # [ 39.571855] nix-grpc-daemon[781]: ts=2026-09-22T16:42:41Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 39.576199] nix-grpc-daemon[781]: ts=2026-09-22T16:42:41Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 39.592055] nix-grpc-daemon[780]: ts=2026-09-22T16:42:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 39.602435] nix-grpc-daemon[780]: ts=2026-09-22T16:42:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 39.610836] nix-grpc-daemon[858]: time=2026-09-22T16:42:41.791Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 39.615461] nix-grpc-daemon[780]: ts=2026-09-22T16:42:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker1 # [ 39.623238] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 39.715974] nix-daemon[845]: accepted connection from pid 931, user nix-grpc-daemon (trusted) worker1 # [ 39.730039] nix-daemon[845]: reaped child process 934, status = succeeded lb # [ 39.788473] niks3-server[966]: 2026/09/22 16:42:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.747225] nix-grpc-daemon[858]: time=2026-09-22T16:42:41.928Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 39.749192] nix-grpc-daemon[858]: time=2026-09-22T16:42:41.930Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 39.819698] niks3-server[966]: 2026/09/22 16:42:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 39.775296] nix-grpc-daemon[858]: time=2026-09-22T16:42:41.956Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.824953] niks3-server[966]: 2026/09/22 16:42:41 INFO Signed narinfos id=5 count=1 lb # [ 39.832758] niks3-server[966]: 2026/09/22 16:42:41 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 39.838136] niks3-server[966]: 2026/09/22 16:42:41 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 39.848344] niks3-server[966]: 2026/09/22 16:42:41 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 39.854997] niks3-server[966]: 2026/09/22 16:42:41 INFO Completed upload id=5 worker1 # [ 39.804981] nix-grpc-daemon[858]: time=2026-09-22T16:42:41.985Z level=INFO msg="Upload complete. (174ms)" worker1 # [ 39.809158] nix-grpc-daemon[780]: ts=2026-09-22T16:42:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 39.860592] niks3-server[966]: 2026/09/22 16:42:41 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker1 # [ 39.814546] nix-grpc-daemon[780]: ts=2026-09-22T16:42:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 39.822556] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 39.828170] nix-daemon[845]: reaped child process 929, status = succeeded worker1 # [ 39.833148] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 40.850820] nix-daemon[845]: reaped child process 938, status = succeeded worker1 # [ 40.931736] nix-daemon[845]: accepted connection from pid 955, user nix-grpc-daemon (trusted) worker1 # [ 40.947990] nix-daemon[845]: reaped child process 958, status = succeeded lb # [ 41.002959] niks3-server[966]: 2026/09/22 16:42:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.958527] nix-grpc-daemon[858]: time=2026-09-22T16:42:43.139Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 40.961148] nix-grpc-daemon[858]: time=2026-09-22T16:42:43.140Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 41.023376] niks3-server[966]: 2026/09/22 16:42:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 41.026372] niks3-server[966]: 2026/09/22 16:42:42 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 41.030068] niks3-server[966]: 2026/09/22 16:42:42 INFO Signed narinfos id=6 count=1 worker1 # [ 40.981730] nix-grpc-daemon[858]: time=2026-09-22T16:42:43.162Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.032699] niks3-server[966]: 2026/09/22 16:42:42 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 41.034658] niks3-server[966]: 2026/09/22 16:42:42 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 41.041032] niks3-server[966]: 2026/09/22 16:42:42 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 41.044352] niks3-server[966]: 2026/09/22 16:42:42 INFO Completed upload id=6 worker1 # [ 40.994361] nix-grpc-daemon[858]: time=2026-09-22T16:42:43.175Z level=INFO msg="Upload complete. (153ms)" lb # [ 41.047073] niks3-server[966]: 2026/09/22 16:42:42 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker1 # [ 40.997441] nix-grpc-daemon[780]: ts=2026-09-22T16:42:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker1 # [ 41.006036] nix-daemon[845]: reaped child process 936, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 4.25 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.12 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.13 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 4.56 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.14 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.18 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 41.782402] nix-grpc-daemon[781]: ts=2026-09-22T16:42:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40992 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 41.791221] nix-grpc-daemon[781]: ts=2026-09-22T16:42:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 41.817697] nix-grpc-daemon[781]: ts=2026-09-22T16:42:43Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.17 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.72 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 42.290789] nix-grpc-daemon[781]: ts=2026-09-22T16:42:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40992 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 42.298769] nix-grpc-daemon[781]: ts=2026-09-22T16:42:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 42.310189] nix-grpc-daemon[781]: ts=2026-09-22T16:42:44Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 42.315269] nix-grpc-daemon[781]: ts=2026-09-22T16:42:44Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 42.295766] nix-grpc-daemon[780]: ts=2026-09-22T16:42:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 42.303253] nix-grpc-daemon[780]: ts=2026-09-22T16:42:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 42.310223] nix-grpc-daemon[858]: time=2026-09-22T16:42:44.490Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker1 # [ 42.314738] nix-grpc-daemon[780]: ts=2026-09-22T16:42:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 42.319828] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 42.423289] nix-daemon[845]: accepted connection from pid 975, user nix-grpc-daemon (trusted) worker1 # [ 42.439971] nix-daemon[845]: reaped child process 978, status = succeeded lb # [ 42.496113] niks3-server[966]: 2026/09/22 16:42:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.450241] nix-grpc-daemon[858]: time=2026-09-22T16:42:44.631Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 42.451849] nix-grpc-daemon[858]: time=2026-09-22T16:42:44.632Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 42.512251] niks3-server[966]: 2026/09/22 16:42:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 42.514043] niks3-server[966]: 2026/09/22 16:42:44 INFO Signed narinfos id=7 count=1 worker1 # [ 42.465775] nix-grpc-daemon[858]: time=2026-09-22T16:42:44.646Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.518236] niks3-server[966]: 2026/09/22 16:42:44 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 42.521160] niks3-server[966]: 2026/09/22 16:42:44 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 42.526532] niks3-server[966]: 2026/09/22 16:42:44 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 42.532066] niks3-server[966]: 2026/09/22 16:42:44 INFO Completed upload id=7 worker1 # [ 42.482439] nix-grpc-daemon[858]: time=2026-09-22T16:42:44.663Z level=INFO msg="Upload complete. (153ms)" lb # [ 42.534751] niks3-server[966]: 2026/09/22 16:42:44 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker1 # [ 42.485850] nix-grpc-daemon[780]: ts=2026-09-22T16:42:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 42.489496] nix-grpc-daemon[780]: ts=2026-09-22T16:42:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 42.498220] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 42.507812] nix-daemon[845]: reaped child process 973, status = succeeded client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... worker1 # [ 42.513895] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 43.933763] nix-daemon[845]: reaped child process 982, status = succeeded worker1 # [ 44.004812] nix-daemon[845]: accepted connection from pid 998, user nix-grpc-daemon (trusted) worker1 # [ 44.018606] nix-daemon[845]: reaped child process 1001, status = succeeded lb # [ 44.072664] niks3-server[966]: 2026/09/22 16:42:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 44.031243] nix-grpc-daemon[858]: time=2026-09-22T16:42:46.211Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 44.037074] nix-grpc-daemon[858]: time=2026-09-22T16:42:46.213Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 44.110145] niks3-server[966]: 2026/09/22 16:42:45 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 44.126793] niks3-server[966]: 2026/09/22 16:42:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 44.135612] niks3-server[966]: 2026/09/22 16:42:45 INFO Signed narinfos id=8 count=1 worker1 # [ 44.089301] nix-grpc-daemon[858]: time=2026-09-22T16:42:46.269Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.140662] niks3-server[966]: 2026/09/22 16:42:45 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 44.145465] niks3-server[966]: 2026/09/22 16:42:45 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 44.155439] niks3-server[966]: 2026/09/22 16:42:45 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 44.160239] niks3-server[966]: 2026/09/22 16:42:45 INFO Completed upload id=8 worker1 # [ 44.110498] nix-grpc-daemon[858]: time=2026-09-22T16:42:46.291Z level=INFO msg="Upload complete. (187ms)" lb # [ 44.161922] niks3-server[966]: 2026/09/22 16:42:45 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker1 # [ 44.116555] nix-grpc-daemon[780]: ts=2026-09-22T16:42:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker1 # [ 44.130788] nix-daemon[845]: reaped child process 980, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.01 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.31 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 worker1 # [ 44.487786] nix-grpc-daemon[780]: ts=2026-09-22T16:42:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59320 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker2 # [ 44.519377] nix-grpc-daemon[781]: ts=2026-09-22T16:42:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 44.540426] nix-grpc-daemon[781]: ts=2026-09-22T16:42:46Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker2 # [ 44.546410] nix-grpc-daemon[781]: ts=2026-09-22T16:42:46Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 44.551618] nix-grpc-daemon[781]: ts=2026-09-22T16:42:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 44.563513] nix-grpc-daemon[781]: ts=2026-09-22T16:42:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker2 # [ 44.574998] nix-grpc-daemon[781]: ts=2026-09-22T16:42:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 44.586349] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 44.604945] nix-grpc-daemon[781]: ts=2026-09-22T16:42:46Z level=info event=niks3_push_started pid=919 worker2 # [ 44.723716] nix-grpc-daemon[919]: time=2026-09-22T16:42:46.836Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 44.818175] nix-daemon[866]: accepted connection from pid 932, user nix-grpc-daemon (trusted) worker2 # [ 44.832140] nix-daemon[866]: reaped child process 935, status = succeeded lb # [ 44.867640] niks3-server[966]: 2026/09/22 16:42:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 44.849259] nix-grpc-daemon[919]: time=2026-09-22T16:42:46.962Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 44.850772] nix-grpc-daemon[919]: time=2026-09-22T16:42:46.964Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 44.905318] niks3-server[966]: 2026/09/22 16:42:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 44.914669] niks3-server[966]: 2026/09/22 16:42:46 INFO Signed narinfos id=9 count=1 worker2 # [ 44.890899] nix-grpc-daemon[919]: time=2026-09-22T16:42:47.003Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.920208] niks3-server[966]: 2026/09/22 16:42:46 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 44.925412] niks3-server[966]: 2026/09/22 16:42:46 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 44.937729] niks3-server[966]: 2026/09/22 16:42:46 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete worker2 # [ 44.918225] nix-grpc-daemon[919]: time=2026-09-22T16:42:47.031Z level=INFO msg="Upload complete. (190ms)" lb # [ 44.945796] niks3-server[966]: 2026/09/22 16:42:46 INFO Completed upload id=9 lb # [ 44.948965] niks3-server[966]: 2026/09/22 16:42:46 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker2 # [ 44.921198] nix-grpc-daemon[781]: ts=2026-09-22T16:42:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 44.928622] nix-grpc-daemon[781]: ts=2026-09-22T16:42:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 44.940060] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 44.943053] nix-daemon[866]: reaped child process 917, status = succeeded client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> worker2: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker2 # [ 44.946892] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) lb # [ 45.559370] envoy[904]: conn peer=[2001:db8:1::1]:53710 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=8 lb # [ 45.562991] envoy[904]: conn peer=[2001:db8:1::1]:53716 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=8 lb # [ 45.566574] envoy[904]: conn peer=[2001:db8:1::1]:53730 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9408 tx=4325 ms=4121 lb # [ 45.570118] envoy[904]: conn peer=[2001:db8:1::1]:53742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=48 lb # [ 45.573512] envoy[904]: conn peer=[2001:db8:1::1]:53750 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4165 tx=1874 ms=1861 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker2 # [ 46.188259] nix-daemon[866]: reaped child process 939, status = succeeded worker2 # [ 46.277649] nix-daemon[866]: accepted connection from pid 955, user nix-grpc-daemon (trusted) worker2 # [ 46.292662] nix-daemon[866]: reaped child process 958, status = succeeded lb # [ 46.327400] niks3-server[966]: 2026/09/22 16:42:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.306711] nix-grpc-daemon[919]: time=2026-09-22T16:42:48.419Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 46.309058] nix-grpc-daemon[919]: time=2026-09-22T16:42:48.421Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 46.354036] niks3-server[966]: 2026/09/22 16:42:47 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 46.360265] niks3-server[966]: 2026/09/22 16:42:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 46.362900] niks3-server[966]: 2026/09/22 16:42:47 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 46.366610] niks3-server[966]: 2026/09/22 16:42:47 INFO Signed narinfos id=10 count=1 worker2 # [ 46.339661] nix-grpc-daemon[919]: time=2026-09-22T16:42:48.452Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.370411] niks3-server[966]: 2026/09/22 16:42:47 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 46.377953] niks3-server[966]: 2026/09/22 16:42:47 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 46.382221] niks3-server[966]: 2026/09/22 16:42:47 INFO Completed upload id=10 worker2 # [ 46.356712] nix-grpc-daemon[919]: time=2026-09-22T16:42:48.470Z level=INFO msg="Upload complete. (201ms)" lb # [ 46.384798] niks3-server[966]: 2026/09/22 16:42:47 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker2 # [ 46.360812] nix-grpc-daemon[781]: ts=2026-09-22T16:42:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker2 # [ 46.366749] nix-grpc-daemon[781]: ts=2026-09-22T16:42:48Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker2 # [ 46.369081] nix-grpc-daemon[781]: ts=2026-09-22T16:42:48Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 46.374155] nix-daemon[866]: reaped child process 937, status = succeeded worker2 # [ 46.411069] nix-grpc-daemon[781]: ts=2026-09-22T16:42:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 46.421319] nix-grpc-daemon[781]: ts=2026-09-22T16:42:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 46.430757] nix-grpc-daemon[919]: time=2026-09-22T16:42:48.544Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker2 # [ 46.438110] nix-grpc-daemon[781]: ts=2026-09-22T16:42:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 46.446277] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 46.540230] nix-daemon[866]: accepted connection from pid 964, user nix-grpc-daemon (trusted) worker2 # [ 46.555925] nix-daemon[866]: reaped child process 967, status = succeeded lb # [ 46.588395] niks3-server[966]: 2026/09/22 16:42:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.565160] nix-grpc-daemon[919]: time=2026-09-22T16:42:48.678Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 46.566600] nix-grpc-daemon[919]: time=2026-09-22T16:42:48.680Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 46.602966] niks3-server[966]: 2026/09/22 16:42:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 46.605751] niks3-server[966]: 2026/09/22 16:42:48 INFO Signed narinfos id=11 count=1 worker2 # [ 46.578771] nix-grpc-daemon[919]: time=2026-09-22T16:42:48.692Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.610493] niks3-server[966]: 2026/09/22 16:42:48 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 46.613244] niks3-server[966]: 2026/09/22 16:42:48 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 46.616686] niks3-server[966]: 2026/09/22 16:42:48 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 46.620236] niks3-server[966]: 2026/09/22 16:42:48 INFO Completed upload id=11 worker2 # [ 46.594192] nix-grpc-daemon[919]: time=2026-09-22T16:42:48.707Z level=INFO msg="Upload complete. (138ms)" lb # [ 46.622053] niks3-server[966]: 2026/09/22 16:42:48 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker2 # [ 46.596652] nix-grpc-daemon[781]: ts=2026-09-22T16:42:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 46.599117] nix-grpc-daemon[781]: ts=2026-09-22T16:42:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 46.606071] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 46.612119] nix-daemon[866]: reaped child process 962, status = succeeded worker2 # [ 46.614919] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> worker2: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker2 # [ 47.831080] nix-daemon[866]: reaped child process 971, status = succeeded worker2 # [ 47.911105] nix-daemon[866]: accepted connection from pid 987, user nix-grpc-daemon (trusted) worker2 # [ 47.925430] nix-daemon[866]: reaped child process 990, status = succeeded lb # [ 47.959548] niks3-server[966]: 2026/09/22 16:42:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.940465] nix-grpc-daemon[919]: time=2026-09-22T16:42:50.053Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 47.941825] nix-grpc-daemon[919]: time=2026-09-22T16:42:50.053Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 47.994598] niks3-server[966]: 2026/09/22 16:42:49 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 48.002974] niks3-server[966]: 2026/09/22 16:42:49 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 48.012587] niks3-server[966]: 2026/09/22 16:42:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker2 # [ 47.991787] nix-grpc-daemon[919]: time=2026-09-22T16:42:50.105Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.018649] niks3-server[966]: 2026/09/22 16:42:49 INFO Signed narinfos id=12 count=1 lb # [ 48.024544] niks3-server[966]: 2026/09/22 16:42:49 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 48.033452] niks3-server[966]: 2026/09/22 16:42:49 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 48.037185] niks3-server[966]: 2026/09/22 16:42:49 INFO Completed upload id=12 worker2 # [ 48.009754] nix-grpc-daemon[919]: time=2026-09-22T16:42:50.123Z level=INFO msg="Upload complete. (186ms)" lb # [ 48.039075] niks3-server[966]: 2026/09/22 16:42:49 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 48.012695] nix-grpc-daemon[781]: ts=2026-09-22T16:42:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker2 # [ 48.020285] nix-grpc-daemon[781]: ts=2026-09-22T16:42:50Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker2 # [ 48.022326] nix-grpc-daemon[781]: ts=2026-09-22T16:42:50Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 48.027287] nix-daemon[866]: reaped child process 969, status = succeeded worker2 # [ 48.063752] nix-grpc-daemon[781]: ts=2026-09-22T16:42:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 48.072099] nix-grpc-daemon[781]: ts=2026-09-22T16:42:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 48.080523] nix-grpc-daemon[919]: time=2026-09-22T16:42:50.193Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 48.086322] nix-grpc-daemon[781]: ts=2026-09-22T16:42:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker2 # [ 48.097337] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 48.186937] nix-daemon[866]: accepted connection from pid 996, user nix-grpc-daemon (trusted) worker2 # [ 48.201372] nix-daemon[866]: reaped child process 999, status = succeeded lb # [ 48.234774] niks3-server[966]: 2026/09/22 16:42:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 48.214735] nix-grpc-daemon[919]: time=2026-09-22T16:42:50.328Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 48.216201] nix-grpc-daemon[919]: time=2026-09-22T16:42:50.329Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 48.265315] niks3-server[966]: 2026/09/22 16:42:49 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 48.273635] niks3-server[966]: 2026/09/22 16:42:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 48.277982] niks3-server[966]: 2026/09/22 16:42:49 INFO Signed narinfos id=13 count=1 worker2 # [ 48.253694] nix-grpc-daemon[919]: time=2026-09-22T16:42:50.367Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.292132] niks3-server[966]: 2026/09/22 16:42:49 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 48.298258] niks3-server[966]: 2026/09/22 16:42:49 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete worker2 # [ 48.276832] nix-grpc-daemon[919]: time=2026-09-22T16:42:50.390Z level=INFO msg="Upload complete. (173ms)" lb # [ 48.303879] niks3-server[966]: 2026/09/22 16:42:49 INFO Completed upload id=13 worker2 # [ 48.279104] nix-grpc-daemon[781]: ts=2026-09-22T16:42:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 48.281803] nix-grpc-daemon[781]: ts=2026-09-22T16:42:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 lb # [ 48.309403] niks3-server[966]: 2026/09/22 16:42:49 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker2 # [ 48.289074] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 48.295396] nix-daemon[866]: reaped child process 994, status = succeeded worker2 # [ 48.298466] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> worker2: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker2 # [ 49.339241] nix-daemon[866]: reaped child process 1003, status = succeeded worker2 # [ 49.425106] nix-daemon[866]: accepted connection from pid 1019, user nix-grpc-daemon (trusted) worker2 # [ 49.439048] nix-daemon[866]: reaped child process 1022, status = succeeded lb # [ 49.471372] niks3-server[966]: 2026/09/22 16:42:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.448734] nix-grpc-daemon[919]: time=2026-09-22T16:42:51.561Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 49.452064] nix-grpc-daemon[919]: time=2026-09-22T16:42:51.564Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 49.492843] niks3-server[966]: 2026/09/22 16:42:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 49.495425] niks3-server[966]: 2026/09/22 16:42:51 INFO Signed narinfos id=14 count=1 worker2 # [ 49.468264] nix-grpc-daemon[919]: time=2026-09-22T16:42:51.581Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.501932] niks3-server[966]: 2026/09/22 16:42:51 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 49.504311] niks3-server[966]: 2026/09/22 16:42:51 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 49.510281] niks3-server[966]: 2026/09/22 16:42:51 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 49.513432] niks3-server[966]: 2026/09/22 16:42:51 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 49.516382] niks3-server[966]: 2026/09/22 16:42:51 INFO Completed upload id=14 worker2 # [ 49.489200] nix-grpc-daemon[919]: time=2026-09-22T16:42:51.602Z level=INFO msg="Upload complete. (181ms)" lb # [ 49.518239] niks3-server[966]: 2026/09/22 16:42:51 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker2 # [ 49.492569] nix-grpc-daemon[781]: ts=2026-09-22T16:42:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker2 # [ 49.502426] nix-daemon[866]: reaped child process 1001, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.17 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.09 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 49.730795] nix-grpc-daemon[780]: ts=2026-09-22T16:42:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:59376 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 49.775434] nix-grpc-daemon[780]: ts=2026-09-22T16:42:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:59376 worker1 # [ 49.782139] nix-grpc-daemon[780]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker1 # [ 49.795457] nix-grpc-daemon[780]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker1 # [ 49.806732] nix-grpc-daemon[780]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.21 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 49.974175] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:57022 worker2 # [ 49.977061] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:57022 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.17 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/890" client # removing stale temporary roots file "/nix/var/nix/temproots/811" client # removing stale temporary roots file "/nix/var/nix/temproots/869" client # removing stale temporary roots file "/nix/var/nix/temproots/849" client # removing stale temporary roots file "/nix/var/nix/temproots/861" client # removing stale temporary roots file "/nix/var/nix/temproots/905" client # removing stale temporary roots file "/nix/var/nix/temproots/827" client # removing stale temporary roots file "/nix/var/nix/temproots/882" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker1 # [ 50.239373] nix-grpc-daemon[780]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 50.246453] nix-grpc-daemon[780]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 50.256239] nix-grpc-daemon[858]: time=2026-09-22T16:42:52.436Z level=INFO msg="All 1 paths already cached" worker2 # [ 50.285959] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40992 worker1 # [ 50.271078] nix-grpc-daemon[780]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59320 worker2 # [ 50.300328] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40992 client # copying 3 paths... worker2 # [ 50.310714] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40992 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker1 # [ 50.303868] nix-grpc-daemon[780]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59320 worker2 # [ 50.332455] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 worker1 # [ 50.309622] nix-grpc-daemon[780]: ts=2026-09-22T16:42:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 50.337781] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 50.343853] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 50.347387] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.39 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 6.04 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 50.441847] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 2f6dd0f7eb5f43efa909dcf0c9fdfbfb client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 50.567808] nix[958]: don't know how to build these paths: client # [ 50.568747] nix[958]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker1 # [ 50.554655] nix-grpc-daemon[780]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59320 worker2 # [ 50.583550] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 50.585509] nix-grpc-daemon[781]: ts=2026-09-22T16:42:52Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 50.604156] nix-grpc-daemon[780]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 50.614556] nix-grpc-daemon[780]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 client # [ 50.635176] nix[958]: copying 1 paths to 'lb:50051'... client # [ 50.636717] nix[958]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker1 # [ 50.623889] nix-grpc-daemon[780]: ts=2026-09-22T16:42:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 50.635614] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 50.744609] nix-daemon[845]: accepted connection from pid 1008, user nix-grpc-daemon (trusted) worker1 # [ 50.762444] nix-daemon[845]: reaped child process 1011, status = succeeded lb # [ 50.819273] niks3-server[966]: 2026/09/22 16:42:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 50.778851] nix-grpc-daemon[858]: time=2026-09-22T16:42:52.959Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 50.780257] nix-grpc-daemon[858]: time=2026-09-22T16:42:52.959Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 50.847955] niks3-server[966]: 2026/09/22 16:42:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 50.853870] niks3-server[966]: 2026/09/22 16:42:52 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 50.860252] niks3-server[966]: 2026/09/22 16:42:52 INFO Signed narinfos id=15 count=1 worker1 # [ 50.813364] nix-grpc-daemon[858]: time=2026-09-22T16:42:52.993Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.872272] niks3-server[966]: 2026/09/22 16:42:52 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete worker1 # [ 50.830251] nix-grpc-daemon[858]: time=2026-09-22T16:42:53.011Z level=INFO msg="Upload complete. (183ms)" lb # [ 50.879994] niks3-server[966]: 2026/09/22 16:42:52 INFO Completed upload id=15 worker1 # [ 50.832850] nix-grpc-daemon[780]: ts=2026-09-22T16:42:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 50.884613] niks3-server[966]: 2026/09/22 16:42:52 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 50.887291] niks3-server[966]: 2026/09/22 16:42:52 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker1 # [ 50.840535] nix-grpc-daemon[780]: ts=2026-09-22T16:42:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 50.845368] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 50.848046] nix-daemon[845]: reaped child process 1006, status = succeeded worker1 # [ 50.853459] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # [ 50.865006] nix[958]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 51.494656] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: cde032351bbe458db15551b28789efb4 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.06 seconds) worker1 # [ 51.642925] nix-grpc-daemon[780]: ts=2026-09-22T16:42:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59320 client # [ 51.667030] nix[974]: this derivation will be built: worker2 # [ 51.680283] nix-grpc-daemon[781]: ts=2026-09-22T16:42:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 51.691262] nix-grpc-daemon[781]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' from 'http://lb:5751'... client # [ 51.696445] nix[974]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 51.713398] nix-grpc-daemon[781]: ts=2026-09-22T16:42:53Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker1 # [ 51.700492] nix-grpc-daemon[780]: ts=2026-09-22T16:42:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 client # [ 51.717769] nix[974]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.03 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 54.902715] nix-daemon[845]: reaped child process 1015, status = succeeded worker1 # [ 54.981417] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted) worker1 # [ 54.998121] nix-daemon[845]: reaped child process 1048, status = succeeded lb # [ 55.051756] niks3-server[966]: 2026/09/22 16:42:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.010534] nix-grpc-daemon[858]: time=2026-09-22T16:42:57.191Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 55.012133] nix-grpc-daemon[858]: time=2026-09-22T16:42:57.192Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 55.093751] niks3-server[966]: 2026/09/22 16:42:56 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 55.098764] niks3-server[966]: 2026/09/22 16:42:56 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 55.105155] niks3-server[966]: 2026/09/22 16:42:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker1 # [ 55.062954] nix-grpc-daemon[858]: time=2026-09-22T16:42:57.243Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.112772] niks3-server[966]: 2026/09/22 16:42:56 INFO Signed narinfos id=16 count=1 lb # [ 55.117563] niks3-server[966]: 2026/09/22 16:42:56 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 55.128316] niks3-server[966]: 2026/09/22 16:42:56 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 55.131888] niks3-server[966]: 2026/09/22 16:42:56 INFO Completed upload id=16 lb # [ 55.134130] niks3-server[966]: 2026/09/22 16:42:56 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker1 # [ 55.083453] nix-grpc-daemon[858]: time=2026-09-22T16:42:57.264Z level=INFO msg="Upload complete. (218ms)" worker1 # [ 55.090625] nix-grpc-daemon[780]: ts=2026-09-22T16:42:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 55.099304] nix-grpc-daemon[780]: ts=2026-09-22T16:42:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker1 # [ 55.111648] nix-daemon[845]: reaped child process 1013, status = succeeded client # [ 55.146800] systemd[1]: dedup2.service: Deactivated successfully. client # [ 55.149983] systemd[1]: dedup2.service: Consumed 137ms CPU time over 3.655s wall clock time, 35.4M memory peak, 6.6K incoming IP traffic, 6.1K outgoing IP traffic. client # [ 55.160192] systemd[1]: dedup1.service: Deactivated successfully. client # [ 55.162565] systemd[1]: dedup1.service: Consumed 116ms CPU time over 4.717s wall clock time, 41.5M memory peak, 7.1K incoming IP traffic, 8.3K outgoing IP traffic. lb # [ 55.560296] envoy[904]: conn peer=[2001:db8:1::1]:43690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=4382 ms=5035 lb # [ 55.563873] envoy[904]: conn peer=[2001:db8:1::1]:43704 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1108 tx=2928 ms=148 lb # [ 55.567595] envoy[904]: conn peer=[2001:db8:1::1]:43720 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=83 lb # [ 55.571111] envoy[904]: conn peer=[2001:db8:1::1]:43724 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=77 lb # [ 55.574517] envoy[904]: conn peer=[2001:db8:1::1]:43738 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=71 lb # [ 55.578113] envoy[904]: conn peer=[2001:db8:1::1]:43762 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1576 tx=1599 ms=3462 lb # [ 55.582196] envoy[904]: conn peer=[2001:db8:1::1]:43754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2994 tx=1518 ms=4557 client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.03 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.70 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 56.273955] nix-grpc-daemon[781]: ts=2026-09-22T16:42:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 56.287460] nix-grpc-daemon[781]: ts=2026-09-22T16:42:58Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 56.292729] nix-grpc-daemon[781]: ts=2026-09-22T16:42:58Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 56.298571] nix-grpc-daemon[781]: ts=2026-09-22T16:42:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 56.309542] nix-grpc-daemon[781]: ts=2026-09-22T16:42:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 56.320573] nix-grpc-daemon[781]: ts=2026-09-22T16:42:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 56.331990] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 56.431565] nix-daemon[866]: accepted connection from pid 1054, user nix-grpc-daemon (trusted) worker2 # [ 56.446518] nix-daemon[866]: reaped child process 1057, status = succeeded lb # [ 56.481414] niks3-server[966]: 2026/09/22 16:42:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 56.462568] nix-grpc-daemon[919]: time=2026-09-22T16:42:58.575Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 56.463966] nix-grpc-daemon[919]: time=2026-09-22T16:42:58.575Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 56.511749] niks3-server[966]: 2026/09/22 16:42:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 56.521268] niks3-server[966]: 2026/09/22 16:42:58 INFO Signed narinfos id=17 count=1 worker2 # [ 56.498667] nix-grpc-daemon[919]: time=2026-09-22T16:42:58.611Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.525819] niks3-server[966]: 2026/09/22 16:42:58 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 56.531975] niks3-server[966]: 2026/09/22 16:42:58 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 56.544125] niks3-server[966]: 2026/09/22 16:42:58 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 56.551292] niks3-server[966]: 2026/09/22 16:42:58 INFO Completed upload id=17 worker2 # [ 56.526330] nix-grpc-daemon[919]: time=2026-09-22T16:42:58.639Z level=INFO msg="Upload complete. (183ms)" worker2 # [ 56.529814] nix-grpc-daemon[781]: ts=2026-09-22T16:42:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 56.558335] niks3-server[966]: 2026/09/22 16:42:58 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker2 # [ 56.535631] nix-grpc-daemon[781]: ts=2026-09-22T16:42:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 56.546144] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 56.553136] nix-daemon[866]: reaped child process 1052, status = succeeded worker2 # [ 56.556869] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 62.769669] nix-grpc-daemon[781]: ts=2026-09-22T16:43:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker2 # [ 62.782843] nix-daemon[866]: reaped child process 1059, status = succeeded worker2 # [ 62.783881] nix-daemon[866]: reaped child process 1061, status = succeeded worker2 # [ 62.928845] nix-grpc-daemon[781]: ts=2026-09-22T16:43:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 62.939615] nix-grpc-daemon[781]: ts=2026-09-22T16:43:05Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker2 # [ 62.944184] nix-grpc-daemon[781]: ts=2026-09-22T16:43:05Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 62.920924] nix-grpc-daemon[780]: ts=2026-09-22T16:43:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 62.934814] nix-grpc-daemon[780]: ts=2026-09-22T16:43:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 62.945834] nix-grpc-daemon[780]: ts=2026-09-22T16:43:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 62.954973] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 63.060988] nix-daemon[845]: accepted connection from pid 1061, user nix-grpc-daemon (trusted) worker1 # [ 63.077421] nix-daemon[845]: reaped child process 1064, status = succeeded lb # [ 63.130880] niks3-server[966]: 2026/09/22 16:43:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 63.089597] nix-grpc-daemon[858]: time=2026-09-22T16:43:05.269Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 63.091079] nix-grpc-daemon[858]: time=2026-09-22T16:43:05.269Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 63.162626] niks3-server[966]: 2026/09/22 16:43:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 63.171132] niks3-server[966]: 2026/09/22 16:43:04 INFO Signed narinfos id=18 count=1 worker1 # [ 63.124507] nix-grpc-daemon[858]: time=2026-09-22T16:43:05.305Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.177623] niks3-server[966]: 2026/09/22 16:43:04 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 63.186274] niks3-server[966]: 2026/09/22 16:43:04 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 63.195562] niks3-server[966]: 2026/09/22 16:43:04 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 63.202991] niks3-server[966]: 2026/09/22 16:43:04 INFO Completed upload id=18 worker1 # [ 63.153412] nix-grpc-daemon[858]: time=2026-09-22T16:43:05.334Z level=INFO msg="Upload complete. (183ms)" lb # [ 63.207256] niks3-server[966]: 2026/09/22 16:43:04 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker1 # [ 63.158653] nix-grpc-daemon[780]: ts=2026-09-22T16:43:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 63.164756] nix-grpc-daemon[780]: ts=2026-09-22T16:43:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 63.176186] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 63.187436] nix-daemon[845]: reaped child process 1059, status = succeeded worker1 # [ 63.190215] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) lb # [ 65.561333] envoy[904]: conn peer=[2001:db8:1::1]:33068 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=935 ms=6511 worker1 # [ 69.003809] nix-grpc-daemon[780]: ts=2026-09-22T16:43:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker1 # [ 69.028499] nix-daemon[845]: reaped child process 1066, status = succeeded worker1 # [ 69.031117] nix-daemon[845]: reaped child process 1068, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.07 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 69.224620] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 9164b15fc23943ada5adf0f4fc76c49a client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 69.361915] nix[1047]: don't know how to build these paths: client # [ 69.362859] nix[1047]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 69.371169] nix-grpc-daemon[781]: ts=2026-09-22T16:43:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 69.381746] nix-grpc-daemon[781]: ts=2026-09-22T16:43:11Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 69.386891] nix-grpc-daemon[781]: ts=2026-09-22T16:43:11Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 69.392643] nix-grpc-daemon[781]: ts=2026-09-22T16:43:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 69.404134] nix-grpc-daemon[781]: ts=2026-09-22T16:43:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 client # [ 69.403081] nix[1047]: copying 1 paths to 'lb:50051'... client # [ 69.403872] nix[1047]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker2 # [ 69.415073] nix-grpc-daemon[781]: ts=2026-09-22T16:43:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 69.423938] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 69.529209] nix-daemon[866]: accepted connection from pid 1088, user nix-grpc-daemon (trusted) worker2 # [ 69.543920] nix-daemon[866]: reaped child process 1091, status = succeeded lb # [ 69.578124] niks3-server[966]: 2026/09/22 16:43:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.561208] nix-grpc-daemon[919]: time=2026-09-22T16:43:11.674Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 69.562627] nix-grpc-daemon[919]: time=2026-09-22T16:43:11.674Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 69.611140] niks3-server[966]: 2026/09/22 16:43:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 69.617743] niks3-server[966]: 2026/09/22 16:43:11 INFO Signed narinfos id=19 count=1 worker2 # [ 69.594120] nix-grpc-daemon[919]: time=2026-09-22T16:43:11.707Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.631399] niks3-server[966]: 2026/09/22 16:43:11 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 69.640274] niks3-server[966]: 2026/09/22 16:43:11 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete worker2 # [ 69.619259] nix-grpc-daemon[919]: time=2026-09-22T16:43:11.732Z level=INFO msg="Upload complete. (181ms)" lb # [ 69.646355] niks3-server[966]: 2026/09/22 16:43:11 INFO Completed upload id=19 worker2 # [ 69.622359] nix-grpc-daemon[781]: ts=2026-09-22T16:43:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 69.651155] niks3-server[966]: 2026/09/22 16:43:11 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 69.655813] niks3-server[966]: 2026/09/22 16:43:11 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker2 # [ 69.627687] nix-grpc-daemon[781]: ts=2026-09-22T16:43:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 69.639117] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 69.643785] nix-daemon[866]: reaped child process 1086, status = succeeded worker2 # [ 69.648822] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # [ 69.637718] nix[1047]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 70.294613] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 2944476797604fc08634425ba9ced4bf client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) worker1 # [ 70.422819] nix-grpc-daemon[780]: ts=2026-09-22T16:43:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59320 client # [ 70.435903] nix[1063]: don't know how to build these paths: client # [ 70.436837] nix[1063]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 70.453917] nix-grpc-daemon[781]: ts=2026-09-22T16:43:12Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 70.456411] nix-grpc-daemon[781]: ts=2026-09-22T16:43:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 client # [ 70.448368] nix[1063]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 73.519717] systemd[1]: share1.service: Sent signal SIGINT to main process 1047 (nix) on client request. client # [ 73.524495] nix[1047]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.04 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 73.530766] nix[1047]: error: interrupted by the user client # [ 73.572763] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 73.574268] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 73.576323] systemd[1]: share1.service: Consumed 113ms CPU time over 4.351s wall clock time, 43.5M memory peak, 6.1K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds) client: waiting for success: ! systemctl is-active share2 worker2 # [ 74.873556] nix-daemon[866]: reaped child process 1095, status = succeeded worker2 # [ 74.951604] nix-daemon[866]: accepted connection from pid 1131, user nix-grpc-daemon (trusted) worker2 # [ 74.965466] nix-daemon[866]: reaped child process 1134, status = succeeded lb # [ 75.000830] niks3-server[966]: 2026/09/22 16:43:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 74.979335] nix-grpc-daemon[919]: time=2026-09-22T16:43:17.092Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 74.980926] nix-grpc-daemon[919]: time=2026-09-22T16:43:17.094Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 75.027239] niks3-server[966]: 2026/09/22 16:43:16 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 75.028820] niks3-server[966]: 2026/09/22 16:43:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 75.031716] niks3-server[966]: 2026/09/22 16:43:16 INFO Signed narinfos id=20 count=1 worker2 # [ 75.004630] nix-grpc-daemon[919]: time=2026-09-22T16:43:17.117Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.034785] niks3-server[966]: 2026/09/22 16:43:16 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 75.037286] niks3-server[966]: 2026/09/22 16:43:16 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 75.042103] niks3-server[966]: 2026/09/22 16:43:16 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 75.044681] niks3-server[966]: 2026/09/22 16:43:16 INFO Completed upload id=20 worker2 # [ 75.018576] nix-grpc-daemon[919]: time=2026-09-22T16:43:17.132Z level=INFO msg="Upload complete. (157ms)" lb # [ 75.049222] niks3-server[966]: 2026/09/22 16:43:16 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker2 # [ 75.022146] nix-grpc-daemon[781]: ts=2026-09-22T16:43:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 75.024855] nix-grpc-daemon[781]: ts=2026-09-22T16:43:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker2 # [ 75.031733] nix-daemon[866]: reaped child process 1093, status = succeeded client # [ 75.082682] systemd[1]: share2.service: Deactivated successfully. client # [ 75.086794] systemd[1]: share2.service: Consumed 117ms CPU time over 4.791s wall clock time, 35.5M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. lb # [ 75.561803] envoy[904]: conn peer=[2001:db8:1::1]:34956 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=933 ms=6150 lb # [ 75.566334] envoy[904]: conn peer=[2001:db8:1::1]:34960 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=796 ms=4182 lb # [ 75.570192] envoy[904]: conn peer=[2001:db8:1::1]:34976 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1453 tx=1197 ms=4627 client: (finished: waiting for success: ! systemctl is-active share2, in 1.06 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.02 seconds) (finished: subtest: the first client leaving does not fail the second, in 6.68 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 75.951726] systemd[1]: Started Nix Daemon. client # [ 76.037740] nix-daemon[1115]: accepted connection from pid 1112, user root (trusted) worker1 # [ 76.139715] nix-grpc-daemon[780]: ts=2026-09-22T16:43:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:59320 worker2 # [ 76.165890] nix-grpc-daemon[781]: ts=2026-09-22T16:43:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 76.180638] nix-grpc-daemon[781]: ts=2026-09-22T16:43:18Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker1 # [ 76.162261] nix-grpc-daemon[780]: ts=2026-09-22T16:43:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker2 # [ 76.183410] nix-grpc-daemon[781]: ts=2026-09-22T16:43:18Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 76.169901] nix-grpc-daemon[780]: ts=2026-09-22T16:43:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 76.176820] nix-grpc-daemon[780]: ts=2026-09-22T16:43:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 76.182072] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 76.265940] nix-daemon[845]: accepted connection from pid 1107, user nix-grpc-daemon (trusted) worker1 # [ 76.278886] nix-daemon[845]: reaped child process 1110, status = succeeded lb # [ 76.336172] niks3-server[966]: 2026/09/22 16:43:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.293918] nix-grpc-daemon[858]: time=2026-09-22T16:43:18.474Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 76.295882] nix-grpc-daemon[858]: time=2026-09-22T16:43:18.476Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 76.367322] niks3-server[966]: 2026/09/22 16:43:17 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 76.376374] niks3-server[966]: 2026/09/22 16:43:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 76.383262] niks3-server[966]: 2026/09/22 16:43:17 INFO Signed narinfos id=21 count=1 worker1 # [ 76.336889] nix-grpc-daemon[858]: time=2026-09-22T16:43:18.517Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.393608] niks3-server[966]: 2026/09/22 16:43:17 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 76.403199] niks3-server[966]: 2026/09/22 16:43:17 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete worker1 # [ 76.358728] nix-grpc-daemon[858]: time=2026-09-22T16:43:18.539Z level=INFO msg="Upload complete. (171ms)" lb # [ 76.408936] niks3-server[966]: 2026/09/22 16:43:17 INFO Completed upload id=21 lb # [ 76.413276] niks3-server[966]: 2026/09/22 16:43:17 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 76.361529] nix-grpc-daemon[780]: ts=2026-09-22T16:43:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 76.366669] nix-grpc-daemon[780]: ts=2026-09-22T16:43:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 76.377959] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 76.384317] nix-daemon[845]: reaped child process 1105, status = succeeded worker1 # [ 76.387146] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 76.800512] nix-daemon[845]: reaped child process 1114, status = succeeded worker1 # [ 76.876285] nix-daemon[845]: accepted connection from pid 1130, user nix-grpc-daemon (trusted) worker1 # [ 76.889444] nix-daemon[845]: reaped child process 1133, status = succeeded lb # [ 76.946113] niks3-server[966]: 2026/09/22 16:43:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.904883] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.084Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 76.906292] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.084Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 76.977957] niks3-server[966]: 2026/09/22 16:43:18 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 76.982053] niks3-server[966]: 2026/09/22 16:43:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 76.983795] niks3-server[966]: 2026/09/22 16:43:18 INFO Signed narinfos id=22 count=1 worker1 # [ 76.935435] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.116Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.985063] niks3-server[966]: 2026/09/22 16:43:18 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 76.991179] niks3-server[966]: 2026/09/22 16:43:18 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 76.994794] niks3-server[966]: 2026/09/22 16:43:18 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 76.998511] niks3-server[966]: 2026/09/22 16:43:18 INFO Completed upload id=22 worker1 # [ 76.949023] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.129Z level=INFO msg="Upload complete. (156ms)" lb # [ 77.000316] niks3-server[966]: 2026/09/22 16:43:18 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 76.951410] nix-grpc-daemon[780]: ts=2026-09-22T16:43:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker1 # [ 76.958645] nix-grpc-daemon[780]: ts=2026-09-22T16:43:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 76.960522] nix-daemon[845]: reaped child process 1112, status = succeeded worker2 # [ 76.995403] nix-grpc-daemon[781]: ts=2026-09-22T16:43:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 77.001244] nix-grpc-daemon[781]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 77.006847] nix-grpc-daemon[781]: ts=2026-09-22T16:43:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 77.141687] nix-grpc-daemon[780]: ts=2026-09-22T16:43:19Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 77.147469] nix-grpc-daemon[780]: ts=2026-09-22T16:43:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 77.152825] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.332Z level=INFO msg="All 1 paths already cached" worker2 # [ 77.184673] nix-grpc-daemon[781]: ts=2026-09-22T16:43:19Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 77.186652] nix-grpc-daemon[781]: ts=2026-09-22T16:43:19Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 77.166547] nix-grpc-daemon[780]: ts=2026-09-22T16:43:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 77.177966] nix-grpc-daemon[780]: ts=2026-09-22T16:43:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 77.190130] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.370Z level=INFO msg="All 1 paths already cached" worker1 # [ 77.197139] nix-grpc-daemon[780]: ts=2026-09-22T16:43:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 77.207697] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 77.303047] nix-daemon[845]: accepted connection from pid 1137, user nix-grpc-daemon (trusted) worker1 # [ 77.316360] nix-daemon[845]: reaped child process 1140, status = succeeded lb # [ 77.373034] niks3-server[966]: 2026/09/22 16:43:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 77.328401] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.508Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 77.329901] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.508Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 77.386605] niks3-server[966]: 2026/09/22 16:43:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 77.389166] niks3-server[966]: 2026/09/22 16:43:18 INFO Signed narinfos id=23 count=1 worker1 # [ 77.339072] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.519Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.392666] niks3-server[966]: 2026/09/22 16:43:18 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 77.395574] niks3-server[966]: 2026/09/22 16:43:18 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 77.399837] niks3-server[966]: 2026/09/22 16:43:18 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 77.402440] niks3-server[966]: 2026/09/22 16:43:18 INFO Completed upload id=23 worker1 # [ 77.352741] nix-grpc-daemon[858]: time=2026-09-22T16:43:19.533Z level=INFO msg="Upload complete. (133ms)" worker1 # [ 77.354868] nix-grpc-daemon[780]: ts=2026-09-22T16:43:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 77.357785] nix-grpc-daemon[780]: ts=2026-09-22T16:43:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 77.363536] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 77.368085] nix-daemon[845]: reaped child process 1135, status = succeeded worker1 # [ 77.372413] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 77.986079] nix-daemon[845]: reaped child process 1144, status = succeeded worker1 # [ 78.063249] nix-daemon[845]: accepted connection from pid 1160, user nix-grpc-daemon (trusted) worker1 # [ 78.075172] nix-daemon[845]: reaped child process 1163, status = succeeded lb # [ 78.131628] niks3-server[966]: 2026/09/22 16:43:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.085963] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.266Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 78.087510] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.268Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 78.155031] niks3-server[966]: 2026/09/22 16:43:19 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 78.157849] niks3-server[966]: 2026/09/22 16:43:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 78.159920] niks3-server[966]: 2026/09/22 16:43:19 INFO Signed narinfos id=24 count=1 worker1 # [ 78.111345] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.292Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.164561] niks3-server[966]: 2026/09/22 16:43:19 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 78.166472] niks3-server[966]: 2026/09/22 16:43:19 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 78.170710] niks3-server[966]: 2026/09/22 16:43:19 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 78.173412] niks3-server[966]: 2026/09/22 16:43:19 INFO Completed upload id=24 worker1 # [ 78.123630] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.304Z level=INFO msg="Upload complete. (144ms)" lb # [ 78.176409] niks3-server[966]: 2026/09/22 16:43:19 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 78.125909] nix-grpc-daemon[780]: ts=2026-09-22T16:43:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker1 # [ 78.132840] nix-daemon[845]: reaped child process 1142, status = succeeded worker2 # [ 78.156458] nix-grpc-daemon[781]: ts=2026-09-22T16:43:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 78.165132] nix-grpc-daemon[781]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 78.187326] nix-grpc-daemon[781]: ts=2026-09-22T16:43:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 78.192327] nix-grpc-daemon[781]: ts=2026-09-22T16:43:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 78.400279] nix-grpc-daemon[781]: ts=2026-09-22T16:43:20Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40992 worker1 # [ 78.381305] nix-grpc-daemon[780]: ts=2026-09-22T16:43:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 78.389361] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.569Z level=INFO msg="All 2 paths already cached" worker2 # [ 78.425353] nix-grpc-daemon[781]: ts=2026-09-22T16:43:20Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker1 # [ 78.404322] nix-grpc-daemon[780]: ts=2026-09-22T16:43:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker2 # [ 78.429509] nix-grpc-daemon[781]: ts=2026-09-22T16:43:20Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 78.413945] nix-grpc-daemon[780]: ts=2026-09-22T16:43:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 78.423553] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.604Z level=INFO msg="All 2 paths already cached" worker1 # [ 78.430663] nix-grpc-daemon[780]: ts=2026-09-22T16:43:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 78.440988] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 78.540477] nix-daemon[845]: accepted connection from pid 1167, user nix-grpc-daemon (trusted) worker1 # [ 78.554921] nix-daemon[845]: reaped child process 1170, status = succeeded lb # [ 78.611108] niks3-server[966]: 2026/09/22 16:43:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.564969] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.745Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 78.566492] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.747Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 78.627391] niks3-server[966]: 2026/09/22 16:43:20 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 78.635059] niks3-server[966]: 2026/09/22 16:43:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign worker1 # [ 78.592868] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.773Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.642602] niks3-server[966]: 2026/09/22 16:43:20 INFO Signed narinfos id=25 count=1 lb # [ 78.648210] niks3-server[966]: 2026/09/22 16:43:20 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 78.659121] niks3-server[966]: 2026/09/22 16:43:20 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete worker1 # [ 78.614230] nix-grpc-daemon[858]: time=2026-09-22T16:43:20.795Z level=INFO msg="Upload complete. (161ms)" lb # [ 78.664121] niks3-server[966]: 2026/09/22 16:43:20 INFO Completed upload id=25 worker1 # [ 78.616353] nix-grpc-daemon[780]: ts=2026-09-22T16:43:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 78.667720] niks3-server[966]: 2026/09/22 16:43:20 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 78.620122] nix-grpc-daemon[780]: ts=2026-09-22T16:43:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 78.627604] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 78.628922] nix-daemon[845]: reaped child process 1165, status = succeeded worker1 # [ 78.634185] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 80.072670] nix-daemon[845]: reaped child process 1174, status = succeeded worker1 # [ 80.149651] nix-daemon[845]: accepted connection from pid 1190, user nix-grpc-daemon (trusted) worker1 # [ 80.162319] nix-daemon[845]: reaped child process 1193, status = succeeded lb # [ 80.218705] niks3-server[966]: 2026/09/22 16:43:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 80.176881] nix-grpc-daemon[858]: time=2026-09-22T16:43:22.357Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 80.179735] nix-grpc-daemon[858]: time=2026-09-22T16:43:22.359Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 80.258261] niks3-server[966]: 2026/09/22 16:43:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 80.265705] niks3-server[966]: 2026/09/22 16:43:21 INFO Signed narinfos id=26 count=1 worker1 # [ 80.219572] nix-grpc-daemon[858]: time=2026-09-22T16:43:22.400Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.274321] niks3-server[966]: 2026/09/22 16:43:21 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 80.279140] niks3-server[966]: 2026/09/22 16:43:21 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 80.283072] niks3-server[966]: 2026/09/22 16:43:21 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 80.294670] niks3-server[966]: 2026/09/22 16:43:21 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 80.300191] niks3-server[966]: 2026/09/22 16:43:21 INFO Completed upload id=26 worker1 # [ 80.250662] nix-grpc-daemon[858]: time=2026-09-22T16:43:22.431Z level=INFO msg="Upload complete. (208ms)" lb # [ 80.302497] niks3-server[966]: 2026/09/22 16:43:21 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker1 # [ 80.256903] nix-grpc-daemon[780]: ts=2026-09-22T16:43:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker2 # [ 80.284603] nix-grpc-daemon[781]: ts=2026-09-22T16:43:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40992 worker1 # [ 80.270883] nix-daemon[845]: reaped child process 1172, status = succeeded worker2 # [ 80.293336] nix-grpc-daemon[781]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker1 # [ 80.291091] nix-grpc-daemon[780]: ts=2026-09-22T16:43:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 80.296494] nix-grpc-daemon[780]: ts=2026-09-22T16:43:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_out=232 client # [ 80.417362] nix-daemon[1115]: reaped child process 1117, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 4.56 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 4.63 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.12 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 81.068989] nix-daemon[1115]: accepted connection from pid 1197, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker1 # [ 81.174234] nix-grpc-daemon[780]: ts=2026-09-22T16:43:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:59320 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 81.200771] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 client # copying 1 paths... client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'... worker2 # [ 81.212767] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 81.224509] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 81.335266] nix-daemon[866]: accepted connection from pid 1150, user nix-grpc-daemon (trusted) worker2 # [ 81.350901] nix-daemon[866]: reaped child process 1153, status = succeeded lb # [ 81.385405] niks3-server[966]: 2026/09/22 16:43:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.367119] nix-grpc-daemon[919]: time=2026-09-22T16:43:23.480Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 81.369135] nix-grpc-daemon[919]: time=2026-09-22T16:43:23.482Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 81.414678] niks3-server[966]: 2026/09/22 16:43:22 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 81.421979] niks3-server[966]: 2026/09/22 16:43:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker2 # [ 81.401841] nix-grpc-daemon[919]: time=2026-09-22T16:43:23.515Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.430263] niks3-server[966]: 2026/09/22 16:43:22 INFO Signed narinfos id=27 count=1 lb # [ 81.437145] niks3-server[966]: 2026/09/22 16:43:22 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 81.447191] niks3-server[966]: 2026/09/22 16:43:22 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 81.454870] niks3-server[966]: 2026/09/22 16:43:22 INFO Completed upload id=27 worker2 # [ 81.427508] nix-grpc-daemon[919]: time=2026-09-22T16:43:23.540Z level=INFO msg="Upload complete. (191ms)" lb # [ 81.458286] niks3-server[966]: 2026/09/22 16:43:22 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 81.432366] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 81.446373] nix-daemon[866]: reaped child process 1148, status = succeeded worker2 # [ 81.450058] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 81.454142] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 81.497951] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 81.507729] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 81.520227] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 81.528591] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 81.624154] nix-daemon[866]: accepted connection from pid 1159, user nix-grpc-daemon (trusted) worker2 # [ 81.639101] nix-daemon[866]: reaped child process 1162, status = succeeded lb # [ 81.673899] niks3-server[966]: 2026/09/22 16:43:23 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 81.682851] niks3-server[966]: 2026/09/22 16:43:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.663530] nix-grpc-daemon[919]: time=2026-09-22T16:43:23.776Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 81.665034] nix-grpc-daemon[919]: time=2026-09-22T16:43:23.778Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" worker2 # [ 81.667710] nix-grpc-daemon[919]: time=2026-09-22T16:43:23.780Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" lb # [ 81.720653] niks3-server[966]: 2026/09/22 16:43:23 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 81.729452] niks3-server[966]: 2026/09/22 16:43:23 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 81.743841] niks3-server[966]: 2026/09/22 16:43:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 81.745456] niks3-server[966]: 2026/09/22 16:43:23 INFO Signed narinfos id=29 count=2 lb # [ 81.747685] niks3-server[966]: 2026/09/22 16:43:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 81.750313] niks3-server[966]: 2026/09/22 16:43:23 INFO Signed narinfos id=28 count=1 lb # [ 81.751459] niks3-server[966]: 2026/09/22 16:43:23 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls worker2 # [ 81.724112] nix-grpc-daemon[919]: time=2026-09-22T16:43:23.836Z level=INFO msg="Uploading 3 narinfos" lb # [ 81.756367] niks3-server[966]: 2026/09/22 16:43:23 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 81.766101] niks3-server[966]: 2026/09/22 16:43:23 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 81.769277] niks3-server[966]: 2026/09/22 16:43:23 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 81.772532] niks3-server[966]: 2026/09/22 16:43:23 INFO Completed upload id=28 lb # [ 81.774312] niks3-server[966]: 2026/09/22 16:43:23 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 81.777141] niks3-server[966]: 2026/09/22 16:43:23 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 81.779150] niks3-server[966]: 2026/09/22 16:43:23 INFO Completed upload id=29 worker2 # [ 81.751913] nix-grpc-daemon[919]: time=2026-09-22T16:43:23.865Z level=INFO msg="Upload complete. (214ms)" lb # [ 81.780937] niks3-server[966]: 2026/09/22 16:43:23 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo worker2 # [ 81.757324] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=2 nar_bytes_in=976 worker2 # [ 81.763196] nix-grpc-daemon[781]: ts=2026-09-22T16:43:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 81.776142] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 81.783993] nix-daemon[866]: reaped child process 1157, status = succeeded worker2 # [ 81.791926] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 83.035532] nix-daemon[866]: reaped child process 1166, status = succeeded worker2 # [ 83.122913] nix-daemon[866]: accepted connection from pid 1182, user nix-grpc-daemon (trusted) worker2 # [ 83.136964] nix-daemon[866]: reaped child process 1185, status = succeeded lb # [ 83.170884] niks3-server[966]: 2026/09/22 16:43:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 83.151761] nix-grpc-daemon[919]: time=2026-09-22T16:43:25.264Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 83.210953] niks3-server[966]: 2026/09/22 16:43:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker2 # [ 83.187787] nix-grpc-daemon[919]: time=2026-09-22T16:43:25.301Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.215244] niks3-server[966]: 2026/09/22 16:43:24 INFO Signed narinfos id=30 count=1 lb # [ 83.222718] niks3-server[966]: 2026/09/22 16:43:24 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 83.230390] niks3-server[966]: 2026/09/22 16:43:24 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 83.241960] niks3-server[966]: 2026/09/22 16:43:24 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 83.249552] niks3-server[966]: 2026/09/22 16:43:24 INFO Completed upload id=30 worker2 # [ 83.222294] nix-grpc-daemon[919]: time=2026-09-22T16:43:25.335Z level=INFO msg="Upload complete. (221ms)" lb # [ 83.251488] niks3-server[966]: 2026/09/22 16:43:24 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker2 # [ 83.230271] nix-grpc-daemon[781]: ts=2026-09-22T16:43:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 worker2 # [ 83.243972] nix-daemon[866]: reaped child process 1164, status = succeeded client # copying 1 paths... worker2 # [ 83.275819] nix-grpc-daemon[781]: ts=2026-09-22T16:43:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40992 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 83.298258] nix-grpc-daemon[781]: ts=2026-09-22T16:43:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 83.303239] nix-grpc-daemon[781]: ts=2026-09-22T16:43:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_out=120 client # [ 83.400916] nix-daemon[1115]: reaped child process 1200, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.45 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 83.503091] nix-daemon[1115]: accepted connection from pid 1219, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 83.632942] nix-grpc-daemon[781]: ts=2026-09-22T16:43:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 83.638865] nix-grpc-daemon[781]: ts=2026-09-22T16:43:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 83.644392] nix-grpc-daemon[919]: time=2026-09-22T16:43:25.756Z level=INFO msg="All 1 paths already cached" worker2 # [ 83.652246] nix-grpc-daemon[781]: ts=2026-09-22T16:43:25Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 83.657843] nix-grpc-daemon[781]: ts=2026-09-22T16:43:25Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 83.639642] nix-grpc-daemon[780]: ts=2026-09-22T16:43:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 83.648688] nix-grpc-daemon[780]: ts=2026-09-22T16:43:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 83.660084] nix-grpc-daemon[780]: ts=2026-09-22T16:43:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 83.668685] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 83.686377] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 1/5) worker1 # [ 83.731684] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 2/5) worker1 # [ 83.744173] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 3/5) worker1 # [ 83.806381] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 249 ms (attempt 4/5) worker1 # [ 84.062553] nix-grpc-daemon[780]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 84.063820] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 84.066193] nix-grpc-daemon[780]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 84.153550] nix-daemon[845]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker1 # [ 84.169105] nix-daemon[845]: reaped child process 1210, status = succeeded lb # [ 84.225845] niks3-server[966]: 2026/09/22 16:43:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 84.180668] nix-grpc-daemon[858]: time=2026-09-22T16:43:26.360Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 84.182079] nix-grpc-daemon[858]: time=2026-09-22T16:43:26.360Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 84.239185] niks3-server[966]: 2026/09/22 16:43:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 84.241042] niks3-server[966]: 2026/09/22 16:43:25 INFO Signed narinfos id=31 count=1 worker1 # [ 84.191317] nix-grpc-daemon[858]: time=2026-09-22T16:43:26.371Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.243051] niks3-server[966]: 2026/09/22 16:43:25 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 84.248790] niks3-server[966]: 2026/09/22 16:43:25 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 84.251536] niks3-server[966]: 2026/09/22 16:43:25 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 84.254064] niks3-server[966]: 2026/09/22 16:43:25 INFO Completed upload id=31 worker1 # [ 84.204345] nix-grpc-daemon[858]: time=2026-09-22T16:43:26.385Z level=INFO msg="Upload complete. (128ms)" worker1 # [ 84.206328] nix-grpc-daemon[780]: ts=2026-09-22T16:43:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 84.257288] niks3-server[966]: 2026/09/22 16:43:25 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker1 # [ 84.209995] nix-grpc-daemon[780]: ts=2026-09-22T16:43:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 84.215538] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) worker1 # [ 84.220096] nix-daemon[845]: reaped child process 1200, status = succeeded worker1 # [ 84.224212] nix-daemon[845]: accepted connection from pid 780, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 85.560728] envoy[904]: conn peer=[2001:db8:1::1]:47112 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3361 tx=1904 ms=857 lb # [ 85.562252] envoy[904]: conn peer=[2001:db8:1::1]:47118 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=23 lb # [ 85.564954] envoy[904]: conn peer=[2001:db8:1::1]:47134 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=2140 ms=1080 lb # [ 85.568609] envoy[904]: conn peer=[2001:db8:1::1]:47146 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=57 lb # [ 85.572158] envoy[904]: conn peer=[2001:db8:1::1]:47158 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=55 lb # [ 85.575798] envoy[904]: conn peer=[2001:db8:1::1]:47150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4323 tx=2392 ms=1969 lb # [ 85.579289] envoy[904]: conn peer=[2001:db8:1::1]:35418 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=58 lb # [ 85.583285] envoy[904]: conn peer=[2001:db8:1::1]:47168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4259 tx=2069 ms=2160 worker1 # [ 85.656861] nix-daemon[845]: reaped child process 1214, status = succeeded worker1 # [ 85.732459] nix-daemon[845]: accepted connection from pid 1230, user nix-grpc-daemon (trusted) worker1 # [ 85.745480] nix-daemon[845]: reaped child process 1233, status = succeeded lb # [ 85.803598] niks3-server[966]: 2026/09/22 16:43:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 85.762451] nix-grpc-daemon[858]: time=2026-09-22T16:43:27.943Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 85.837323] niks3-server[966]: 2026/09/22 16:43:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker1 # [ 85.795385] nix-grpc-daemon[858]: time=2026-09-22T16:43:27.976Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.845598] niks3-server[966]: 2026/09/22 16:43:27 INFO Signed narinfos id=32 count=1 lb # [ 85.848205] niks3-server[966]: 2026/09/22 16:43:27 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 85.853991] niks3-server[966]: 2026/09/22 16:43:27 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 85.868906] niks3-server[966]: 2026/09/22 16:43:27 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 85.873692] niks3-server[966]: 2026/09/22 16:43:27 INFO Completed upload id=32 worker1 # [ 85.823945] nix-grpc-daemon[858]: time=2026-09-22T16:43:28.004Z level=INFO msg="Upload complete. (190ms)" worker1 # [ 85.828646] nix-grpc-daemon[780]: ts=2026-09-22T16:43:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 worker1 # [ 85.841065] nix-daemon[845]: reaped child process 1212, status = succeeded client # copying 1 paths... worker2 # [ 85.899841] nix-grpc-daemon[781]: ts=2026-09-22T16:43:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 85.911932] nix-grpc-daemon[781]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 85.922147] nix-grpc-daemon[780]: ts=2026-09-22T16:43:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 85.928476] nix-grpc-daemon[780]: ts=2026-09-22T16:43:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59320 duration_s=0 paths=1 nar_bytes_out=120 client # [ 86.008339] nix-daemon[1115]: reaped child process 1222, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.61 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 86.109881] nix-daemon[1115]: accepted connection from pid 1241, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 86.216300] nix-grpc-daemon[780]: ts=2026-09-22T16:43:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 86.222783] nix-grpc-daemon[780]: ts=2026-09-22T16:43:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 86.228474] nix-grpc-daemon[858]: time=2026-09-22T16:43:28.408Z level=INFO msg="All 1 paths already cached" worker2 # [ 86.260766] nix-grpc-daemon[781]: ts=2026-09-22T16:43:28Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 86.266614] nix-grpc-daemon[781]: ts=2026-09-22T16:43:28Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 86.272559] nix-grpc-daemon[781]: ts=2026-09-22T16:43:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 86.284264] nix-grpc-daemon[781]: ts=2026-09-22T16:43:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40992 client # copying 1 paths to 'lb:50051'... worker2 # [ 86.298210] nix-grpc-daemon[919]: time=2026-09-22T16:43:28.409Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 86.302776] nix-grpc-daemon[781]: ts=2026-09-22T16:43:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 86.313291] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 86.419891] nix-daemon[866]: accepted connection from pid 1194, user nix-grpc-daemon (trusted) worker2 # [ 86.434501] nix-daemon[866]: reaped child process 1197, status = succeeded lb # [ 86.470678] niks3-server[966]: 2026/09/22 16:43:27 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.451222] nix-grpc-daemon[919]: time=2026-09-22T16:43:28.564Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 86.452742] nix-grpc-daemon[919]: time=2026-09-22T16:43:28.566Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 86.499817] niks3-server[966]: 2026/09/22 16:43:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 86.507297] niks3-server[966]: 2026/09/22 16:43:28 INFO Signed narinfos id=33 count=1 worker2 # [ 86.484029] nix-grpc-daemon[919]: time=2026-09-22T16:43:28.597Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.513972] niks3-server[966]: 2026/09/22 16:43:28 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 86.522414] niks3-server[966]: 2026/09/22 16:43:28 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 86.535612] niks3-server[966]: 2026/09/22 16:43:28 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 86.540289] niks3-server[966]: 2026/09/22 16:43:28 INFO Completed upload id=33 worker2 # [ 86.513166] nix-grpc-daemon[919]: time=2026-09-22T16:43:28.626Z level=INFO msg="Upload complete. (189ms)" worker2 # [ 86.516992] nix-grpc-daemon[781]: ts=2026-09-22T16:43:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_in=560 lb # [ 86.546109] niks3-server[966]: 2026/09/22 16:43:28 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker2 # [ 86.523844] nix-grpc-daemon[781]: ts=2026-09-22T16:43:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 86.534574] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 86.538276] nix-daemon[866]: reaped child process 1192, status = succeeded client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 86.542397] nix-daemon[866]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 87.379380] nix-daemon[866]: reaped child process 1201, status = succeeded worker2 # [ 87.463345] nix-daemon[866]: accepted connection from pid 1217, user nix-grpc-daemon (trusted) worker2 # [ 87.476583] nix-daemon[866]: reaped child process 1220, status = succeeded lb # [ 87.510428] niks3-server[966]: 2026/09/22 16:43:29 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 87.487482] nix-grpc-daemon[919]: time=2026-09-22T16:43:29.600Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 87.525593] niks3-server[966]: 2026/09/22 16:43:29 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 87.528575] niks3-server[966]: 2026/09/22 16:43:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 87.530673] niks3-server[966]: 2026/09/22 16:43:29 INFO Signed narinfos id=34 count=1 worker2 # [ 87.503674] nix-grpc-daemon[919]: time=2026-09-22T16:43:29.616Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.533584] niks3-server[966]: 2026/09/22 16:43:29 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 87.539195] niks3-server[966]: 2026/09/22 16:43:29 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 87.541801] niks3-server[966]: 2026/09/22 16:43:29 INFO Completed upload id=34 worker2 # [ 87.515612] nix-grpc-daemon[919]: time=2026-09-22T16:43:29.629Z level=INFO msg="Upload complete. (166ms)" lb # [ 87.544738] niks3-server[966]: 2026/09/22 16:43:29 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker2 # [ 87.518502] nix-grpc-daemon[781]: ts=2026-09-22T16:43:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 client # copying 1 paths... worker2 # [ 87.526567] nix-daemon[866]: reaped child process 1199, status = succeeded worker1 # [ 87.503195] nix-grpc-daemon[780]: ts=2026-09-22T16:43:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59320 worker1 # [ 87.511796] nix-grpc-daemon[780]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 87.552875] nix-grpc-daemon[781]: ts=2026-09-22T16:43:29Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 worker2 # [ 87.555156] nix-grpc-daemon[781]: ts=2026-09-22T16:43:29Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40992 duration_s=0 paths=1 nar_bytes_out=120 client # [ 87.635436] nix-daemon[1115]: reaped child process 1244, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.62 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.15 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.23 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.14 seconds) worker2 # [ 88.395289] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 88.790667] nix-grpc-daemon[781]: ts=2026-09-22T16:43:30Z level=info event=signal_exit lb # [ 89.035237] niks3-server[966]: 2026/09/22 16:43:30 INFO lead: released remote=192.168.1.4:50168 lb # [ 90.030624] niks3-server[966]: 2026/09/22 16:43:31 INFO lead: acquired remote=192.168.1.3:56212 worker1 # [ 89.982259] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_take_over worker2 # [ 90.010811] nix-grpc-daemon[781]: ts=2026-09-22T16:43:32Z level=info event=scheduler_restarting worker1 # [ 89.988483] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 90.016463] nix-grpc-daemon[781]: ts=2026-09-22T16:43:32Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 90.019870] nix-grpc-daemon[781]: ts=2026-09-22T16:43:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56654 worker2 # [ 90.023647] nix-grpc-daemon[781]: ts=2026-09-22T16:43:32Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 90.026994] nix-grpc-daemon[781]: ts=2026-09-22T16:43:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56654 worker2 # [ 90.030891] nix-grpc-daemon[781]: ts=2026-09-22T16:43:32Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 90.051260] nix-daemon[866]: reaped child process 868, status = succeeded worker1 # [ 90.189892] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.193773] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.225340] nix-grpc-daemon[781]: ts=2026-09-22T16:43:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 90.394920] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.399149] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.599989] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.604259] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.805157] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.809285] nix-grpc-daemon[780]: ts=2026-09-22T16:43:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.932614] nix-grpc-daemon[781]: E0000 00:00:1790095413.045774 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker2 # [ 90.937702] nix-grpc-daemon[781]: E0000 00:00:1790095413.045950 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 91.011250] nix-grpc-daemon[780]: ts=2026-09-22T16:43:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.022172] nix-grpc-daemon[780]: ts=2026-09-22T16:43:33Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57048 worker1 # [ 91.025813] nix-grpc-daemon[780]: ts=2026-09-22T16:43:33Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 92.185852] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 92.189273] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 92.192426] systemd[1]: nix-grpc-daemon.service: Consumed 2.086s CPU time over 1min 16.548s wall clock time, 67.7M memory peak, 93K incoming IP traffic, 249.5K outgoing IP traffic. worker2 # [ 92.204666] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 92.208985] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 92.213209] systemd[1]: nix-grpc-daemon.socket: Consumed 298us CPU time over 1min 24.520s wall clock time, 256K memory peak, 109.9K incoming IP traffic, 95.9K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 92.384524] nix-grpc-daemon[780]: ts=2026-09-22T16:43:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59320 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker1 # [ 92.387134] nix-grpc-daemon[780]: ts=2026-09-22T16:43:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59320 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 92.487186] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 92.490938] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 92.712453] nix-grpc-daemon[780]: ts=2026-09-22T16:43:34Z level=info event=signal_exit lb # [ 93.039748] niks3-server[966]: 2026/09/22 16:43:34 INFO lead: released remote=192.168.1.3:56212 worker2 # [ 93.181302] systemd[1]: Starting scheduler-token.service... worker2 # [ 93.243872] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 93.247136] systemd[1]: Finished scheduler-token.service. worker2 # [ 93.249590] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 65ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 93.258397] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 93.340418] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 93.342576] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 93.345839] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 93.350054] nix-grpc-daemon[1244]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 93.352165] nix-grpc-daemon[1244]: E0000 00:00:1790095415.463277 1244 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 93.358183] nix-grpc-daemon[1244]: E0000 00:00:1790095415.468879 1244 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 93.360294] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 93.361830] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 93.369061] nix-grpc-daemon[1244]: E0000 00:00:1790095415.482370 1285 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 93.398465] niks3-server[966]: 2026/09/22 16:43:34 INFO lead: acquired remote=192.168.1.4:53090 worker2 # [ 93.373154] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=scheduler_take_over worker2 # [ 93.384468] nix-grpc-daemon[1244]: E0000 00:00:1790095415.497854 1285 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 93.388139] nix-grpc-daemon[1244]: E0000 00:00:1790095415.500122 1285 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 93.398572] nix-grpc-daemon[1244]: E0000 00:00:1790095415.511962 1285 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 93.407713] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.409356] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.611204] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.615170] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.816750] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.820758] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.988977] nix-grpc-daemon[780]: ts=2026-09-22T16:43:36Z level=info event=scheduler_restarting worker1 # [ 93.993339] nix-grpc-daemon[780]: ts=2026-09-22T16:43:36Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 93.994838] nix-grpc-daemon[780]: ts=2026-09-22T16:43:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57048 worker1 # [ 93.996317] nix-grpc-daemon[780]: ts=2026-09-22T16:43:36Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 94.021995] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.025869] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 94.016554] nix-daemon[845]: reaped child process 847, status = succeeded worker2 # [ 94.224442] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.228282] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 94.207275] nix-grpc-daemon[780]: ts=2026-09-22T16:43:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 94.427295] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.440152] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:36Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 94.443948] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:36Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:50054 worker2 # [ 94.447888] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 94.826674] nix-grpc-daemon[780]: E0000 00:00:1790095417.007160 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 94.832221] nix-grpc-daemon[780]: E0000 00:00:1790095417.012574 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true lb # [ 95.561237] envoy[904]: conn peer=[2001:db8:1::1]:35426 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3727 tx=2097 ms=2327 lb # [ 95.562842] envoy[904]: conn peer=[2001:db8:1::1]:35440 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=20 lb # [ 95.564332] envoy[904]: conn peer=[2001:db8:1::1]:35442 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3738 tx=2082 ms=1367 lb # [ 95.565849] envoy[904]: conn peer=[2001:db8:1::1]:35444 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=49 lb # [ 95.567263] envoy[904]: conn peer=[2001:db8:1::4]:47096 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=63615 tx=3343 ms=74401 lb # [ 95.568787] envoy[904]: conn peer=[2001:db8:1::1]:35460 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=12 lb # [ 95.570159] envoy[904]: conn peer=[2001:db8:1::3]:60724 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=18230 tx=3729 ms=78461 worker1 # [ 96.123836] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 96.127354] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 96.131370] systemd[1]: nix-grpc-daemon.service: Consumed 2.380s CPU time over 1min 20.610s wall clock time, 62.3M memory peak, 102.1K incoming IP traffic, 191.9K outgoing IP traffic. worker1 # [ 96.143165] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 96.147468] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 96.150630] systemd[1]: nix-grpc-daemon.socket: Consumed 303us CPU time over 1min 28.116s wall clock time, 256K memory peak, 104.4K incoming IP traffic, 89.6K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 96.345899] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 96.350967] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker2 # [ 96.358704] nix-grpc-daemon[1244]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5) worker2 # [ 96.417048] nix-grpc-daemon[1244]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 2/5) worker2 # [ 96.419915] nix-grpc-daemon[1244]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 357 ms (attempt 3/5) worker2 # [ 96.780696] nix-grpc-daemon[1244]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 407 ms (attempt 4/5) worker2 # [ 97.190407] nix-grpc-daemon[1244]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 97.194629] nix-grpc-daemon[1244]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 97.211058] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50058 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 97.217723] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker2 # [ 97.231341] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:39Z level=info event=niks3_push_started pid=1304 worker2 # [ 97.333586] nix-grpc-daemon[1304]: time=2026-09-22T16:43:39.446Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 97.421814] nix-daemon[866]: accepted connection from pid 1316, user nix-grpc-daemon (trusted) worker2 # [ 97.436376] nix-daemon[866]: reaped child process 1319, status = succeeded lb # [ 97.470226] niks3-server[966]: 2026/09/22 16:43:38 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 97.478587] niks3-server[966]: 2026/09/22 16:43:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.458512] nix-grpc-daemon[1304]: time=2026-09-22T16:43:39.571Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 97.461054] nix-grpc-daemon[1304]: time=2026-09-22T16:43:39.573Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" worker2 # [ 97.462657] nix-grpc-daemon[1304]: time=2026-09-22T16:43:39.573Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" lb # [ 97.521132] niks3-server[966]: 2026/09/22 16:43:39 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 97.543187] niks3-server[966]: 2026/09/22 16:43:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 97.545424] niks3-server[966]: 2026/09/22 16:43:39 INFO Signed narinfos id=36 count=2 lb # [ 97.547196] niks3-server[966]: 2026/09/22 16:43:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 97.549577] niks3-server[966]: 2026/09/22 16:43:39 INFO Signed narinfos id=35 count=1 worker2 # [ 97.523155] nix-grpc-daemon[1304]: time=2026-09-22T16:43:39.635Z level=INFO msg="Uploading 3 narinfos" lb # [ 97.553399] niks3-server[966]: 2026/09/22 16:43:39 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 97.570384] niks3-server[966]: 2026/09/22 16:43:39 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 97.573286] niks3-server[966]: 2026/09/22 16:43:39 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 97.581230] niks3-server[966]: 2026/09/22 16:43:39 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 97.587827] niks3-server[966]: 2026/09/22 16:43:39 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 97.590983] niks3-server[966]: 2026/09/22 16:43:39 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 97.594757] niks3-server[966]: 2026/09/22 16:43:39 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 97.600041] niks3-server[966]: 2026/09/22 16:43:39 INFO Completed upload id=36 lb # [ 97.602411] niks3-server[966]: 2026/09/22 16:43:39 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 97.604736] niks3-server[966]: 2026/09/22 16:43:39 INFO Completed upload id=35 worker2 # [ 97.577883] nix-grpc-daemon[1304]: time=2026-09-22T16:43:39.691Z level=INFO msg="Upload complete. (240ms)" worker2 # [ 97.585126] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50058 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 97.598252] nix-daemon[866]: reaped child process 1302, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.40 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 97.657727] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 97.664990] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 97.758420] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:39Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 97.760486] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 97.763793] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 97.769055] nix-grpc-daemon[1257]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 97.770458] nix-grpc-daemon[1257]: E0000 00:00:1790095419.949344 1257 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 97.775437] nix-grpc-daemon[1257]: E0000 00:00:1790095419.954458 1257 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 97.781111] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 97.784098] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 97.789091] nix-grpc-daemon[1257]: E0000 00:00:1790095419.968076 1298 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 97.802080] nix-grpc-daemon[1257]: E0000 00:00:1790095419.981288 1298 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 97.804310] nix-grpc-daemon[1257]: E0000 00:00:1790095419.981657 1298 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 97.815285] nix-grpc-daemon[1257]: E0000 00:00:1790095419.996074 1298 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 97.829105] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.855465] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:39Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:50054 worker2 # [ 97.860150] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.28 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 99.024384] systemd[1]: Stopping niks3 server... lb # [ 99.027875] niks3-server[966]: 2026/09/22 16:43:40 INFO Shutdown signal received, draining in-flight requests timeout=10s worker1 # [ 98.978704] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:41Z level=info event=scheduler_lock_lost status=200 lb # [ 99.031453] niks3-server[966]: 2026/09/22 16:43:40 INFO lead: released remote=192.168.1.4:53090 worker2 # [ 99.005468] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:41Z level=info event=scheduler_lock_lost status=200 lb # [ 99.042973] systemd[1]: niks3.service: Deactivated successfully. lb # [ 99.044626] systemd[1]: Stopped niks3 server. lb # [ 99.045434] systemd[1]: niks3.service: Consumed 631ms CPU time over 1min 19.242s wall clock time, 28.8M memory peak, 96.5K incoming IP traffic, 139.2K outgoing IP traffic. lb # [ 99.052599] systemd[1]: Starting niks3 server... lb # [ 99.102158] niks3-server[1113]: 2026/09/22 16:43:40 goose: no migrations to run. current version: 20260920000000 lb # [ 99.106835] niks3-server[1113]: 2026/09/22 16:43:40 OK 1_commit_pending_closure.sql (5.44ms) lb # [ 99.110027] niks3-server[1113]: 2026/09/22 16:43:40 OK 2_object_stats_trigger.sql (2.8ms) lb # [ 99.111078] niks3-server[1113]: 2026/09/22 16:43:40 goose: up to current file version: 2 lb # [ 99.112330] niks3-server[1113]: 2026/09/22 16:43:40 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 99.123032] niks3-server[1113]: 2026/09/22 16:43:40 INFO Read proxy enabled — serving cache objects from S3 lb # [ 99.124584] niks3-server[1113]: 2026/09/22 16:43:40 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 99.126721] systemd[1]: Started niks3 server. lb # [ 99.127523] niks3-server[1113]: 2026/09/22 16:43:40 INFO systemd watchdog enabled interval=15s lb # [ 99.128986] niks3-server[1113]: 2026/09/22 16:43:40 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 99.371739] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 99.384212] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker1 # [ 99.398640] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 99.409132] nix-grpc-daemon[1257]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 1/5) worker1 # [ 99.510678] nix-grpc-daemon[1257]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 2/5) worker1 # [ 99.606282] nix-grpc-daemon[1257]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 217 ms (attempt 3/5) worker1 # [ 99.829834] nix-grpc-daemon[1257]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 227 ms (attempt 4/5) lb # [ 100.037581] niks3-server[1113]: 2026/09/22 16:43:41 INFO lead: acquired remote=192.168.1.4:53138 worker1 # [ 100.058787] nix-grpc-daemon[1257]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 100.060656] nix-grpc-daemon[1257]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 100.118350] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:42Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker2 # [ 100.122617] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:42Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 100.161156] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 100.175771] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50058 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 100.188334] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 100.200631] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker2 # [ 100.306267] nix-daemon[866]: accepted connection from pid 1338, user nix-grpc-daemon (trusted) worker2 # [ 100.320116] nix-daemon[866]: reaped child process 1341, status = succeeded lb # [ 100.354726] niks3-server[1113]: 2026/09/22 16:43:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.338124] nix-grpc-daemon[1304]: time=2026-09-22T16:43:42.451Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 100.340309] nix-grpc-daemon[1304]: time=2026-09-22T16:43:42.453Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 100.390339] niks3-server[1113]: 2026/09/22 16:43:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 100.421415] niks3-server[1113]: 2026/09/22 16:43:41 INFO Signed narinfos id=37 count=1 lb # [ 100.422832] niks3-server[1113]: 2026/09/22 16:43:41 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst worker2 # [ 100.396100] nix-grpc-daemon[1304]: time=2026-09-22T16:43:42.508Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.429433] niks3-server[1113]: 2026/09/22 16:43:41 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 100.433338] niks3-server[1113]: 2026/09/22 16:43:41 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 100.439051] niks3-server[1113]: 2026/09/22 16:43:41 INFO Completed upload id=37 lb # [ 100.440850] niks3-server[1113]: 2026/09/22 16:43:41 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker2 # [ 100.411916] nix-grpc-daemon[1304]: time=2026-09-22T16:43:42.525Z level=INFO msg="Upload complete. (199ms)" worker2 # [ 100.415956] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50058 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 100.421299] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 100.433311] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker2 # [ 100.436129] nix-daemon[866]: reaped child process 1336, status = succeeded worker2 # [ 100.441358] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 101.288622] nix-daemon[866]: reaped child process 1345, status = succeeded worker2 # [ 101.366683] nix-daemon[866]: accepted connection from pid 1361, user nix-grpc-daemon (trusted) worker2 # [ 101.379622] nix-daemon[866]: reaped child process 1364, status = succeeded lb # [ 101.412120] niks3-server[1113]: 2026/09/22 16:43:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.389563] nix-grpc-daemon[1304]: time=2026-09-22T16:43:43.502Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 101.392053] nix-grpc-daemon[1304]: time=2026-09-22T16:43:43.504Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 101.431382] niks3-server[1113]: 2026/09/22 16:43:42 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 101.435726] niks3-server[1113]: 2026/09/22 16:43:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 101.438402] niks3-server[1113]: 2026/09/22 16:43:42 INFO Signed narinfos id=38 count=1 worker2 # [ 101.411267] nix-grpc-daemon[1304]: time=2026-09-22T16:43:43.524Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.440930] niks3-server[1113]: 2026/09/22 16:43:42 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 101.447365] niks3-server[1113]: 2026/09/22 16:43:42 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 101.449370] niks3-server[1113]: 2026/09/22 16:43:42 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 101.456629] niks3-server[1113]: 2026/09/22 16:43:42 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo lb # [ 101.461498] niks3-server[1113]: 2026/09/22 16:43:42 INFO Completed upload id=38 worker2 # [ 101.434298] nix-grpc-daemon[1304]: time=2026-09-22T16:43:43.547Z level=INFO msg="Upload complete. (185ms)" worker2 # [ 101.438810] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50058 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker2 # [ 101.444655] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:43Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 101.446580] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:43Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 101.450962] nix-daemon[866]: reaped child process 1343, status = succeeded worker2 # [ 101.488155] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 101.498546] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 101.510122] nix-grpc-daemon[1304]: time=2026-09-22T16:43:43.623Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 101.517499] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 101.523976] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker2 # [ 101.612164] nix-daemon[866]: accepted connection from pid 1370, user nix-grpc-daemon (trusted) worker2 # [ 101.626497] nix-daemon[866]: reaped child process 1373, status = succeeded lb # [ 101.660178] niks3-server[1113]: 2026/09/22 16:43:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.642821] nix-grpc-daemon[1304]: time=2026-09-22T16:43:43.756Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 101.644339] nix-grpc-daemon[1304]: time=2026-09-22T16:43:43.757Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 101.692063] niks3-server[1113]: 2026/09/22 16:43:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker2 # [ 101.673889] nix-grpc-daemon[1304]: time=2026-09-22T16:43:43.787Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.702076] niks3-server[1113]: 2026/09/22 16:43:43 INFO Signed narinfos id=39 count=1 lb # [ 101.704944] niks3-server[1113]: 2026/09/22 16:43:43 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 101.712791] niks3-server[1113]: 2026/09/22 16:43:43 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 101.725570] niks3-server[1113]: 2026/09/22 16:43:43 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 101.735180] niks3-server[1113]: 2026/09/22 16:43:43 INFO Completed upload id=39 worker2 # [ 101.708056] nix-grpc-daemon[1304]: time=2026-09-22T16:43:43.821Z level=INFO msg="Upload complete. (173ms)" lb # [ 101.739118] niks3-server[1113]: 2026/09/22 16:43:43 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker2 # [ 101.712313] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50058 duration_s=0 paths=1 nar_bytes_in=656 worker2 # [ 101.716976] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 101.728140] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker2 # [ 101.737472] nix-daemon[866]: reaped child process 1368, status = succeeded worker2 # [ 101.740088] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 102.969344] nix-daemon[866]: reaped child process 1377, status = succeeded worker2 # [ 103.059656] nix-daemon[866]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 103.071625] nix-daemon[866]: reaped child process 1396, status = succeeded lb # [ 103.107659] niks3-server[1113]: 2026/09/22 16:43:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 103.091533] nix-grpc-daemon[1304]: time=2026-09-22T16:43:45.204Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 103.093214] nix-grpc-daemon[1304]: time=2026-09-22T16:43:45.206Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 103.147734] niks3-server[1113]: 2026/09/22 16:43:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 103.152209] niks3-server[1113]: 2026/09/22 16:43:44 INFO Signed narinfos id=40 count=1 worker2 # [ 103.127927] nix-grpc-daemon[1304]: time=2026-09-22T16:43:45.241Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.159683] niks3-server[1113]: 2026/09/22 16:43:44 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 103.168489] niks3-server[1113]: 2026/09/22 16:43:44 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 103.172879] niks3-server[1113]: 2026/09/22 16:43:44 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 103.176992] niks3-server[1113]: 2026/09/22 16:43:44 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 103.179537] niks3-server[1113]: 2026/09/22 16:43:44 INFO Completed upload id=40 worker2 # [ 103.152369] nix-grpc-daemon[1304]: time=2026-09-22T16:43:45.265Z level=INFO msg="Upload complete. (202ms)" lb # [ 103.182384] niks3-server[1113]: 2026/09/22 16:43:44 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 103.158789] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50058 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker2 # [ 103.167492] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:45Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 103.172172] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:45Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 103.177866] nix-daemon[866]: reaped child process 1375, status = succeeded worker2 # [ 103.211328] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 103.223432] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 103.237399] nix-grpc-daemon[1304]: time=2026-09-22T16:43:45.350Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 103.246297] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 103.256181] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker2 # [ 103.352990] nix-daemon[866]: accepted connection from pid 1403, user nix-grpc-daemon (trusted) worker2 # [ 103.368927] nix-daemon[866]: reaped child process 1406, status = succeeded lb # [ 103.400226] niks3-server[1113]: 2026/09/22 16:43:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 103.382531] nix-grpc-daemon[1304]: time=2026-09-22T16:43:45.495Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 103.384081] nix-grpc-daemon[1304]: time=2026-09-22T16:43:45.497Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 103.431572] niks3-server[1113]: 2026/09/22 16:43:44 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 103.442388] niks3-server[1113]: 2026/09/22 16:43:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 103.446386] niks3-server[1113]: 2026/09/22 16:43:44 INFO Signed narinfos id=41 count=1 worker2 # [ 103.422301] nix-grpc-daemon[1304]: time=2026-09-22T16:43:45.535Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.455197] niks3-server[1113]: 2026/09/22 16:43:44 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 103.463783] niks3-server[1113]: 2026/09/22 16:43:44 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 103.467579] niks3-server[1113]: 2026/09/22 16:43:44 INFO Completed upload id=41 worker2 # [ 103.440451] nix-grpc-daemon[1304]: time=2026-09-22T16:43:45.553Z level=INFO msg="Upload complete. (174ms)" lb # [ 103.469116] niks3-server[1113]: 2026/09/22 16:43:44 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 103.444763] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50058 duration_s=0 paths=1 nar_bytes_in=784 worker2 # [ 103.449919] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50058 worker2 # [ 103.459329] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) worker2 # [ 103.466542] nix-daemon[866]: reaped child process 1401, status = succeeded worker2 # [ 103.469442] nix-daemon[866]: accepted connection from pid 1244, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 104.309676] nix-daemon[866]: reaped child process 1410, status = succeeded worker2 # [ 104.387788] nix-daemon[866]: accepted connection from pid 1426, user nix-grpc-daemon (trusted) worker2 # [ 104.401617] nix-daemon[866]: reaped child process 1429, status = succeeded lb # [ 104.434791] niks3-server[1113]: 2026/09/22 16:43:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 104.416229] nix-grpc-daemon[1304]: time=2026-09-22T16:43:46.529Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 104.418141] nix-grpc-daemon[1304]: time=2026-09-22T16:43:46.531Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 104.474864] niks3-server[1113]: 2026/09/22 16:43:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 104.484094] niks3-server[1113]: 2026/09/22 16:43:45 INFO Signed narinfos id=42 count=1 worker2 # [ 104.464747] nix-grpc-daemon[1304]: time=2026-09-22T16:43:46.578Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.492113] niks3-server[1113]: 2026/09/22 16:43:45 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 104.496736] niks3-server[1113]: 2026/09/22 16:43:46 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 104.502499] niks3-server[1113]: 2026/09/22 16:43:46 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 104.513053] niks3-server[1113]: 2026/09/22 16:43:46 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 104.515917] niks3-server[1113]: 2026/09/22 16:43:46 INFO Completed upload id=42 worker2 # [ 104.488941] nix-grpc-daemon[1304]: time=2026-09-22T16:43:46.602Z level=INFO msg="Upload complete. (212ms)" lb # [ 104.518932] niks3-server[1113]: 2026/09/22 16:43:46 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 104.495848] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50058 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 104.511119] nix-daemon[866]: reaped child process 1408, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 5.24 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.10 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 5.69 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 104.767225] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 105.363224] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:47Z level=info event=signal_exit lb # [ 105.561967] envoy[904]: conn peer=[2001:db8:1::1]:51434 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1003 tx=282 ms=1248 lb # [ 105.567484] envoy[904]: conn peer=[2001:db8:1::1]:51450 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9692 tx=4433 ms=5123 lb # [ 106.042169] niks3-server[1113]: 2026/09/22 16:43:47 INFO lead: released remote=192.168.1.4:53138 worker1 # [ 106.993146] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:49Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 107.013926] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:49Z level=info event=scheduler_restarting worker2 # [ 107.024179] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50054 worker2 # [ 107.027534] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:49Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 107.031418] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:49Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 107.034397] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50054 worker2 # [ 107.037802] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:49Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 107.058722] nix-daemon[866]: reaped child process 1296, status = succeeded worker1 # [ 107.193264] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.195449] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.225951] nix-grpc-daemon[1244]: ts=2026-09-22T16:43:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 107.402423] nix-grpc-daemon[1244]: E0000 00:00:1790095429.515710 1289 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 107.404713] nix-grpc-daemon[1244]: E0000 00:00:1790095429.518163 1289 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 107.396213] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.398233] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.599390] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.603391] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.804352] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.808499] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.010538] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.014485] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.212412] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.216560] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.417558] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.421674] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.622862] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.627089] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.827925] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.832138] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.034908] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.037755] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.211061] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 109.212769] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 109.214410] systemd[1]: nix-grpc-daemon.service: Consumed 916ms CPU time over 15.954s wall clock time, 37.8M memory peak, 46.6K incoming IP traffic, 84.8K outgoing IP traffic. worker2 # [ 109.218826] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 109.220596] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 109.221779] systemd[1]: nix-grpc-daemon.socket: Consumed 331us CPU time over 16.737s wall clock time, 256K memory peak, 36.8K incoming IP traffic, 27.3K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 109.235790] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.239887] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 109.440233] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.442081] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.642729] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.644465] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.845155] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.848373] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 110.033612] niks3-server[1113]: 2026/09/22 16:43:51 INFO lead: acquired remote=192.168.1.3:59166 worker1 # [ 109.984227] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=info event=scheduler_take_over worker1 # [ 110.050384] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.053563] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.251363] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.258470] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:51780 worker1 # [ 110.262483] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker1 # [ 110.467247] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39572 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 110.475719] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 110.492159] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 110.497605] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 110.536070] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 110.546372] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39572 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 110.556364] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 110.567805] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) worker1 # [ 110.587343] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:52Z level=info event=niks3_push_started pid=1333 worker1 # [ 110.689880] nix-grpc-daemon[1333]: time=2026-09-22T16:43:52.870Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 110.776044] nix-daemon[845]: accepted connection from pid 1346, user nix-grpc-daemon (trusted) worker1 # [ 110.789237] nix-daemon[845]: reaped child process 1349, status = succeeded lb # [ 110.844189] niks3-server[1113]: 2026/09/22 16:43:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.798768] nix-grpc-daemon[1333]: time=2026-09-22T16:43:52.979Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 110.800268] nix-grpc-daemon[1333]: time=2026-09-22T16:43:52.981Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 110.866816] niks3-server[1113]: 2026/09/22 16:43:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 110.868896] niks3-server[1113]: 2026/09/22 16:43:52 INFO Signed narinfos id=43 count=1 worker1 # [ 110.821069] nix-grpc-daemon[1333]: time=2026-09-22T16:43:53.001Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.870852] niks3-server[1113]: 2026/09/22 16:43:52 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 110.873960] niks3-server[1113]: 2026/09/22 16:43:52 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 110.879950] niks3-server[1113]: 2026/09/22 16:43:52 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 110.882130] niks3-server[1113]: 2026/09/22 16:43:52 INFO Completed upload id=43 worker1 # [ 110.833690] nix-grpc-daemon[1333]: time=2026-09-22T16:43:53.014Z level=INFO msg="Upload complete. (140ms)" lb # [ 110.884713] niks3-server[1113]: 2026/09/22 16:43:52 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker1 # [ 110.835852] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39572 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 110.838927] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 110.844330] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) worker1 # [ 110.848802] nix-daemon[845]: reaped child process 1331, status = succeeded worker1 # [ 110.853699] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 112.070470] nix-daemon[845]: reaped child process 1353, status = succeeded worker1 # [ 112.156302] nix-daemon[845]: accepted connection from pid 1369, user nix-grpc-daemon (trusted) worker1 # [ 112.169543] nix-daemon[845]: reaped child process 1372, status = succeeded lb # [ 112.226743] niks3-server[1113]: 2026/09/22 16:43:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.183823] nix-grpc-daemon[1333]: time=2026-09-22T16:43:54.364Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 112.185637] nix-grpc-daemon[1333]: time=2026-09-22T16:43:54.366Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 112.268313] niks3-server[1113]: 2026/09/22 16:43:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 112.274318] niks3-server[1113]: 2026/09/22 16:43:53 INFO Signed narinfos id=44 count=1 worker1 # [ 112.228061] nix-grpc-daemon[1333]: time=2026-09-22T16:43:54.408Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.281579] niks3-server[1113]: 2026/09/22 16:43:53 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 112.289929] niks3-server[1113]: 2026/09/22 16:43:53 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 112.299981] niks3-server[1113]: 2026/09/22 16:43:53 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 112.306065] niks3-server[1113]: 2026/09/22 16:43:53 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 112.309832] niks3-server[1113]: 2026/09/22 16:43:53 INFO Completed upload id=44 lb # [ 112.312748] niks3-server[1113]: 2026/09/22 16:43:53 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker1 # [ 112.261984] nix-grpc-daemon[1333]: time=2026-09-22T16:43:54.442Z level=INFO msg="Upload complete. (199ms)" worker1 # [ 112.269774] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker1 # [ 112.284386] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:54Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 112.288195] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:54Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 112.297468] nix-daemon[845]: reaped child process 1351, status = succeeded worker1 # [ 112.328257] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 112.339352] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 112.350942] nix-grpc-daemon[1333]: time=2026-09-22T16:43:54.531Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 112.359915] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 112.370127] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) worker1 # [ 112.460480] nix-daemon[845]: accepted connection from pid 1378, user nix-grpc-daemon (trusted) worker1 # [ 112.474351] nix-daemon[845]: reaped child process 1381, status = succeeded lb # [ 112.531144] niks3-server[1113]: 2026/09/22 16:43:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.489423] nix-grpc-daemon[1333]: time=2026-09-22T16:43:54.670Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 112.491188] nix-grpc-daemon[1333]: time=2026-09-22T16:43:54.671Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 112.563487] niks3-server[1113]: 2026/09/22 16:43:54 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 112.568386] niks3-server[1113]: 2026/09/22 16:43:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 112.574489] niks3-server[1113]: 2026/09/22 16:43:54 INFO Signed narinfos id=45 count=1 worker1 # [ 112.527917] nix-grpc-daemon[1333]: time=2026-09-22T16:43:54.708Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.587108] niks3-server[1113]: 2026/09/22 16:43:54 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 112.593691] niks3-server[1113]: 2026/09/22 16:43:54 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 112.600830] niks3-server[1113]: 2026/09/22 16:43:54 INFO Completed upload id=45 worker1 # [ 112.551061] nix-grpc-daemon[1333]: time=2026-09-22T16:43:54.731Z level=INFO msg="Upload complete. (171ms)" lb # [ 112.604418] niks3-server[1113]: 2026/09/22 16:43:54 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 112.555879] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39572 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 112.562115] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 112.570261] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) worker1 # [ 112.577120] nix-daemon[845]: reaped child process 1376, status = succeeded client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... worker1 # [ 112.581068] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 113.621241] nix-daemon[845]: reaped child process 1385, status = succeeded worker1 # [ 113.697666] nix-daemon[845]: accepted connection from pid 1401, user nix-grpc-daemon (trusted) worker1 # [ 113.710109] nix-daemon[845]: reaped child process 1404, status = succeeded lb # [ 113.766561] niks3-server[1113]: 2026/09/22 16:43:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 113.726340] nix-grpc-daemon[1333]: time=2026-09-22T16:43:55.906Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 113.728146] nix-grpc-daemon[1333]: time=2026-09-22T16:43:55.908Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 113.808255] niks3-server[1113]: 2026/09/22 16:43:55 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 113.812174] niks3-server[1113]: 2026/09/22 16:43:55 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 113.818312] niks3-server[1113]: 2026/09/22 16:43:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 113.822742] niks3-server[1113]: 2026/09/22 16:43:55 INFO Signed narinfos id=46 count=1 worker1 # [ 113.776386] nix-grpc-daemon[1333]: time=2026-09-22T16:43:55.956Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.828446] niks3-server[1113]: 2026/09/22 16:43:55 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 113.835172] niks3-server[1113]: 2026/09/22 16:43:55 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 113.839276] niks3-server[1113]: 2026/09/22 16:43:55 INFO Completed upload id=46 worker1 # [ 113.789684] nix-grpc-daemon[1333]: time=2026-09-22T16:43:55.970Z level=INFO msg="Upload complete. (201ms)" lb # [ 113.842239] niks3-server[1113]: 2026/09/22 16:43:55 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 113.795909] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 113.804821] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:55Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 113.808802] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:55Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 113.816914] nix-daemon[845]: reaped child process 1383, status = succeeded worker1 # [ 113.848673] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 113.860632] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 113.873656] nix-grpc-daemon[1333]: time=2026-09-22T16:43:56.054Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 113.882435] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 113.892169] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) worker1 # [ 113.984864] nix-daemon[845]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 113.998073] nix-daemon[845]: reaped child process 1413, status = succeeded lb # [ 114.055484] niks3-server[1113]: 2026/09/22 16:43:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 114.014773] nix-grpc-daemon[1333]: time=2026-09-22T16:43:56.195Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 114.016272] nix-grpc-daemon[1333]: time=2026-09-22T16:43:56.197Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 114.087417] niks3-server[1113]: 2026/09/22 16:43:55 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 114.097352] niks3-server[1113]: 2026/09/22 16:43:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 114.104375] niks3-server[1113]: 2026/09/22 16:43:55 INFO Signed narinfos id=47 count=1 worker1 # [ 114.057354] nix-grpc-daemon[1333]: time=2026-09-22T16:43:56.238Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.108100] niks3-server[1113]: 2026/09/22 16:43:55 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 114.119661] niks3-server[1113]: 2026/09/22 16:43:55 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 114.122877] niks3-server[1113]: 2026/09/22 16:43:55 INFO Completed upload id=47 worker1 # [ 114.073294] nix-grpc-daemon[1333]: time=2026-09-22T16:43:56.253Z level=INFO msg="Upload complete. (170ms)" lb # [ 114.126137] niks3-server[1113]: 2026/09/22 16:43:55 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 114.077474] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39572 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 114.083238] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 114.091800] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) worker1 # [ 114.097416] nix-daemon[845]: reaped child process 1408, status = succeeded worker1 # [ 114.102503] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 115.318822] nix-daemon[845]: reaped child process 1417, status = succeeded worker1 # [ 115.393419] nix-daemon[845]: accepted connection from pid 1433, user nix-grpc-daemon (trusted) worker1 # [ 115.405778] nix-daemon[845]: reaped child process 1436, status = succeeded lb # [ 115.462708] niks3-server[1113]: 2026/09/22 16:43:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 115.423066] nix-grpc-daemon[1333]: time=2026-09-22T16:43:57.603Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 115.424593] nix-grpc-daemon[1333]: time=2026-09-22T16:43:57.605Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 115.500316] niks3-server[1113]: 2026/09/22 16:43:57 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 115.512974] niks3-server[1113]: 2026/09/22 16:43:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 115.518845] niks3-server[1113]: 2026/09/22 16:43:57 INFO Signed narinfos id=48 count=1 worker1 # [ 115.472283] nix-grpc-daemon[1333]: time=2026-09-22T16:43:57.652Z level=INFO msg="Uploading 1 narinfos" lb # [ 115.527253] niks3-server[1113]: 2026/09/22 16:43:57 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 115.537202] niks3-server[1113]: 2026/09/22 16:43:57 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 115.543266] niks3-server[1113]: 2026/09/22 16:43:57 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 115.546179] niks3-server[1113]: 2026/09/22 16:43:57 INFO Completed upload id=48 worker1 # [ 115.497805] nix-grpc-daemon[1333]: time=2026-09-22T16:43:57.678Z level=INFO msg="Upload complete. (187ms)" lb # [ 115.549361] niks3-server[1113]: 2026/09/22 16:43:57 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker1 # [ 115.504602] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 lb # [ 115.561874] envoy[904]: conn peer=[2001:db8:1::4]:58426 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5880 tx=648 ms=13817 worker1 # [ 115.519279] nix-daemon[845]: reaped child process 1415, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.21 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.11 seconds) worker2 # [ 115.697984] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 115.700267] systemd[1]: Starting scheduler-token.service... worker2 # [ 115.736210] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 115.737748] systemd[1]: Finished scheduler-token.service. worker2 # [ 115.738972] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 37ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 115.743288] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 115.819706] nix-grpc-daemon[1450]: ts=2026-09-22T16:43:57Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 115.821661] nix-grpc-daemon[1450]: ts=2026-09-22T16:43:57Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 115.825347] nix-grpc-daemon[1450]: ts=2026-09-22T16:43:57Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 115.829053] nix-grpc-daemon[1450]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 115.830474] nix-grpc-daemon[1450]: E0000 00:00:1790095437.942376 1450 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 115.837656] nix-grpc-daemon[1450]: E0000 00:00:1790095437.947723 1450 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 115.841342] nix-grpc-daemon[1450]: ts=2026-09-22T16:43:57Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 115.845108] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 115.848116] nix-grpc-daemon[1450]: E0000 00:00:1790095437.957595 1492 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 115.858835] nix-grpc-daemon[1450]: E0000 00:00:1790095437.972162 1492 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 115.862207] nix-grpc-daemon[1450]: E0000 00:00:1790095437.972406 1492 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 115.873825] nix-grpc-daemon[1450]: E0000 00:00:1790095437.987224 1492 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 115.884399] nix-grpc-daemon[1450]: ts=2026-09-22T16:43:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.870170] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 115.874466] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:51780 worker1 # [ 115.878406] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.42 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 116.073131] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 8677cb88016247b3893a787e4586edde client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) worker1 # [ 116.193024] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39572 client # [ 116.209487] nix[1368]: don't know how to build these paths: client # [ 116.210384] nix[1368]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 116.202407] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 116.204449] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 116.246135] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 116.253847] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39572 client # [ 116.272072] nix[1368]: copying 1 paths to 'lb:50051'... worker1 # [ 116.260645] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39572 client # [ 116.273112] nix[1368]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 116.265469] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) worker1 # [ 116.349386] nix-daemon[845]: accepted connection from pid 1449, user nix-grpc-daemon (trusted) worker1 # [ 116.362962] nix-daemon[845]: reaped child process 1452, status = succeeded lb # [ 116.419086] niks3-server[1113]: 2026/09/22 16:43:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 116.376375] nix-grpc-daemon[1333]: time=2026-09-22T16:43:58.557Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 116.377821] nix-grpc-daemon[1333]: time=2026-09-22T16:43:58.558Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 116.451897] niks3-server[1113]: 2026/09/22 16:43:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 116.408183] nix-grpc-daemon[1333]: time=2026-09-22T16:43:58.588Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.457819] niks3-server[1113]: 2026/09/22 16:43:57 INFO Signed narinfos id=49 count=1 lb # [ 116.463708] niks3-server[1113]: 2026/09/22 16:43:57 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 116.468938] niks3-server[1113]: 2026/09/22 16:43:57 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 116.484103] niks3-server[1113]: 2026/09/22 16:43:57 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete worker1 # [ 116.441311] nix-grpc-daemon[1333]: time=2026-09-22T16:43:58.621Z level=INFO msg="Upload complete. (170ms)" lb # [ 116.490764] niks3-server[1113]: 2026/09/22 16:43:57 INFO Completed upload id=49 worker1 # [ 116.444112] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39572 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 116.494460] niks3-server[1113]: 2026/09/22 16:43:58 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 116.448743] nix-grpc-daemon[1257]: ts=2026-09-22T16:43:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 worker1 # [ 116.454194] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) worker1 # [ 116.456529] nix-daemon[845]: reaped child process 1447, status = succeeded worker1 # [ 116.461859] nix-daemon[845]: accepted connection from pid 1257, user nix-grpc-daemon (trusted) client # [ 116.473354] nix[1368]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 118.678755] systemd-journald[282]: Received client request to rotate journal, rotating. worker2 # [ 118.698766] systemd-journald[282]: Vacuuming done, freed 0B of archived journals from /var/log/journal/9994ff6b72f94254bc315334689556f0. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 118.583672] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 worker1 # [ 118.788862] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:00Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 123.885563] nix-daemon[845]: reaped child process 1456, status = succeeded worker1 # [ 123.964043] nix-daemon[845]: accepted connection from pid 1497, user nix-grpc-daemon (trusted) worker1 # [ 123.976853] nix-daemon[845]: reaped child process 1500, status = succeeded lb # [ 124.032295] niks3-server[1113]: 2026/09/22 16:44:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 123.991769] nix-grpc-daemon[1333]: time=2026-09-22T16:44:06.172Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 123.993481] nix-grpc-daemon[1333]: time=2026-09-22T16:44:06.174Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 124.080794] niks3-server[1113]: 2026/09/22 16:44:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 124.037064] nix-grpc-daemon[1333]: time=2026-09-22T16:44:06.217Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.086846] niks3-server[1113]: 2026/09/22 16:44:05 INFO Signed narinfos id=50 count=1 lb # [ 124.093681] niks3-server[1113]: 2026/09/22 16:44:05 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 124.101797] niks3-server[1113]: 2026/09/22 16:44:05 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 124.106180] niks3-server[1113]: 2026/09/22 16:44:05 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 124.117280] niks3-server[1113]: 2026/09/22 16:44:05 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 124.124122] niks3-server[1113]: 2026/09/22 16:44:05 INFO Completed upload id=50 lb # [ 124.126581] niks3-server[1113]: 2026/09/22 16:44:05 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 124.075801] nix-grpc-daemon[1333]: time=2026-09-22T16:44:06.256Z level=INFO msg="Upload complete. (200ms)" worker1 # [ 124.084637] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39572 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 124.093774] nix-daemon[845]: reaped child process 1454, status = succeeded client # [ 124.125087] systemd[1]: rs.service: Deactivated successfully. client # [ 124.128622] systemd[1]: rs.service: Consumed 122ms CPU time over 8.055s wall clock time, 43.4M memory peak, 7.3K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 124.789444] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:06Z level=info event=signal_exit lb # [ 125.035833] niks3-server[1113]: 2026/09/22 16:44:06 INFO lead: released remote=192.168.1.3:59166 lb # [ 125.563221] envoy[904]: conn peer=[2001:db8:1::1]:48188 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9543 tx=4355 ms=5051 lb # [ 125.566787] envoy[904]: conn peer=[2001:db8:1::1]:48930 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2973 tx=1514 ms=7900 lb # [ 125.873256] niks3-server[1113]: 2026/09/22 16:44:07 INFO lead: acquired remote=192.168.1.4:50880 worker2 # [ 125.850222] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:07Z level=info event=scheduler_take_over worker2 # [ 126.010376] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:08Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 125.991699] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:08Z level=info event=scheduler_restarting worker1 # [ 125.995363] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:51780 worker1 # [ 125.999203] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:08Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 126.002637] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:08Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 126.005894] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:51780 worker1 # [ 126.009557] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:08Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 126.027425] nix-daemon[845]: reaped child process 1309, status = succeeded worker1 # [ 126.172989] nix-grpc-daemon[1257]: E0000 00:00:1790095448.353468 1302 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker1 # [ 126.178137] nix-grpc-daemon[1257]: E0000 00:00:1790095448.353688 1302 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 126.211477] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 126.215652] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 126.202300] nix-grpc-daemon[1257]: ts=2026-09-22T16:44:08Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 126.416709] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 126.429153] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:08Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 126.433163] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56962 worker2 # [ 126.437112] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.15 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 127.974176] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 127.977687] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 127.979809] systemd[1]: nix-grpc-daemon.service: Consumed 1.035s CPU time over 30.309s wall clock time, 37.7M memory peak, 48.1K incoming IP traffic, 101.8K outgoing IP traffic. worker1 # [ 127.995156] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 128.079879] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:10Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 128.081809] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 128.084865] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 128.089056] nix-grpc-daemon[1507]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 128.091175] nix-grpc-daemon[1507]: E0000 00:00:1790095450.269590 1507 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.096077] nix-grpc-daemon[1507]: E0000 00:00:1790095450.274968 1507 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.099506] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 128.102464] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 128.105131] nix-grpc-daemon[1507]: E0000 00:00:1790095450.284913 1546 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 128.116266] nix-grpc-daemon[1507]: E0000 00:00:1790095450.297016 1546 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.120057] nix-grpc-daemon[1507]: E0000 00:00:1790095450.299190 1546 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 128.137050] nix-grpc-daemon[1507]: E0000 00:00:1790095450.317733 1546 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 128.147923] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.172355] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:10Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56962 worker2 # [ 128.174210] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:10Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.14 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 128.195726] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: b33f69777fb44216affd1d1d5ed74163 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.03 seconds) worker2 # [ 128.331140] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56964 worker2 # [ 128.342759] nix-daemon[866]: accepted connection from pid 1450, user nix-grpc-daemon (trusted) client # [ 128.344089] nix[1404]: don't know how to build these paths: client # [ 128.344935] nix[1404]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker2 # [ 128.363197] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:10Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 128.368673] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:10Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 128.410988] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56964 worker2 # [ 128.422439] nix-grpc-daemon[1450]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5) worker2 # [ 128.509256] nix-grpc-daemon[1450]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 2/5) worker2 # [ 128.523607] nix-grpc-daemon[1450]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 115 ms (attempt 3/5) worker2 # [ 128.646258] nix-grpc-daemon[1450]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 4/5) worker2 # [ 128.750734] nix-grpc-daemon[1450]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 128.752578] nix-grpc-daemon[1450]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 128.764238] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56964 client # [ 128.760469] nix[1404]: copying 1 paths to 'lb:50051'... worker2 # [ 128.774753] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56964 client # [ 128.764144] nix[1404]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker2 # [ 128.782077] nix-daemon[866]: accepted connection from pid 1450, user nix-grpc-daemon (trusted) worker2 # [ 128.793233] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:10Z level=info event=niks3_push_started pid=1578 worker2 # [ 128.884277] nix-grpc-daemon[1578]: time=2026-09-22T16:44:10.997Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 128.967396] nix-daemon[866]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) worker2 # [ 128.980685] nix-daemon[866]: reaped child process 1594, status = succeeded lb # [ 129.016933] niks3-server[1113]: 2026/09/22 16:44:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 128.998311] nix-grpc-daemon[1578]: time=2026-09-22T16:44:11.111Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 128.999854] nix-grpc-daemon[1578]: time=2026-09-22T16:44:11.113Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 129.055912] niks3-server[1113]: 2026/09/22 16:44:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 129.065771] niks3-server[1113]: 2026/09/22 16:44:10 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 129.085116] niks3-server[1113]: 2026/09/22 16:44:10 INFO Signed narinfos id=51 count=1 worker2 # [ 129.058048] nix-grpc-daemon[1578]: time=2026-09-22T16:44:11.171Z level=INFO msg="Uploading 1 narinfos" lb # [ 129.093198] niks3-server[1113]: 2026/09/22 16:44:10 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 129.096261] niks3-server[1113]: 2026/09/22 16:44:10 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 129.101938] niks3-server[1113]: 2026/09/22 16:44:10 INFO Completed upload id=51 worker2 # [ 129.074943] nix-grpc-daemon[1578]: time=2026-09-22T16:44:11.188Z level=INFO msg="Upload complete. (187ms)" lb # [ 129.105614] niks3-server[1113]: 2026/09/22 16:44:10 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker2 # [ 129.079459] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56964 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 129.084814] nix-grpc-daemon[1450]: ts=2026-09-22T16:44:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56964 worker2 # [ 129.096124] nix-daemon[866]: accepted connection from pid 1450, user nix-grpc-daemon (trusted) worker2 # [ 129.100346] nix-daemon[866]: reaped child process 1576, status = succeeded worker2 # [ 129.105230] nix-daemon[866]: accepted connection from pid 1450, user nix-grpc-daemon (trusted) client # [ 129.094292] nix[1404]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 130.616456] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1450 (nix-grpc-daemon) on client request. worker2 # [ 130.621441] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 130.658821] niks3-server[1113]: 2026/09/22 16:44:12 INFO lead: released remote=192.168.1.4:50880 client # [ 130.625786] nix[1404]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2 # [ 130.638249] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL client # [ 130.627693] nix[1404]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 130.639768] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 130.614663] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:12Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker2 # [ 130.641157] systemd[1]: nix-grpc-daemon.service: Consumed 336ms CPU time over 14.893s wall clock time, 35.6M memory peak, 15K incoming IP traffic, 29.1K outgoing IP traffic. worker2 # [ 130.650727] systemd[1]: Starting scheduler-token.service... worker2 # [ 130.670668] nix-daemon[866]: reaped child process 1596, status = succeeded worker2 # [ 130.672042] nix-daemon[866]: reaped child process 1568, status = succeeded worker2 # [ 130.678952] nix-daemon[1598]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 130.684734] nix-daemon[866]: reaped child process 1598, status = failed with exit code 1 worker2 # [ 130.700271] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 130.701840] systemd[1]: Finished scheduler-token.service. worker2 # [ 130.703382] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 51ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 130.705905] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 130.709622] systemd[1]: Starting scheduler-token.service... worker2 # [ 130.743181] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 130.744709] systemd[1]: Finished scheduler-token.service. worker2 # [ 130.745924] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 35ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 130.750454] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 130.826352] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 130.828478] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 130.831714] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 130.835983] nix-grpc-daemon[1641]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 130.837449] nix-grpc-daemon[1641]: E0000 00:00:1790095452.949180 1641 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 130.814964] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 130.844330] nix-grpc-daemon[1641]: E0000 00:00:1790095452.955398 1641 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 130.848125] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 130.851791] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 130.856100] nix-grpc-daemon[1641]: E0000 00:00:1790095452.969184 1680 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 130.884481] niks3-server[1113]: 2026/09/22 16:44:12 INFO lead: acquired remote=192.168.1.4:39310 worker2 # [ 130.862070] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:12Z level=info event=scheduler_take_over worker1 # [ 130.838608] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.28 seconds) client: must succeed: sleep 5.0 worker2 # [ 130.871470] nix-grpc-daemon[1641]: E0000 00:00:1790095452.984876 1680 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 130.875172] nix-grpc-daemon[1641]: E0000 00:00:1790095452.987102 1680 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 130.885655] nix-grpc-daemon[1641]: E0000 00:00:1790095452.999065 1680 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 130.894458] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 130.899309] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:13Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 130.900709] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:13Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56976 worker2 # [ 130.902426] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 131.039525] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 131.064274] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:13Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56976 worker2 # [ 131.068064] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 131.148809] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:13Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 131.154376] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:13Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 131.201897] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56990 worker2 # [ 131.211345] nix-daemon[866]: accepted connection from pid 1641, user nix-grpc-daemon (trusted) worker2 # [ 131.225393] nix-daemon[866]: accepted connection from pid 1641, user nix-grpc-daemon (trusted) client # [ 131.227635] nix[1404]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker2 # [ 131.239627] nix-daemon[866]: accepted connection from pid 1641, user nix-grpc-daemon (trusted) lb # [ 135.564179] envoy[904]: conn peer=[2001:db8:1::3]:45392 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4581 tx=1083 ms=28371 lb # [ 135.568265] envoy[904]: conn peer=[2001:db8:1::4]:60822 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2871 tx=376 ms=14757 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 136.058101] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:18Z level=info event=niks3_push_started pid=1724 worker2 # [ 136.073413] nix-daemon[866]: reaped child process 1699, status = succeeded worker2 # [ 136.153221] nix-grpc-daemon[1724]: time=2026-09-22T16:44:18.265Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 136.236736] nix-daemon[866]: accepted connection from pid 1737, user nix-grpc-daemon (trusted) worker2 # [ 136.250516] nix-daemon[866]: reaped child process 1740, status = succeeded lb # [ 136.285493] niks3-server[1113]: 2026/09/22 16:44:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.270203] nix-grpc-daemon[1724]: time=2026-09-22T16:44:18.383Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 136.271739] nix-grpc-daemon[1724]: time=2026-09-22T16:44:18.385Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 136.343566] niks3-server[1113]: 2026/09/22 16:44:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 136.348198] niks3-server[1113]: 2026/09/22 16:44:17 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 136.353783] niks3-server[1113]: 2026/09/22 16:44:17 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 136.357066] niks3-server[1113]: 2026/09/22 16:44:17 INFO Signed narinfos id=52 count=1 worker2 # [ 136.330023] nix-grpc-daemon[1724]: time=2026-09-22T16:44:18.443Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.358408] niks3-server[1113]: 2026/09/22 16:44:17 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 136.364958] niks3-server[1113]: 2026/09/22 16:44:17 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 136.369157] niks3-server[1113]: 2026/09/22 16:44:17 INFO Completed upload id=52 worker2 # [ 136.342238] nix-grpc-daemon[1724]: time=2026-09-22T16:44:18.455Z level=INFO msg="Upload complete. (186ms)" lb # [ 136.371832] niks3-server[1113]: 2026/09/22 16:44:17 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker2 # [ 136.349881] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56990 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 136.358146] nix-daemon[866]: reaped child process 1697, status = succeeded client # [ 136.370546] systemd[1]: mid.service: Deactivated successfully. client # [ 136.374147] systemd[1]: mid.service: Consumed 130ms CPU time over 8.177s wall clock time, 41.4M memory peak, 8.5K incoming IP traffic, 10.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 8.97 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 137.158180] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 8027180d20c2475da763d44a7870691b client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker2 # [ 137.286468] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56990 client # [ 137.277080] nix[1440]: don't know how to build these paths: client # [ 137.277949] nix[1440]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker2 # [ 137.292760] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:19Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker2 # [ 137.294694] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:19Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 137.320115] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 137.330129] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 137.346212] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 1/5) worker1 # [ 137.368556] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 2/5) worker1 # [ 137.375449] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 384 ms (attempt 3/5) worker1 # [ 137.768765] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 142 ms (attempt 4/5) worker1 # [ 137.913215] nix-grpc-daemon[1507]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 137.916197] nix-grpc-daemon[1507]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 137.930447] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 client # [ 137.951158] nix[1440]: copying 1 paths to 'lb:50051'... worker1 # [ 137.940127] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 client # [ 137.954948] nix[1440]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker1 # [ 137.951126] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 137.972140] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:20Z level=info event=niks3_push_started pid=1595 worker1 # [ 138.071677] nix-grpc-daemon[1595]: time=2026-09-22T16:44:20.252Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 138.158494] nix-daemon[845]: accepted connection from pid 1608, user nix-grpc-daemon (trusted) worker1 # [ 138.170900] nix-daemon[845]: reaped child process 1611, status = succeeded lb # [ 138.227108] niks3-server[1113]: 2026/09/22 16:44:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.181373] nix-grpc-daemon[1595]: time=2026-09-22T16:44:20.362Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 138.182882] nix-grpc-daemon[1595]: time=2026-09-22T16:44:20.363Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 138.249071] niks3-server[1113]: 2026/09/22 16:44:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 138.251947] niks3-server[1113]: 2026/09/22 16:44:19 INFO Signed narinfos id=53 count=1 worker1 # [ 138.204194] nix-grpc-daemon[1595]: time=2026-09-22T16:44:20.384Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.254059] niks3-server[1113]: 2026/09/22 16:44:19 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 138.257105] niks3-server[1113]: 2026/09/22 16:44:19 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 138.263537] niks3-server[1113]: 2026/09/22 16:44:19 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 138.266578] niks3-server[1113]: 2026/09/22 16:44:19 INFO Completed upload id=53 worker1 # [ 138.216808] nix-grpc-daemon[1595]: time=2026-09-22T16:44:20.397Z level=INFO msg="Upload complete. (141ms)" lb # [ 138.268511] niks3-server[1113]: 2026/09/22 16:44:19 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker1 # [ 138.218768] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 138.223252] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 138.234305] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 138.238390] nix-daemon[845]: reaped child process 1593, status = succeeded client # [ 138.254412] nix[1440]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... worker1 # [ 138.245189] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 139.432610] systemd[1]: intr.service: Sent signal SIGINT to main process 1440 (nix) on client request. worker1 # [ 139.422559] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:21Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 139.439533] nix[1440]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 139.444855] nix[1440]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 139.471794] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 139.474272] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 139.476775] systemd[1]: intr.service: Consumed 111ms CPU time over 2.315s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic. worker1 # [ 139.473776] nix-daemon[845]: reaped child process 1617, status = succeeded worker1 # [ 139.475358] nix-daemon[1619]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 139.482252] nix-daemon[845]: reaped child process 1619, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 2.40 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 139.575391] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 6591edc175534d3690f01c3c7974c4ee client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.05 seconds) client # [ 139.706463] nix[1461]: don't know how to build these paths: client # [ 139.707312] nix[1461]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 139.693570] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50620 worker2 # [ 139.725947] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:21Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 139.730246] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:21Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 139.767821] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56990 worker2 # [ 139.774178] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5) worker2 # [ 139.827961] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 132 ms (attempt 2/5) worker2 # [ 139.961339] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 3/5) worker2 # [ 140.050657] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 471 ms (attempt 4/5) worker2 # [ 140.523160] nix-grpc-daemon[1641]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 140.524780] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 140.535846] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56990 client # [ 140.531988] nix[1461]: copying 1 paths to 'lb:50051'... worker2 # [ 140.546493] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56990 client # [ 140.536073] nix[1461]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker2 # [ 140.550419] nix-daemon[866]: accepted connection from pid 1641, user nix-grpc-daemon (trusted) worker2 # [ 140.635118] nix-daemon[866]: accepted connection from pid 1772, user nix-grpc-daemon (trusted) worker2 # [ 140.648507] nix-daemon[866]: reaped child process 1775, status = succeeded lb # [ 140.682840] niks3-server[1113]: 2026/09/22 16:44:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 140.664450] nix-grpc-daemon[1724]: time=2026-09-22T16:44:22.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 140.666872] nix-grpc-daemon[1724]: time=2026-09-22T16:44:22.779Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 140.714491] niks3-server[1113]: 2026/09/22 16:44:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker2 # [ 140.694984] nix-grpc-daemon[1724]: time=2026-09-22T16:44:22.807Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.721978] niks3-server[1113]: 2026/09/22 16:44:22 INFO Signed narinfos id=54 count=1 lb # [ 140.726944] niks3-server[1113]: 2026/09/22 16:44:22 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 140.739351] niks3-server[1113]: 2026/09/22 16:44:22 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 140.741250] niks3-server[1113]: 2026/09/22 16:44:22 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 140.748356] niks3-server[1113]: 2026/09/22 16:44:22 INFO Completed upload id=54 worker2 # [ 140.721136] nix-grpc-daemon[1724]: time=2026-09-22T16:44:22.834Z level=INFO msg="Upload complete. (164ms)" lb # [ 140.749850] niks3-server[1113]: 2026/09/22 16:44:22 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker2 # [ 140.724498] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56990 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 140.727698] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56990 worker2 # [ 140.738324] nix-daemon[866]: accepted connection from pid 1641, user nix-grpc-daemon (trusted) worker2 # [ 140.744135] nix-daemon[866]: reaped child process 1770, status = succeeded worker2 # [ 140.751489] nix-daemon[866]: accepted connection from pid 1641, user nix-grpc-daemon (trusted) client # [ 140.740730] nix[1461]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # [ 142.268506] nixos[1811]: switching to system configuration /nix/store/l0fg19025khizi78zyd50mp1rbqr80z2-nixos-system-worker2-test worker2 # [ 142.270650] systemd[1]: Stopped target Local File Systems. worker2 # activating the configuration... worker2 # [ 142.274085] systemd[1]: Stopped target Remote File Systems. worker2 # setting up /etc... worker2 # [ 142.686182] systemd[1]: Reload requested from client PID 1811 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 142.688205] systemd[1]: Reloading... worker2 # [ 144.041459] systemd[1]: Reloading finished in 1350 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 144.103271] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 144.208344] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 144.212589] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 144.217115] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 144.224073] dbus-broker-launch[516]: Caught SIGHUP, trigger reload. worker2 # [ 144.226164] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 144.236531] dbus-broker-launch[516]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 144.238179] dbus-broker-launch[516]: NSS returned no entry for 'systemd-timesync' worker2 # [ 144.240087] dbus-broker-launch[516]: Invalid user-name in /nix/store/9f31zf0wixjfmyvwg6m53sif40vrkysg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 144.258102] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 144.263229] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 144.267150] systemd[1]: Reached target Local File Systems. worker2 # [ 144.274499] systemd[1]: Reached target Remote File Systems. worker2 # [ 144.276961] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 144.278627] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 144.285148] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 144.291241] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 144.292067] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 144.293235] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 144.297652] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 144.299176] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 144.302139] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 144.540083] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 144.545246] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 144.547104] systemd[1]: Starting linger-users.service... worker2 # [ 144.574617] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 144.578335] systemd[1]: Finished linger-users.service. worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 144.835230] nixos[1811]: finished switching to system configuration /nix/store/l0fg19025khizi78zyd50mp1rbqr80z2-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.90 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2 # [ 144.848401] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:26Z level=info event=draining worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker1 # [ 144.996519] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 145.002373] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker2 # [ 145.044140] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:27Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker2 # [ 145.045970] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:27Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 145.071558] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 145.083415] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 client # copying 1 paths to 'lb:50051'... worker1 # [ 145.095376] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker1 # [ 145.116334] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 145.219195] nix-daemon[845]: accepted connection from pid 1662, user nix-grpc-daemon (trusted) worker1 # [ 145.232154] nix-daemon[845]: reaped child process 1665, status = succeeded lb # [ 145.290256] niks3-server[1113]: 2026/09/22 16:44:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 145.248034] nix-grpc-daemon[1595]: time=2026-09-22T16:44:27.428Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.250351] nix-grpc-daemon[1595]: time=2026-09-22T16:44:27.430Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 145.320085] niks3-server[1113]: 2026/09/22 16:44:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 145.327783] niks3-server[1113]: 2026/09/22 16:44:26 INFO Signed narinfos id=55 count=1 worker1 # [ 145.281556] nix-grpc-daemon[1595]: time=2026-09-22T16:44:27.462Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.342246] niks3-server[1113]: 2026/09/22 16:44:26 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 145.346843] niks3-server[1113]: 2026/09/22 16:44:26 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 145.356951] niks3-server[1113]: 2026/09/22 16:44:26 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 145.362991] niks3-server[1113]: 2026/09/22 16:44:26 INFO Completed upload id=55 worker1 # [ 145.313277] nix-grpc-daemon[1595]: time=2026-09-22T16:44:27.493Z level=INFO msg="Upload complete. (185ms)" lb # [ 145.367533] niks3-server[1113]: 2026/09/22 16:44:26 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker1 # [ 145.317861] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 145.324310] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 145.332531] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 145.342535] nix-daemon[845]: reaped child process 1660, status = succeeded client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... worker1 # [ 145.347771] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 145.564564] envoy[904]: conn peer=[2001:db8:1::1]:41674 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3891 tx=1924 ms=8033 lb # [ 145.568630] envoy[904]: conn peer=[2001:db8:1::1]:36450 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3032 tx=826 ms=2184 client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker1 # [ 146.761985] nix-daemon[845]: reaped child process 1669, status = succeeded worker1 # [ 146.839172] nix-daemon[845]: accepted connection from pid 1685, user nix-grpc-daemon (trusted) worker1 # [ 146.853871] nix-daemon[845]: reaped child process 1688, status = succeeded lb # [ 146.910338] niks3-server[1113]: 2026/09/22 16:44:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.871209] nix-grpc-daemon[1595]: time=2026-09-22T16:44:29.051Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 146.873032] nix-grpc-daemon[1595]: time=2026-09-22T16:44:29.053Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 146.956606] niks3-server[1113]: 2026/09/22 16:44:28 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 146.972279] niks3-server[1113]: 2026/09/22 16:44:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 146.977463] niks3-server[1113]: 2026/09/22 16:44:28 INFO Signed narinfos id=56 count=1 worker1 # [ 146.930711] nix-grpc-daemon[1595]: time=2026-09-22T16:44:29.111Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.983517] niks3-server[1113]: 2026/09/22 16:44:28 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 146.987926] niks3-server[1113]: 2026/09/22 16:44:28 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 146.995168] niks3-server[1113]: 2026/09/22 16:44:28 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 146.999284] niks3-server[1113]: 2026/09/22 16:44:28 INFO Completed upload id=56 lb # [ 147.000993] niks3-server[1113]: 2026/09/22 16:44:28 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker1 # [ 146.950071] nix-grpc-daemon[1595]: time=2026-09-22T16:44:29.130Z level=INFO msg="Upload complete. (195ms)" worker2 # [ 146.982789] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:29Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker1 # [ 146.956477] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker2 # [ 146.985320] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:29Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 146.970907] nix-daemon[845]: reaped child process 1667, status = succeeded worker1 # [ 147.003971] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 147.016397] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 147.030186] nix-grpc-daemon[1595]: time=2026-09-22T16:44:29.210Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 147.038457] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker1 # [ 147.055148] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 147.154220] nix-daemon[845]: accepted connection from pid 1692, user nix-grpc-daemon (trusted) worker1 # [ 147.167652] nix-daemon[845]: reaped child process 1695, status = succeeded lb # [ 147.223604] niks3-server[1113]: 2026/09/22 16:44:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.181485] nix-grpc-daemon[1595]: time=2026-09-22T16:44:29.362Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 147.182978] nix-grpc-daemon[1595]: time=2026-09-22T16:44:29.363Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 147.257461] niks3-server[1113]: 2026/09/22 16:44:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 147.263470] niks3-server[1113]: 2026/09/22 16:44:28 INFO Signed narinfos id=57 count=1 worker1 # [ 147.219955] nix-grpc-daemon[1595]: time=2026-09-22T16:44:29.400Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.270962] niks3-server[1113]: 2026/09/22 16:44:28 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 147.277298] niks3-server[1113]: 2026/09/22 16:44:28 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 147.290864] niks3-server[1113]: 2026/09/22 16:44:28 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 147.295926] niks3-server[1113]: 2026/09/22 16:44:28 INFO Completed upload id=57 worker1 # [ 147.246340] nix-grpc-daemon[1595]: time=2026-09-22T16:44:29.427Z level=INFO msg="Upload complete. (177ms)" lb # [ 147.301286] niks3-server[1113]: 2026/09/22 16:44:28 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker1 # [ 147.250841] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 147.256623] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 147.265514] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 147.274566] nix-daemon[845]: reaped child process 1690, status = succeeded worker1 # [ 147.279174] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker1 # [ 148.307604] nix-daemon[845]: reaped child process 1699, status = succeeded worker1 # [ 148.375382] nix-daemon[845]: accepted connection from pid 1715, user nix-grpc-daemon (trusted) worker1 # [ 148.388982] nix-daemon[845]: reaped child process 1718, status = succeeded lb # [ 148.445153] niks3-server[1113]: 2026/09/22 16:44:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.400235] nix-grpc-daemon[1595]: time=2026-09-22T16:44:30.580Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 148.402531] nix-grpc-daemon[1595]: time=2026-09-22T16:44:30.582Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 148.463651] niks3-server[1113]: 2026/09/22 16:44:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker1 # [ 148.414228] nix-grpc-daemon[1595]: time=2026-09-22T16:44:30.594Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.465624] niks3-server[1113]: 2026/09/22 16:44:29 INFO Signed narinfos id=58 count=1 lb # [ 148.470540] niks3-server[1113]: 2026/09/22 16:44:29 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 148.474124] niks3-server[1113]: 2026/09/22 16:44:29 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 148.476914] niks3-server[1113]: 2026/09/22 16:44:29 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 148.481281] niks3-server[1113]: 2026/09/22 16:44:29 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 148.484333] niks3-server[1113]: 2026/09/22 16:44:29 INFO Completed upload id=58 worker1 # [ 148.434619] nix-grpc-daemon[1595]: time=2026-09-22T16:44:30.615Z level=INFO msg="Upload complete. (148ms)" lb # [ 148.487895] niks3-server[1113]: 2026/09/22 16:44:29 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker1 # [ 148.437184] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker2 # [ 148.465733] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:30Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 148.445100] nix-daemon[845]: reaped child process 1697, status = succeeded worker2 # [ 148.468393] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:30Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 148.486632] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 148.495873] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 148.504459] nix-grpc-daemon[1595]: time=2026-09-22T16:44:30.685Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 148.511775] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker1 # [ 148.525132] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 148.615671] nix-daemon[845]: accepted connection from pid 1722, user nix-grpc-daemon (trusted) worker1 # [ 148.629589] nix-daemon[845]: reaped child process 1725, status = succeeded lb # [ 148.685647] niks3-server[1113]: 2026/09/22 16:44:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.640181] nix-grpc-daemon[1595]: time=2026-09-22T16:44:30.820Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 148.641691] nix-grpc-daemon[1595]: time=2026-09-22T16:44:30.822Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 148.704073] niks3-server[1113]: 2026/09/22 16:44:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 148.706191] niks3-server[1113]: 2026/09/22 16:44:30 INFO Signed narinfos id=59 count=1 worker1 # [ 148.656194] nix-grpc-daemon[1595]: time=2026-09-22T16:44:30.836Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.710207] niks3-server[1113]: 2026/09/22 16:44:30 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 148.713975] niks3-server[1113]: 2026/09/22 16:44:30 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 148.716950] niks3-server[1113]: 2026/09/22 16:44:30 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 148.721450] niks3-server[1113]: 2026/09/22 16:44:30 INFO Completed upload id=59 worker1 # [ 148.671785] nix-grpc-daemon[1595]: time=2026-09-22T16:44:30.852Z level=INFO msg="Upload complete. (137ms)" lb # [ 148.723482] niks3-server[1113]: 2026/09/22 16:44:30 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker1 # [ 148.673952] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 148.678101] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 148.684309] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 148.686715] nix-daemon[845]: reaped child process 1720, status = succeeded client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... worker1 # [ 148.692186] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 149.305953] nix-daemon[845]: reaped child process 1729, status = succeeded client # farm-top> LOG-farm-top-during-drain worker1 # [ 149.375868] nix-daemon[845]: accepted connection from pid 1745, user nix-grpc-daemon (trusted) worker1 # [ 149.389222] nix-daemon[845]: reaped child process 1748, status = succeeded lb # [ 149.444433] niks3-server[1113]: 2026/09/22 16:44:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.403326] nix-grpc-daemon[1595]: time=2026-09-22T16:44:31.583Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 149.406063] nix-grpc-daemon[1595]: time=2026-09-22T16:44:31.585Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 149.486914] niks3-server[1113]: 2026/09/22 16:44:30 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 149.491730] niks3-server[1113]: 2026/09/22 16:44:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 149.499450] niks3-server[1113]: 2026/09/22 16:44:31 INFO Signed narinfos id=60 count=1 worker1 # [ 149.453094] nix-grpc-daemon[1595]: time=2026-09-22T16:44:31.633Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.505646] niks3-server[1113]: 2026/09/22 16:44:31 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 149.516884] niks3-server[1113]: 2026/09/22 16:44:31 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 149.525127] niks3-server[1113]: 2026/09/22 16:44:31 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 149.530592] niks3-server[1113]: 2026/09/22 16:44:31 INFO Completed upload id=60 lb # [ 149.532207] niks3-server[1113]: 2026/09/22 16:44:31 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker1 # [ 149.482279] nix-grpc-daemon[1595]: time=2026-09-22T16:44:31.662Z level=INFO msg="Upload complete. (184ms)" worker1 # [ 149.488722] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker1 # [ 149.504083] nix-daemon[845]: reaped child process 1727, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.66 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.11 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 149.779288] nix-daemon[866]: reaped child process 1783, status = succeeded worker2 # [ 149.850447] nix-daemon[866]: accepted connection from pid 1957, user nix-grpc-daemon (trusted) worker2 # [ 149.865133] nix-daemon[866]: reaped child process 1960, status = succeeded lb # [ 149.898215] niks3-server[1113]: 2026/09/22 16:44:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 149.879552] nix-grpc-daemon[1724]: time=2026-09-22T16:44:31.992Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 149.881046] nix-grpc-daemon[1724]: time=2026-09-22T16:44:31.994Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 149.938662] niks3-server[1113]: 2026/09/22 16:44:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 149.944639] niks3-server[1113]: 2026/09/22 16:44:31 INFO Signed narinfos id=61 count=1 worker2 # [ 149.921101] nix-grpc-daemon[1724]: time=2026-09-22T16:44:32.034Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.956855] niks3-server[1113]: 2026/09/22 16:44:31 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 149.961449] niks3-server[1113]: 2026/09/22 16:44:31 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 149.966150] niks3-server[1113]: 2026/09/22 16:44:31 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 149.975246] niks3-server[1113]: 2026/09/22 16:44:31 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 149.979848] niks3-server[1113]: 2026/09/22 16:44:31 INFO Completed upload id=61 lb # [ 149.981795] niks3-server[1113]: 2026/09/22 16:44:31 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker2 # [ 149.954233] nix-grpc-daemon[1724]: time=2026-09-22T16:44:32.067Z level=INFO msg="Upload complete. (184ms)" worker2 # [ 149.962879] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56990 duration_s=9 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker2 # [ 149.976673] nix-daemon[866]: reaped child process 1780, status = succeeded client # [ 149.978544] systemd[1]: sw.service: Deactivated successfully. client # [ 149.982804] systemd[1]: sw.service: Consumed 124ms CPU time over 10.405s wall clock time, 41.5M memory peak, 7.4K incoming IP traffic, 8.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.04 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 150.850306] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:32Z level=info event=signal_exit lb # [ 150.887429] niks3-server[1113]: 2026/09/22 16:44:32 INFO lead: released remote=192.168.1.4:39310 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2 # [ 151.859406] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:33Z level=info event=scheduler_restarting worker1 # [ 151.837951] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:34Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 151.862829] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56976 worker2 # [ 151.864681] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:33Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 151.866318] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:33Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 151.867570] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56976 worker2 # [ 151.869061] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:33Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 151.881329] nix-daemon[866]: reaped child process 1695, status = succeeded lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 152.037663] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 152.039555] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 152.074460] nix-grpc-daemon[1641]: ts=2026-09-22T16:44:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 152.240181] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 152.241975] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 152.293303] nix-grpc-daemon[1641]: E0000 00:00:1790095474.406461 1686 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 20, started true, shutdown true worker2 # [ 152.298864] nix-grpc-daemon[1641]: E0000 00:00:1790095474.411995 1686 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 152.442889] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 152.446859] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 152.647689] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 152.651804] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 152.853359] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 152.877540] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 152.857154] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 152.882204] systemd[1]: nix-grpc-daemon.service: Consumed 536ms CPU time over 22.243s wall clock time, 36.1M memory peak, 24.7K incoming IP traffic, 33.1K outgoing IP traffic. lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 153.057435] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 153.059355] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 153.154469] niks3-server[1113]: 2026/09/22 16:44:34 INFO lead: acquired remote=192.168.1.3:34002 worker1 # [ 153.107670] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_take_over worker1 # [ 153.259746] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 153.261650] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 153.462219] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 153.464210] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 153.665302] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 153.669295] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 153.872656] systemd[1]: Starting scheduler-token.service... worker1 # [ 153.871601] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 153.874841] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 153.930643] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 153.935564] systemd[1]: Finished scheduler-token.service. worker2 # [ 153.937208] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 60ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 153.945878] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 154.023105] nix-grpc-daemon[1975]: ts=2026-09-22T16:44:36Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 154.025179] nix-grpc-daemon[1975]: ts=2026-09-22T16:44:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 154.028361] nix-grpc-daemon[1975]: ts=2026-09-22T16:44:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 154.032649] nix-grpc-daemon[1975]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 154.034045] nix-grpc-daemon[1975]: E0000 00:00:1790095476.146027 1975 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 154.040111] nix-grpc-daemon[1975]: E0000 00:00:1790095476.151556 1975 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 154.044099] nix-grpc-daemon[1975]: ts=2026-09-22T16:44:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 154.045770] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 154.051067] nix-grpc-daemon[1975]: E0000 00:00:1790095476.164247 2017 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 154.065836] nix-grpc-daemon[1975]: E0000 00:00:1790095476.179233 2017 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 154.071056] nix-grpc-daemon[1975]: E0000 00:00:1790095476.181596 2017 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 154.080058] nix-grpc-daemon[1975]: E0000 00:00:1790095476.193460 2017 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 154.088660] nix-grpc-daemon[1975]: ts=2026-09-22T16:44:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 154.073923] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 154.080175] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:36Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37564 worker1 # [ 154.085418] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:36Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 154.093450] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:36Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 154.097329] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:36Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:37564 worker1 # [ 154.101540] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 4.25 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.59 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 155.255192] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 155.262651] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 155.305237] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker1 # [ 155.309768] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 155.315358] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker1 # [ 155.319329] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 155.354163] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 155.366405] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 155.377761] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 155.389762] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 155.489202] nix-daemon[845]: accepted connection from pid 1757, user nix-grpc-daemon (trusted) worker1 # [ 155.502659] nix-daemon[845]: reaped child process 1760, status = succeeded lb # [ 155.559583] niks3-server[1113]: 2026/09/22 16:44:37 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 155.565397] envoy[904]: conn peer=[2001:db8:1::1]:39474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=4382 ms=4505 lb # [ 155.571147] envoy[904]: conn peer=[2001:db8:1::1]:36460 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2962 tx=1543 ms=10259 lb # [ 155.574781] envoy[904]: conn peer=[2001:db8:1::4]:40136 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1584 tx=344 ms=21174 worker1 # [ 155.531659] nix-grpc-daemon[1595]: time=2026-09-22T16:44:37.712Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 155.533676] nix-grpc-daemon[1595]: time=2026-09-22T16:44:37.713Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 155.602974] niks3-server[1113]: 2026/09/22 16:44:37 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 155.618101] niks3-server[1113]: 2026/09/22 16:44:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 155.622809] niks3-server[1113]: 2026/09/22 16:44:37 INFO Signed narinfos id=62 count=1 worker1 # [ 155.573023] nix-grpc-daemon[1595]: time=2026-09-22T16:44:37.753Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.631970] niks3-server[1113]: 2026/09/22 16:44:37 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 155.638824] niks3-server[1113]: 2026/09/22 16:44:37 INFO Completed upload id=62 worker1 # [ 155.588748] nix-grpc-daemon[1595]: time=2026-09-22T16:44:37.769Z level=INFO msg="Upload complete. (187ms)" lb # [ 155.641397] niks3-server[1113]: 2026/09/22 16:44:37 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 155.593404] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 155.649483] niks3-server[1113]: 2026/09/22 16:44:37 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst worker1 # [ 155.598379] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 155.607501] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 155.615256] nix-daemon[845]: reaped child process 1755, status = succeeded worker1 # [ 155.618662] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 156.244546] nix-daemon[845]: reaped child process 1764, status = succeeded worker1 # [ 156.337764] nix-daemon[845]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker1 # [ 156.350304] nix-daemon[845]: reaped child process 1783, status = succeeded lb # [ 156.405608] niks3-server[1113]: 2026/09/22 16:44:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.362225] nix-grpc-daemon[1595]: time=2026-09-22T16:44:38.543Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 156.363820] nix-grpc-daemon[1595]: time=2026-09-22T16:44:38.544Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 156.432164] niks3-server[1113]: 2026/09/22 16:44:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 156.435325] niks3-server[1113]: 2026/09/22 16:44:37 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 156.437674] niks3-server[1113]: 2026/09/22 16:44:37 INFO Signed narinfos id=63 count=1 worker1 # [ 156.387975] nix-grpc-daemon[1595]: time=2026-09-22T16:44:38.568Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.442078] niks3-server[1113]: 2026/09/22 16:44:37 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 156.445347] niks3-server[1113]: 2026/09/22 16:44:37 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 156.449378] niks3-server[1113]: 2026/09/22 16:44:37 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 156.453102] niks3-server[1113]: 2026/09/22 16:44:37 INFO Completed upload id=63 worker1 # [ 156.403395] nix-grpc-daemon[1595]: time=2026-09-22T16:44:38.584Z level=INFO msg="Upload complete. (179ms)" lb # [ 156.455389] niks3-server[1113]: 2026/09/22 16:44:37 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 156.405931] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=1 worker1 # [ 156.410691] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:38Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.416874] nix-daemon[845]: reaped child process 1762, status = succeeded worker1 # [ 156.450629] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 156.456445] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:38Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 156.464572] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 156.472931] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 156.480903] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 156.565174] nix-daemon[845]: accepted connection from pid 1789, user nix-grpc-daemon (trusted) worker1 # [ 156.578639] nix-daemon[845]: reaped child process 1792, status = succeeded lb # [ 156.636155] niks3-server[1113]: 2026/09/22 16:44:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.595240] nix-grpc-daemon[1595]: time=2026-09-22T16:44:38.775Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 156.597381] nix-grpc-daemon[1595]: time=2026-09-22T16:44:38.777Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 156.666904] niks3-server[1113]: 2026/09/22 16:44:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker1 # [ 156.625705] nix-grpc-daemon[1595]: time=2026-09-22T16:44:38.806Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.675604] niks3-server[1113]: 2026/09/22 16:44:38 INFO Signed narinfos id=64 count=1 lb # [ 156.679448] niks3-server[1113]: 2026/09/22 16:44:38 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 156.688120] niks3-server[1113]: 2026/09/22 16:44:38 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 156.696056] niks3-server[1113]: 2026/09/22 16:44:38 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 156.698870] niks3-server[1113]: 2026/09/22 16:44:38 INFO Completed upload id=64 worker1 # [ 156.648957] nix-grpc-daemon[1595]: time=2026-09-22T16:44:38.829Z level=INFO msg="Upload complete. (163ms)" lb # [ 156.700555] niks3-server[1113]: 2026/09/22 16:44:38 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 156.652687] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 156.657411] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 156.666799] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 156.670431] nix-daemon[845]: reaped child process 1787, status = succeeded worker1 # [ 156.675108] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 158.312803] nix-daemon[845]: reaped child process 1796, status = succeeded worker1 # [ 158.397094] nix-daemon[845]: accepted connection from pid 1812, user nix-grpc-daemon (trusted) worker1 # [ 158.409891] nix-daemon[845]: reaped child process 1815, status = succeeded lb # [ 158.466389] niks3-server[1113]: 2026/09/22 16:44:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.424753] nix-grpc-daemon[1595]: time=2026-09-22T16:44:40.605Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.428058] nix-grpc-daemon[1595]: time=2026-09-22T16:44:40.607Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 158.509724] niks3-server[1113]: 2026/09/22 16:44:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 158.519777] niks3-server[1113]: 2026/09/22 16:44:40 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 158.525717] niks3-server[1113]: 2026/09/22 16:44:40 INFO Signed narinfos id=65 count=1 worker1 # [ 158.479376] nix-grpc-daemon[1595]: time=2026-09-22T16:44:40.659Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.530961] niks3-server[1113]: 2026/09/22 16:44:40 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 158.536456] niks3-server[1113]: 2026/09/22 16:44:40 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 158.546727] niks3-server[1113]: 2026/09/22 16:44:40 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 158.554069] niks3-server[1113]: 2026/09/22 16:44:40 INFO Completed upload id=65 worker1 # [ 158.504566] nix-grpc-daemon[1595]: time=2026-09-22T16:44:40.685Z level=INFO msg="Upload complete. (220ms)" lb # [ 158.556565] niks3-server[1113]: 2026/09/22 16:44:40 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 158.517172] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=1 worker1 # [ 158.524269] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:40Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 158.527948] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 158.531296] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:40Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 158.541488] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 158.544857] nix-daemon[845]: reaped child process 1794, status = succeeded worker1 # [ 158.549274] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 158.552974] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 158.637251] nix-daemon[845]: accepted connection from pid 1821, user nix-grpc-daemon (trusted) worker1 # [ 158.650409] nix-daemon[845]: reaped child process 1824, status = succeeded lb # [ 158.706403] niks3-server[1113]: 2026/09/22 16:44:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.664207] nix-grpc-daemon[1595]: time=2026-09-22T16:44:40.845Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.666253] nix-grpc-daemon[1595]: time=2026-09-22T16:44:40.846Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 158.735330] niks3-server[1113]: 2026/09/22 16:44:40 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 158.741782] niks3-server[1113]: 2026/09/22 16:44:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 158.747545] niks3-server[1113]: 2026/09/22 16:44:40 INFO Signed narinfos id=66 count=1 worker1 # [ 158.700779] nix-grpc-daemon[1595]: time=2026-09-22T16:44:40.881Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.760740] niks3-server[1113]: 2026/09/22 16:44:40 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 158.766991] niks3-server[1113]: 2026/09/22 16:44:40 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 158.771967] niks3-server[1113]: 2026/09/22 16:44:40 INFO Completed upload id=66 worker1 # [ 158.722136] nix-grpc-daemon[1595]: time=2026-09-22T16:44:40.902Z level=INFO msg="Upload complete. (163ms)" lb # [ 158.777633] niks3-server[1113]: 2026/09/22 16:44:40 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 158.725821] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 158.731306] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 158.739115] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 158.747162] nix-daemon[845]: reaped child process 1819, status = succeeded worker1 # [ 158.750064] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 159.364423] nix-daemon[845]: reaped child process 1828, status = succeeded worker1 # [ 159.438849] nix-daemon[845]: accepted connection from pid 1844, user nix-grpc-daemon (trusted) worker1 # [ 159.452247] nix-daemon[845]: reaped child process 1847, status = succeeded lb # [ 159.508386] niks3-server[1113]: 2026/09/22 16:44:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.465717] nix-grpc-daemon[1595]: time=2026-09-22T16:44:41.646Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 159.467318] nix-grpc-daemon[1595]: time=2026-09-22T16:44:41.648Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 159.545881] niks3-server[1113]: 2026/09/22 16:44:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker1 # [ 159.502092] nix-grpc-daemon[1595]: time=2026-09-22T16:44:41.682Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.551576] niks3-server[1113]: 2026/09/22 16:44:41 INFO Signed narinfos id=67 count=1 lb # [ 159.561209] niks3-server[1113]: 2026/09/22 16:44:41 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 159.567814] niks3-server[1113]: 2026/09/22 16:44:41 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 159.572900] niks3-server[1113]: 2026/09/22 16:44:41 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 159.582688] niks3-server[1113]: 2026/09/22 16:44:41 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 159.586740] niks3-server[1113]: 2026/09/22 16:44:41 INFO Completed upload id=67 lb # [ 159.590178] niks3-server[1113]: 2026/09/22 16:44:41 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 159.538320] nix-grpc-daemon[1595]: time=2026-09-22T16:44:41.719Z level=INFO msg="Upload complete. (182ms)" worker1 # [ 159.548223] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=1 worker1 # [ 159.553938] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:41Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.564766] nix-daemon[845]: reaped child process 1826, status = succeeded worker1 # [ 159.589783] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 159.596806] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:41Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 159.605112] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 159.616990] nix-grpc-daemon[1595]: time=2026-09-22T16:44:41.797Z level=INFO msg="All 1 paths already cached" worker1 # [ 159.623618] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 159.631989] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 159.715743] nix-daemon[845]: accepted connection from pid 1853, user nix-grpc-daemon (trusted) worker1 # [ 159.731667] nix-daemon[845]: reaped child process 1856, status = succeeded lb # [ 159.780293] niks3-server[1113]: 2026/09/22 16:44:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.738907] nix-grpc-daemon[1595]: time=2026-09-22T16:44:41.919Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 159.740485] nix-grpc-daemon[1595]: time=2026-09-22T16:44:41.921Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 159.812591] niks3-server[1113]: 2026/09/22 16:44:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker1 # [ 159.768393] nix-grpc-daemon[1595]: time=2026-09-22T16:44:41.949Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.819262] niks3-server[1113]: 2026/09/22 16:44:41 INFO Signed narinfos id=68 count=1 lb # [ 159.825372] niks3-server[1113]: 2026/09/22 16:44:41 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 159.834756] niks3-server[1113]: 2026/09/22 16:44:41 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 159.843689] niks3-server[1113]: 2026/09/22 16:44:41 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete worker1 # [ 159.799790] nix-grpc-daemon[1595]: time=2026-09-22T16:44:41.980Z level=INFO msg="Upload complete. (159ms)" lb # [ 159.849120] niks3-server[1113]: 2026/09/22 16:44:41 INFO Completed upload id=68 lb # [ 159.855191] niks3-server[1113]: 2026/09/22 16:44:41 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 159.803053] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 159.808289] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 159.818485] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 159.823092] nix-daemon[845]: reaped child process 1851, status = succeeded worker1 # [ 159.827295] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 160.870780] nix-daemon[845]: reaped child process 1860, status = succeeded worker1 # [ 160.944089] nix-daemon[845]: accepted connection from pid 1876, user nix-grpc-daemon (trusted) worker1 # [ 160.955810] nix-daemon[845]: reaped child process 1879, status = succeeded lb # [ 161.013199] niks3-server[1113]: 2026/09/22 16:44:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.969202] nix-grpc-daemon[1595]: time=2026-09-22T16:44:43.149Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 160.972060] nix-grpc-daemon[1595]: time=2026-09-22T16:44:43.151Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 161.037969] niks3-server[1113]: 2026/09/22 16:44:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 161.040866] niks3-server[1113]: 2026/09/22 16:44:42 INFO Signed narinfos id=69 count=1 worker1 # [ 160.991318] nix-grpc-daemon[1595]: time=2026-09-22T16:44:43.171Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.044866] niks3-server[1113]: 2026/09/22 16:44:42 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 161.047325] niks3-server[1113]: 2026/09/22 16:44:42 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 161.049579] niks3-server[1113]: 2026/09/22 16:44:42 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 161.054580] niks3-server[1113]: 2026/09/22 16:44:42 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 161.058103] niks3-server[1113]: 2026/09/22 16:44:42 INFO Completed upload id=69 worker1 # [ 161.009498] nix-grpc-daemon[1595]: time=2026-09-22T16:44:43.190Z level=INFO msg="Upload complete. (173ms)" lb # [ 161.059643] niks3-server[1113]: 2026/09/22 16:44:42 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 161.012699] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=1 worker1 # [ 161.017695] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:43Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.021057] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 161.022980] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:43Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 161.029288] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 161.031472] nix-daemon[845]: reaped child process 1858, status = succeeded worker1 # [ 161.035319] nix-grpc-daemon[1595]: time=2026-09-22T16:44:43.216Z level=INFO msg="All 1 paths already cached" worker1 # [ 161.039118] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 161.042994] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 161.129110] nix-daemon[845]: accepted connection from pid 1885, user nix-grpc-daemon (trusted) worker1 # [ 161.143201] nix-daemon[845]: reaped child process 1888, status = succeeded lb # [ 161.198500] niks3-server[1113]: 2026/09/22 16:44:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.156366] nix-grpc-daemon[1595]: time=2026-09-22T16:44:43.337Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 161.157818] nix-grpc-daemon[1595]: time=2026-09-22T16:44:43.338Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 161.228185] niks3-server[1113]: 2026/09/22 16:44:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker1 # [ 161.184765] nix-grpc-daemon[1595]: time=2026-09-22T16:44:43.365Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.234897] niks3-server[1113]: 2026/09/22 16:44:42 INFO Signed narinfos id=70 count=1 lb # [ 161.242809] niks3-server[1113]: 2026/09/22 16:44:42 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 161.247618] niks3-server[1113]: 2026/09/22 16:44:42 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 161.259757] niks3-server[1113]: 2026/09/22 16:44:42 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 161.266946] niks3-server[1113]: 2026/09/22 16:44:42 INFO Completed upload id=70 worker1 # [ 161.216909] nix-grpc-daemon[1595]: time=2026-09-22T16:44:43.397Z level=INFO msg="Upload complete. (167ms)" lb # [ 161.269996] niks3-server[1113]: 2026/09/22 16:44:42 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 161.220975] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 161.226268] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 161.236924] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 161.240776] nix-daemon[845]: reaped child process 1883, status = succeeded worker1 # [ 161.245472] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 162.083428] nix-daemon[845]: reaped child process 1892, status = succeeded worker1 # [ 162.166225] nix-daemon[845]: accepted connection from pid 1908, user nix-grpc-daemon (trusted) worker1 # [ 162.180069] nix-daemon[845]: reaped child process 1911, status = succeeded lb # [ 162.236311] niks3-server[1113]: 2026/09/22 16:44:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.195460] nix-grpc-daemon[1595]: time=2026-09-22T16:44:44.376Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 162.197041] nix-grpc-daemon[1595]: time=2026-09-22T16:44:44.377Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 162.276459] niks3-server[1113]: 2026/09/22 16:44:43 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 162.280738] niks3-server[1113]: 2026/09/22 16:44:43 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 162.290122] niks3-server[1113]: 2026/09/22 16:44:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign lb # [ 162.294447] niks3-server[1113]: 2026/09/22 16:44:43 INFO Signed narinfos id=71 count=1 worker1 # [ 162.247557] nix-grpc-daemon[1595]: time=2026-09-22T16:44:44.428Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.302791] niks3-server[1113]: 2026/09/22 16:44:43 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 162.307662] niks3-server[1113]: 2026/09/22 16:44:43 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 162.310396] niks3-server[1113]: 2026/09/22 16:44:43 INFO Completed upload id=71 worker1 # [ 162.260699] nix-grpc-daemon[1595]: time=2026-09-22T16:44:44.441Z level=INFO msg="Upload complete. (207ms)" lb # [ 162.313116] niks3-server[1113]: 2026/09/22 16:44:43 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 162.267653] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=1 worker1 # [ 162.275333] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:44Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.285686] nix-daemon[845]: reaped child process 1890, status = succeeded worker1 # [ 162.310360] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 162.317752] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:44Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 162.326658] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 162.337445] nix-grpc-daemon[1595]: time=2026-09-22T16:44:44.518Z level=INFO msg="All 1 paths already cached" worker1 # [ 162.343538] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 162.351984] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 162.439903] nix-daemon[845]: accepted connection from pid 1917, user nix-grpc-daemon (trusted) worker1 # [ 162.452820] nix-daemon[845]: reaped child process 1920, status = succeeded lb # [ 162.510160] niks3-server[1113]: 2026/09/22 16:44:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.474133] nix-grpc-daemon[1595]: time=2026-09-22T16:44:44.654Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 162.475755] nix-grpc-daemon[1595]: time=2026-09-22T16:44:44.656Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 162.547765] niks3-server[1113]: 2026/09/22 16:44:44 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 162.551558] niks3-server[1113]: 2026/09/22 16:44:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 162.556139] niks3-server[1113]: 2026/09/22 16:44:44 INFO Signed narinfos id=72 count=1 worker1 # [ 162.510545] nix-grpc-daemon[1595]: time=2026-09-22T16:44:44.691Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.563356] niks3-server[1113]: 2026/09/22 16:44:44 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 162.572840] niks3-server[1113]: 2026/09/22 16:44:44 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 162.576072] niks3-server[1113]: 2026/09/22 16:44:44 INFO Completed upload id=72 worker1 # [ 162.526358] nix-grpc-daemon[1595]: time=2026-09-22T16:44:44.707Z level=INFO msg="Upload complete. (166ms)" lb # [ 162.578140] niks3-server[1113]: 2026/09/22 16:44:44 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 162.530567] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 162.535518] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 162.547505] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 162.550711] nix-daemon[845]: reaped child process 1915, status = succeeded worker1 # [ 162.554902] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 163.571431] nix-daemon[845]: reaped child process 1924, status = succeeded worker1 # [ 163.647481] nix-daemon[845]: accepted connection from pid 1940, user nix-grpc-daemon (trusted) worker1 # [ 163.660861] nix-daemon[845]: reaped child process 1943, status = succeeded lb # [ 163.720232] niks3-server[1113]: 2026/09/22 16:44:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.678791] nix-grpc-daemon[1595]: time=2026-09-22T16:44:45.859Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 163.681060] nix-grpc-daemon[1595]: time=2026-09-22T16:44:45.861Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 163.752741] niks3-server[1113]: 2026/09/22 16:44:45 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 163.755184] niks3-server[1113]: 2026/09/22 16:44:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 163.758540] niks3-server[1113]: 2026/09/22 16:44:45 INFO Signed narinfos id=73 count=1 worker1 # [ 163.709076] nix-grpc-daemon[1595]: time=2026-09-22T16:44:45.889Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.760559] niks3-server[1113]: 2026/09/22 16:44:45 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 163.763087] niks3-server[1113]: 2026/09/22 16:44:45 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 163.770066] niks3-server[1113]: 2026/09/22 16:44:45 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 163.772904] niks3-server[1113]: 2026/09/22 16:44:45 INFO Completed upload id=73 worker1 # [ 163.722996] nix-grpc-daemon[1595]: time=2026-09-22T16:44:45.903Z level=INFO msg="Upload complete. (160ms)" lb # [ 163.775744] niks3-server[1113]: 2026/09/22 16:44:45 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 163.725662] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=1 worker1 # [ 163.730358] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:45Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.733561] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 163.736364] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:45Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 163.742675] nix-daemon[845]: reaped child process 1922, status = succeeded worker1 # [ 163.744122] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 163.749862] nix-grpc-daemon[1595]: time=2026-09-22T16:44:45.930Z level=INFO msg="All 2 paths already cached" worker1 # [ 163.753977] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 163.758863] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 163.842594] nix-daemon[845]: accepted connection from pid 1949, user nix-grpc-daemon (trusted) worker1 # [ 163.855450] nix-daemon[845]: reaped child process 1952, status = succeeded lb # [ 163.912294] niks3-server[1113]: 2026/09/22 16:44:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.871261] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.052Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.873296] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.053Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 163.941993] niks3-server[1113]: 2026/09/22 16:44:45 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 163.948590] niks3-server[1113]: 2026/09/22 16:44:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign worker1 # [ 163.907851] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.957309] niks3-server[1113]: 2026/09/22 16:44:45 INFO Signed narinfos id=74 count=1 lb # [ 163.965140] niks3-server[1113]: 2026/09/22 16:44:45 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 163.979415] niks3-server[1113]: 2026/09/22 16:44:45 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 163.982059] niks3-server[1113]: 2026/09/22 16:44:45 INFO Completed upload id=74 worker1 # [ 163.932179] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.112Z level=INFO msg="Upload complete. (168ms)" worker1 # [ 163.934384] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 163.984698] niks3-server[1113]: 2026/09/22 16:44:45 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 163.939219] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 163.945228] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 163.947526] nix-daemon[845]: reaped child process 1947, status = succeeded worker1 # [ 163.953070] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 164.385768] nix-daemon[845]: reaped child process 1956, status = succeeded worker1 # [ 164.470236] nix-daemon[845]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) worker1 # [ 164.483339] nix-daemon[845]: reaped child process 1975, status = succeeded lb # [ 164.540609] niks3-server[1113]: 2026/09/22 16:44:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.499303] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.680Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 164.500863] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.681Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 164.581627] niks3-server[1113]: 2026/09/22 16:44:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign worker1 # [ 164.538128] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.718Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.588879] niks3-server[1113]: 2026/09/22 16:44:46 INFO Signed narinfos id=75 count=1 lb # [ 164.593414] niks3-server[1113]: 2026/09/22 16:44:46 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 164.599812] niks3-server[1113]: 2026/09/22 16:44:46 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 164.607352] niks3-server[1113]: 2026/09/22 16:44:46 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 164.617548] niks3-server[1113]: 2026/09/22 16:44:46 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 164.623946] niks3-server[1113]: 2026/09/22 16:44:46 INFO Completed upload id=75 worker1 # [ 164.574225] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.754Z level=INFO msg="Upload complete. (213ms)" lb # [ 164.628052] niks3-server[1113]: 2026/09/22 16:44:46 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 164.579688] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=1 worker1 # [ 164.587409] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:46Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.600399] nix-daemon[845]: reaped child process 1954, status = succeeded worker1 # [ 164.629636] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 164.641457] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 164.654440] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.835Z level=INFO msg="All 2 paths already cached" worker1 # [ 164.662329] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 164.673162] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 164.768978] nix-daemon[845]: accepted connection from pid 1979, user nix-grpc-daemon (trusted) worker1 # [ 164.782599] nix-daemon[845]: reaped child process 1982, status = succeeded lb # [ 164.840577] niks3-server[1113]: 2026/09/22 16:44:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.797966] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.978Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 164.799467] nix-grpc-daemon[1595]: time=2026-09-22T16:44:46.980Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 164.871777] niks3-server[1113]: 2026/09/22 16:44:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign worker1 # [ 164.829551] nix-grpc-daemon[1595]: time=2026-09-22T16:44:47.010Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.879203] niks3-server[1113]: 2026/09/22 16:44:46 INFO Signed narinfos id=76 count=1 lb # [ 164.887469] niks3-server[1113]: 2026/09/22 16:44:46 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 164.893359] niks3-server[1113]: 2026/09/22 16:44:46 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 164.903151] niks3-server[1113]: 2026/09/22 16:44:46 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete lb # [ 164.908629] niks3-server[1113]: 2026/09/22 16:44:46 INFO Completed upload id=76 worker1 # [ 164.858637] nix-grpc-daemon[1595]: time=2026-09-22T16:44:47.039Z level=INFO msg="Upload complete. (174ms)" lb # [ 164.913244] niks3-server[1113]: 2026/09/22 16:44:46 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 164.862737] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 164.868275] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 164.877510] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 164.885146] nix-daemon[845]: reaped child process 1977, status = succeeded worker1 # [ 164.887960] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 166.157506] nix-daemon[845]: reaped child process 1986, status = succeeded worker1 # [ 166.200713] nix-daemon[845]: accepted connection from pid 2002, user nix-grpc-daemon (trusted) worker1 # [ 166.213150] nix-daemon[845]: reaped child process 2005, status = succeeded lb # [ 166.269879] niks3-server[1113]: 2026/09/22 16:44:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.229350] nix-grpc-daemon[1595]: time=2026-09-22T16:44:48.409Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 166.230996] nix-grpc-daemon[1595]: time=2026-09-22T16:44:48.411Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 166.311443] niks3-server[1113]: 2026/09/22 16:44:47 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 166.319997] niks3-server[1113]: 2026/09/22 16:44:47 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 166.325234] niks3-server[1113]: 2026/09/22 16:44:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 166.332279] niks3-server[1113]: 2026/09/22 16:44:47 INFO Signed narinfos id=77 count=1 worker1 # [ 166.285879] nix-grpc-daemon[1595]: time=2026-09-22T16:44:48.466Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.338087] niks3-server[1113]: 2026/09/22 16:44:47 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 166.348840] niks3-server[1113]: 2026/09/22 16:44:47 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 166.355483] niks3-server[1113]: 2026/09/22 16:44:47 INFO Completed upload id=77 worker1 # [ 166.305324] nix-grpc-daemon[1595]: time=2026-09-22T16:44:48.486Z level=INFO msg="Upload complete. (209ms)" lb # [ 166.358295] niks3-server[1113]: 2026/09/22 16:44:47 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 166.313535] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=1 worker1 # [ 166.319821] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:48Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 166.332092] nix-daemon[845]: reaped child process 1984, status = succeeded worker1 # [ 166.354536] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 166.366134] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 166.378319] nix-grpc-daemon[1595]: time=2026-09-22T16:44:48.559Z level=INFO msg="All 2 paths already cached" worker1 # [ 166.385666] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 166.395162] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 166.488202] nix-daemon[845]: accepted connection from pid 2009, user nix-grpc-daemon (trusted) worker1 # [ 166.501606] nix-daemon[845]: reaped child process 2012, status = succeeded lb # [ 166.556492] niks3-server[1113]: 2026/09/22 16:44:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.516107] nix-grpc-daemon[1595]: time=2026-09-22T16:44:48.696Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 166.517622] nix-grpc-daemon[1595]: time=2026-09-22T16:44:48.698Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 166.586726] niks3-server[1113]: 2026/09/22 16:44:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign lb # [ 166.595146] niks3-server[1113]: 2026/09/22 16:44:48 INFO Signed narinfos id=78 count=1 worker1 # [ 166.550045] nix-grpc-daemon[1595]: time=2026-09-22T16:44:48.730Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.602916] niks3-server[1113]: 2026/09/22 16:44:48 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 166.608131] niks3-server[1113]: 2026/09/22 16:44:48 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 166.622367] niks3-server[1113]: 2026/09/22 16:44:48 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete worker1 # [ 166.578083] nix-grpc-daemon[1595]: time=2026-09-22T16:44:48.758Z level=INFO msg="Upload complete. (172ms)" lb # [ 166.627840] niks3-server[1113]: 2026/09/22 16:44:48 INFO Completed upload id=78 worker1 # [ 166.580378] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 166.583561] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 lb # [ 166.633999] niks3-server[1113]: 2026/09/22 16:44:48 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 166.591674] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 166.593168] nix-daemon[845]: reaped child process 2007, status = succeeded worker1 # [ 166.598345] nix-daemon[845]: accepted connection from pid 1507, user nix-grpc-daemon (trusted) worker1 # [ 167.815615] nix-daemon[845]: reaped child process 2016, status = succeeded worker1 # [ 167.883995] nix-daemon[845]: accepted connection from pid 2032, user nix-grpc-daemon (trusted) worker1 # [ 167.896712] nix-daemon[845]: reaped child process 2035, status = succeeded lb # [ 167.953398] niks3-server[1113]: 2026/09/22 16:44:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.910065] nix-grpc-daemon[1595]: time=2026-09-22T16:44:50.090Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 167.912143] nix-grpc-daemon[1595]: time=2026-09-22T16:44:50.092Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 167.990643] niks3-server[1113]: 2026/09/22 16:44:49 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 168.000662] niks3-server[1113]: 2026/09/22 16:44:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign lb # [ 168.006712] niks3-server[1113]: 2026/09/22 16:44:49 INFO Signed narinfos id=79 count=1 worker1 # [ 167.960220] nix-grpc-daemon[1595]: time=2026-09-22T16:44:50.140Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.014551] niks3-server[1113]: 2026/09/22 16:44:49 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 168.018991] niks3-server[1113]: 2026/09/22 16:44:49 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 168.030572] niks3-server[1113]: 2026/09/22 16:44:49 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 168.035455] niks3-server[1113]: 2026/09/22 16:44:49 INFO Completed upload id=79 worker1 # [ 167.985678] nix-grpc-daemon[1595]: time=2026-09-22T16:44:50.166Z level=INFO msg="Upload complete. (181ms)" lb # [ 168.038062] niks3-server[1113]: 2026/09/22 16:44:49 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 167.988287] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50620 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=1 worker1 # [ 167.996142] nix-daemon[845]: reaped child process 2014, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 12.95 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 168.139488] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 9640a1cd0a824240a078e3ab32d3f740 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 168.280811] nix-grpc-daemon[1975]: ts=2026-09-22T16:44:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 168.292258] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) client # [ 168.295156] nix[1541]: don't know how to build these paths: client # [ 168.296041] nix[1541]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker2 # [ 168.306945] nix-grpc-daemon[1975]: ts=2026-09-22T16:44:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 168.317253] nix-grpc-daemon[1975]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 1/5) worker2 # [ 168.375674] nix-grpc-daemon[1975]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5) worker2 # [ 168.533848] nix-grpc-daemon[1975]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 3/5) worker2 # [ 168.591817] nix-grpc-daemon[1975]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 759 ms (attempt 4/5) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 169.353849] nix-grpc-daemon[1975]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 169.357826] nix-grpc-daemon[1975]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 169.355395] nix-grpc-daemon[1507]: ts=2026-09-22T16:44:51Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 client # [ 169.367874] nix[1541]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 175.566630] envoy[904]: conn peer=[2001:db8:1::1]:39518 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27077 tx=12280 ms=12792 client # [ 199.368959] nix[1541]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 199.379285] nix[1541]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 199.405684] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 199.409364] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 199.413485] systemd[1]: gpu.service: Consumed 129ms CPU time over 31.270s wall clock time, 37.6M memory peak, 5.4K incoming IP traffic, 5.1K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.16 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 44.60 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.93 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 201.121193] nix-grpc-daemon[1507]: ts=2026-09-22T16:45:23Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 201.909543] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52252 worker1 # [ 201.891352] nix-grpc-daemon[1507]: ts=2026-09-22T16:45:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50620 worker1 # [ 201.911852] nix-grpc-daemon[1507]: ts=2026-09-22T16:45:24Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker1 # [ 201.915961] nix-grpc-daemon[1507]: ts=2026-09-22T16:45:24Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 201.978246] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 201.990480] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52252 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 202.002841] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 202.011777] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker2 # [ 202.032536] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:24Z level=info event=niks3_push_started pid=2035 worker2 # [ 202.142894] nix-grpc-daemon[2035]: time=2026-09-22T16:45:24.255Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 202.232190] nix-daemon[866]: accepted connection from pid 2048, user nix-grpc-daemon (trusted) worker2 # [ 202.244189] nix-daemon[866]: reaped child process 2051, status = succeeded lb # [ 202.280825] niks3-server[1113]: 2026/09/22 16:45:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 202.261592] nix-grpc-daemon[2035]: time=2026-09-22T16:45:24.375Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 202.263157] nix-grpc-daemon[2035]: time=2026-09-22T16:45:24.376Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 202.319312] niks3-server[1113]: 2026/09/22 16:45:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign worker2 # [ 202.298731] nix-grpc-daemon[2035]: time=2026-09-22T16:45:24.411Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.325279] niks3-server[1113]: 2026/09/22 16:45:23 INFO Signed narinfos id=80 count=1 lb # [ 202.338743] niks3-server[1113]: 2026/09/22 16:45:23 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 202.343140] niks3-server[1113]: 2026/09/22 16:45:23 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 202.359061] niks3-server[1113]: 2026/09/22 16:45:23 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete lb # [ 202.362244] niks3-server[1113]: 2026/09/22 16:45:23 INFO Completed upload id=80 worker2 # [ 202.336297] nix-grpc-daemon[2035]: time=2026-09-22T16:45:24.449Z level=INFO msg="Upload complete. (190ms)" lb # [ 202.364822] niks3-server[1113]: 2026/09/22 16:45:23 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 202.340968] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52252 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 202.346941] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 202.356477] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker2 # [ 202.366733] nix-daemon[866]: reaped child process 2033, status = succeeded client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker2 # [ 202.369519] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 203.408882] nix-daemon[866]: reaped child process 2055, status = succeeded worker2 # [ 203.488086] nix-daemon[866]: accepted connection from pid 2071, user nix-grpc-daemon (trusted) worker2 # [ 203.500588] nix-daemon[866]: reaped child process 2074, status = succeeded lb # [ 203.534638] niks3-server[1113]: 2026/09/22 16:45:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.515778] nix-grpc-daemon[2035]: time=2026-09-22T16:45:25.629Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 203.517783] nix-grpc-daemon[2035]: time=2026-09-22T16:45:25.630Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 203.575587] niks3-server[1113]: 2026/09/22 16:45:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign lb # [ 203.579903] niks3-server[1113]: 2026/09/22 16:45:25 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 203.584275] niks3-server[1113]: 2026/09/22 16:45:25 INFO Signed narinfos id=81 count=1 worker2 # [ 203.559403] nix-grpc-daemon[2035]: time=2026-09-22T16:45:25.672Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.592292] niks3-server[1113]: 2026/09/22 16:45:25 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 203.602069] niks3-server[1113]: 2026/09/22 16:45:25 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 203.604654] niks3-server[1113]: 2026/09/22 16:45:25 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 203.607898] niks3-server[1113]: 2026/09/22 16:45:25 INFO Completed upload id=81 worker2 # [ 203.580812] nix-grpc-daemon[2035]: time=2026-09-22T16:45:25.694Z level=INFO msg="Upload complete. (204ms)" lb # [ 203.610067] niks3-server[1113]: 2026/09/22 16:45:25 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 203.586062] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52252 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=1 worker1 # [ 203.571881] nix-grpc-daemon[1507]: ts=2026-09-22T16:45:25Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 203.598912] nix-daemon[866]: reaped child process 2053, status = succeeded worker1 # [ 203.576217] nix-grpc-daemon[1507]: ts=2026-09-22T16:45:25Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 203.637088] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 203.648181] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 203.660500] nix-grpc-daemon[2035]: time=2026-09-22T16:45:25.773Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 203.668157] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 203.675988] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker2 # [ 203.771870] nix-daemon[866]: accepted connection from pid 2078, user nix-grpc-daemon (trusted) worker2 # [ 203.785051] nix-daemon[866]: reaped child process 2081, status = succeeded lb # [ 203.819516] niks3-server[1113]: 2026/09/22 16:45:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.800203] nix-grpc-daemon[2035]: time=2026-09-22T16:45:25.913Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 203.801691] nix-grpc-daemon[2035]: time=2026-09-22T16:45:25.915Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 203.849474] niks3-server[1113]: 2026/09/22 16:45:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign lb # [ 203.853964] niks3-server[1113]: 2026/09/22 16:45:25 INFO Signed narinfos id=82 count=1 worker2 # [ 203.829953] nix-grpc-daemon[2035]: time=2026-09-22T16:45:25.943Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.860098] niks3-server[1113]: 2026/09/22 16:45:25 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 203.866951] niks3-server[1113]: 2026/09/22 16:45:25 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 203.872356] niks3-server[1113]: 2026/09/22 16:45:25 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 203.875718] niks3-server[1113]: 2026/09/22 16:45:25 INFO Completed upload id=82 worker2 # [ 203.848464] nix-grpc-daemon[2035]: time=2026-09-22T16:45:25.961Z level=INFO msg="Upload complete. (159ms)" lb # [ 203.878832] niks3-server[1113]: 2026/09/22 16:45:25 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 203.850613] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52252 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 203.856172] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 203.862693] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker2 # [ 203.864969] nix-daemon[866]: reaped child process 2076, status = succeeded worker2 # [ 203.870316] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 205.088863] nix-daemon[866]: reaped child process 2085, status = succeeded worker2 # [ 205.161460] nix-daemon[866]: accepted connection from pid 2101, user nix-grpc-daemon (trusted) worker2 # [ 205.175937] nix-daemon[866]: reaped child process 2104, status = succeeded lb # [ 205.208137] niks3-server[1113]: 2026/09/22 16:45:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.185123] nix-grpc-daemon[2035]: time=2026-09-22T16:45:27.298Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 205.186644] nix-grpc-daemon[2035]: time=2026-09-22T16:45:27.300Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 205.229252] niks3-server[1113]: 2026/09/22 16:45:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign lb # [ 205.231662] niks3-server[1113]: 2026/09/22 16:45:26 INFO Signed narinfos id=83 count=1 worker2 # [ 205.205842] nix-grpc-daemon[2035]: time=2026-09-22T16:45:27.319Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.234427] niks3-server[1113]: 2026/09/22 16:45:26 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 205.236631] niks3-server[1113]: 2026/09/22 16:45:26 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 205.241391] niks3-server[1113]: 2026/09/22 16:45:26 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 205.249027] niks3-server[1113]: 2026/09/22 16:45:26 INFO Completed upload id=83 worker2 # [ 205.221797] nix-grpc-daemon[2035]: time=2026-09-22T16:45:27.335Z level=INFO msg="Upload complete. (144ms)" lb # [ 205.251053] niks3-server[1113]: 2026/09/22 16:45:26 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker2 # [ 205.224620] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52252 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=1 lb # [ 205.254141] niks3-server[1113]: 2026/09/22 16:45:26 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 205.231943] nix-daemon[866]: reaped child process 2083, status = succeeded worker1 # [ 205.213995] nix-grpc-daemon[1507]: ts=2026-09-22T16:45:27Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker1 # [ 205.218381] nix-grpc-daemon[1507]: ts=2026-09-22T16:45:27Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 205.278895] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 205.288713] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 205.299207] nix-grpc-daemon[2035]: time=2026-09-22T16:45:27.412Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 205.307138] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 205.313722] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker2 # [ 205.405893] nix-daemon[866]: accepted connection from pid 2108, user nix-grpc-daemon (trusted) worker2 # [ 205.421423] nix-daemon[866]: reaped child process 2111, status = succeeded lb # [ 205.452337] niks3-server[1113]: 2026/09/22 16:45:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.429185] nix-grpc-daemon[2035]: time=2026-09-22T16:45:27.542Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 205.431270] nix-grpc-daemon[2035]: time=2026-09-22T16:45:27.544Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 205.468092] niks3-server[1113]: 2026/09/22 16:45:26 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 205.471150] niks3-server[1113]: 2026/09/22 16:45:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign lb # [ 205.473837] niks3-server[1113]: 2026/09/22 16:45:26 INFO Signed narinfos id=84 count=1 worker2 # [ 205.446773] nix-grpc-daemon[2035]: time=2026-09-22T16:45:27.560Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.478586] niks3-server[1113]: 2026/09/22 16:45:26 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 205.485040] niks3-server[1113]: 2026/09/22 16:45:26 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete lb # [ 205.488209] niks3-server[1113]: 2026/09/22 16:45:26 INFO Completed upload id=84 worker2 # [ 205.460985] nix-grpc-daemon[2035]: time=2026-09-22T16:45:27.574Z level=INFO msg="Upload complete. (136ms)" lb # [ 205.490276] niks3-server[1113]: 2026/09/22 16:45:26 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 205.463328] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52252 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 205.467338] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52252 worker2 # [ 205.473727] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker2 # [ 205.476113] nix-daemon[866]: reaped child process 2106, status = succeeded worker2 # [ 205.481663] nix-daemon[866]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 205.567573] envoy[904]: conn peer=[2001:db8:1::1]:45328 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=912 tx=604 ms=31123 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 206.716403] nix-daemon[866]: reaped child process 2115, status = succeeded worker2 # [ 206.803089] nix-daemon[866]: accepted connection from pid 2131, user nix-grpc-daemon (trusted) worker2 # [ 206.815225] nix-daemon[866]: reaped child process 2134, status = succeeded lb # [ 206.850203] niks3-server[1113]: 2026/09/22 16:45:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 206.830983] nix-grpc-daemon[2035]: time=2026-09-22T16:45:28.944Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 206.833899] nix-grpc-daemon[2035]: time=2026-09-22T16:45:28.946Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 206.882145] niks3-server[1113]: 2026/09/22 16:45:28 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 206.897962] niks3-server[1113]: 2026/09/22 16:45:28 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 206.903779] niks3-server[1113]: 2026/09/22 16:45:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign worker2 # [ 206.883314] nix-grpc-daemon[2035]: time=2026-09-22T16:45:28.996Z level=INFO msg="Uploading 1 narinfos" lb # [ 206.910352] niks3-server[1113]: 2026/09/22 16:45:28 INFO Signed narinfos id=85 count=1 lb # [ 206.920954] niks3-server[1113]: 2026/09/22 16:45:28 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 206.926492] niks3-server[1113]: 2026/09/22 16:45:28 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 206.932167] niks3-server[1113]: 2026/09/22 16:45:28 INFO Completed upload id=85 worker2 # [ 206.905320] nix-grpc-daemon[2035]: time=2026-09-22T16:45:29.018Z level=INFO msg="Upload complete. (215ms)" lb # [ 206.935068] niks3-server[1113]: 2026/09/22 16:45:28 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 206.911759] nix-grpc-daemon[1975]: ts=2026-09-22T16:45:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52252 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=1 worker2 # [ 206.926404] nix-daemon[866]: reaped child process 2113, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.18 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.10 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 208.130588] nix-grpc-daemon[1507]: ts=2026-09-22T16:45:30Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.56 seconds) (finished: run the VM test script, in 209.22 seconds) test script finished in 209.37s cleanup kill QemuMachine (pid 50) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-22T16:45:30Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T16:45:30Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T16:45:30Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 49) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-22T16:45:30Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T16:45:30Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T16:45:30Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T16:45:31Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T16:45:31Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T16:45:31Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T16:45:31Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T16:45:31Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T16:45:31Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.08 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh