tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2 # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 52) worker2 # Formatting '/build/vm-state-worker2/tmp.FBi8oysBIH', fmt=raw size=1073741824 worker2 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: 99b73c50-b0c8-4fbd-a58c-cb4c1b037971 worker2 # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) client # Formatting '/build/vm-state-client/tmp.pK5bNSNY26', fmt=raw size=1073741824 worker2 # client # mke2fs 1.47.4 (6-Mar-2025) worker2 # Allocating group tables: 0/8 done client # Discarding device blocks: 0/262144 done worker2 # Writing inode tables: 0/8 done client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Creating journal (8192 blocks): done client # Filesystem UUID: 395dedcd-1a69-4569-8b1c-9b65c0bdba46 worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Superblock backups stored on blocks: worker2 # client # 32768, 98304, 163840, 229376 worker2 # Virtualisation disk image created. client # worker2 # Starting virtiofs daemons... client # Allocating group tables: 0/8 done worker2 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Writing inode tables: 0/8 done worker2 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Creating journal (8192 blocks): done worker2 # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # worker2 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Virtualisation disk image created. worker2 # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Starting virtiofs daemons... worker2 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 50) lb # Formatting '/build/vm-state-lb/tmp.bBZe9ifhjK', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: 0462966c-9ade-45a3-b61a-be0249fbfa11 lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 lb # lb # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. lb # Starting virtiofs daemons... lb # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests worker1: QEMU running (pid 51) worker1 # Disk image does not exist, creating the virtualisation disk image... (finished: start all VMs, in 0.26 seconds) worker1 # Formatting '/build/vm-state-worker1/tmp.XE6rDlsdpV', fmt=raw size=1073741824 client: waiting for unit network-addresses-eth1.service worker1 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: b86d2bb0-fb2f-4811-a307-f0d372f4dda3 client: waiting for the VM to finish booting worker1 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker1 # worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker1 # Virtualisation disk image created. worker1 # Starting virtiofs daemons... worker1 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T15:59:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T15:59:29Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-23T15:59:29Z INFO virtiofsd] Client connected, servicing requests worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # client # worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # worker1 # lb # lb # client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker2 # Booting from ROM... lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker1 # Booting from ROM... client # Booting from ROM... lb # Booting from ROM... worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ryyw8nza55ayn45yacz76nd2ajf36w90-nixos-system-worker2-test/init regInfo=/nix/store/b4kcswdscn3288f20kcibxgb5i0sxv2l-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-provided physical RAM map: worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] kvm-clock: using sched offset of 464506469 cycles worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor worker2 # [ 0.000809] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.002733] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.002744] Using GB pages for direct mapping worker2 # [ 0.002824] RAMDISK: [mem 0x5e36f000-0x5ffcffff] worker2 # [ 0.002833] ACPI: Early table checksum verification disabled worker2 # [ 0.002836] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.002839] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/x5xm43clszqqn1s52xaz4fgg5ff2y8g4-nixos-system-worker1-test/init regInfo=/nix/store/7qz9sz7kdv8kd3dah4cq47kqnn15rajm-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.002843] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.002849] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002851] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.002853] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.002854] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.002856] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.002857] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.002859] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.002860] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.002860] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.002861] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.002861] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.002862] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test/init regInfo=/nix/store/ahb1sfxh6ggw7bfwmy5j8nfvv6w9sgga-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.002862] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.003085] No NUMA configuration found worker1 # [ 0.000000] Hypervisor detected: KVM client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.003086] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.003088] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.005317] Zone ranges: worker1 # [ 0.000000] kvm-clock: using sched offset of 468131861 cycles client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.005318] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.005319] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.005320] Normal empty client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000004] tsc: Detected 2400.012 MHz processor worker2 # [ 0.005321] Device empty client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.005322] Movable zone start for each node worker1 # [ 0.000808] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.005323] Early memory node ranges client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000835] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.005323] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.005324] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.002734] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.005325] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.002745] Using GB pages for direct mapping lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.005344] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.002869] RAMDISK: [mem 0x5e370000-0x5ffcffff] client # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.005599] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.002879] ACPI: Early table checksum verification disabled client # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] SMBIOS 2.8 present. worker2 # [ 0.031167] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.002881] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.031625] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.031635] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.002885] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.031661] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.002889] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.031663] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002896] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.031665] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.002898] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.000001] kvm-clock: using sched offset of 497489634 cycles lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.031666] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.002899] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.031667] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) lb # [ 0.000000] APIC: Static calls initialized client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.002901] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.031668] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.031670] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.002903] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.031671] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.031674] TSC deadline timer available worker1 # [ 0.002904] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.031678] CPU topo: Max. logical packages: 1 client # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002905] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.031679] CPU topo: Max. logical dies: 1 client # [ 0.002721] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.031679] CPU topo: Max. dies per package: 1 worker1 # [ 0.002907] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.002732] Using GB pages for direct mapping lb # [ 0.000000] kvm-clock: using sched offset of 497082595 cycles worker2 # [ 0.031682] CPU topo: Max. threads per core: 1 client # [ 0.002886] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker1 # [ 0.002907] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.031683] CPU topo: Num. cores per package: 1 client # [ 0.002897] ACPI: Early table checksum verification disabled worker2 # [ 0.031683] CPU topo: Num. threads per package: 1 lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.002908] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] client # [ 0.002900] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.031684] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.000004] tsc: Detected 2400.012 MHz processor worker1 # [ 0.002908] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] lb # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.002904] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.031701] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.002908] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.031730] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.002908] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002909] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.003140] No NUMA configuration found worker2 # [ 0.031731] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.002916] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002724] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.003141] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.031732] [mem 0x60000000-0xafffffff] available for PCI devices client # [ 0.002919] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.002734] Using GB pages for direct mapping worker1 # [ 0.003144] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.031734] Booting paravirtualized kernel on KVM lb # [ 0.002863] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker1 # [ 0.005417] Zone ranges: client # [ 0.002920] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002872] ACPI: Early table checksum verification disabled worker1 # [ 0.005418] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.031736] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.002922] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002874] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.005419] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.036194] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.005420] Normal empty worker1 # [ 0.005421] Device empty client # [ 0.002923] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002878] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.038456] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.005421] Movable zone start for each node worker1 # [ 0.005422] Early memory node ranges worker2 # [ 0.038498] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.002925] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002883] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005423] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.002926] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] lb # [ 0.002890] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005424] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.002927] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] lb # [ 0.002892] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.005425] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.002928] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.002894] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005445] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.002928] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.005705] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.038500] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ryyw8nza55ayn45yacz76nd2ajf36w90-nixos-system-worker2-test/init regInfo=/nix/store/b4kcswdscn3288f20kcibxgb5i0sxv2l-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.002895] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002929] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.032102] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.002897] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.032562] ACPI: PM-Timer IO Port: 0x608 client # [ 0.002929] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.038591] Unknown kernel command line parameters "regInfo=/nix/store/b4kcswdscn3288f20kcibxgb5i0sxv2l-closure-info/registration", will be passed to user space. worker1 # [ 0.032573] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.038604] random: crng init done lb # [ 0.002898] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002930] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.032600] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.003161] No NUMA configuration found lb # [ 0.002900] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.038605] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.032603] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.003162] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.002901] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.040658] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.003164] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.032604] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.005443] Zone ranges: lb # [ 0.002901] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.041691] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.032605] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.005444] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.041721] Fallback order for Node 0: 0 lb # [ 0.002902] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.032607] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.005447] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.041724] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.005448] Normal empty lb # [ 0.002902] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker2 # [ 0.041725] Policy zone: DMA32 worker1 # [ 0.032607] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.005449] Device empty lb # [ 0.002903] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] client # [ 0.005449] Movable zone start for each node worker2 # [ 0.044128] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.032610] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.005450] Early memory node ranges worker1 # [ 0.032611] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.002903] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker2 # [ 0.047080] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.005451] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.032614] TSC deadline timer available lb # [ 0.003127] No NUMA configuration found worker2 # [ 0.050483] allocated 3145728 bytes of page_ext worker1 # [ 0.032618] CPU topo: Max. logical packages: 1 client # [ 0.005452] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.059995] ftrace: allocating 48787 entries in 192 pages lb # [ 0.003128] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.032619] CPU topo: Max. logical dies: 1 worker2 # [ 0.059997] ftrace: allocated 192 pages with 2 groups client # [ 0.005453] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] lb # [ 0.003131] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.032619] CPU topo: Max. dies per package: 1 worker2 # [ 0.060812] Dynamic Preempt: lazy lb # [ 0.005415] Zone ranges: client # [ 0.005472] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.032622] CPU topo: Max. threads per core: 1 worker2 # [ 0.060963] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.005416] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.032623] CPU topo: Num. cores per package: 1 client # [ 0.005737] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.060964] rcu: RCU event tracing is enabled. worker1 # [ 0.032623] CPU topo: Num. threads per package: 1 lb # [ 0.005418] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.032036] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.005419] Normal empty worker2 # [ 0.060965] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.005420] Device empty worker1 # [ 0.032624] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.032498] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.060966] Trampoline variant of Tasks RCU enabled. lb # [ 0.005420] Movable zone start for each node client # [ 0.032510] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.060967] Rude variant of Tasks RCU enabled. lb # [ 0.005421] Early memory node ranges worker1 # [ 0.032642] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.060967] Tracing variant of Tasks RCU enabled. client # [ 0.032539] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.005421] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.032674] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.060968] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.032542] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.005422] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.032676] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.060968] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.005423] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.032544] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.032677] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.032679] Booting paravirtualized kernel on KVM lb # [ 0.005443] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.061024] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.032551] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.005710] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.032552] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.061026] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.032682] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.031982] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.032553] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.032443] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.037149] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.061027] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.032555] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.032455] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.039286] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.065345] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.032556] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.032488] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.032560] TSC deadline timer available worker1 # [ 0.039330] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.065622] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.032564] CPU topo: Max. logical packages: 1 lb # [ 0.032490] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.032564] CPU topo: Max. logical dies: 1 worker2 # [ 0.065628] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.032492] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.032565] CPU topo: Max. dies per package: 1 client # [ 0.032568] CPU topo: Max. threads per core: 1 lb # [ 0.032494] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.065726] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.032568] CPU topo: Num. cores per package: 1 worker2 # [ 0.069190] Console: colour VGA+ 80x25 lb # [ 0.032495] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.032569] CPU topo: Num. threads per package: 1 worker2 # [ 0.069193] printk: legacy console [tty0] enabled worker1 # [ 0.039331] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/x5xm43clszqqn1s52xaz4fgg5ff2y8g4-nixos-system-worker1-test/init regInfo=/nix/store/7qz9sz7kdv8kd3dah4cq47kqnn15rajm-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.032495] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.032569] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.098678] printk: legacy console [ttyS0] enabled lb # [ 0.032498] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.032588] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.197323] ACPI: Core revision 20250807 lb # [ 0.032499] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker1 # [ 0.039425] Unknown kernel command line parameters "regInfo=/nix/store/7qz9sz7kdv8kd3dah4cq47kqnn15rajm-closure-info/registration", will be passed to user space. lb # [ 0.032502] TSC deadline timer available worker1 # [ 0.039437] random: crng init done client # [ 0.032623] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.032506] CPU topo: Max. logical packages: 1 worker2 # [ 0.198191] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.032624] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.039438] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.032507] CPU topo: Max. logical dies: 1 lb # [ 0.032507] CPU topo: Max. dies per package: 1 client # [ 0.032626] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.199701] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.041536] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.032510] CPU topo: Max. threads per core: 1 client # [ 0.032627] Booting paravirtualized kernel on KVM worker2 # [ 0.200665] x2apic enabled lb # [ 0.032511] CPU topo: Num. cores per package: 1 worker1 # [ 0.042777] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.042808] Fallback order for Node 0: 0 lb # [ 0.032511] CPU topo: Num. threads per package: 1 worker2 # [ 0.201402] APIC: Switched APIC routing to: physical x2apic client # [ 0.032630] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.032512] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.042811] Built 1 zonelists, mobility grouping on. Total pages: 393078 client # [ 0.037149] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.042812] Policy zone: DMA32 lb # [ 0.032530] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.039296] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.045281] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.203195] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.032559] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] client # [ 0.039341] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.048420] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.051703] allocated 3145728 bytes of page_ext lb # [ 0.032561] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.204162] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.061625] ftrace: allocating 48787 entries in 192 pages lb # [ 0.032562] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.061627] ftrace: allocated 192 pages with 2 groups lb # [ 0.032564] Booting paravirtualized kernel on KVM worker1 # [ 0.062456] Dynamic Preempt: lazy worker2 # [ 0.205807] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.062593] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.032566] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.206890] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.062594] rcu: RCU event tracing is enabled. client # [ 0.039343] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test/init regInfo=/nix/store/ahb1sfxh6ggw7bfwmy5j8nfvv6w9sgga-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.037033] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker1 # [ 0.062594] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.207925] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.062596] Trampoline variant of Tasks RCU enabled. lb # [ 0.039240] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.039437] Unknown kernel command line parameters "regInfo=/nix/store/ahb1sfxh6ggw7bfwmy5j8nfvv6w9sgga-closure-info/registration", will be passed to user space. worker1 # [ 0.062596] Rude variant of Tasks RCU enabled. worker2 # [ 0.208804] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.039285] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.039449] random: crng init done worker1 # [ 0.062596] Tracing variant of Tasks RCU enabled. client # [ 0.039449] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.062597] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.209808] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.041569] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.062598] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.042659] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.210804] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.062619] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.042689] Fallback order for Node 0: 0 lb # [ 0.039287] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.211804] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.042692] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.062621] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.042693] Policy zone: DMA32 worker2 # [ 0.212804] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.045329] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.062621] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.039380] Unknown kernel command line parameters "regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration", will be passed to user space. lb # [ 0.039393] random: crng init done worker2 # [ 0.213804] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.067225] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 client # [ 0.048431] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.051893] allocated 3145728 bytes of page_ext lb # [ 0.039394] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.067492] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.061849] ftrace: allocating 48787 entries in 192 pages lb # [ 0.041505] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.061851] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.067500] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.062680] Dynamic Preempt: lazy lb # [ 0.042737] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.062819] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.042771] Fallback order for Node 0: 0 worker1 # [ 0.067603] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.062820] rcu: RCU event tracing is enabled. worker1 # [ 0.071088] Console: colour VGA+ 80x25 lb # [ 0.042774] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.214804] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.042775] Policy zone: DMA32 worker1 # [ 0.071091] printk: legacy console [tty0] enabled client # [ 0.062821] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.216811] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.100508] printk: legacy console [ttyS0] enabled client # [ 0.062822] Trampoline variant of Tasks RCU enabled. lb # [ 0.045252] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.062823] Rude variant of Tasks RCU enabled. worker1 # [ 0.197847] ACPI: Core revision 20250807 lb # [ 0.048352] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.217805] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.062823] Tracing variant of Tasks RCU enabled. lb # [ 0.051644] allocated 3145728 bytes of page_ext worker2 # [ 0.218805] active return thunk: srso_alias_return_thunk client # [ 0.062824] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. lb # [ 0.061506] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.198703] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns lb # [ 0.061508] ftrace: allocated 192 pages with 2 groups client # [ 0.062825] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.062321] Dynamic Preempt: lazy worker1 # [ 0.200198] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.219825] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.062512] rcu: Preemptible hierarchical RCU implementation. client # [ 0.062880] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.201165] x2apic enabled worker2 # [ 0.220804] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.062513] rcu: RCU event tracing is enabled. client # [ 0.062882] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.201932] APIC: Switched APIC routing to: physical x2apic lb # [ 0.062513] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.221804] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.062515] Trampoline variant of Tasks RCU enabled. client # [ 0.062883] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.222804] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.062515] Rude variant of Tasks RCU enabled. client # [ 0.067248] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.062516] Tracing variant of Tasks RCU enabled. worker1 # [ 0.203751] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.223804] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.067517] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.062516] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.224804] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.062517] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.204730] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.067525] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.225804] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.062538] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.067635] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.206408] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) client # [ 0.071184] Console: colour VGA+ 80x25 worker2 # [ 0.226804] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.062540] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.071186] printk: legacy console [tty0] enabled worker1 # [ 0.207493] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker2 # [ 0.227804] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.100693] printk: legacy console [ttyS0] enabled lb # [ 0.062541] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.208535] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.197852] ACPI: Core revision 20250807 worker2 # [ 0.228804] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.067060] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.209405] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.067336] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.229804] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.198750] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.230804] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.067343] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.210409] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto client # [ 0.200257] APIC: Switch to symmetric I/O mode setup client # [ 0.201227] x2apic enabled lb # [ 0.067445] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.231804] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.071009] Console: colour VGA+ 80x25 worker1 # [ 0.212405] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.201999] APIC: Switched APIC routing to: physical x2apic lb # [ 0.071012] printk: legacy console [tty0] enabled worker1 # [ 0.213405] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.100486] printk: legacy console [ttyS0] enabled lb # [ 0.197503] ACPI: Core revision 20250807 worker1 # [ 0.214404] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.203812] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.215405] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.198440] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.204870] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.199999] APIC: Switch to symmetric I/O mode setup lb # [ 0.201038] x2apic enabled client # [ 0.206605] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.201788] APIC: Switched APIC routing to: physical x2apic client # [ 0.207690] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.216404] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.218411] Spectre V2 : Enabling IBPB for BPF client # [ 0.209657] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.203675] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.219406] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.210602] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.220406] active return thunk: srso_alias_return_thunk lb # [ 0.204689] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.211606] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.222051] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.206387] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker1 # [ 0.223299] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.212602] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.207474] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.224164] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.214602] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.209296] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker1 # [ 0.225131] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.215602] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.210077] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.226147] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.216602] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.227147] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.211158] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.228218] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.212384] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.229405] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.213384] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.217602] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.230405] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.214384] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.219610] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.231404] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.215287] Speculative Return Stack Overflow: Mitigation: Safe RET client # [ 0.220338] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.232404] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.221603] active return thunk: srso_alias_return_thunk worker1 # [ 0.233405] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.222625] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.234405] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. client # [ 0.223602] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.216135] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.217391] Spectre V2 : Enabling IBPB for BPF client # [ 0.224602] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.225602] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.218937] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.226602] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.219384] active return thunk: srso_alias_return_thunk client # [ 0.227602] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.220270] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' client # [ 0.228602] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.221384] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.230550] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.222384] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.231602] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.223384] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.232565] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.266356] Freeing SMP alternatives memory: 44K lb # [ 0.224384] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.266807] pid_max: default: 32768 minimum: 301 client # [ 0.233602] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.225384] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.267887] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.234543] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.226384] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.268913] landlock: Up and running. worker2 # [ 0.269530] Yama: becoming mindful. client # [ 0.235340] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.227384] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.270438] LSM support for eBPF active lb # [ 0.228384] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.229384] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.271389] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.230384] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.271840] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.231384] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.232384] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.275046] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.276363] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.276813] ... version: 2 worker2 # [ 0.277572] ... bit width: 48 worker2 # [ 0.277807] ... generic counters: 6 worker2 # [ 0.278538] ... generic bitmap: 000000000000003f worker2 # [ 0.278806] ... fixed-purpose counters: 0 worker2 # [ 0.279566] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.279806] ... value mask: 0000ffffffffffff worker2 # [ 0.280763] ... max period: 00007fffffffffff worker2 # [ 0.281558] ... global_ctrl mask: 000000000000003f worker2 # [ 0.281901] signal: max sigframe size: 3376 worker2 # [ 0.282754] rcu: Hierarchical SRCU implementation. worker2 # [ 0.283448] rcu: Max phase no-delay instances is 400. worker1 # [ 0.268630] Freeing SMP alternatives memory: 44K worker1 # [ 0.269407] pid_max: default: 32768 minimum: 301 worker1 # [ 0.270253] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.288378] smp: Bringing up secondary CPUs ... worker1 # [ 0.271470] landlock: Up and running. worker1 # [ 0.272079] Yama: becoming mindful. worker2 # [ 0.288821] smp: Brought up 1 node, 1 CPU worker1 # [ 0.272617] LSM support for eBPF active worker2 # [ 0.289526] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.273513] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.290015] Memory: 1454600K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) worker1 # [ 0.274443] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.291030] devtmpfs: initialized worker2 # [ 0.291895] x86/mm: Memory block size: 128MB worker1 # [ 0.277253] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.293675] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.278009] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.278409] ... version: 2 worker2 # [ 0.294770] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.279101] ... bit width: 48 client # [ 0.269974] Freeing SMP alternatives memory: 44K worker1 # [ 0.279407] ... generic counters: 6 worker2 # [ 0.295894] pinctrl core: initialized pinctrl subsystem client # [ 0.270601] pid_max: default: 32768 minimum: 301 worker1 # [ 0.280123] ... generic bitmap: 000000000000003f worker2 # [ 0.296950] PM: RTC time: 15:59:29, date: 2026-09-23 client # [ 0.271668] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.280417] ... fixed-purpose counters: 0 client # [ 0.272706] landlock: Up and running. worker1 # [ 0.281109] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.273333] Yama: becoming mindful. worker1 # [ 0.281407] ... value mask: 0000ffffffffffff client # [ 0.273815] LSM support for eBPF active worker1 # [ 0.282348] ... max period: 00007fffffffffff lb # [ 0.267279] Freeing SMP alternatives memory: 44K client # [ 0.274697] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.300673] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.283121] ... global_ctrl mask: 000000000000003f lb # [ 0.267935] pid_max: default: 32768 minimum: 301 worker1 # [ 0.283517] signal: max sigframe size: 3376 client # [ 0.275645] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.301957] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.268492] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.284295] rcu: Hierarchical SRCU implementation. lb # [ 0.269489] landlock: Up and running. worker1 # [ 0.285006] rcu: Max phase no-delay instances is 400. worker2 # [ 0.302825] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.270385] Yama: becoming mindful. client # [ 0.278492] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.271472] LSM support for eBPF active worker2 # [ 0.304073] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.272210] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.279116] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.304816] audit: initializing netlink subsys (disabled) client # [ 0.279607] ... version: 2 lb # [ 0.273424] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.305982] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.280308] ... bit width: 48 client # [ 0.280605] ... generic counters: 6 worker2 # [ 0.305984] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.289920] smp: Bringing up secondary CPUs ... client # [ 0.281345] ... generic bitmap: 000000000000003f worker2 # [ 0.306808] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.290420] smp: Brought up 1 node, 1 CPU lb # [ 0.275713] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.281653] ... fixed-purpose counters: 0 worker2 # [ 0.307800] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.291106] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.282386] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.276933] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.282606] ... value mask: 0000ffffffffffff worker2 # [ 0.308732] audit: type=2000 audit(1790179170.376:1): state=initialized audit_enabled=0 res=1 lb # [ 0.277393] ... version: 2 client # [ 0.283475] ... max period: 00007fffffffffff worker2 # [ 0.310809] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.278100] ... bit width: 48 worker1 # [ 0.291577] Memory: 1454624K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.310824] cpuidle: using governor menu client # [ 0.284284] ... global_ctrl mask: 000000000000003f lb # [ 0.278386] ... generic counters: 6 worker1 # [ 0.292643] devtmpfs: initialized client # [ 0.284724] signal: max sigframe size: 3376 lb # [ 0.279112] ... generic bitmap: 000000000000003f worker1 # [ 0.293445] x86/mm: Memory block size: 128MB worker2 # [ 0.313009] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.285488] rcu: Hierarchical SRCU implementation. lb # [ 0.279386] ... fixed-purpose counters: 0 client # [ 0.286169] rcu: Max phase no-delay instances is 400. lb # [ 0.280114] ... fixed-purpose bitmap: 0000000000000000 worker2 # [ 0.314036] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.295191] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.280386] ... value mask: 0000ffffffffffff worker2 # [ 0.314810] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.281246] ... max period: 00007fffffffffff worker1 # [ 0.296295] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.315818] PCI: Using configuration type 1 for base access lb # [ 0.282041] ... global_ctrl mask: 000000000000003f worker1 # [ 0.297492] pinctrl core: initialized pinctrl subsystem lb # [ 0.282498] signal: max sigframe size: 3376 worker2 # [ 0.316924] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.298636] PM: RTC time: 15:59:29, date: 2026-09-23 lb # [ 0.283292] rcu: Hierarchical SRCU implementation. lb # [ 0.283983] rcu: Max phase no-delay instances is 400. client # [ 0.291235] smp: Bringing up secondary CPUs ... client # [ 0.291619] smp: Brought up 1 node, 1 CPU client # [ 0.292320] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.302183] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.322055] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.292768] Memory: 1454600K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker1 # [ 0.303704] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.293919] devtmpfs: initialized worker2 # [ 0.322807] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.288966] smp: Bringing up secondary CPUs ... worker1 # [ 0.304432] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.289401] smp: Brought up 1 node, 1 CPU client # [ 0.294792] x86/mm: Memory block size: 128MB lb # [ 0.290087] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.305681] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.306416] audit: initializing netlink subsys (disabled) client # [ 0.296576] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.290554] Memory: 1454572K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) worker1 # [ 0.307549] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.297512] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.307551] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.291647] devtmpfs: initialized worker2 # [ 0.327807] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.298681] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.308408] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.292499] x86/mm: Memory block size: 128MB worker2 # [ 0.328807] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.299714] PM: RTC time: 15:59:29, date: 2026-09-23 worker1 # [ 0.309302] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.294255] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.310097] audit: type=2000 audit(1790179170.402:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.311410] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.295314] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.311432] cpuidle: using governor menu client # [ 0.303280] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.296464] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.313630] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.297645] PM: RTC time: 15:59:29, date: 2026-09-23 client # [ 0.304107] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.304629] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.314681] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.315410] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.305885] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.316419] PCI: Using configuration type 1 for base access lb # [ 0.301099] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.306615] audit: initializing netlink subsys (disabled) worker2 # [ 0.339126] ACPI: Added _OSI(Module Device) worker2 # [ 0.339808] ACPI: Added _OSI(Processor Device) worker1 # [ 0.317507] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.307607] audit: type=2000 audit(1790179170.414:1): state=initialized audit_enabled=0 res=1 lb # [ 0.301897] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.340536] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.308752] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.302409] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.308754] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.303658] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.309606] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.304397] audit: initializing netlink subsys (disabled) client # [ 0.310606] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.305580] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.311587] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.312403] cpuidle: using governor menu lb # [ 0.305582] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.306387] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.324662] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.314147] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.346767] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.325408] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.307389] audit: type=2000 audit(1790179170.419:1): state=initialized audit_enabled=0 res=1 client # [ 0.314831] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.309389] thermal_sys: Registered thermal governor 'user_space' client # [ 0.315608] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.309391] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.316617] PCI: Using configuration type 1 for base access lb # [ 0.310389] cpuidle: using governor menu lb # [ 0.312620] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.317743] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.330408] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.353210] ACPI: Interpreter enabled worker1 # [ 0.331409] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.313626] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.353823] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.314390] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.354558] ACPI: Using IOAPIC for interrupt routing lb # [ 0.315398] PCI: Using configuration type 1 for base access worker2 # [ 0.354884] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.316529] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.355807] PCI: Using E820 reservations for host bridge windows client # [ 0.324619] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.325605] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.358952] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.340011] ACPI: Added _OSI(Module Device) lb # [ 0.321467] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.340409] ACPI: Added _OSI(Processor Device) lb # [ 0.322387] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.341164] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.330607] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.331606] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.327388] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.367583] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.328386] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.368621] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.347984] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.370419] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.370929] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.351332] ACPI: Interpreter enabled worker2 # [ 0.372157] PCI host bridge to bus 0000:00 worker1 # [ 0.351872] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.372811] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.352408] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.373807] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.342832] ACPI: Added _OSI(Module Device) worker1 # [ 0.353282] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.343566] ACPI: Added _OSI(Processor Device) worker2 # [ 0.374807] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.344144] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.375807] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.338731] ACPI: Added _OSI(Module Device) lb # [ 0.339388] ACPI: Added _OSI(Processor Device) worker2 # [ 0.376807] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.340122] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.377812] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.358408] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.378832] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.359536] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.379855] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.350118] ACPI: 1 ACPI AML tables successfully acquired and loaded worker2 # [ 0.381248] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.354014] ACPI: Interpreter enabled client # [ 0.354620] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.346376] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.355327] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.368100] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.383860] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.368771] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.352827] ACPI: Interpreter enabled client # [ 0.357653] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.384818] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.353402] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.358605] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.369484] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.354096] ACPI: Using IOAPIC for interrupt routing worker2 # [ 0.385761] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.370530] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.371809] PCI host bridge to bus 0000:00 worker2 # [ 0.386773] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.361657] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.372412] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.356444] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.373408] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.388526] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.357388] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.374408] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.375407] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.391849] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.360464] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.376407] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.392695] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.377408] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.393550] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.378408] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.369123] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.393812] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.379382] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.369611] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.395319] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.370683] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.380841] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.371736] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.367961] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) client # [ 0.372953] PCI host bridge to bus 0000:00 worker2 # [ 0.397848] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.373610] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.368394] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.398718] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.374605] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.399558] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.369465] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.375605] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] lb # [ 0.370518] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.400482] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.376605] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.371761] PCI host bridge to bus 0000:00 worker1 # [ 0.383492] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.377605] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.372391] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker1 # [ 0.384419] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.373387] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.378605] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.385377] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.379605] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.374386] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.380569] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.375386] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.386356] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker2 # [ 0.404154] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.376387] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.382052] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.405709] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.388316] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.377392] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.406645] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.378387] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.379377] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.408393] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.391437] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.392329] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.380880] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.393161] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.410760] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.393413] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.411531] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.384694] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] client # [ 0.385617] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.411829] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.394976] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.386552] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.412813] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.414374] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.387644] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.398399] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.399024] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.383475] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.415848] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.399429] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.384399] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.389593] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.416823] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] lb # [ 0.385353] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.400986] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.418404] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.386348] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.392643] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.393512] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.388114] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.394399] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.420310] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.395481] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.404261] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.420854] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.405056] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.391426] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.405430] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.422398] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.396941] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.392302] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.393147] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.406958] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.423695] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.394231] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.424508] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.400641] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.401596] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.409305] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.425381] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.395786] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.402364] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.410012] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.410429] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.403202] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.426819] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.398424] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.411413] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.427829] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.399301] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.400174] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.413010] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.429385] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.401855] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.405972] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.414420] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.430824] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.407263] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker2 # [ 0.431674] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.415375] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.407627] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.432562] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.416781] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.409181] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.404395] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.433383] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.406040] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.406433] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.418444] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.411528] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.435696] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.412261] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.419430] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.407933] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.436459] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.412627] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.436828] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.420972] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.409424] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.413611] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.438411] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.410338] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.422447] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.411144] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker2 # [ 0.439463] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.415185] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.423429] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.411392] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.440031] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.424989] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.416648] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.441421] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.412931] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.417628] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.442425] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.426420] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.419201] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.414388] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.427429] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.443375] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] lb # [ 0.415356] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.428963] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.416849] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.420649] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.421664] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.418399] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.431230] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.423170] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.432080] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.419392] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.432430] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.424618] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.420994] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.425627] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.433979] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.422407] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.427173] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.423409] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker1 # [ 0.436140] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.444031] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.436414] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.424948] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.428648] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.437371] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.446333] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] client # [ 0.430337] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] lb # [ 0.426400] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.447115] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.438789] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.431144] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.427348] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.448101] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.440164] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.449216] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.428948] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.440609] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.433474] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.434278] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.450713] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] lb # [ 0.430404] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker1 # [ 0.442920] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.451486] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] client # [ 0.434627] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.431221] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.443617] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.452126] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.432143] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.436144] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.445113] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.453437] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.432955] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.438402] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.439345] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.435359] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker2 # [ 0.457226] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.439627] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.436091] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.457910] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.436408] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.458907] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.441224] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.459906] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.437982] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.442414] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.460937] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.461908] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.439118] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.443460] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.462908] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.439606] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.463904] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.445455] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.441027] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.464847] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.445625] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.446440] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.465818] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.448174] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.441580] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.466820] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.448359] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.467821] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.448682] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.443060] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.468823] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.449887] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.469822] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.470821] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker1 # [ 0.450702] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.471819] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker1 # [ 0.452435] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.474161] iommu: Default domain type: Translated worker1 # [ 0.453340] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.474820] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.476118] ACPI: bus type USB registered worker1 # [ 0.454502] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.476880] usbcore: registered new interface driver usbfs worker1 # [ 0.456116] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.477817] usbcore: registered new interface driver hub worker2 # [ 0.478710] usbcore: registered new device driver usb worker2 # [ 0.480427] NetLabel: Initializing client # [ 0.448862] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.443642] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.480808] NetLabel: domain hash size = 128 worker2 # [ 0.481530] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.451399] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.459923] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.446020] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.481899] NetLabel: unlabeled traffic allowed by default worker1 # [ 0.460516] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.482794] PCI: Using ACPI for IRQ routing client # [ 0.452553] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.446628] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.461508] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.462503] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.453883] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.447671] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.463508] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.454903] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.448655] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.464503] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.465507] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.456633] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] lb # [ 0.450410] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.466511] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.457465] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.451240] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.467449] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 lb # [ 0.452424] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.458688] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.468424] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.469422] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.454088] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] client # [ 0.460344] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.470419] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.471422] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker1 # [ 0.472420] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.473419] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.457450] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.463703] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.474421] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.458492] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.464710] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.459483] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.476450] iommu: Default domain type: Translated client # [ 0.465703] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 lb # [ 0.460494] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.477240] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.466728] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.478421] ACPI: bus type USB registered lb # [ 0.461487] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.467731] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.479182] usbcore: registered new interface driver usbfs lb # [ 0.462484] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.468704] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.479420] usbcore: registered new interface driver hub lb # [ 0.463488] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.480304] usbcore: registered new device driver usb client # [ 0.469704] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.464488] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.470725] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.481852] NetLabel: Initializing lb # [ 0.465423] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.482409] NetLabel: domain hash size = 128 client # [ 0.471647] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.483148] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.466389] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.472608] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.483447] NetLabel: unlabeled traffic allowed by default lb # [ 0.467401] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.473570] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.484332] PCI: Using ACPI for IRQ routing lb # [ 0.468400] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.474338] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.469404] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.474617] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.470395] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.475618] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.471401] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.476586] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.472363] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.477385] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.474266] iommu: Default domain type: Translated client # [ 0.478665] iommu: Default domain type: Translated lb # [ 0.474995] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.479497] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.475696] ACPI: bus type USB registered client # [ 0.480704] ACPI: bus type USB registered lb # [ 0.476445] usbcore: registered new interface driver usbfs client # [ 0.481471] usbcore: registered new interface driver usbfs lb # [ 0.477379] usbcore: registered new interface driver hub client # [ 0.482317] usbcore: registered new interface driver hub lb # [ 0.478097] usbcore: registered new device driver usb client # [ 0.482615] usbcore: registered new device driver usb lb # [ 0.479200] NetLabel: Initializing client # [ 0.484697] NetLabel: Initializing lb # [ 0.479866] NetLabel: domain hash size = 128 client # [ 0.485375] NetLabel: domain hash size = 128 lb # [ 0.480386] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.485605] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.481482] NetLabel: unlabeled traffic allowed by default client # [ 0.486654] NetLabel: unlabeled traffic allowed by default lb # [ 0.482528] PCI: Using ACPI for IRQ routing client # [ 0.487598] PCI: Using ACPI for IRQ routing worker2 # [ 0.527086] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.527803] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.527803] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.527813] vgaarb: loaded worker2 # [ 0.528654] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.529464] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.533921] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.538015] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.538769] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.540225] pnp: PnP ACPI init worker2 # [ 0.541088] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.542096] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.543703] pnp: PnP ACPI: found 5 devices worker1 # [ 0.528333] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.528403] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.528403] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.551486] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.528412] vgaarb: loaded worker2 # [ 0.552941] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.529184] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.553969] NET: Registered PF_INET protocol family worker1 # [ 0.529408] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.555216] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.533497] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.537175] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.537851] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.539268] pnp: PnP ACPI init worker1 # [ 0.540079] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.532246] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.527831] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.541038] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.532601] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.528383] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.542535] pnp: PnP ACPI: found 5 devices client # [ 0.532601] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.532610] vgaarb: loaded lb # [ 0.528383] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.528394] vgaarb: loaded client # [ 0.533333] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 lb # [ 0.529219] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.533605] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.530044] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.572555] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.574219] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.575609] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.533503] clocksource: Switched to clocksource kvm-clock client # [ 0.537687] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.550162] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.576960] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.551572] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.578235] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.552558] NET: Registered PF_INET protocol family worker2 # [ 0.579392] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.537290] VFS: Disk quotas dquot_6.6.0 client # [ 0.541294] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.553761] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.541983] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.580673] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.538048] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.543327] pnp: PnP ACPI init lb # [ 0.539488] pnp: PnP ACPI init worker2 # [ 0.581748] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.544108] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.540387] ACPI: IRQ 4 override to edge(!), high(!) worker2 # [ 0.583036] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.584103] NET: Registered PF_XDP protocol family client # [ 0.545026] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.541433] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.584925] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.546538] pnp: PnP ACPI: found 5 devices lb # [ 0.542953] pnp: PnP ACPI: found 5 devices worker2 # [ 0.585959] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.587026] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker2 # [ 0.588215] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.589373] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.590537] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.592432] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.554159] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.550665] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.555596] clocksource: Switched to clocksource acpi_pm lb # [ 0.552116] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.594992] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.556641] NET: Registered PF_INET protocol family lb # [ 0.553150] NET: Registered PF_INET protocol family worker1 # [ 0.570251] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.596950] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.557841] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.554402] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.571767] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.598910] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker1 # [ 0.573133] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.600845] PCI: CLS 0 bytes, default 64 worker1 # [ 0.574524] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.575774] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.601764] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.576926] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.603563] Trying to unpack rootfs image as initramfs... worker1 # [ 0.578224] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.579401] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.580665] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.581679] NET: Registered PF_XDP protocol family worker1 # [ 0.582616] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.583665] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.584719] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.585876] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.587056] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.574540] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.571231] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.588174] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.576041] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.589827] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.572741] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.577363] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.574033] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.578695] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.592544] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.579895] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.576335] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.581068] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.594477] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.578076] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.582340] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.583417] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.596466] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.579342] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.584601] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.580647] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.598120] PCI: CLS 0 bytes, default 64 client # [ 0.585547] NET: Registered PF_XDP protocol family lb # [ 0.581829] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.599030] Trying to unpack rootfs image as initramfs... client # [ 0.586394] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.583136] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.587406] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.584133] NET: Registered PF_XDP protocol family client # [ 0.588399] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.585015] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.589531] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.586086] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.590637] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.587159] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.603213] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.591682] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.588238] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.593399] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.589374] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.590505] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.596051] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.592446] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.598133] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.595402] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.600060] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.597387] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.601773] PCI: CLS 0 bytes, default 64 lb # [ 0.599379] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.602638] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.604396] Trying to unpack rootfs image as initramfs... lb # [ 0.601025] PCI: CLS 0 bytes, default 64 lb # [ 0.601991] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.603841] Trying to unpack rootfs image as initramfs... worker2 # [ 0.649409] Initialise system trusted keyrings worker2 # [ 0.652259] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.644342] Initialise system trusted keyrings worker1 # [ 0.645331] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.672572] Key type asymmetric registered worker2 # [ 0.675211] Asymmetric key parser 'x509' registered worker2 # [ 0.676116] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.679415] io scheduler mq-deadline registered worker2 # [ 0.682210] io scheduler kyber registered worker2 # [ 0.683685] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.685020] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.648044] Initialise system trusted keyrings client # [ 0.651148] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.664882] Key type asymmetric registered worker2 # [ 0.691204] Linux agpgart interface v0.103 worker2 # [ 0.691993] ACPI: bus type drm_connector registered lb # [ 0.649530] Initialise system trusted keyrings worker2 # [ 0.694719] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.669937] Asymmetric key parser 'x509' registered lb # [ 0.653116] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker2 # [ 0.695897] usbserial: USB Serial support registered for generic worker1 # [ 0.670729] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.698216] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.698216] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.674071] io scheduler mq-deadline registered worker1 # [ 0.674833] io scheduler kyber registered worker2 # [ 0.700556] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.677457] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.678763] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.706372] drop_monitor: Initializing network drop monitor service worker2 # [ 0.707704] NET: Registered PF_INET6 protocol family worker1 # [ 0.684709] Linux agpgart interface v0.103 worker2 # [ 0.710727] Segment Routing with IPv6 client # [ 0.672433] Key type asymmetric registered worker1 # [ 0.685478] ACPI: bus type drm_connector registered client # [ 0.675116] Asymmetric key parser 'x509' registered worker2 # [ 0.714221] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.688399] usbcore: registered new interface driver usbserial_generic client # [ 0.676002] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.715344] IPI shorthand broadcast: enabled worker1 # [ 0.689523] usbserial: USB Serial support registered for generic lb # [ 0.674406] Key type asymmetric registered lb # [ 0.675195] Asymmetric key parser 'x509' registered client # [ 0.679254] io scheduler mq-deadline registered client # [ 0.680023] io scheduler kyber registered worker1 # [ 0.691942] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.691942] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.694232] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.678091] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.682688] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.683952] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.681116] io scheduler mq-deadline registered worker2 # [ 0.723577] sched_clock: Marking stable (587014756, 136174859)->(794655217, -71465602) lb # [ 0.681898] io scheduler kyber registered worker1 # [ 0.700060] drop_monitor: Initializing network drop monitor service worker1 # [ 0.701315] NET: Registered PF_INET6 protocol family lb # [ 0.684748] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.728449] registered taskstats version 1 client # [ 0.689876] Linux agpgart interface v0.103 client # [ 0.690650] ACPI: bus type drm_connector registered worker2 # [ 0.729477] Loading compiled-in X.509 certificates worker1 # [ 0.704420] Segment Routing with IPv6 lb # [ 0.688078] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.693551] usbcore: registered new interface driver usbserial_generic client # [ 0.694706] usbserial: USB Serial support registered for generic worker1 # [ 0.707943] In-situ OAM (IOAM) with IPv6 lb # [ 0.691837] Linux agpgart interface v0.103 worker1 # [ 0.708990] IPI shorthand broadcast: enabled lb # [ 0.692644] ACPI: bus type drm_connector registered client # [ 0.698117] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.698117] Please enable it if your BIOS has the CPPC option. lb # [ 0.695527] usbcore: registered new interface driver usbserial_generic lb # [ 0.696642] usbserial: USB Serial support registered for generic client # [ 0.700465] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.703271] drop_monitor: Initializing network drop monitor service lb # [ 0.699075] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.704454] NET: Registered PF_INET6 protocol family lb # [ 0.699075] Please enable it if your BIOS has the CPPC option. worker1 # [ 0.717190] sched_clock: Marking stable (582014082, 134903716)->(791170804, -74253006) lb # [ 0.701359] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled client # [ 0.707580] Segment Routing with IPv6 worker2 # [ 0.747204] Demotion targets for Node 0: null worker1 # [ 0.722011] registered taskstats version 1 client # [ 0.710132] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.722992] Loading compiled-in X.509 certificates lb # [ 0.706226] drop_monitor: Initializing network drop monitor service client # [ 0.711166] IPI shorthand broadcast: enabled lb # [ 0.707411] NET: Registered PF_INET6 protocol family worker2 # [ 0.750246] Key type .fscrypt registered worker2 # [ 0.750903] Key type fscrypt-provisioning registered worker2 # [ 0.751919] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.710569] Segment Routing with IPv6 worker2 # [ 0.754222] ima: Allocated hash algorithm: sha1 worker2 # [ 0.755040] ima: No architecture policies found lb # [ 0.713082] In-situ OAM (IOAM) with IPv6 lb # [ 0.714244] IPI shorthand broadcast: enabled client # [ 0.719489] sched_clock: Marking stable (584014827, 135076974)->(794514097, -75422296) worker2 # [ 0.759202] PM: Magic number: 10:780:993 worker2 # [ 0.760975] RAS: Correctable Errors collector initialized. client # [ 0.724195] registered taskstats version 1 client # [ 0.725200] Loading compiled-in X.509 certificates worker1 # [ 0.739353] Demotion targets for Node 0: null lb # [ 0.722804] sched_clock: Marking stable (588017467, 134039795)->(795372993, -73315731) worker1 # [ 0.742964] Key type .fscrypt registered lb # [ 0.726282] registered taskstats version 1 worker1 # [ 0.743616] Key type fscrypt-provisioning registered worker2 # [ 0.769962] clk: Disabling unused clocks lb # [ 0.727321] Loading compiled-in X.509 certificates worker1 # [ 0.744605] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.772221] PM: genpd: Disabling unused power domains worker1 # [ 0.746941] ima: Allocated hash algorithm: sha1 worker1 # [ 0.747725] ima: No architecture policies found worker1 # [ 0.749930] PM: Magic number: 10:780:993 worker1 # [ 0.751616] RAS: Correctable Errors collector initialized. client # [ 0.743104] Demotion targets for Node 0: null client # [ 0.746145] Key type .fscrypt registered client # [ 0.746837] Key type fscrypt-provisioning registered worker1 # [ 0.760605] clk: Disabling unused clocks client # [ 0.747832] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.746077] Demotion targets for Node 0: null client # [ 0.750108] ima: Allocated hash algorithm: sha1 client # [ 0.750899] ima: No architecture policies found worker1 # [ 0.764950] PM: genpd: Disabling unused power domains lb # [ 0.749110] Key type .fscrypt registered lb # [ 0.749838] Key type fscrypt-provisioning registered lb # [ 0.750824] ima: No TPM chip found, activating TPM-bypass! client # [ 0.755109] PM: Magic number: 10:780:993 client # [ 0.756688] RAS: Correctable Errors collector initialized. lb # [ 0.753077] ima: Allocated hash algorithm: sha1 lb # [ 0.753907] ima: No architecture policies found lb # [ 0.758068] PM: Magic number: 10:780:993 lb # [ 0.759815] RAS: Correctable Errors collector initialized. client # [ 0.765815] clk: Disabling unused clocks client # [ 0.768212] PM: genpd: Disabling unused power domains lb # [ 0.768856] clk: Disabling unused clocks lb # [ 0.771077] PM: genpd: Disabling unused power domains worker2 # [ 0.940673] Freeing initrd memory: 29060K worker2 # [ 0.944207] Freeing unused decrypted memory: 2028K worker2 # [ 0.947152] Freeing unused kernel image (initmem) memory: 3652K worker2 # [ 0.948302] Write protecting the kernel read-only data: 32768k worker2 # [ 0.950301] Freeing unused kernel image (text/rodata gap) memory: 1184K worker2 # [ 0.951893] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.928127] Freeing initrd memory: 29056K worker1 # [ 0.931272] Freeing unused decrypted memory: 2028K worker1 # [ 0.933937] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.935030] Write protecting the kernel read-only data: 32768k worker1 # [ 0.936898] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.938462] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.931496] Freeing initrd memory: 29056K client # [ 0.934691] Freeing unused decrypted memory: 2028K client # [ 0.937315] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.938455] Write protecting the kernel read-only data: 32768k lb # [ 0.936249] Freeing initrd memory: 29064K client # [ 0.940343] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.941860] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.939618] Freeing unused decrypted memory: 2028K lb # [ 0.942455] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.943597] Write protecting the kernel read-only data: 32768k lb # [ 0.945536] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.947106] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 1.002949] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 1.004140] Run /init as init process worker2 # [ 1.016013] systemd[1]: Inserted module 'autofs4' worker1 # [ 0.990737] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.991870] Run /init as init process worker1 # [ 1.002670] systemd[1]: Inserted module 'autofs4' client # [ 0.992899] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.994014] Run /init as init process worker2 # [ 1.036249] fuse: init (API version 7.45) lb # [ 0.998159] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.999289] Run /init as init process client # [ 1.004840] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.043823] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.046263] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.022491] fuse: init (API version 7.45) worker2 # [ 1.049428] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.051415] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.010762] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.029946] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.056542] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.032388] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.058129] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker1 # [ 1.035476] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.024641] fuse: init (API version 7.45) worker1 # [ 1.037519] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.065511] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.067250] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 1.043014] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.070469] virtiofs virtio7: discovered new tag: xchg client # [ 1.032030] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.044524] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.071911] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.034521] ACPI: \_SB_.GSIH: Enabled at IRQ 23 lb # [ 1.030772] fuse: init (API version 7.45) client # [ 1.037636] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.051326] virtiofs virtio6: discovered new tag: shared client # [ 1.039679] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.052847] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.038295] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.056435] virtiofs virtio7: discovered new tag: xchg client # [ 1.044782] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.041414] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.058003] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.046394] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.044619] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.046862] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.091104] systemd[1]: Successfully made /usr/ read-only. client # [ 1.053565] virtiofs virtio6: discovered new tag: shared client # [ 1.055365] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.052575] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.054458] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.058739] virtiofs virtio7: discovered new tag: xchg client # [ 1.060234] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.077648] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.062563] virtiofs virtio6: discovered new tag: shared lb # [ 1.064108] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.067755] virtiofs virtio7: discovered new tag: xchg lb # [ 1.069487] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.080895] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.091076] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.427712] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.439774] systemd[1]: Detected virtualization kvm. worker2 # [ 1.441953] systemd[1]: Detected architecture x86-64. worker1 # [ 1.413323] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.418387] systemd[1]: Detected virtualization kvm. worker2 # [ 1.444078] systemd[1]: Running in initrd. worker1 # [ 1.419247] systemd[1]: Detected architecture x86-64. worker1 # [ 1.420104] systemd[1]: Running in initrd. worker1 # [ 1.421183] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.446662] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.422457] systemd[1]: Hostname set to . worker2 # [ 1.449582] systemd[1]: Hostname set to . client # [ 1.417389] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.429417] systemd[1]: Detected virtualization kvm. client # [ 1.431520] systemd[1]: Detected architecture x86-64. client # [ 1.433629] systemd[1]: Running in initrd. client # [ 1.436167] systemd[1]: Initializing machine ID from random generator. client # [ 1.438973] systemd[1]: Hostname set to . lb # [ 1.427732] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.439712] systemd[1]: Detected virtualization kvm. lb # [ 1.441880] systemd[1]: Detected architecture x86-64. lb # [ 1.444087] systemd[1]: Running in initrd. lb # [ 1.446565] systemd[1]: Initializing machine ID from random generator. lb # [ 1.449440] systemd[1]: Hostname set to . worker1 # [ 1.605224] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.642707] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.647184] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.648424] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.649891] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.674830] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.651072] systemd[1]: Reached target Path Units. worker1 # [ 1.651941] systemd[1]: Reached target Slice Units. worker1 # [ 1.652804] systemd[1]: Reached target Swaps. worker1 # [ 1.653612] systemd[1]: Reached target Timer Units. worker1 # [ 1.654605] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.655871] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.657069] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.658099] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.659188] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.660201] systemd[1]: Reached target Socket Units. worker1 # [ 1.661983] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.665744] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.661723] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.675313] systemd[1]: Starting Journal Service... lb # [ 1.674293] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.697111] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.729272] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.703070] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.732576] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.708096] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.733815] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.735230] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.736387] systemd[1]: Reached target Path Units. worker2 # [ 1.737346] systemd[1]: Reached target Slice Units. worker2 # [ 1.738244] systemd[1]: Reached target Swaps. worker2 # [ 1.739039] systemd[1]: Reached target Timer Units. worker2 # [ 1.740054] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.741315] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.742597] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.743629] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.744709] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.745725] systemd[1]: Reached target Socket Units. worker2 # [ 1.747597] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.722240] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.725320] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.752262] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.714363] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.729181] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.718360] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.719584] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.721018] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.722192] systemd[1]: Reached target Path Units. client # [ 1.723103] systemd[1]: Reached target Slice Units. client # [ 1.723994] systemd[1]: Reached target Swaps. client # [ 1.724799] systemd[1]: Reached target Timer Units. worker1 # [ 1.738291] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.725794] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.727046] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.728285] systemd[1]: Listening on Journal Sockets. client # [ 1.729350] systemd[1]: Listening on udev Control Socket. client # [ 1.730407] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.742344] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.731397] systemd[1]: Reached target Socket Units. lb # [ 1.728303] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.733278] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.761882] systemd[1]: Starting Journal Service... lb # [ 1.732407] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.737172] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.733572] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.734946] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.736028] systemd[1]: Reached target Path Units. lb # [ 1.736897] systemd[1]: Reached target Slice Units. lb # [ 1.737756] systemd[1]: Reached target Swaps. lb # [ 1.738523] systemd[1]: Reached target Timer Units. worker1 # [ 1.755010] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.739447] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.740622] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.741775] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.784389] systemd[1]: Starting Load Kernel Modules... lb # [ 1.742726] systemd[1]: Listening on udev Control Socket. lb # [ 1.743688] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.744593] systemd[1]: Reached target Socket Units. worker1 # [ 1.760408] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.746354] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.791328] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.750131] systemd[1]: Starting Load Kernel Module configfs... client # [ 1.745680] systemd[1]: Starting Journal Service... worker2 # [ 1.796375] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.771072] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.809747] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.771281] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.811147] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.759131] systemd[1]: Starting Journal Service... client # [ 1.775201] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.817152] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.793464] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.783336] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.823591] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.784126] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.802120] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.829073] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.788226] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.794452] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.796342] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.813985] systemd[1]: Finished Load Kernel Modules. lb # [ 1.797528] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.803557] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.843260] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.820140] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.804634] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.809478] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.848426] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.812155] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.816508] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.815770] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.859409] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.822466] systemd[1]: Finished Load Kernel Module configfs. client # [ 1.828191] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.841484] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.827445] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.831997] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.847566] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.714450] systemd-modules-load[67]: Inserted module 'dm_mod' worker1 # [ 1.718265] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker1 # [ 1.719254] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker1 # [ 1.855639] systemd[1]: Reached target Local File Systems. lb # [ 1.840183] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.883780] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.845307] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.860112] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.866084] systemd[1]: Started Journal Service. lb # [ 1.848383] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.736216] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.897287] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.858097] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.867755] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.747151] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.908315] systemd[1]: Finished Load Kernel Modules. client # [ 1.876290] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.915539] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.877616] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.888256] systemd[1]: Finished Load Kernel Modules. lb # [ 1.887284] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.772372] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.798253] systemd-modules-load[67]: Inserted module 'dm_mod' client # [ 1.896377] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.799532] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker2 # [ 1.936739] systemd[1]: Started Journal Service. worker2 # [ 1.802401] systemd-modules-load[67]: Inserted module 'virtio_gpu' lb # [ 1.899123] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.807925] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.784244] systemd-udevd[74]: Using default interface naming scheme 'v261'. worker2 # [ 1.814880] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.909156] systemd[1]: Starting Apply Kernel Variables... client # [ 1.915007] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.818121] systemd[1]: Reached target Local File Systems. worker2 # [ 1.819132] systemd[1]: Starting Create System Files and Directories... client # [ 1.782749] systemd-modules-load[68]: Inserted module 'dm_mod' client # [ 1.787380] systemd-modules-load[68]: Inserted module 'virtio_balloon' client # [ 1.788499] systemd-modules-load[68]: Inserted module 'virtio_gpu' client # [ 1.925346] systemd[1]: Started Journal Service. worker2 # [ 1.828077] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.806856] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.833069] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.791861] systemd-modules-load[67]: Inserted module 'dm_mod' lb # [ 1.794210] systemd-modules-load[67]: Inserted module 'virtio_balloon' lb # [ 1.929190] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.798827] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.797330] systemd-modules-load[67]: Inserted module 'virtio_gpu' client # [ 1.801676] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.803082] systemd[1]: Reached target Local File Systems. lb # [ 1.934301] systemd[1]: Started Journal Service. client # [ 1.805257] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.850280] systemd[1]: Finished Create System Files and Directories. lb # [ 1.809843] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.813082] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.812830] systemd[1]: Reached target Local File Systems. lb # [ 1.814157] systemd[1]: Starting Create System Files and Directories... lb # [ 1.821613] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.825680] systemd[1]: Finished Apply Kernel Variables. client # [ 1.835951] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.877263] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 1.861518] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 1.863138] systemd[1]: Reached target System Initialization. worker1 # [ 1.863955] systemd[1]: Reached target Basic System. lb # [ 1.848177] systemd[1]: Finished Create System Files and Directories. client # [ 1.858918] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker2 # [ 1.900782] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.871793] systemd-udevd[81]: Using default interface naming scheme 'v261'. client # [ 1.882512] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.897076] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.955623] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.956646] systemd[1]: Reached target System Initialization. worker2 # [ 1.958240] systemd[1]: Reached target Basic System. client # [ 1.935917] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.936776] systemd[1]: Reached target System Initialization. client # [ 1.937578] systemd[1]: Reached target Basic System. lb # [ 1.952981] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.953961] systemd[1]: Reached target System Initialization. lb # [ 1.954891] systemd[1]: Reached target Basic System. worker1 # [ 2.182507] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.186543] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.191576] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.195830] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.205879] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.206754] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.208488] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.209853] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.217464] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.219192] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker1 # [ 2.220328] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.223922] usb usb1: Product: EHCI Host Controller worker1 # [ 2.224603] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.226655] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.228384] hub 1-0:1.0: USB hub found worker1 # [ 2.229935] hub 1-0:1.0: 6 ports detected worker1 # [ 2.236289] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker1 # [ 2.237061] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.250951] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.251699] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.260451] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.288363] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.291108] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.292866] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.256863] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.299277] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.273930] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.266627] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.283278] usb usb2: Product: UHCI Host Controller worker1 # [ 2.149520] systemd[1]: Starting Virtual Console Setup... client # [ 2.271865] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.314820] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.153256] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.277341] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.315732] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.278033] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.317918] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.157468] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.276822] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.320700] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.297067] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.297867] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.164247] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.283184] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 2.327621] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.328547] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.286766] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker2 # [ 2.331139] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.332136] usb usb1: Product: EHCI Host Controller client # [ 2.294726] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.291578] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.295647] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 lb # [ 2.292280] serio: i8042 AUX port at 0x60,0x64 irq 12 worker2 # [ 2.335194] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker2 # [ 2.335946] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.297407] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.338114] hub 1-0:1.0: USB hub found worker2 # [ 2.339225] hub 1-0:1.0: 6 ports detected lb # [ 2.297091] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.314243] hub 2-0:1.0: USB hub found lb # [ 2.297964] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.341524] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.299684] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.342341] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.305289] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.306470] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.307596] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.322083] SCSI subsystem initialized client # [ 2.310936] usb usb1: Product: EHCI Host Controller client # [ 2.311724] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.308079] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 lb # [ 2.309015] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.313461] usb usb1: SerialNumber: 0000:00:1d.7 worker1 # [ 2.326218] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.327783] hub 2-0:1.0: 2 ports detected client # [ 2.315052] hub 1-0:1.0: USB hub found lb # [ 2.311565] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.316527] hub 1-0:1.0: 6 ports detected worker2 # [ 2.356777] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.195442] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.197121] systemd[1]: Finished Virtual Console Setup. lb # [ 2.315246] usb usb1: Product: EHCI Host Controller client # [ 2.319723] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.315995] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.317198] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.360587] SCSI subsystem initialized lb # [ 2.319199] hub 1-0:1.0: USB hub found client # [ 2.323303] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.320951] hub 1-0:1.0: 6 ports detected worker2 # [ 2.365398] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.325526] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.332675] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.333464] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.347171] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker1 # [ 2.347872] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.374066] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.333857] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.336393] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.356110] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.356869] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.384142] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.345192] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.349228] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.350364] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.362947] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.364108] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.230261] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.233066] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.233828] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.396591] usb usb2: Product: UHCI Host Controller lb # [ 2.355489] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.356608] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.262970] (udev-worker)[89]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.376147] usb usb3: Product: UHCI Host Controller worker2 # [ 2.265919] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.376864] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.365020] SCSI subsystem initialized worker1 # [ 2.377973] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.232221] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.271077] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.381992] hub 3-0:1.0: USB hub found worker1 # [ 2.385939] hub 3-0:1.0: 2 ports detected worker2 # [ 2.413424] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.376122] usb usb2: Product: UHCI Host Controller worker2 # [ 2.415339] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.376775] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.416061] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.393186] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.377062] usb usb2: Product: UHCI Host Controller client # [ 2.245453] (udev-worker)[87]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.377898] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.284818] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.394989] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.398074] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.398825] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.402130] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.253146] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.388431] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.404993] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.432976] hub 2-0:1.0: USB hub found worker1 # [ 2.407976] usb usb4: Product: UHCI Host Controller lb # [ 2.391778] SCSI subsystem initialized worker1 # [ 2.408656] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.260069] systemd[1]: Starting Virtual Console Setup... client # [ 2.263125] (udev-worker)[87]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.411256] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.438249] hub 2-0:1.0: 2 ports detected client # [ 2.265261] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.281185] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.402146] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.419399] hub 4-0:1.0: USB hub found worker2 # [ 2.308941] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.270986] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.272922] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.288066] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.313124] systemd[1]: Finished Virtual Console Setup. client # [ 2.411188] usb usb2: SerialNumber: 0000:00:1d.0 worker1 # [ 2.424591] hub 4-0:1.0: 2 ports detected client # [ 2.413715] hub 2-0:1.0: USB hub found client # [ 2.417110] hub 2-0:1.0: 2 ports detected lb # [ 2.277860] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.279890] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.416190] hub 2-0:1.0: USB hub found client # [ 2.421267] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.461245] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.462120] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.469921] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.431088] hub 2-0:1.0: 2 ports detected worker2 # [ 2.474365] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.298254] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.304343] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.301371] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.478257] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.479429] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.306120] systemd[1]: Reached target Initrd Root Device. client # [ 2.442043] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.442812] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.346064] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.456523] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.346934] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.457693] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.310075] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.348333] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.461733] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.452488] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.492014] usb usb3: Product: UHCI Host Controller client # [ 2.453324] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.492759] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.450549] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.493707] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.467945] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.451293] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.471249] scsi host0: ahci worker1 # [ 2.473207] scsi host1: ahci client # [ 2.461220] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.474828] scsi host2: ahci worker2 # [ 2.501540] hub 3-0:1.0: USB hub found worker1 # [ 2.476550] scsi host3: ahci worker2 # [ 2.503680] hub 3-0:1.0: 2 ports detected worker1 # [ 2.478240] scsi host4: ahci worker1 # [ 2.479740] scsi host5: ahci client # [ 2.466619] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.467890] usb usb3: Product: UHCI Host Controller worker1 # [ 2.480800] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.468821] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.465325] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.469646] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.482480] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.509295] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.483670] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 lb # [ 2.467429] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.510037] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.484829] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.472716] hub 3-0:1.0: USB hub found lb # [ 2.335338] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.485995] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.513043] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.336402] systemd[1]: Reached target Initrd Root Device. worker1 # [ 2.487166] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.475168] hub 3-0:1.0: 2 ports detected lb # [ 2.340146] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.480416] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.476198] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.481236] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.520493] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.386331] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.480097] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.525346] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.487187] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.488024] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.526699] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.354697] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.486088] usb usb3: Product: UHCI Host Controller lb # [ 2.486808] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.394406] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.490078] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.360464] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.534711] usb usb4: Product: UHCI Host Controller worker2 # [ 2.535708] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.496734] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.497911] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.538306] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.496208] hub 3-0:1.0: USB hub found lb # [ 2.497529] hub 3-0:1.0: 2 ports detected worker2 # [ 2.540281] hub 4-0:1.0: USB hub found worker2 # [ 2.542253] hub 4-0:1.0: 2 ports detected client # [ 2.504271] usb usb4: Product: UHCI Host Controller worker2 # [ 2.543134] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.505018] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.502143] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.507156] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.502910] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.509592] hub 4-0:1.0: USB hub found worker2 # [ 2.549587] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.507337] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.511514] hub 4-0:1.0: 2 ports detected lb # [ 2.510921] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.380380] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.557758] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.515555] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.516750] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.388435] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.524624] usb usb4: Product: UHCI Host Controller lb # [ 2.525809] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.568848] scsi host0: ahci worker2 # [ 2.572248] scsi host1: ahci lb # [ 2.530078] usb usb4: SerialNumber: 0000:00:1d.2 client # [ 2.534987] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.531708] hub 4-0:1.0: USB hub found worker2 # [ 2.574962] scsi host2: ahci lb # [ 2.533113] hub 4-0:1.0: 2 ports detected worker2 # [ 2.578214] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.580037] scsi host3: ahci client # [ 2.541581] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.582216] scsi host4: ahci client # [ 2.544878] ahci 0000:00:1f.2: flags: 64bit ncq only worker2 # [ 2.585880] scsi host5: ahci worker2 # [ 2.588228] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.550873] scsi host0: ahci client # [ 2.551549] scsi host1: ahci client # [ 2.553875] scsi host2: ahci worker2 # [ 2.592640] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.555107] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.593882] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.556809] scsi host3: ahci worker2 # [ 2.595072] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.596265] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.558486] scsi host4: ahci worker2 # [ 2.597431] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 client # [ 2.560105] scsi host5: ahci client # [ 2.560643] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 client # [ 2.562725] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.564011] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 client # [ 2.565297] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.562107] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.566486] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.567660] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.566308] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.567437] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.573343] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.577790] scsi host0: ahci lb # [ 2.579563] scsi host1: ahci lb # [ 2.581207] scsi host2: ahci lb # [ 2.582854] scsi host3: ahci worker1 # [ 2.597326] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.584508] scsi host4: ahci worker1 # [ 2.600239] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.586212] scsi host5: ahci lb # [ 2.586740] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.603424] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.605249] usb 1-1: Manufacturer: QEMU lb # [ 2.588917] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.590266] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.606997] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.591461] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 lb # [ 2.592630] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 lb # [ 2.593828] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker1 # [ 2.638392] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.708515] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.711435] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.714615] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.716395] usb 1-1: Manufacturer: QEMU worker2 # [ 2.718048] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.684540] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.687427] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.690696] usb 1-1: Product: QEMU USB Tablet client # [ 2.692655] usb 1-1: Manufacturer: QEMU client # [ 2.694364] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.692390] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 lb # [ 2.695289] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.698637] usb 1-1: Product: QEMU USB Tablet lb # [ 2.700676] usb 1-1: Manufacturer: QEMU worker1 # [ 2.583699] systemd[1]: Mounting /sysroot... lb # [ 2.702536] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.751575] hid: raw HID events driver (C) Jiri Kosina client # [ 2.726247] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.735300] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.673149] systemd[1]: Mounting /sysroot... worker1 # [ 2.795255] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.800290] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.802631] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.804842] ata3.00: applying bridge limits worker1 # [ 2.806746] ata3.00: configured for UDMA/100 client # [ 2.660601] systemd[1]: Mounting /sysroot... worker1 # [ 2.808745] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.811066] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.813311] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.815477] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.818323] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.677563] systemd[1]: Mounting /sysroot... worker2 # [ 2.907047] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.909861] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.912477] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.914427] ata3.00: applying bridge limits client # [ 2.876334] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.916445] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.893023] usbcore: registered new interface driver usbhid worker2 # [ 2.918569] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.893767] usbhid: USB HID core driver worker2 # [ 2.921051] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.923427] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.884595] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.925503] ata3.00: configured for UDMA/100 client # [ 2.886948] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.889247] ata3.00: applying bridge limits worker2 # [ 2.927979] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.891186] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.893505] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.895783] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.909425] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.898152] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.913156] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.900546] ata3.00: configured for UDMA/100 client # [ 2.902691] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.922072] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.907779] ata6: SATA link down (SStatus 0 SControl 300) lb # [ 2.910685] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.913358] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.915707] ata3.00: applying bridge limits lb # [ 2.917854] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.920528] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.939016] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 2.922887] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.925336] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.927427] ata3.00: configured for UDMA/100 lb # [ 2.929930] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.957587] EXT4-fs (vda): mounted filesystem b86d2bb0-fb2f-4811-a307-f0d372f4dda3 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.828159] systemd[1]: Mounted /sysroot. worker1 # [ 2.829915] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.831674] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.000406] usbcore: registered new interface driver usbhid worker2 # [ 3.001160] usbhid: USB HID core driver worker1 # [ 2.846386] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 2.849212] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.851141] systemd[1]: Reloading... client # [ 2.977208] usbcore: registered new interface driver usbhid client # [ 2.977980] usbhid: USB HID core driver worker2 # [ 3.022364] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 3.034383] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker2 # [ 3.036139] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.998249] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 3.038284] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 3.009284] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 3.010981] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 3.008217] usbcore: registered new interface driver usbhid lb # [ 3.008997] usbhid: USB HID core driver client # [ 3.014726] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 3.059839] EXT4-fs (vda): mounted filesystem 99b73c50-b0c8-4fbd-a58c-cb4c1b037971 r/w with ordered data mode. Quota mode: none. lb # [ 3.023255] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.932105] systemd[1]: Mounted /sysroot. client # [ 3.028806] EXT4-fs (vda): mounted filesystem 395dedcd-1a69-4569-8b1c-9b65c0bdba46 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.932765] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.936081] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.029305] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.899899] systemd[1]: Mounted /sysroot. lb # [ 3.031282] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.901084] systemd[1]: Reached target Initrd Root File System. client # [ 2.904496] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.038192] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.945252] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.950068] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.951920] systemd[1]: Reloading... worker1 # [ 2.927205] systemd[1]: Reloading finished in 76 ms. client # [ 2.918801] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 2.921553] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.936209] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... client # [ 2.923995] systemd[1]: Reloading... worker1 # [ 2.940182] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker1 # [ 2.943761] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.946092] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 2.946964] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.066936] EXT4-fs (vda): mounted filesystem 0462966c-9ade-45a3-b61a-be0249fbfa11 r/w with ordered data mode. Quota mode: none. lb # [ 2.939377] systemd[1]: Mounted /sysroot. lb # [ 2.940814] systemd[1]: Reached target Initrd Root File System. lb # [ 2.942893] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.961799] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.967063] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.968536] systemd[1]: Reloading... worker2 # [ 3.031290] systemd[1]: Reloading finished in 81 ms. worker2 # [ 3.039614] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... client # [ 3.002960] systemd[1]: Reloading finished in 79 ms. worker2 # [ 3.042139] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... worker2 # [ 3.048225] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.049276] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.012524] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.050417] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.017170] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... client # [ 3.019909] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.021287] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.023181] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.043802] systemd[1]: Reloading finished in 77 ms. lb # [ 3.052702] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... lb # [ 3.056257] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... lb # [ 3.059650] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.061049] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.062119] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.585253] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.592188] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.601160] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.610173] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.624321] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.675180] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.657638] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.682211] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.660039] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.665921] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.691177] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.668162] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.671403] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.674128] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.662098] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.701163] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.669187] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.684046] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.685770] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.710670] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.675309] systemd[1]: Mounting /sysroot/run... lb # [ 3.679696] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.687164] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.687183] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.695360] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.694324] systemd[1]: Mounting /sysroot/run... lb # [ 3.704299] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.751966] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.753248] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.755777] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.756523] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.758554] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.718593] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.762147] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.734717] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.772519] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.773962] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.739403] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.742391] systemd[1]: Mounted /sysroot/run. client # [ 3.743304] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.746113] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.749276] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.759077] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.760540] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.760598] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.761644] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.763409] systemd[1]: Mounted /sysroot/run. lb # [ 3.764355] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.766056] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.769668] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.780317] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.781798] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.584874] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.635175] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.637096] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.638672] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.642136] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.673873] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.660309] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.663718] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.669730] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.670957] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.672866] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.661671] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.686213] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.687475] systemd[1]: Stopped target Basic System. worker1 # [ 4.688477] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.689457] systemd[1]: Stopped target Path Units. worker1 # [ 4.691112] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.692091] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.693098] systemd[1]: Stopped target Slice Units. worker1 # [ 4.693762] systemd[1]: Stopped target Socket Units. worker1 # [ 4.694563] systemd[1]: Stopped target System Initialization. worker1 # [ 4.695529] systemd[1]: Stopped target Swaps. lb # [ 4.678192] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.696558] systemd[1]: Stopped target Timer Units. worker1 # [ 4.697597] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.722745] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.698660] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.700142] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.701189] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.726130] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.702355] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.704178] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.729123] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.705283] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.706227] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.707367] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.708297] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.709582] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.733667] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.710856] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.712133] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.714251] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.715202] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.716222] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.717365] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.720131] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.721225] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.722184] systemd[1]: Stopped Virtual Console Setup. client # [ 4.711079] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.712799] systemd[1]: Reached target Initrd File Systems. client # [ 4.715078] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.729648] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 4.717441] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.756829] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.733111] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.760922] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.737853] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.738888] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.766545] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.767797] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.742909] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.726790] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.743977] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.769882] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.745275] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.729589] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.746346] systemd[1]: Closed udev Control Socket. worker1 # [ 4.747808] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.749084] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 4.736362] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.733067] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.750073] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.751139] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 4.738394] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.753134] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.754150] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.755041] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.739273] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.745742] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.783327] systemd[1]: Stopped target Initrd Default Target. client # [ 4.746952] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.784645] systemd[1]: Stopped target Basic System. worker2 # [ 4.786212] systemd[1]: Stopped target Initrd Root Device. client # [ 4.749091] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.786969] systemd[1]: Stopped target Path Units. worker2 # [ 4.787677] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.788688] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.789822] systemd[1]: Stopped target Slice Units. worker2 # [ 4.790855] systemd[1]: Stopped target Socket Units. worker2 # [ 4.791889] systemd[1]: Stopped target System Initialization. worker2 # [ 4.793177] systemd[1]: Stopped target Swaps. worker1 # [ 4.768262] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.793804] systemd[1]: Stopped target Timer Units. worker1 # [ 4.769759] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.794702] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.771251] systemd[1]: Reached target Switch Root. worker2 # [ 4.796123] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.796919] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.772805] systemd[1]: Starting NixOS Activation... worker2 # [ 4.797944] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.799224] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.762377] systemd[1]: Stopped target Initrd Default Target. client # [ 4.763695] systemd[1]: Stopped target Basic System. worker2 # [ 4.801182] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.802254] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.765124] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.762209] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.765892] systemd[1]: Stopped target Path Units. worker2 # [ 4.803221] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.804423] systemd[1]: Stopped Load Kernel Modules. client # [ 4.766660] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.767672] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.764394] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.805862] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.768822] systemd[1]: Stopped target Slice Units. worker2 # [ 4.806929] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.769761] systemd[1]: Stopped target Socket Units. worker2 # [ 4.808146] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.770816] systemd[1]: Stopped target System Initialization. client # [ 4.771816] systemd[1]: Stopped target Swaps. worker2 # [ 4.809620] systemd[1]: Stopped Create System Files and Directories. client # [ 4.772779] systemd[1]: Stopped target Timer Units. worker2 # [ 4.810551] systemd[1]: Stopped target Local File Systems. client # [ 4.774186] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.811733] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.774974] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.772419] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.813125] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.775809] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.773544] systemd[1]: Reached target Initrd Default Target. client # [ 4.776775] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.814446] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.778158] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.775385] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.816100] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 4.779088] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.817916] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.781224] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.818968] systemd[1]: Stopped Virtual Console Setup. client # [ 4.782232] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.783414] systemd[1]: Stopped Load Kernel Modules. client # [ 4.784398] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.786126] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.787213] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.825859] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 4.788417] systemd[1]: Stopped Create System Files and Directories. client # [ 4.789291] systemd[1]: Stopped target Local File Systems. client # [ 4.791123] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.829063] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.788741] systemd[1]: Stopped target Initrd Default Target. client # [ 4.792055] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.789672] systemd[1]: Stopped target Basic System. client # [ 4.792971] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.790668] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.792124] systemd[1]: Stopped target Path Units. client # [ 4.795273] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.792834] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.833781] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.793933] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.797170] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.794971] systemd[1]: Stopped target Slice Units. client # [ 4.798159] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.795811] systemd[1]: Stopped target Socket Units. lb # [ 4.796780] systemd[1]: Stopped target System Initialization. lb # [ 4.797823] systemd[1]: Stopped target Swaps. worker2 # [ 4.837983] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.839039] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.798765] systemd[1]: Stopped target Timer Units. worker2 # [ 4.839962] systemd[1]: Closed udev Control Socket. lb # [ 4.800140] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.801224] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.843150] systemd[1]: Starting Cleanup udev Database... lb # [ 4.802659] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.805732] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.803650] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.844134] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.804706] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.845921] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.805590] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.846829] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 4.809820] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.807366] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.847949] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.848921] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.809137] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.849943] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.810219] systemd[1]: Stopped Load Kernel Modules. client # [ 4.813156] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.851113] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.810956] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.814544] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.812264] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.853589] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.813313] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.814323] systemd[1]: Stopped Create System Files and Directories. client # [ 4.818175] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.816099] systemd[1]: Stopped target Local File Systems. client # [ 4.819203] systemd[1]: Closed udev Control Socket. lb # [ 4.816867] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.817815] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.821067] systemd[1]: Starting Cleanup udev Database... lb # [ 4.818790] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.821798] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 4.822780] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.820070] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 4.824133] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 4.825224] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.822504] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.826220] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.823508] systemd[1]: Stopped Virtual Console Setup. client # [ 4.827717] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 4.828597] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.868349] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 4.831117] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.844127] initrd-nixos-activation-start[191]: booting system configuration /nix/store/x5xm43clszqqn1s52xaz4fgg5ff2y8g4-nixos-system-worker1-test worker2 # [ 4.870100] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.871094] systemd[1]: Reached target Switch Root. worker2 # [ 4.872693] systemd[1]: Starting NixOS Activation... lb # [ 4.833276] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.836088] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.840126] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 4.844444] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 4.845892] systemd[1]: Finished Cleanup udev Database. lb # [ 4.843063] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 4.848114] systemd[1]: Reached target Switch Root. client # [ 4.848975] systemd[1]: Starting NixOS Activation... lb # [ 4.846116] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.847171] systemd[1]: Closed udev Control Socket. lb # [ 4.849068] systemd[1]: Starting Cleanup udev Database... lb # [ 4.849861] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.850927] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.852142] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.853270] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.855140] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.871075] initrd-nixos-activation-start[191]: running activation script... lb # [ 4.856080] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.857288] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.858715] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.874911] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.876517] systemd[1]: Finished Cleanup udev Database. lb # [ 4.878237] systemd[1]: Reached target Switch Root. lb # [ 4.879920] systemd[1]: Starting NixOS Activation... worker2 # [ 4.946983] initrd-nixos-activation-start[191]: booting system configuration /nix/store/ryyw8nza55ayn45yacz76nd2ajf36w90-nixos-system-worker2-test client # [ 4.920942] initrd-nixos-activation-start[190]: booting system configuration /nix/store/hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test worker2 # [ 4.974782] initrd-nixos-activation-start[191]: running activation script... client # [ 4.948091] initrd-nixos-activation-start[190]: running activation script... lb # [ 4.954747] initrd-nixos-activation-start[191]: booting system configuration /nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test lb # [ 4.982607] initrd-nixos-activation-start[191]: running activation script... worker1 # [ 5.059237] initrd-nixos-activation-start[214]: setting up /etc... worker2 # [ 5.167829] initrd-nixos-activation-start[214]: setting up /etc... client # [ 5.138880] initrd-nixos-activation-start[213]: setting up /etc... worker1 # [ 5.163665] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.165257] systemd[1]: Finished NixOS Activation. worker1 # [ 5.167125] systemd[1]: Starting Switch Root... worker1 # [ 5.179683] systemd[1]: Switching root. lb # [ 5.177993] initrd-nixos-activation-start[214]: setting up /etc... worker2 # [ 5.276694] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.278354] systemd[1]: Finished NixOS Activation. worker2 # [ 5.280405] systemd[1]: Starting Switch Root... client # [ 5.243652] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.246181] systemd[1]: Finished NixOS Activation. client # [ 5.247161] systemd[1]: Starting Switch Root... worker2 # [ 5.293162] systemd[1]: Switching root. client # [ 5.259730] systemd[1]: Switching root. lb # [ 5.284889] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.286589] systemd[1]: Finished NixOS Activation. lb # [ 5.288585] systemd[1]: Starting Switch Root... worker1 # [ 5.441118] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 5.301246] systemd[1]: Switching root. client # [ 5.518956] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.558694] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.545378] NET: Registered PF_VSOCK protocol family lb # [ 5.558345] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.631315] NET: Registered PF_VSOCK protocol family client # [ 5.607506] NET: Registered PF_VSOCK protocol family lb # [ 5.644975] NET: Registered PF_VSOCK protocol family worker1 # [ 5.903816] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.913388] systemd[1]: Detected virtualization kvm. worker1 # [ 5.915195] systemd[1]: Detected architecture x86-64. worker1 # [ 5.917041] systemd[1]: Detected first boot. worker1 # [ 5.921047] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.990573] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.000031] systemd[1]: Detected virtualization kvm. worker2 # [ 6.001831] systemd[1]: Detected architecture x86-64. worker2 # [ 6.003721] systemd[1]: Detected first boot. worker2 # [ 6.008065] systemd[1]: Initializing machine ID from random generator. client # [ 5.968356] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.978120] systemd[1]: Detected virtualization kvm. client # [ 5.979872] systemd[1]: Detected architecture x86-64. client # [ 5.981796] systemd[1]: Detected first boot. client # [ 5.985820] systemd[1]: Initializing machine ID from random generator. lb # [ 6.005277] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.015090] systemd[1]: Detected virtualization kvm. lb # [ 6.016919] systemd[1]: Detected architecture x86-64. lb # [ 6.018907] systemd[1]: Detected first boot. lb # [ 6.023149] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.163475] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.251110] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.227744] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.266915] systemd[1]: Applying preset policy. lb # [ 6.266891] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.370923] systemd[1]: Applying preset policy. client # [ 6.341121] systemd[1]: Applying preset policy. lb # [ 6.380760] systemd[1]: Applying preset policy. worker1 # [ 6.446452] systemd[1]: Populated /etc with preset unit settings. client # [ 6.504655] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.543598] systemd[1]: Populated /etc with preset unit settings. lb # [ 6.557540] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 6.649288] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 6.650660] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.653228] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 6.655273] systemd[1]: Created slice Slice /system/getty. worker1 # [ 6.656637] systemd[1]: Created slice User and Session Slice. worker1 # [ 6.657560] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.658756] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.659921] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.660590] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 6.661384] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.662229] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.662992] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.663728] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 6.664556] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.665481] systemd[1]: Reached target Path Units. worker1 # [ 6.666210] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.667011] systemd[1]: Reached target Slice Units. worker1 # [ 6.667679] systemd[1]: Reached target Swaps. worker1 # [ 6.681191] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 6.683690] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 6.685531] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 6.687520] systemd[1]: Listening on Factory Reset Management. worker1 # [ 6.688456] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 6.691331] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.692662] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 6.695125] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 6.696606] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.697729] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.699036] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 6.706991] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.707980] systemd[1]: Listening on udev Control Socket. worker1 # [ 6.708791] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.710960] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.715222] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.720489] systemd[1]: Mounting Kernel Debug File System... client # [ 6.709381] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.710732] systemd[1]: Stopped initrd-switch-root.service. client # [ 6.712708] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 6.752345] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.714748] systemd[1]: Created slice Slice /system/getty. worker2 # [ 6.753765] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.728127] systemd[1]: Mounting Kernel Trace File System... client # [ 6.716015] systemd[1]: Created slice User and Session Slice. client # [ 6.716972] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 6.755868] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.718221] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.719322] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 6.758003] systemd[1]: Created slice Slice /system/getty. client # [ 6.720026] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.720773] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 6.759438] systemd[1]: Created slice User and Session Slice. client # [ 6.721640] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 6.760417] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.722396] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.723267] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 6.761694] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 6.762897] systemd[1]: Expecting device /dev/hvc0... client # [ 6.724127] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.725012] systemd[1]: Reached target Path Units. worker2 # [ 6.763641] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 6.738061] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.725712] systemd[1]: Reached target Remote File Systems. worker2 # [ 6.764433] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.726530] systemd[1]: Reached target Slice Units. worker2 # [ 6.765246] systemd[1]: Stopped target initrd-fs.target. client # [ 6.727273] systemd[1]: Reached target Swaps. worker2 # [ 6.765962] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 6.766761] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 6.767627] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.729215] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.768557] systemd[1]: Reached target Path Units. worker2 # [ 6.769293] systemd[1]: Reached target Remote File Systems. worker2 # [ 6.770088] systemd[1]: Reached target Slice Units. client # [ 6.731826] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.770784] systemd[1]: Reached target Swaps. worker1 # [ 6.747025] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.772956] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 6.747854] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 6.775518] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 6.777362] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.733653] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 6.758245] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.747207] systemd[1]: Listening on Factory Reset Management. client # [ 6.748148] systemd[1]: Listening on Hostname Service Socket. client # [ 6.750959] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 6.779254] systemd[1]: Listening on Factory Reset Management. client # [ 6.752411] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 6.791765] systemd[1]: Listening on Hostname Service Socket. client # [ 6.755429] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 6.794878] systemd[1]: Starting Journal Log Access Socket... client # [ 6.756543] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.769350] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.796427] systemd[1]: Listening on Journal Audit Socket. client # [ 6.757638] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.758934] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 6.799014] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 6.800508] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.763088] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 6.801650] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.764148] systemd[1]: Listening on udev Control Socket. worker2 # [ 6.802966] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.765004] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.779528] systemd[1]: Mounting FUSE Control File System... client # [ 6.767148] systemd[1]: Mounting Huge Pages File System... worker2 # [ 6.807104] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 6.808118] systemd[1]: Listening on udev Control Socket. client # [ 6.769656] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.809002] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 6.811305] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.784076] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.776156] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 6.815247] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 6.774456] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.775833] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.794143] systemd[1]: Starting Journal Service... lb # [ 6.777985] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 6.821244] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.780352] systemd[1]: Created slice Slice /system/getty. client # [ 6.784210] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.781707] systemd[1]: Created slice User and Session Slice. worker1 # [ 6.799471] systemd[1]: Starting Load Kernel Modules... lb # [ 6.782641] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.783898] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.785006] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.785765] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.786496] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.787350] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.788127] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 6.831253] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.788916] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.793354] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.806091] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.789831] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 6.790787] systemd[1]: Reached target Path Units. lb # [ 6.791486] systemd[1]: Reached target Remote File Systems. lb # [ 6.792280] systemd[1]: Reached target Slice Units. lb # [ 6.792989] systemd[1]: Reached target Swaps. lb # [ 6.794842] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 6.838793] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.812844] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 6.797415] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.802474] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 6.815294] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.819975] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 6.847970] systemd[1]: Starting Load Kernel Module configfs... client # [ 6.811144] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.824367] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.850462] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.827540] systemd[1]: Mounted Huge Pages File System. lb # [ 6.799275] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 6.853595] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.829724] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.813085] systemd[1]: Listening on Factory Reset Management. lb # [ 6.814079] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 6.832097] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 6.857607] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.816896] systemd[1]: Starting Journal Log Access Socket... client # [ 6.820501] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.834011] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 6.834866] systemd[1]: Mounted FUSE Control File System. lb # [ 6.818326] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.820996] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.822167] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.823308] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.840424] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.827508] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.824597] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 6.868558] systemd[1]: Mounting FUSE Control File System... lb # [ 6.828798] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.829857] systemd[1]: Listening on udev Control Socket. worker1 # [ 6.846268] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.830734] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.832948] systemd[1]: Mounting Huge Pages File System... worker2 # [ 6.874492] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.838430] systemd[1]: Mounting FUSE Control File System... lb # [ 6.835449] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.841163] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.842204] systemd[1]: Mounting Kernel Debug File System... client # [ 6.852552] systemd[1]: Starting Journal Service... lb # [ 6.850105] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 6.897310] systemd[1]: Starting Journal Service... worker1 # [ 6.873535] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 6.857187] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.875479] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.866369] systemd[1]: Starting Load Kernel Modules... worker2 # [ 6.905629] systemd[1]: Starting Load Kernel Modules... worker1 # [ 6.880150] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.867812] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.911829] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.873144] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 6.877761] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 6.917329] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.918347] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.924094] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.882752] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.902261] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.890570] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.930818] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.933388] systemd[1]: Mounted Huge Pages File System. client # [ 6.895244] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.934998] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.937361] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.896337] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.939589] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 6.942377] systemd[1]: Mounted FUSE Control File System. worker1 # [ 6.918109] EXT4-fs (vda): re-mounted b86d2bb0-fb2f-4811-a307-f0d372f4dda3. client # [ 6.906454] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 6.948795] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.923430] systemd-journald[284]: Collecting audit messages is enabled. lb # [ 6.907532] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.952091] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.915583] systemd-journald[283]: Collecting audit messages is enabled. lb # [ 6.910455] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.930740] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.920412] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 6.934253] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.935247] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.920851] systemd[1]: Starting Journal Service... client # [ 6.928535] systemd[1]: Mounted Huge Pages File System. worker1 # [ 6.942311] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 6.943937] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.933309] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 6.949833] loop: module loaded lb # [ 6.933134] systemd[1]: Starting Load Kernel Modules... client # [ 6.940327] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 6.956693] systemd[1]: Finished Load Kernel Modules. client # [ 6.944386] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 6.983885] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.811893] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 6.986230] systemd[1]: Finished Load Kernel Module configfs. lb # [ 6.944293] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.949284] systemd[1]: Started Journal Service. worker1 # [ 6.962398] systemd[1]: Starting Firewall... worker2 # [ 6.990725] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.817604] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.967452] systemd[1]: Starting Apply Kernel Variables... client # [ 6.955383] loop: module loaded client # [ 6.825808] systemd-modules-load[284]: Inserted module 'loop' lb # [ 6.958260] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.828650] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.978800] systemd[1]: Started Journal Service. client # [ 6.831473] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 6.962219] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.834403] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 6.852824] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.975144] EXT4-fs (vda): re-mounted 395dedcd-1a69-4569-8b1c-9b65c0bdba46. worker2 # [ 7.015448] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.973548] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.843396] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.856227] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 6.858370] systemd-modules-load[285]: Inserted module 'loop' worker1 # [ 6.864960] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.983273] systemd-journald[284]: Collecting audit messages is enabled. client # [ 6.856125] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 6.857089] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.860529] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.991612] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.034329] systemd-journald[284]: Collecting audit messages is enabled. worker2 # [ 7.035319] EXT4-fs (vda): re-mounted 99b73c50-b0c8-4fbd-a58c-cb4c1b037971. client # [ 6.865346] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.997216] systemd[1]: Mounted Huge Pages File System. client # [ 6.868076] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.001155] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 7.004766] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.048825] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.888308] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.876138] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 7.050051] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 7.051849] loop: module loaded worker2 # [ 7.052521] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.012296] systemd[1]: Started Journal Service. worker1 # [ 6.893986] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.875974] systemd[1]: Queued start job for default target Multi-User System. lb # [ 6.881852] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 7.059252] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.886697] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 7.060025] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.065289] systemd[1]: Finished Load Kernel Modules. lb # [ 6.890636] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.892213] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 7.069520] systemd[1]: Starting Firewall... client # [ 6.896176] systemd-oomd[286]: No swap; memory pressure usage will be degraded lb # [ 6.894135] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 7.031306] loop: module loaded worker2 # [ 7.073832] systemd[1]: Starting Apply Kernel Variables... client # [ 6.901401] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.900222] systemd-modules-load[285]: Inserted module 'loop' client # [ 6.903182] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.901141] systemd[1]: Finished Load Kernel Module configfs. client # [ 6.904323] systemd[1]: Mounted FUSE Control File System. worker1 # [ 6.919306] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.920241] systemd[1]: Reached target First Boot Complete. client # [ 6.907873] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 6.915117] systemd[1]: Finished Load Kernel Modules. worker2 # [ 7.097102] systemd[1]: Started Journal Service. worker1 # [ 7.071470] systemd-journald[284]: Received client request to flush runtime journal. worker2 # [ 6.961779] systemd[1]: Queued start job for default target Multi-User System. lb # [ 6.925211] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 6.967413] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 7.062049] EXT4-fs (vda): re-mounted 0462966c-9ade-45a3-b61a-be0249fbfa11. lb # [ 6.932174] systemd[1]: Starting Firewall... worker2 # [ 6.974503] systemd-modules-load[285]: Inserted module 'loop' client # [ 7.076654] systemd-journald[283]: Received client request to flush runtime journal. worker2 # [ 6.982386] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.942882] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 6.983604] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.991613] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.951116] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.957813] systemd[1]: Mounted FUSE Control File System. lb # [ 6.963497] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 6.969789] systemd-oomd[287]: No swap; memory pressure usage will be degraded lb # [ 6.982071] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 6.983103] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 6.997061] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.998026] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.002245] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 7.003369] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.048181] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 7.050292] systemd[1]: Reached target First Boot Complete. worker2 # [ 7.052340] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 7.062370] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 7.202690] systemd-journald[284]: Received client request to flush runtime journal. client # [ 7.036582] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.038509] systemd[1]: Reached target First Boot Complete. client # [ 7.040701] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.043446] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 7.065388] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker1 # [ 7.068928] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.072063] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.072871] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.073827] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 7.074770] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.077122] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 7.196736] systemd-journald[284]: Received client request to flush runtime journal. client # [ 7.067380] systemd[1]: Finished Apply Kernel Variables. client # [ 7.112756] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 7.153521] systemd[1]: Finished Apply Kernel Variables. client # [ 7.117314] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 7.164799] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.132512] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 7.145992] systemd-udevd[317]: Using default interface naming scheme 'v261'. worker2 # [ 7.177862] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 7.178891] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 7.181231] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 7.152564] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.153721] systemd[1]: Reached target Preparation for Local File Systems. client # [ 7.156160] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 7.161409] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.164396] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 7.166272] systemd[1]: Reached target First Boot Complete. lb # [ 7.167091] systemd[1]: Finished Apply Kernel Variables. lb # [ 7.171130] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.184291] systemd-udevd[315]: Using default interface naming scheme 'v261'. worker1 # [ 7.220519] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 7.209739] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.213276] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 7.216798] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 7.275289] systemd-udevd[319]: Using default interface naming scheme 'v261'. lb # [ 7.271871] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 7.302405] systemd[1]: Finished Coldplug All udev Devices. lb # [ 7.286570] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 7.287776] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 7.290593] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 7.296436] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.352130] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 7.334548] systemd-udevd[327]: Using default interface naming scheme 'v261'. client # [ 7.344096] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 7.386345] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.355152] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.384518] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.382260] (udev-worker)[327]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.385542] (udev-worker)[321]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.388138] (udev-worker)[321]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.385164] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.457099] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 7.458283] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.471866] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.459987] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.462233] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.500446] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.464096] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.465699] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.493450] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 7.502523] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.519058] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.537280] (udev-worker)[346]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.666935] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.672689] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 worker1 # [ 7.558475] (udev-worker)[351]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 7.561563] (udev-worker)[351]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.588254] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 7.573108] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.574129] systemd[1]: Reached target Local File Systems. worker1 # [ 7.577042] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.604832] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.580933] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.583676] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.585133] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.587951] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.590519] systemd[1]: Starting Create System Files and Directories... client # [ 7.578304] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.618963] systemd[1]: Mounting /run/wrappers... lb # [ 7.589930] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.607631] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 7.619778] systemd[1]: Mounted /run/wrappers. client # [ 7.621203] systemd[1]: Reached target Local File Systems. worker2 # [ 7.661584] systemd[1]: Mounted /run/wrappers. client # [ 7.625141] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.662937] systemd[1]: Reached target Local File Systems. worker2 # [ 7.665248] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 7.628604] systemd[1]: Starting register-nix-paths.service... worker2 # [ 7.668182] systemd[1]: Starting register-nix-paths.service... client # [ 7.633156] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.671284] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 7.634165] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.672461] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.679150] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 7.637750] (udev-worker)[356]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.642108] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.680834] systemd[1]: Starting Create System Files and Directories... lb # [ 7.642616] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.645089] (udev-worker)[356]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.647546] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.695215] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.683291] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.686742] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.686609] systemd[1]: Mounted /run/wrappers. worker2 # [ 7.728300] (udev-worker)[354]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.692171] systemd[1]: Reached target Local File Systems. lb # [ 7.697924] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.700703] systemd[1]: Starting register-nix-paths.service... client # [ 7.706355] systemd[1]: Starting Create System Files and Directories... lb # [ 7.706156] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 7.707323] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.749476] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 7.729195] systemd[1]: Finished Create System Files and Directories. lb # [ 7.715241] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.735201] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.737073] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 7.729158] systemd[1]: Starting Create System Files and Directories... client # [ 7.687112] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 client # [ 7.697977] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.791257] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.795980] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 7.698272] ACPI: button: Power Button [PWRF] client # [ 7.775747] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.781567] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 7.785509] rtc_cmos PNP0B00:00: registered as rtc0 client # [ 7.777725] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.780097] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 7.783081] systemd[1]: Finished Create System Files and Directories. client # [ 7.791121] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 7.808626] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.796868] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 7.804243] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.847137] systemd[1]: Finished Create System Files and Directories. lb # [ 7.812077] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.853254] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 7.855884] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 7.785573] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T15:59:37 UTC (1790179177) client # [ 7.785645] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs client # [ 7.786331] systemd-journald[283]: Time jumped backwards, rotating. worker1 # [ 7.867313] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.856850] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 7.871350] systemd[1]: Starting Update is Completed... client # [ 7.883257] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.888322] systemd[1]: Starting Update is Completed... lb # [ 7.883898] systemd[1]: Finished Create System Files and Directories. lb # [ 7.895138] systemd[1]: Starting Rebuild Journal Catalog... client # [ 7.875536] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.875639] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 7.878133] Console: switching to colour dummy device 80x25 lb # [ 7.901898] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.944393] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 7.913502] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 7.923817] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.926147] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.929145] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.933665] systemd[1]: Finished Update is Completed. lb # [ 7.931181] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.933231] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.934983] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.958448] systemd[1]: Finished Update is Completed. client # [ 8.077302] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 8.077433] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 7.973438] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.974586] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.976365] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.978246] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.004411] systemd[1]: Finished Rebuild Journal Catalog. client # [ 8.103538] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 7.980929] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.103540] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 8.006681] systemd[1]: Starting Update is Completed... worker1 # [ 7.983201] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.985653] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.109437] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 8.125682] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 8.129583] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 8.131323] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 7.998214] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 8.039662] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 8.047117] systemd[1]: Starting Update is Completed... worker2 # [ 8.089616] systemd[1]: Finished Update is Completed. worker1 # [ 8.095602] systemd[1]: Finished Firewall. client # [ 8.099968] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.140140] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 8.141723] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.143905] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.145561] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.148520] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.150819] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.153128] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.267339] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 8.130873] systemd[1]: Finished Update is Completed. worker1 # [ 8.282440] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 8.138069] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.139720] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.289439] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 8.279214] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.153403] systemd[1]: Starting Virtual Console Setup... lb # [ 8.297187] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 8.326620] Console: switching to colour frame buffer device 160x50 client # [ 8.339498] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.225132] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.230581] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.382639] ppdev: user-space parallel port driver worker2 # [ 8.288569] systemd[1]: Finished Firewall. client # [ 8.271557] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 8.274694] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.431708] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 8.472260] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 8.299272] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.301231] systemd[1]: Stopped Virtual Console Setup. client # [ 8.306916] systemd[1]: Starting Virtual Console Setup... client # [ 8.451921] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 8.363237] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 8.364249] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 8.302160] ACPI: button: Power Button [PWRF] lb # [ 8.329406] ACPI: button: Power Button [PWRF] worker1 # [ 8.327774] mousedev: PS/2 mouse device common for all mice lb # [ 8.346125] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 8.413247] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 8.424429] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 8.424497] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T15:59:37 UTC (1790179177) worker1 # [ 8.424573] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 8.425598] systemd-journald[284]: Time jumped backwards, rotating. worker1 # [ 8.474264] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized client # [ 8.553196] kvm_amd: TSC scaling supported client # [ 8.553616] kvm_amd: Nested Virtualization enabled worker1 # [ 8.475963] parport_pc 00:02: reported by Plug and Play ACPI client # [ 8.554482] kvm_amd: Nested Paging enabled client # [ 8.554908] kvm_amd: LBR virtualization supported worker1 # [ 8.476064] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 8.493747] Console: switching to colour dummy device 80x25 client # [ 8.555559] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.556235] kvm_amd: Virtual GIF supported worker1 # [ 8.568733] [drm] Found bochs VGA, ID 0xb0c5. client # [ 8.556619] kvm_amd: Virtual NMI enabled worker1 # [ 8.568736] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 8.577039] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 8.577721] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 8.592511] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.593251] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.593275] EDAC MC: Ver: 3.0.0 lb # [ 8.385716] mousedev: PS/2 mouse device common for all mice lb # [ 8.486340] Console: switching to colour dummy device 80x25 lb # [ 8.504898] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 8.553232] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 8.467585] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.470683] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 8.629816] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 8.631041] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 8.480855] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 8.553304] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T15:59:38 UTC (1790179178) lb # [ 8.553389] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 8.493399] ACPI: button: Power Button [PWRF] lb # [ 8.554312] systemd-journald[284]: Time jumped backwards, rotating. worker2 # [ 8.518755] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker2 # [ 8.540560] mousedev: PS/2 mouse device common for all mice worker2 # [ 8.607590] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 8.631287] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 8.631356] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T15:59:38 UTC (1790179178) worker2 # [ 8.631439] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 8.546068] systemd[1]: Finished register-nix-paths.service. worker1 # [ 8.550172] systemd[1]: Reached target System Initialization. worker1 # [ 8.550973] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.536797] systemd[1]: Finished register-nix-paths.service. lb # [ 8.537793] systemd[1]: Reached target System Initialization. lb # [ 8.539078] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.540889] systemd[1]: Started niks3 garbage collection timer. worker1 # [ 8.557474] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 8.541850] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 8.558444] systemd[1]: Reached target Timer Units. lb # [ 8.544246] systemd[1]: Reached target Timer Units. lb # [ 8.544982] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 8.563234] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 8.550091] systemd[1]: Listening on niks3 server socket. lb # [ 8.550881] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.552154] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.553328] systemd[1]: Reached target Socket Units. lb # [ 8.554091] systemd[1]: Reached target Basic System. worker1 # [ 8.570295] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 8.573445] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.559503] systemd[1]: Started backdoor.service. lb # [ 8.561279] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.579120] systemd[1]: Reached target Socket Units. worker1 # [ 8.584231] systemd[1]: Reached target Basic System. lb # [ 8.578486] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 8.585946] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.612558] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.704888] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.704891] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 8.587584] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 8.588623] systemd[1]: Started backdoor.service. lb # [ 8.573160] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 8.593878] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.596283] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.584613] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.601317] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.604129] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.633218] systemd-journald[284]: Time jumped backwards, rotating. worker2 # [ 8.666397] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 8.666493] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 8.610089] systemd[1]: Starting resolvconf update... worker1 # [ 8.613954] systemd[1]: Starting D-Bus System Message Bus... lb # [ 8.600129] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.673956] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 8.612259] systemd[1]: Starting resolvconf update... worker2 # [ 8.681546] Console: switching to colour dummy device 80x25 worker2 # [ 8.789828] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 8.789836] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 8.618845] systemd[1]: Finished register-nix-paths.service. client # [ 8.623600] systemd-vconsole-setup[419]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 8.627082] systemd[1]: Finished Virtual Console Setup. client # [ 8.628421] systemd[1]: Reached target System Initialization. worker2 # [ 8.802512] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 8.803224] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.629777] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.631145] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.633204] systemd[1]: Reached target Timer Units. client # [ 8.633916] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 8.631475] systemd[1]: Started rustfs.service. client # [ 8.634784] systemd[1]: Listening on Nix Daemon Socket. client # [ 8.635610] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 8.636747] systemd[1]: Reached target Socket Units. client # [ 8.637550] systemd[1]: Reached target Basic System. client # [ 8.639174] systemd[1]: Started backdoor.service. worker2 # [ 8.677165] systemd[1]: Finished register-nix-paths.service. worker2 # [ 8.679366] systemd[1]: Reached target System Initialization. client # [ 8.641974] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 8.681855] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.646295] systemd[1]: Starting nftables firewall... worker2 # [ 8.684268] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 8.780719] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.781433] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 8.688373] systemd[1]: Reached target Timer Units. worker2 # [ 8.689093] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 8.690169] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.650070] systemd[1]: Starting rustfs-bucket.service... client # [ 8.653071] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.696164] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 8.697326] systemd[1]: Reached target Socket Units. worker2 # [ 8.698032] systemd[1]: Reached target Basic System. worker2 # [ 8.698731] systemd[1]: Started backdoor.service. client # [ 8.661197] systemd[1]: Starting Post-Boot Actions... worker2 # [ 8.699428] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 8.663205] systemd[1]: Finished Firewall. worker2 # [ 8.704198] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.705130] systemd[1]: Starting Post-Boot Actions... worker2 # [ 8.842404] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 8.843055] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 8.672104] systemd[1]: Started Reset console on configuration changes. lb # connecting to host... lb # [ 8.811032] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 8.811737] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.687228] systemd[1]: Starting resolvconf update... lb # [ 8.687392] systemd[1]: Finished Post-Boot Actions. worker2 # [ 8.730207] systemd[1]: Started Reset console on configuration changes. worker2 # [ 8.734912] systemd[1]: Starting resolvconf update... worker2 # [ 8.738487] systemd[1]: Starting D-Bus System Message Bus... lb # [ 8.707073] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.711377] nsncd[520]: Sep 23 15:59:38.787 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # connecting to host... worker1 # [ 8.742397] systemd[1]: Finished Post-Boot Actions. lb # [ 8.729737] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.730652] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.735708] nsncd[427]: Sep 23 15:59:38.584 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.753466] nix-grpc-daemon[512]: ts=2026-09-23T15:59:37Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 8.747869] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 8.926870] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 client # [ 8.748669] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.760574] systemd[1]: Finished Post-Boot Actions. client # [ 8.772258] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.780380] nix-grpc-daemon[512]: ts=2026-09-23T15:59:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 8.929391] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.746994] systemd[1]: Starting D-Bus System Message Bus... client: connected to guest root shell client # [ 8.773208] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.786832] nix-grpc-daemon[512]: ts=2026-09-23T15:59:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 8.809323] systemd[1]: Finished Post-Boot Actions. lb # [ 8.765717] systemd[1]: Starting User Login Management... worker1 # [ 8.790194] nix-grpc-daemon[512]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 8.837080] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.803135] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 8.793187] nix-grpc-daemon[512]: E0000 00:00:1790179177.992334 512 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 8.837939] systemd[1]: Reached target Host and Network Name Lookups. client: (connecting took 9.49 seconds) client # [ 8.781615] systemd[1]: Starting User Login Management... worker1 # [ 8.799354] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 8.840710] systemd[1]: Reached target User and Group Name Lookups. client: (finished: waiting for the VM to finish booting, in 9.49 seconds) client # [ 8.786237] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 8.805287] nix-grpc-daemon[512]: E0000 00:00:1790179178.002840 512 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 8.845703] systemd[1]: Starting User Login Management... worker1 # [ 8.813094] nix-grpc-daemon[512]: ts=2026-09-23T15:59:38Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 8.848511] nsncd[513]: Sep 23 15:59:38.851 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.821362] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.825061] nix-grpc-daemon[512]: ts=2026-09-23T15:59:38Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Could not connect to server" worker1 # connecting to host... worker2 # connecting to host... worker1 # [ 8.836700] nix-grpc-daemon[512]: E0000 00:00:1790179178.030493 571 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 8.846689] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.847772] nsncd[515]: Sep 23 15:59:38.041 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.856062] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.856910] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.891250] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 8.867137] nix-grpc-daemon[512]: E0000 00:00:1790179178.066321 571 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 8.870099] nix-grpc-daemon[512]: E0000 00:00:1790179178.068359 571 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 8.872271] systemd[1]: Starting User Login Management... worker1 # [ 8.885622] nix-grpc-daemon[512]: E0000 00:00:1790179178.093824 571 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 8.917888] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.895038] nix-grpc-daemon[512]: ts=2026-09-23T15:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker2 # [ 8.926743] dbus-broker-launch[519]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.901317] dbus-broker-launch[453]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 8.940889] dbus-broker-launch[519]: NSS returned no entry for 'systemd-timesync' client # [ 8.904142] systemd-logind[457]: New seat seat0. worker1 # [ 9.051222] Console: switching to colour frame buffer device 160x50 worker2 # [ 8.942057] dbus-broker-launch[519]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 8.919552] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 8.913938] systemd-logind[457]: Watching system buttons on /dev/input/event3 (Power Button) client # [ 8.915088] dbus-broker-launch[453]: NSS returned no entry for 'systemd-timesync' client # [ 8.916036] dbus-broker-launch[453]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 8.934648] dbus-broker-launch[519]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.922239] systemd-logind[457]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) client # [ 8.923398] systemd-logind[457]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 8.962618] systemd[1]: Started D-Bus System Message Bus. client # [ 8.927754] systemd[1]: Started User Login Management. client # [ 8.931085] systemd[1]: Starting linger-users.service... worker1 # [ 8.948173] dbus-broker-launch[519]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.949864] dbus-broker-launch[519]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 8.956089] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 8.957072] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.957928] systemd[1]: Stopped target User and Group Name Lookups. client # [ 8.960500] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.961347] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.968992] systemd[1]: Started D-Bus System Message Bus. client # [ 8.971867] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.975902] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 8.980862] dbus-broker-launch[550]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 9.132912] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.967188] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 9.006866] dbus-broker-launch[519]: Ready worker1 # [ 9.014176] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.015200] systemd[1]: Stopped Virtual Console Setup. client # [ 9.004195] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.018269] systemd[1]: Starting Virtual Console Setup... client # [ 9.009939] dbus-broker-launch[453]: Ready client # [ 9.023935] systemd[1]: linger-users.service: Deactivated successfully. client # [ 9.030434] systemd[1]: Finished linger-users.service. client # [ 9.052827] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 9.054690] nsncd[519]: Sep 23 15:59:38.903 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.057685] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.059875] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.074523] systemd-logind[591]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 9.065863] systemd[1]: Finished resolvconf update. worker2 # [ 9.240105] Console: switching to colour frame buffer device 160x50 worker1 # [ 9.080117] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 9.070559] systemd[1]: Starting DHCP Client... worker1 # [ 9.084082] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 9.084857] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 9.087688] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 9.090570] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 9.093563] systemd-logind[591]: New seat seat0. worker1 # [ 9.096136] nix-grpc-daemon[512]: ts=2026-09-23T15:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker1 # [ 9.101175] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 9.101948] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 9.104813] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.105719] systemd[1]: Started User Login Management. worker1 # [ 9.108123] systemd[1]: Starting linger-users.service... worker1 # [ 9.127958] systemd-logind[591]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 9.292289] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 9.042951] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 9.043291] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 9.002556] dbus-broker-launch[519]: Ready worker2 # [ 9.167813] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 9.176543] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 9.180904] nsncd[586]: Sep 23 15:59:39.104 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 9.186066] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 9.163072] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 9.190823] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 9.166422] systemd[1]: Finished linger-users.service. worker2 # [ 9.191817] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.194155] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 9.194967] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 9.195867] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.172185] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.172972] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.161499] dhcpcd[553]: dhcpcd-10.3.2 starting worker1 # [ 9.175187] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 9.200351] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 9.201269] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 9.202108] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.176831] nsncd[641]: Sep 23 15:59:38.384 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 9.202888] systemd[1]: Finished resolvconf update. worker2 # [ 9.203587] systemd[1]: Reached target Preparation for Network. worker2 # [ 9.204408] systemd[1]: Starting DHCP Client... client # [ 9.167119] dhcpcd[561]: dev: loaded udev lb # [ 9.154830] Console: switching to colour frame buffer device 160x50 lb # [ 9.299073] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 9.001250] dbus-broker-launch[550]: NSS returned no entry for 'systemd-timesync' lb # [ 9.167195] dbus-broker-launch[550]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 9.209810] systemd[1]: Starting Address configuration of eth1... lb # [ 9.169471] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 9.210853] systemd[1]: Starting Extra networking commands.... lb # [ 9.170514] systemd[1]: Stopping Host and Network Name Lookups... client # [ 9.311445] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 9.215455] systemd-logind[537]: New seat seat0. lb # [ 9.174373] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 9.178839] nsncd[608]: Sep 23 15:59:39.213 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 9.220579] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.181590] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 9.222823] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.182554] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.224119] systemd[1]: Starting Virtual Console Setup... worker2 # [ 9.224838] systemd[1]: Started User Login Management. lb # [ 9.185465] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 9.227715] systemd[1]: Starting linger-users.service... worker1 # [ 9.203187] systemd[1]: Finished resolvconf update. lb # [ 9.187925] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 9.203869] systemd[1]: Reached target Preparation for Network. lb # [ 9.188923] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 9.229255] systemd-logind[537]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 9.190273] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 9.231739] systemd-logind[537]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 9.207805] systemd[1]: Starting DHCP Client... lb # [ 9.192456] systemd[1]: Starting Virtual Console Setup... lb # [ 9.193511] dbus-broker-launch[550]: Ready worker2 # [ 9.234142] systemd-logind[537]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 9.212105] systemd[1]: Starting Address configuration of eth1... lb # [ 9.196191] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.197295] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.198068] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.214433] systemd[1]: Starting Extra networking commands.... lb # [ 9.198895] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.199733] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.202141] systemd[1]: Starting Virtual Console Setup... lb # [ 9.203133] systemd-logind[552]: New seat seat0. lb # [ 9.203930] systemd[1]: Started User Login Management. lb # [ 9.205597] systemd-logind[552]: Watching system buttons on /dev/input/event2 (Power Button) lb # [ 9.206812] systemd-logind[552]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 9.217823] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.216638] systemd[1]: Starting linger-users.service... worker2 # [ 9.402271] ppdev: user-space parallel port driver worker2 # [ 9.276497] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 9.277528] systemd[1]: Finished linger-users.service. lb # [ 9.239692] systemd[1]: Finished resolvconf update. lb # [ 9.245082] systemd[1]: Reached target Preparation for Network. client # [ 9.383889] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 9.292983] network-addresses-eth1-start[613]: adding address 192.168.1.4/24... done lb # [ 9.256190] systemd[1]: Starting DHCP Client... client # [ 9.404030] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.404719] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 9.267355] systemd[1]: Starting Address configuration of eth1... worker2 # [ 9.308694] network-addresses-eth1-start[613]: adding address 2001:db8:1::4/64... done client # [ 9.407559] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.408424] cfg80211: failed to load regulatory.db worker1 # [ 9.287225] systemd-logind[591]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 9.333505] systemd[1]: Finished Address configuration of eth1. lb # [ 9.293332] systemd[1]: Starting Extra networking commands.... client # [ 9.298510] systemd[1]: Finished nftables firewall. client # [ 9.300988] systemd[1]: Reached target Preparation for Network. client # [ 9.304831] systemd[1]: Starting Address configuration of eth1... client # [ 9.309402] systemd[1]: Starting Extra networking commands.... worker1 # [ 9.458213] ppdev: user-space parallel port driver lb # [ 9.310372] systemd[1]: linger-users.service: Deactivated successfully. client # [ 9.453793] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.319949] dhcpcd[561]: eth0: waiting for carrier worker1 # [ 9.333115] network-addresses-eth1-start[670]: adding address 192.168.1.3/24... done client # [ 9.320925] dhcpcd[561]: eth0: carrier acquired lb # [ 9.318036] systemd[1]: Finished linger-users.service. client # [ 9.331289] dhcpcd[561]: DUID 00:01:00:01:32:46:b3:eb:52:54:00:12:34:56 client # [ 9.332495] dhcpcd[561]: eth0: IAID 00:12:34:56 worker1 # [ 9.480808] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 9.334127] dhcpcd[561]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 9.354371] network-addresses-eth1-start[670]: adding address 2001:db8:1::3/64... done lb # [ 9.341918] systemd-logind[552]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 9.493349] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 9.372564] systemd-vconsole-setup[620]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.377597] systemd[1]: Finished Virtual Console Setup. client # [ 9.367474] network-addresses-eth1-start[581]: adding address 192.168.1.1/24... done worker1 # [ 9.382098] systemd[1]: Finished Address configuration of eth1. client # [ 9.377651] network-addresses-eth1-start[581]: adding address 2001:db8:1::1/64... done worker1 # [ 9.534912] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 9.390343] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.446543] systemd[1]: Finished Extra networking commands.. worker2 # [ 9.448382] systemd[1]: Reached target Network. client # [ 9.412731] systemd[1]: Finished Extra networking commands.. worker2 # [ 9.450977] dhcpcd[626]: dhcpcd-10.3.2 starting lb # [ 9.545212] ppdev: user-space parallel port driver client # [ 9.414463] systemd[1]: Reached target Network. worker2 # [ 9.452924] systemd[1]: Starting Permit User Sessions... client # [ 9.416936] systemd[1]: Starting Permit User Sessions... worker2 # [ 9.462055] dhcpcd[687]: dev: loaded udev client # [ 9.433233] systemd[1]: Finished Permit User Sessions. client # [ 9.436455] systemd[1]: Started Getty on tty1. worker2 # [ 9.610897] 8021q: 802.1Q VLAN Support v1.8 client # [ 9.437799] systemd[1]: Reached target Login Prompts. worker2 # [ 9.612344] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 9.624477] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.466829] systemd[1]: Finished Extra networking commands.. worker1 # [ 9.468566] systemd[1]: Reached target Network. worker1 # [ 9.470600] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.472977] dhcpcd[680]: dhcpcd-10.3.2 starting worker1 # [ 9.480266] dhcpcd[739]: dev: loaded udev lb # [ 9.470886] network-addresses-eth1-start[645]: adding address 192.168.1.2/24... done worker1 # [ 9.488161] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 9.513225] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 9.489679] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 9.516188] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 9.491461] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 9.493284] systemd[1]: Starting Virtual Console Setup... worker1 # [ 9.495120] nix-grpc-daemon[512]: ts=2026-09-23T15:59:38Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker2 # [ 9.524435] systemd[1]: Finished Permit User Sessions. worker2 # [ 9.530199] systemd[1]: Started Getty on tty1. worker2 # [ 9.530878] systemd[1]: Reached target Login Prompts. worker1 # [ 9.641517] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 9.644082] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 9.537388] systemd[1]: Starting Virtual Console Setup... lb # [ 9.508254] network-addresses-eth1-start[645]: adding address 2001:db8:1::2/64... done lb # [ 9.643739] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 9.535438] systemd[1]: Finished Permit User Sessions. worker1 # [ 9.543099] systemd[1]: Started Getty on tty1. worker1 # [ 9.544134] systemd[1]: Reached target Login Prompts. worker2 # [ 9.706505] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker2 # [ 9.597066] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 9.578107] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.697125] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 9.572604] systemd[1]: Finished Address configuration of eth1. worker2 # [ 9.764868] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 9.592304] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.597137] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.609966] dhcpcd[660]: dhcpcd-10.3.2 starting lb # [ 9.614781] systemd[1]: Starting Virtual Console Setup... lb # [ 9.620139] dhcpcd[716]: dev: loaded udev worker1 # [ 9.798102] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 9.828873] kvm_amd: TSC scaling supported worker2 # [ 9.829367] kvm_amd: Nested Virtualization enabled worker2 # [ 9.829803] kvm_amd: Nested Paging enabled worker2 # [ 9.830624] kvm_amd: LBR virtualization supported worker2 # [ 9.831084] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 9.831819] kvm_amd: Virtual GIF supported worker2 # [ 9.832467] kvm_amd: Virtual NMI enabled lb # [ 9.790682] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.791165] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 9.841929] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 9.842650] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 9.667212] systemd[1]: Finished Extra networking commands.. lb # [ 9.668736] systemd[1]: Reached target Network. worker2 # [ 9.845801] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 9.846727] cfg80211: failed to load regulatory.db worker1 # [ 9.820785] kvm_amd: TSC scaling supported worker1 # [ 9.821382] kvm_amd: Nested Virtualization enabled worker1 # [ 9.821829] kvm_amd: Nested Paging enabled worker1 # [ 9.822741] kvm_amd: LBR virtualization supported worker1 # [ 9.823406] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 9.824043] kvm_amd: Virtual GIF supported worker1 # [ 9.824426] kvm_amd: Virtual NMI enabled lb # [ 9.677268] systemd[1]: Starting PostgreSQL Server... lb # [ 9.683358] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.835029] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 9.835668] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 9.838439] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 9.839319] cfg80211: failed to load regulatory.db worker2 # [ 9.878063] EDAC MC: Ver: 3.0.0 worker2 # [ 9.893337] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 9.758352] dhcpcd[687]: eth0: waiting for carrier worker2 # [ 9.759479] dhcpcd[687]: libudev: received NULL device worker2 # [ 9.760780] dhcpcd[687]: libudev: received NULL device worker2 # [ 9.761802] dhcpcd[687]: eth0: carrier acquired worker1 # [ 9.875488] EDAC MC: Ver: 3.0.0 worker2 # [ 9.768299] dhcpcd[687]: DUID 00:01:00:01:32:46:b3:eb:52:54:00:12:34:56 worker2 # [ 9.769610] dhcpcd[687]: eth0: IAID 00:12:34:56 worker2 # [ 9.770460] dhcpcd[687]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 9.884515] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 9.750938] dhcpcd[739]: eth0: waiting for carrier worker1 # [ 9.752810] dhcpcd[739]: libudev: received NULL device worker1 # [ 9.753873] dhcpcd[739]: libudev: received NULL device worker1 # [ 9.755099] dhcpcd[739]: eth0: carrier acquired worker1 # [ 9.759960] dhcpcd[739]: DUID 00:01:00:01:32:46:b3:ea:52:54:00:12:34:56 worker1 # [ 9.761402] dhcpcd[739]: eth0: IAID 00:12:34:56 worker1 # [ 9.762588] dhcpcd[739]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.770162] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.794656] systemd[1]: Finished Permit User Sessions. worker2 # [ 9.834659] systemd-vconsole-setup[693]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 9.837482] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.813254] systemd-vconsole-setup[741]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 9.816993] systemd[1]: Finished Virtual Console Setup. lb # [ 9.833552] systemd[1]: Started Getty on tty1. lb # [ 9.834303] systemd[1]: Reached target Login Prompts. lb # [ 10.037725] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 10.059503] kvm_amd: TSC scaling supported lb # [ 10.059948] kvm_amd: Nested Virtualization enabled lb # [ 10.061573] kvm_amd: Nested Paging enabled lb # [ 10.063342] kvm_amd: LBR virtualization supported lb # [ 10.063833] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 10.065082] kvm_amd: Virtual GIF supported lb # [ 10.065490] kvm_amd: Virtual NMI enabled worker2 # [ 10.007668] dhcpcd[687]: eth0: soliciting a DHCP lease lb # [ 10.104225] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 10.104928] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 10.107276] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 10.108149] cfg80211: failed to load regulatory.db worker2 # [ 10.162210] NET: Registered PF_PACKET protocol family worker2 # [ 10.032917] dhcpcd[687]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 10.037365] dhcpcd[687]: eth0: probing address 10.0.2.15/24 lb # [ 10.132770] EDAC MC: Ver: 3.0.0 lb # [ 10.191735] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 10.060586] dhcpcd[716]: eth0: waiting for carrier lb # [ 10.061826] dhcpcd[716]: eth0: carrier acquired client: (finished: waiting for unit network-addresses-eth1.service, in 10.76 seconds) lb # [ 10.077275] dhcpcd[716]: DUID 00:01:00:01:32:46:b3:ec:52:54:00:12:34:56 client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 10.078320] dhcpcd[716]: eth0: IAID 00:12:34:56 lb # [ 10.078990] dhcpcd[716]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 10.084469] postgresql-pre-start[738]: The files belonging to this database system will be owned by user "postgres". lb # [ 10.085983] postgresql-pre-start[738]: This user must also own the server process. lb # [ 10.090082] postgresql-pre-start[738]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 10.091383] postgresql-pre-start[738]: The default database encoding has accordingly been set to "UTF8". lb # [ 10.092650] postgresql-pre-start[738]: The default text search configuration will be set to "english". lb # [ 10.093868] postgresql-pre-start[738]: Data page checksums are enabled. lb # [ 10.094781] postgresql-pre-start[738]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 10.095932] postgresql-pre-start[738]: creating subdirectories ... ok lb # [ 10.096812] postgresql-pre-start[738]: selecting dynamic shared memory implementation ... posix client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.193535] postgresql-pre-start[738]: selecting default "max_connections" ... 100 lb: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } client # [ 10.203594] dhcpcd[561]: eth0: soliciting a DHCP lease client # [ 10.355949] NET: Registered PF_PACKET protocol family client # [ 10.226827] dhcpcd[561]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 10.229377] dhcpcd[561]: eth0: probing address 10.0.2.15/24 lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.251727] postgresql-pre-start[738]: selecting default "shared_buffers" ... 128MB lb # [ 10.258732] systemd-vconsole-setup[714]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 10.263222] systemd[1]: Finished Virtual Console Setup. worker1 # [ 10.296324] nix-grpc-daemon[512]: ts=2026-09-23T15:59:39Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.02 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service client # [ 10.837970] dhcpcd[561]: eth0: soliciting an IPv6 router client # [ 10.840581] dhcpcd[561]: eth0: Router Advertisement from fe80::2 client # [ 10.842977] dhcpcd[561]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 10.845415] dhcpcd[561]: eth0: adding route to fec0::/64 client # [ 10.847412] dhcpcd[561]: eth0: adding default route via fe80::2 lb # [ 10.905074] postgresql-pre-start[738]: selecting default time zone ... UTC lb # [ 10.907972] postgresql-pre-start[738]: creating configuration files ... ok lb # [ 11.071148] postgresql-pre-start[738]: running bootstrap script ... ok lb # [ 11.196488] dhcpcd[716]: eth0: soliciting a DHCP lease lb # [ 11.344882] NET: Registered PF_PACKET protocol family lb # [ 11.217514] dhcpcd[716]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 11.220186] dhcpcd[716]: eth0: probing address 10.0.2.15/24 worker1 # [ 11.281390] dhcpcd[739]: eth0: soliciting a DHCP lease worker1 # [ 11.433914] NET: Registered PF_PACKET protocol family worker1 # [ 11.306196] dhcpcd[739]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 11.309271] dhcpcd[739]: eth0: probing address 10.0.2.15/24 worker1 # [ 11.468762] dhcpcd[739]: eth0: soliciting an IPv6 router worker1 # [ 11.472081] dhcpcd[739]: eth0: Router Advertisement from fe80::2 worker1 # [ 11.474324] dhcpcd[739]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 11.476537] dhcpcd[739]: eth0: adding route to fec0::/64 worker1 # [ 11.478364] dhcpcd[739]: eth0: adding default route via fe80::2 lb # [ 11.477260] postgresql-pre-start[738]: performing post-bootstrap initialization ... ok lb # [ 11.637747] postgresql-pre-start[738]: syncing data to disk ... ok lb # [ 11.639617] postgresql-pre-start[738]: initdb: warning: enabling "trust" authentication for local connections lb # [ 11.640822] postgresql-pre-start[738]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 11.642606] postgresql-pre-start[738]: Success. You can now start the database server using: lb # [ 11.643624] postgresql-pre-start[738]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 11.722711] postgres[792]: [792] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 11.725556] postgres[792]: [792] LOG: listening on IPv6 address "::1", port 5432 lb # [ 11.726651] postgres[792]: [792] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 11.729356] postgres[792]: [792] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 11.743283] postgres[801]: [801] LOG: database system was shut down at 2026-09-23 15:59:41 GMT lb # [ 11.748233] postgres[792]: [792] LOG: database system is ready to accept connections lb # [ 11.753543] systemd[1]: Started PostgreSQL Server. lb # [ 11.759890] systemd[1]: Starting PostgreSQL Setup Scripts... worker1 # [ 11.896360] nix-grpc-daemon[512]: ts=2026-09-23T15:59:41Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 11.888979] postgresql-setup-start[812]: CREATE DATABASE lb # [ 11.919153] postgresql-setup-start[817]: CREATE ROLE lb # [ 11.931592] postgresql-setup-start[819]: ALTER DATABASE lb # [ 11.936209] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 11.937956] systemd[1]: Reached target PostgreSQL. worker2 # [ 12.055880] dhcpcd[687]: eth0: soliciting an IPv6 router worker2 # [ 12.058073] dhcpcd[687]: eth0: Router Advertisement from fe80::2 worker2 # [ 12.060276] dhcpcd[687]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 12.062412] dhcpcd[687]: eth0: adding route to fec0::/64 worker2 # [ 12.064210] dhcpcd[687]: eth0: adding default route via fe80::2 lb # [ 12.556156] dhcpcd[716]: eth0: soliciting an IPv6 router lb # [ 12.559448] dhcpcd[716]: eth0: Router Advertisement from fe80::2 lb # [ 12.562446] dhcpcd[716]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 12.565423] dhcpcd[716]: eth0: adding route to fec0::/64 lb # [ 12.567691] dhcpcd[716]: eth0: adding default route via fe80::2 worker2 # [ 14.995660] dhcpcd[687]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 14.998693] dhcpcd[687]: eth0: adding route to 10.0.2.0/24 worker2 # [ 15.001140] dhcpcd[687]: eth0: adding default route via 10.0.2.2 worker2 # [ 15.088475] systemd[1]: Started DHCP Client. worker2 # [ 15.091144] systemd[1]: Reached target Network is Online. worker2 # [ 15.093103] systemd[1]: Starting scheduler-token.service... worker1 # [ 15.096954] nix-grpc-daemon[512]: ts=2026-09-23T15:59:44Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 15.129739] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 15.131332] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. worker2 # [ 15.133340] systemd[1]: Failed to start scheduler-token.service. worker2 # [ 15.134879] systemd[1]: Dependency failed for Nix worker-protocol over gRPC. worker2 # [ 15.136774] systemd[1]: nix-grpc-daemon.service: Job nix-grpc-daemon.service/start failed with result 'dependency'. worker2 # [ 15.138467] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 39ms wall clock time, 3.1M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. worker2 # [ 15.140297] systemd[1]: Reached target Multi-User System. worker2 # [ 15.141036] systemd[1]: Startup finished in 872ms (kernel) + 4.599s (initrd) + 9.666s (userspace) = 15.138s. client # [ 15.256686] dhcpcd[561]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 15.259570] dhcpcd[561]: eth0: adding route to 10.0.2.0/24 client # [ 15.261768] dhcpcd[561]: eth0: adding default route via 10.0.2.2 client # [ 15.343141] systemd[1]: Started DHCP Client. client # [ 15.345395] systemd[1]: Reached target Multi-User System. client # [ 15.346398] systemd[1]: Startup finished in 862ms (kernel) + 4.587s (initrd) + 9.896s (userspace) = 15.346s. lb # [ 16.037387] dhcpcd[716]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 16.040374] dhcpcd[716]: eth0: adding route to 10.0.2.0/24 lb # [ 16.042785] dhcpcd[716]: eth0: adding default route via 10.0.2.2 worker2 # [ 16.134275] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 1. worker2 # [ 16.142894] systemd[1]: Starting scheduler-token.service... lb # [ 16.126091] systemd[1]: Started DHCP Client. lb # [ 16.128455] systemd[1]: Reached target Network is Online. lb # [ 16.131332] systemd[1]: Started Envoy reverse proxy. lb # [ 16.135292] systemd[1]: Started mock-oidc.service. worker2 # [ 16.196761] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 16.198355] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. worker2 # [ 16.200365] systemd[1]: Failed to start scheduler-token.service. worker2 # [ 16.201693] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 1.065s wall clock time, 2.1M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. lb # [ 16.290364] mock-oidc-server[919]: Mock OIDC Server running lb # [ 16.291853] mock-oidc-server[919]: OIDC Address: 192.168.1.2:8080 lb # [ 16.292861] mock-oidc-server[919]: Issue Address: 0.0.0.0:8081 lb # [ 16.294081] mock-oidc-server[919]: Issuer: http://192.168.1.2:8080/oidc lb # [ 16.294947] mock-oidc-server[919]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 16.296364] mock-oidc-server[919]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 16.297617] mock-oidc-server[919]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 16.438469] envoy[918]: [2026-09-23 15:59:46.518][918][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 16.441054] envoy[918]: [2026-09-23 15:59:46.520][918][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 16.442433] envoy[918]: [2026-09-23 15:59:46.520][918][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 16.445132] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 16.457191] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 16.463387] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 16.469180] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 16.471592] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 16.473638] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.476726] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 16.478828] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 16.480834] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 16.483025] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 16.484971] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 16.489483] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 16.493391] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 16.495020] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 16.496979] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 16.498917] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 16.501126] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 16.512893] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 16.514912] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 16.516848] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 16.519100] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 16.520978] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 16.523786] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 16.525572] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 16.527235] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 16.529437] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 16.531290] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 16.537313] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 16.539665] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 16.541745] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 16.544122] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 16.547137] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 16.550088] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 16.556433] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 16.558303] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 16.559863] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 16.561534] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 16.563741] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 16.565401] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 16.566877] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 16.568455] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.570385] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 16.573192] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 16.574777] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 16.576388] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 16.580923] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 16.582564] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 16.584344] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 16.586180] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 16.587930] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 16.590825] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 16.593150] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 16.598648] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 16.600151] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 16.601844] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 16.603522] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 16.606748] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 16.608797] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 16.634167] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 16.635769] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 16.637750] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 16.640083] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 16.642479] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 16.644538] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 16.650551] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 16.652246] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 16.654636] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 16.656860] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 16.660115] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 16.663947] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 16.668189] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 16.669994] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 16.673967] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 16.677129] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 16.679327] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 16.682196] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 16.684904] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 16.693986] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 16.697401] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 16.702100] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 16.703942] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 16.707019] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 16.709347] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 16.713397] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 16.716274] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 16.718507] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 16.721141] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 16.723714] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 16.725421] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 16.727145] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 16.729222] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 16.731519] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 16.733214] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 16.736246] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 16.740178] envoy[918]: [2026-09-23 15:59:46.521][918][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 16.742545] envoy[918]: [2026-09-23 15:59:46.532][918][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 16.744904] envoy[918]: [2026-09-23 15:59:46.532][918][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 16.746540] envoy[918]: [2026-09-23 15:59:46.533][918][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 16.748147] envoy[918]: [2026-09-23 15:59:46.533][918][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 16.750863] envoy[918]: [2026-09-23 15:59:46.533][918][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 16.752481] envoy[918]: [2026-09-23 15:59:46.533][918][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 16.756659] envoy[918]: [2026-09-23 15:59:46.533][918][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 16.758119] envoy[918]: [2026-09-23 15:59:46.533][918][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 16.760587] envoy[918]: [2026-09-23 15:59:46.557][918][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 16.761882] envoy[918]: [2026-09-23 15:59:46.595][918][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 16.774638] envoy[918]: [2026-09-23 15:59:46.595][918][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 16.776086] envoy[918]: [2026-09-23 15:59:46.595][918][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 16.784506] envoy[918]: [2026-09-23 15:59:46.595][918][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 16.789471] envoy[918]: [2026-09-23 15:59:46.870][918][info][main] [source/server/server.cc:968] runtime: {} lb # [ 16.791972] envoy[918]: [2026-09-23 15:59:46.872][918][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 16.793615] envoy[918]: [2026-09-23 15:59:46.874][918][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 16.795481] envoy[918]: [2026-09-23 15:59:46.876][918][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 16.797522] envoy[918]: [2026-09-23 15:59:46.878][918][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 16.799376] envoy[918]: [2026-09-23 15:59:46.879][918][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 16.800873] envoy[918]: [2026-09-23 15:59:46.879][918][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) worker1 # [ 16.826516] dhcpcd[739]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 16.814594] envoy[918]: [2026-09-23 15:59:46.895][918][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 16.831844] dhcpcd[739]: eth0: adding route to 10.0.2.0/24 lb # [ 16.818788] envoy[918]: [2026-09-23 15:59:46.899][918][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker1 # [ 16.834491] dhcpcd[739]: eth0: adding default route via 10.0.2.2 lb # [ 16.820856] envoy[918]: [2026-09-23 15:59:46.901][918][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 16.824414] envoy[918]: [2026-09-23 15:59:46.901][918][info][main] [source/server/server.cc:1077] starting main dispatch loop lb # [ 16.825822] envoy[918]: [2026-09-23 15:59:46.904][918][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 16.827320] envoy[918]: [2026-09-23 15:59:46.904][918][info][upstream] [source/common/upstream/cluster_manager_impl.cc:227] cm init: initializing secondary clusters worker1 # [ 16.918787] systemd[1]: Started DHCP Client. worker1 # [ 16.920921] systemd[1]: Reached target Multi-User System. worker1 # [ 16.921770] systemd[1]: Startup finished in 860ms (kernel) + 4.526s (initrd) + 11.533s (userspace) = 16.920s. worker2 # [ 17.296397] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 2. worker2 # [ 17.304769] systemd[1]: Starting scheduler-token.service... worker2 # [ 17.367902] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 17.371120] systemd[1]: Finished scheduler-token.service. worker2 # [ 17.373501] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 1.166s wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb # [ 17.534471] rustfs-bucket-start[943]: mb s3://farm lb # [ 17.550301] systemd[1]: Finished rustfs-bucket.service. lb # [ 17.557773] systemd[1]: Starting niks3 server... lb # [ 17.674461] postgres[955]: [955] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 17.676121] postgres[955]: [955] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 17.697485] niks3-server[950]: 2026/09/23 15:59:47 OK 20241026095416_initial_model.sql (12.69ms) lb # [ 17.701453] niks3-server[950]: 2026/09/23 15:59:47 OK 20251210153512_drop_unused_gin_index.sql (4.16ms) lb # [ 17.706799] niks3-server[950]: 2026/09/23 15:59:47 OK 20251218171726_add_pins.sql (5.4ms) lb # [ 17.711280] niks3-server[950]: 2026/09/23 15:59:47 OK 20260628120000_add_object_size_and_stats.sql (3.23ms) lb # [ 17.716230] niks3-server[950]: 2026/09/23 15:59:47 OK 20260905000000_add_claims.sql (5ms) lb # [ 17.720409] niks3-server[950]: 2026/09/23 15:59:47 OK 20260920000000_drop_claims.sql (3.03ms) lb # [ 17.723534] niks3-server[950]: 2026/09/23 15:59:47 OK 20260923120000_add_pushes.sql (1.87ms) lb # [ 17.724831] niks3-server[950]: 2026/09/23 15:59:47 goose: successfully migrated database to version: 20260923120000 lb # [ 17.729100] niks3-server[950]: 2026/09/23 15:59:47 OK 1_commit_pending_closure.sql (4.17ms) lb # [ 17.732155] niks3-server[950]: 2026/09/23 15:59:47 OK 2_object_stats_trigger.sql (3ms) lb # [ 17.734753] niks3-server[950]: 2026/09/23 15:59:47 OK 3_commit_push.sql (2.54ms) lb # [ 17.735767] niks3-server[950]: 2026/09/23 15:59:47 goose: up to current file version: 3 lb # [ 17.739204] niks3-server[950]: 2026/09/23 15:59:47 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 17.766057] niks3-server[950]: 2026/09/23 15:59:47 INFO Read proxy enabled — serving cache objects from S3 lb # [ 17.768149] niks3-server[950]: 2026/09/23 15:59:47 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 17.770068] systemd[1]: Started niks3 server. lb # [ 17.771292] niks3-server[950]: 2026/09/23 15:59:47 INFO systemd watchdog enabled interval=15s lb # [ 17.773310] niks3-server[950]: 2026/09/23 15:59:47 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 17.776069] systemd[1]: Reached target Multi-User System. lb # [ 17.777420] systemd[1]: Startup finished in 869ms (kernel) + 4.618s (initrd) + 12.289s (userspace) = 17.777s. lb: (finished: waiting for unit niks3.service, in 7.53 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.02 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost worker1 # [ 20.097581] nix-grpc-daemon[512]: ts=2026-09-23T15:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1 # [ 25.098329] nix-grpc-daemon[512]: ts=2026-09-23T15:59:54Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 27.782797] niks3-server[950]: 2026/09/23 15:59:57 INFO lead: acquired remote=192.168.1.3:54832 worker1 # [ 27.802831] nix-grpc-daemon[512]: ts=2026-09-23T15:59:57Z level=info event=scheduler_take_over worker1 # [ 30.099122] nix-grpc-daemon[512]: ts=2026-09-23T15:59:59Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1 # [ 31.270228] nix-grpc-daemon[512]: ts=2026-09-23T16:00:00Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:56022 lb # [ 31.255685] envoy[918]: [2026-09-23 16:00:01.335][918][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 31.260569] envoy[918]: [2026-09-23 16:00:01.335][918][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 31.266471] envoy[918]: [2026-09-23 16:00:01.347][918][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 31.439710] envoy[918]: conn peer=[::1]:59588 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=5 lb: (finished: waiting for TCP port 50051 on localhost, in 13.49 seconds) worker2 # [ 31.583304] systemd[1]: Starting scheduler-token.service... worker2 # [ 31.629601] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 31.631277] systemd[1]: Finished scheduler-token.service. worker2 # [ 31.632523] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 51ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 31.637141] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 31.742897] nix-grpc-daemon[801]: ts=2026-09-23T16:00:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 31.753061] nix-grpc-daemon[801]: ts=2026-09-23T16:00:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 31.755311] nix-grpc-daemon[801]: ts=2026-09-23T16:00:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 31.769292] nix-grpc-daemon[801]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 31.770979] nix-grpc-daemon[801]: E0000 00:00:1790179201.773698 801 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 31.777123] nix-grpc-daemon[801]: E0000 00:00:1790179201.781666 801 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 31.780794] nix-grpc-daemon[801]: ts=2026-09-23T16:00:01Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 31.784730] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 31.794074] nix-grpc-daemon[801]: E0000 00:00:1790179201.798775 843 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 31.808065] nix-grpc-daemon[801]: E0000 00:00:1790179201.812040 843 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 31.810188] nix-grpc-daemon[801]: E0000 00:00:1790179201.812139 843 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 31.821559] nix-grpc-daemon[801]: E0000 00:00:1790179201.826241 843 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 31.840159] nix-grpc-daemon[801]: ts=2026-09-23T16:00:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.829586] nix-grpc-daemon[512]: ts=2026-09-23T16:00:01Z level=info event=oidc_jwks provider=mock keys=1 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 31.832618] nix-grpc-daemon[512]: ts=2026-09-23T16:00:01Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56024 worker1 # [ 31.837125] nix-grpc-daemon[512]: ts=2026-09-23T16:00:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 35.100718] nix-grpc-daemon[512]: ts=2026-09-23T16:00:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.105976] nix-grpc-daemon[512]: ts=2026-09-23T16:00:04Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56024 worker1 # [ 35.112249] nix-grpc-daemon[512]: ts=2026-09-23T16:00:04Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 4.26 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.44 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 36.648759] nix-grpc-daemon[512]: ts=2026-09-23T16:00:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 36.659527] systemd[1]: Started Nix Daemon. worker1 # [ 36.771825] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 36.795367] nix-grpc-daemon[512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5) worker1 # [ 36.867980] nix-grpc-daemon[512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 158 ms (attempt 2/5) worker1 # [ 37.028588] nix-grpc-daemon[512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 3/5) worker1 # [ 37.040914] nix-grpc-daemon[512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 730 ms (attempt 4/5) worker1 # [ 37.780316] nix-grpc-daemon[512]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 37.784585] nix-grpc-daemon[512]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 37.837204] nix-grpc-daemon[801]: ts=2026-09-23T16:00:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 37.848961] systemd[1]: Started Nix Daemon. worker2 # [ 37.971658] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 37.997228] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 1/5) worker2 # [ 38.051932] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 2/5) worker2 # [ 38.113374] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 115 ms (attempt 3/5) worker2 # [ 38.230379] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 309 ms (attempt 4/5) worker2 # [ 38.546564] nix-grpc-daemon[801]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 38.550723] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 38.564695] nix-grpc-daemon[801]: ts=2026-09-23T16:00:08Z level=debug event=path_info_miss path=hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test error="error: path '/nix/store/hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 38.575608] nix-grpc-daemon[801]: ts=2026-09-23T16:00:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 38.581565] nix-grpc-daemon[801]: ts=2026-09-23T16:00:08Z level=debug event=path_info_miss path=hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test error="error: path '/nix/store/hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.05 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker2 # [ 38.811173] nix-grpc-daemon[801]: ts=2026-09-23T16:00:08Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 38.816545] nix-grpc-daemon[801]: ts=2026-09-23T16:00:08Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:42452 worker2 # [ 38.832550] nix-grpc-daemon[801]: ts=2026-09-23T16:00:08Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:42452 worker2 # [ 38.844411] nix-grpc-daemon[801]: ts=2026-09-23T16:00:08Z level=debug event=path_info_miss path=hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test error="error: path '/nix/store/hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 38.854252] nix-grpc-daemon[801]: ts=2026-09-23T16:00:08Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:42452 worker1 # [ 38.823773] nix-grpc-daemon[512]: E0000 00:00:1790179208.032743 570 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 38.861420] nix-grpc-daemon[801]: ts=2026-09-23T16:00:08Z level=debug event=path_info_miss path=hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test error="error: path '/nix/store/hcd7c1gssanjyr6daz78amrlyss1f6ps-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 38.855159] nix-grpc-daemon[512]: E0000 00:00:1790179208.064780 570 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. client: must succeed: rm -r /var/lib/nix-grpc-store worker1 # [ 38.865133] nix-grpc-daemon[512]: E0000 00:00:1790179208.071536 570 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.01 seconds) worker1 # [ 38.886149] nix-grpc-daemon[512]: E0000 00:00:1790179208.096358 570 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 38.989155] nix-grpc-daemon[512]: ts=2026-09-23T16:00:08Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 39.165940] nix-grpc-daemon[801]: ts=2026-09-23T16:00:09Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.70 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 39.308860] nix-grpc-daemon[801]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42452 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 39.317874] nix-grpc-daemon[801]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 39.323885] nix-grpc-daemon[512]: ts=2026-09-23T16:00:08Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker1 # [ 39.328447] nix-grpc-daemon[512]: ts=2026-09-23T16:00:08Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 39.361090] nix-grpc-daemon[801]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 39.373428] nix-grpc-daemon[801]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 client # copying 1 paths to 'lb:50051'... worker2 # [ 39.385142] nix-grpc-daemon[801]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker2 # [ 39.405930] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 39.433273] nix-grpc-daemon[801]: ts=2026-09-23T16:00:09Z level=info event=niks3_push_started pid=871 worker2 # [ 39.592809] nix-grpc-daemon[871]: time=2026-09-23T16:00:09.596Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 39.692944] nix-daemon[858]: accepted connection from pid 884, user nix-grpc-daemon (trusted) worker2 # [ 39.706139] nix-daemon[858]: reaped child process 887, status = succeeded lb # [ 39.674243] niks3-server[950]: 2026/09/23 16:00:09 INFO Received push request method=POST path=/api/pushes worker2 # [ 39.732357] nix-grpc-daemon[871]: time=2026-09-23T16:00:09.737Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 39.733878] nix-grpc-daemon[871]: time=2026-09-23T16:00:09.738Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 39.733411] niks3-server[950]: 2026/09/23 16:00:09 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign lb # [ 39.744453] niks3-server[950]: 2026/09/23 16:00:09 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 39.763798] niks3-server[950]: 2026/09/23 16:00:09 INFO Signed narinfos id=1 count=1 worker2 # [ 39.807163] nix-grpc-daemon[871]: time=2026-09-23T16:00:09.811Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.770893] niks3-server[950]: 2026/09/23 16:00:09 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 39.778772] niks3-server[950]: 2026/09/23 16:00:09 INFO Received complete push request method=POST path=/api/pushes/1/complete lb # [ 39.788856] niks3-server[950]: 2026/09/23 16:00:09 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo worker2 # [ 39.836515] nix-grpc-daemon[871]: time=2026-09-23T16:00:09.840Z level=INFO msg="Upload complete. (238ms)" worker2 # [ 39.840769] nix-grpc-daemon[801]: ts=2026-09-23T16:00:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 39.848926] nix-grpc-daemon[801]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 39.859343] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 39.872262] nix-daemon[858]: reaped child process 869, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... worker2 # [ 39.879740] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 40.518495] nix-daemon[858]: reaped child process 891, status = succeeded worker2 # [ 40.604496] nix-daemon[858]: accepted connection from pid 907, user nix-grpc-daemon (trusted) worker2 # [ 40.618241] nix-daemon[858]: reaped child process 910, status = succeeded lb # [ 40.585191] niks3-server[950]: 2026/09/23 16:00:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 40.636815] nix-grpc-daemon[871]: time=2026-09-23T16:00:10.641Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 40.638330] nix-grpc-daemon[871]: time=2026-09-23T16:00:10.643Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 40.629469] niks3-server[950]: 2026/09/23 16:00:10 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 40.640316] niks3-server[950]: 2026/09/23 16:00:10 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 40.648833] niks3-server[950]: 2026/09/23 16:00:10 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign worker2 # [ 40.695564] nix-grpc-daemon[871]: time=2026-09-23T16:00:10.700Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.655193] niks3-server[950]: 2026/09/23 16:00:10 INFO Signed narinfos id=2 count=1 lb # [ 40.660192] niks3-server[950]: 2026/09/23 16:00:10 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 40.668922] niks3-server[950]: 2026/09/23 16:00:10 INFO Received complete push request method=POST path=/api/pushes/2/complete lb # [ 40.678554] niks3-server[950]: 2026/09/23 16:00:10 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker2 # [ 40.723212] nix-grpc-daemon[871]: time=2026-09-23T16:00:10.727Z level=INFO msg="Upload complete. (233ms)" worker2 # [ 40.728665] nix-grpc-daemon[801]: ts=2026-09-23T16:00:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker1 # [ 40.715223] nix-grpc-daemon[512]: ts=2026-09-23T16:00:09Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 40.742099] nix-grpc-daemon[801]: ts=2026-09-23T16:00:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 40.719498] nix-grpc-daemon[512]: ts=2026-09-23T16:00:09Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 40.751451] nix-daemon[858]: reaped child process 889, status = succeeded worker2 # [ 40.753912] nix-grpc-daemon[801]: ts=2026-09-23T16:00:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 40.762738] nix-grpc-daemon[871]: time=2026-09-23T16:00:10.767Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 40.770132] nix-grpc-daemon[801]: ts=2026-09-23T16:00:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker2 # [ 40.786920] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 40.887768] nix-daemon[858]: accepted connection from pid 914, user nix-grpc-daemon (trusted) worker2 # [ 40.903295] nix-daemon[858]: reaped child process 917, status = succeeded lb # [ 40.869135] niks3-server[950]: 2026/09/23 16:00:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 40.920577] nix-grpc-daemon[871]: time=2026-09-23T16:00:10.925Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 40.922214] nix-grpc-daemon[871]: time=2026-09-23T16:00:10.926Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 40.904526] niks3-server[950]: 2026/09/23 16:00:10 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 40.911480] niks3-server[950]: 2026/09/23 16:00:10 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign lb # [ 40.917094] niks3-server[950]: 2026/09/23 16:00:10 INFO Signed narinfos id=3 count=1 worker2 # [ 40.961141] nix-grpc-daemon[871]: time=2026-09-23T16:00:10.965Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.930462] niks3-server[950]: 2026/09/23 16:00:11 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 40.941896] niks3-server[950]: 2026/09/23 16:00:11 INFO Received complete push request method=POST path=/api/pushes/3/complete lb # [ 40.947688] niks3-server[950]: 2026/09/23 16:00:11 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker2 # [ 40.991211] nix-grpc-daemon[871]: time=2026-09-23T16:00:10.995Z level=INFO msg="Upload complete. (192ms)" worker2 # [ 40.996596] nix-grpc-daemon[801]: ts=2026-09-23T16:00:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 41.003505] nix-grpc-daemon[801]: ts=2026-09-23T16:00:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 41.012454] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 41.026874] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... worker2 # [ 41.029049] nix-daemon[858]: reaped child process 912, status = succeeded client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 42.064837] nix-daemon[858]: reaped child process 921, status = succeeded worker2 # [ 42.149276] nix-daemon[858]: accepted connection from pid 938, user nix-grpc-daemon (trusted) worker2 # [ 42.162986] nix-daemon[858]: reaped child process 941, status = succeeded lb # [ 42.130705] niks3-server[950]: 2026/09/23 16:00:12 INFO Received push request method=POST path=/api/pushes worker2 # [ 42.179861] nix-grpc-daemon[871]: time=2026-09-23T16:00:12.184Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 42.181371] nix-grpc-daemon[871]: time=2026-09-23T16:00:12.186Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 42.171155] niks3-server[950]: 2026/09/23 16:00:12 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign worker2 # [ 42.221236] nix-grpc-daemon[871]: time=2026-09-23T16:00:12.225Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.180231] niks3-server[950]: 2026/09/23 16:00:12 INFO Signed narinfos id=4 count=1 lb # [ 42.189652] niks3-server[950]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 42.194920] niks3-server[950]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 42.199249] niks3-server[950]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 42.204500] niks3-server[950]: 2026/09/23 16:00:12 INFO Received complete push request method=POST path=/api/pushes/4/complete lb # [ 42.211502] niks3-server[950]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker2 # [ 42.255507] nix-grpc-daemon[871]: time=2026-09-23T16:00:12.260Z level=INFO msg="Upload complete. (220ms)" worker2 # [ 42.261071] nix-grpc-daemon[801]: ts=2026-09-23T16:00:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker1 # [ 42.243851] nix-grpc-daemon[512]: ts=2026-09-23T16:00:11Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker1 # [ 42.248573] nix-grpc-daemon[512]: ts=2026-09-23T16:00:11Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 42.276054] nix-grpc-daemon[801]: ts=2026-09-23T16:00:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 42.282295] nix-daemon[858]: reaped child process 919, status = succeeded worker2 # [ 42.287698] nix-grpc-daemon[801]: ts=2026-09-23T16:00:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 42.296728] nix-grpc-daemon[871]: time=2026-09-23T16:00:12.301Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 42.304088] nix-grpc-daemon[801]: ts=2026-09-23T16:00:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker2 # [ 42.323362] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 42.420135] nix-daemon[858]: accepted connection from pid 945, user nix-grpc-daemon (trusted) worker2 # [ 42.433337] nix-daemon[858]: reaped child process 948, status = succeeded lb # [ 42.401348] niks3-server[950]: 2026/09/23 16:00:12 INFO Received push request method=POST path=/api/pushes worker2 # [ 42.450924] nix-grpc-daemon[871]: time=2026-09-23T16:00:12.455Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 42.452430] nix-grpc-daemon[871]: time=2026-09-23T16:00:12.457Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 42.434811] niks3-server[950]: 2026/09/23 16:00:12 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign lb # [ 42.440274] niks3-server[950]: 2026/09/23 16:00:12 INFO Signed narinfos id=5 count=1 worker2 # [ 42.487257] nix-grpc-daemon[871]: time=2026-09-23T16:00:12.491Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.449673] niks3-server[950]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 42.455296] niks3-server[950]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 42.467756] niks3-server[950]: 2026/09/23 16:00:12 INFO Received complete push request method=POST path=/api/pushes/5/complete worker2 # [ 42.520109] nix-grpc-daemon[871]: time=2026-09-23T16:00:12.524Z level=INFO msg="Upload complete. (186ms)" lb # [ 42.480160] niks3-server[950]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker2 # [ 42.524946] nix-grpc-daemon[801]: ts=2026-09-23T16:00:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 42.530558] nix-grpc-daemon[801]: ts=2026-09-23T16:00:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 42.541494] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 42.552099] nix-daemon[858]: reaped child process 943, status = succeeded worker2 # [ 42.555121] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker2 # [ 43.370573] nix-daemon[858]: reaped child process 952, status = succeeded worker2 # [ 43.453442] nix-daemon[858]: accepted connection from pid 968, user nix-grpc-daemon (trusted) worker2 # [ 43.465269] nix-daemon[858]: reaped child process 971, status = succeeded lb # [ 43.433956] niks3-server[950]: 2026/09/23 16:00:13 INFO Received push request method=POST path=/api/pushes worker2 # [ 43.483856] nix-grpc-daemon[871]: time=2026-09-23T16:00:13.488Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 43.485311] nix-grpc-daemon[871]: time=2026-09-23T16:00:13.490Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 43.468640] niks3-server[950]: 2026/09/23 16:00:13 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 43.485710] niks3-server[950]: 2026/09/23 16:00:13 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign worker2 # [ 43.535480] nix-grpc-daemon[871]: time=2026-09-23T16:00:13.540Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.494665] niks3-server[950]: 2026/09/23 16:00:13 INFO Signed narinfos id=6 count=1 lb # [ 43.497849] niks3-server[950]: 2026/09/23 16:00:13 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 43.504510] niks3-server[950]: 2026/09/23 16:00:13 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 43.514349] niks3-server[950]: 2026/09/23 16:00:13 INFO Received complete push request method=POST path=/api/pushes/6/complete worker2 # [ 43.559676] nix-grpc-daemon[871]: time=2026-09-23T16:00:13.564Z level=INFO msg="Upload complete. (198ms)" lb # [ 43.521814] niks3-server[950]: 2026/09/23 16:00:13 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker2 # [ 43.566479] nix-grpc-daemon[801]: ts=2026-09-23T16:00:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker2 # [ 43.580579] nix-daemon[858]: reaped child process 950, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 4.42 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.12 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 4.77 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.17 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 44.424559] nix-grpc-daemon[801]: ts=2026-09-23T16:00:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42452 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # [ 44.443819] nix-grpc-daemon[801]: ts=2026-09-23T16:00:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 44.452915] nix-grpc-daemon[871]: time=2026-09-23T16:00:14.457Z level=INFO msg="All 2 paths already cached" worker1 # [ 44.444567] nix-grpc-daemon[512]: ts=2026-09-23T16:00:13Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.20 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.81 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 worker1 # [ 44.974438] nix-grpc-daemon[512]: ts=2026-09-23T16:00:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45556 client # don't know how to build these paths: client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 45.009297] nix-grpc-daemon[801]: ts=2026-09-23T16:00:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 45.019443] nix-grpc-daemon[871]: time=2026-09-23T16:00:15.023Z level=INFO msg="All 2 paths already cached" worker1 # [ 45.008283] nix-grpc-daemon[512]: ts=2026-09-23T16:00:14Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker1 # [ 45.012383] nix-grpc-daemon[512]: ts=2026-09-23T16:00:14Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 45.044610] nix-grpc-daemon[801]: ts=2026-09-23T16:00:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 45.058836] nix-grpc-daemon[801]: ts=2026-09-23T16:00:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 45.073437] nix-grpc-daemon[871]: time=2026-09-23T16:00:15.078Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker2 # [ 45.082856] nix-grpc-daemon[801]: ts=2026-09-23T16:00:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 45.094171] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 45.202858] nix-daemon[858]: accepted connection from pid 988, user nix-grpc-daemon (trusted) worker2 # [ 45.216565] nix-daemon[858]: reaped child process 991, status = succeeded lb # [ 45.186184] niks3-server[950]: 2026/09/23 16:00:15 INFO Received push request method=POST path=/api/pushes worker2 # [ 45.234691] nix-grpc-daemon[871]: time=2026-09-23T16:00:15.239Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 45.236709] nix-grpc-daemon[871]: time=2026-09-23T16:00:15.240Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 45.221843] niks3-server[950]: 2026/09/23 16:00:15 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 45.227117] niks3-server[950]: 2026/09/23 16:00:15 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign worker2 # [ 45.273503] nix-grpc-daemon[871]: time=2026-09-23T16:00:15.278Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.232596] niks3-server[950]: 2026/09/23 16:00:15 INFO Signed narinfos id=7 count=1 lb # [ 45.238416] niks3-server[950]: 2026/09/23 16:00:15 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 45.248567] niks3-server[950]: 2026/09/23 16:00:15 INFO Received complete push request method=POST path=/api/pushes/7/complete lb # [ 45.255656] niks3-server[950]: 2026/09/23 16:00:15 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker2 # [ 45.295718] nix-grpc-daemon[871]: time=2026-09-23T16:00:15.300Z level=INFO msg="Upload complete. (188ms)" worker2 # [ 45.299826] nix-grpc-daemon[801]: ts=2026-09-23T16:00:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 45.304621] nix-grpc-daemon[801]: ts=2026-09-23T16:00:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 45.316024] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 45.319789] nix-daemon[858]: reaped child process 986, status = succeeded worker2 # [ 45.324451] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 46.752955] nix-daemon[858]: reaped child process 995, status = succeeded worker2 # [ 46.837810] nix-daemon[858]: accepted connection from pid 1011, user nix-grpc-daemon (trusted) worker2 # [ 46.851087] nix-daemon[858]: reaped child process 1014, status = succeeded lb # [ 46.817984] envoy[918]: conn peer=[2001:db8:1::1]:45588 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=406 ms=1935 lb # [ 46.822977] envoy[918]: conn peer=[2001:db8:1::1]:45598 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=69 lb # [ 46.826505] envoy[918]: conn peer=[2001:db8:1::1]:45608 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=11 lb # [ 46.831524] envoy[918]: conn peer=[2001:db8:1::1]:45622 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=12 lb # [ 46.835267] envoy[918]: conn peer=[2001:db8:1::1]:45630 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9464 tx=4373 ms=4275 lb # [ 46.840521] envoy[918]: conn peer=[2001:db8:1::1]:45382 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=58 lb # [ 46.844725] niks3-server[950]: 2026/09/23 16:00:16 INFO Received push request method=POST path=/api/pushes worker2 # [ 46.892609] nix-grpc-daemon[871]: time=2026-09-23T16:00:16.897Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 46.896794] nix-grpc-daemon[871]: time=2026-09-23T16:00:16.898Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 46.883767] niks3-server[950]: 2026/09/23 16:00:16 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign lb # [ 46.888209] niks3-server[950]: 2026/09/23 16:00:16 INFO Signed narinfos id=8 count=1 worker2 # [ 46.931613] nix-grpc-daemon[871]: time=2026-09-23T16:00:16.936Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.898141] niks3-server[950]: 2026/09/23 16:00:16 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 46.902400] niks3-server[950]: 2026/09/23 16:00:16 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 46.908062] niks3-server[950]: 2026/09/23 16:00:16 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 46.909781] niks3-server[950]: 2026/09/23 16:00:16 INFO Received complete push request method=POST path=/api/pushes/8/complete lb # [ 46.913735] niks3-server[950]: 2026/09/23 16:00:16 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker2 # [ 46.953497] nix-grpc-daemon[871]: time=2026-09-23T16:00:16.958Z level=INFO msg="Upload complete. (221ms)" worker2 # [ 46.959749] nix-grpc-daemon[801]: ts=2026-09-23T16:00:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker2 # [ 46.974396] nix-daemon[858]: reaped child process 993, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.13 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.45 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 worker2 # [ 47.358521] nix-grpc-daemon[801]: ts=2026-09-23T16:00:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42452 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker1 # [ 47.344655] nix-grpc-daemon[512]: ts=2026-09-23T16:00:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 47.367230] nix-grpc-daemon[512]: ts=2026-09-23T16:00:16Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker1 # [ 47.372768] nix-grpc-daemon[512]: ts=2026-09-23T16:00:16Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 47.377907] nix-grpc-daemon[512]: ts=2026-09-23T16:00:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 47.390119] nix-grpc-daemon[512]: ts=2026-09-23T16:00:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker1 # [ 47.402316] nix-grpc-daemon[512]: ts=2026-09-23T16:00:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 47.417543] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 47.434712] nix-grpc-daemon[512]: ts=2026-09-23T16:00:16Z level=info event=niks3_push_started pid=917 worker1 # [ 47.559798] nix-grpc-daemon[917]: time=2026-09-23T16:00:16.769Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 47.650535] nix-daemon[865]: accepted connection from pid 930, user nix-grpc-daemon (trusted) worker1 # [ 47.664196] nix-daemon[865]: reaped child process 933, status = succeeded lb # [ 47.653338] niks3-server[950]: 2026/09/23 16:00:17 INFO Received push request method=POST path=/api/pushes worker1 # [ 47.677742] nix-grpc-daemon[917]: time=2026-09-23T16:00:16.888Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 47.679290] nix-grpc-daemon[917]: time=2026-09-23T16:00:16.889Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 47.693358] niks3-server[950]: 2026/09/23 16:00:17 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign lb # [ 47.701730] niks3-server[950]: 2026/09/23 16:00:17 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 47.707150] niks3-server[950]: 2026/09/23 16:00:17 INFO Signed narinfos id=9 count=1 worker1 # [ 47.727294] nix-grpc-daemon[917]: time=2026-09-23T16:00:16.937Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.714581] niks3-server[950]: 2026/09/23 16:00:17 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 47.728396] niks3-server[950]: 2026/09/23 16:00:17 INFO Received complete push request method=POST path=/api/pushes/9/complete worker1 # [ 47.754319] nix-grpc-daemon[917]: time=2026-09-23T16:00:16.964Z level=INFO msg="Upload complete. (190ms)" lb # [ 47.740220] niks3-server[950]: 2026/09/23 16:00:17 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker1 # [ 47.757349] nix-grpc-daemon[512]: ts=2026-09-23T16:00:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 47.763672] nix-grpc-daemon[512]: ts=2026-09-23T16:00:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 47.774647] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 47.779993] nix-daemon[865]: reaped child process 915, status = succeeded worker1 # [ 47.783206] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> node-a: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker1 # [ 48.621250] nix-daemon[865]: reaped child process 937, status = succeeded worker1 # [ 48.696550] nix-daemon[865]: accepted connection from pid 953, user nix-grpc-daemon (trusted) worker1 # [ 48.710722] nix-daemon[865]: reaped child process 956, status = succeeded lb # [ 48.701274] niks3-server[950]: 2026/09/23 16:00:18 INFO Received push request method=POST path=/api/pushes worker1 # [ 48.725349] nix-grpc-daemon[917]: time=2026-09-23T16:00:17.935Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 48.726954] nix-grpc-daemon[917]: time=2026-09-23T16:00:17.937Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 48.740172] niks3-server[950]: 2026/09/23 16:00:18 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign lb # [ 48.745769] niks3-server[950]: 2026/09/23 16:00:18 INFO Signed narinfos id=10 count=1 worker1 # [ 48.764795] nix-grpc-daemon[917]: time=2026-09-23T16:00:17.974Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.758723] niks3-server[950]: 2026/09/23 16:00:18 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 48.763152] niks3-server[950]: 2026/09/23 16:00:18 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 48.772838] niks3-server[950]: 2026/09/23 16:00:18 INFO Received complete push request method=POST path=/api/pushes/10/complete lb # [ 48.779431] niks3-server[950]: 2026/09/23 16:00:18 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 48.785636] niks3-server[950]: 2026/09/23 16:00:18 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker1 # [ 48.800996] nix-grpc-daemon[917]: time=2026-09-23T16:00:18.011Z level=INFO msg="Upload complete. (210ms)" worker1 # [ 48.807844] nix-grpc-daemon[512]: ts=2026-09-23T16:00:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker1 # [ 48.818727] nix-grpc-daemon[512]: ts=2026-09-23T16:00:18Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker1 # [ 48.824267] nix-grpc-daemon[512]: ts=2026-09-23T16:00:18Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 48.828772] nix-grpc-daemon[512]: ts=2026-09-23T16:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 48.837604] nix-daemon[865]: reaped child process 935, status = succeeded worker1 # [ 48.839186] nix-grpc-daemon[512]: ts=2026-09-23T16:00:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 48.846447] nix-grpc-daemon[917]: time=2026-09-23T16:00:18.056Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 48.852097] nix-grpc-daemon[512]: ts=2026-09-23T16:00:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker1 # [ 48.857054] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 48.943209] nix-daemon[865]: accepted connection from pid 962, user nix-grpc-daemon (trusted) worker1 # [ 48.958229] nix-daemon[865]: reaped child process 965, status = succeeded lb # [ 48.947660] niks3-server[950]: 2026/09/23 16:00:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 48.971097] nix-grpc-daemon[917]: time=2026-09-23T16:00:18.181Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 48.972752] nix-grpc-daemon[917]: time=2026-09-23T16:00:18.182Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 48.979266] niks3-server[950]: 2026/09/23 16:00:19 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 48.985295] niks3-server[950]: 2026/09/23 16:00:19 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign lb # [ 48.989805] niks3-server[950]: 2026/09/23 16:00:19 INFO Signed narinfos id=11 count=1 worker1 # [ 49.009040] nix-grpc-daemon[917]: time=2026-09-23T16:00:18.219Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.003860] niks3-server[950]: 2026/09/23 16:00:19 INFO Received complete push request method=POST path=/api/pushes/11/complete lb # [ 49.012805] niks3-server[950]: 2026/09/23 16:00:19 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 49.017361] niks3-server[950]: 2026/09/23 16:00:19 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker1 # [ 49.037719] nix-grpc-daemon[917]: time=2026-09-23T16:00:18.247Z level=INFO msg="Upload complete. (174ms)" worker1 # [ 49.042515] nix-grpc-daemon[512]: ts=2026-09-23T16:00:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 49.049332] nix-grpc-daemon[512]: ts=2026-09-23T16:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 49.057519] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 49.066361] nix-daemon[865]: reaped child process 960, status = succeeded worker1 # [ 49.071377] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> node-a: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker1 # [ 50.486810] nix-daemon[865]: reaped child process 969, status = succeeded worker1 # [ 50.561898] nix-daemon[865]: accepted connection from pid 985, user nix-grpc-daemon (trusted) worker1 # [ 50.572995] nix-daemon[865]: reaped child process 988, status = succeeded lb # [ 50.565419] niks3-server[950]: 2026/09/23 16:00:20 INFO Received push request method=POST path=/api/pushes worker1 # [ 50.590216] nix-grpc-daemon[917]: time=2026-09-23T16:00:19.800Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 50.591966] nix-grpc-daemon[917]: time=2026-09-23T16:00:19.802Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 50.603838] niks3-server[950]: 2026/09/23 16:00:20 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign lb # [ 50.607326] niks3-server[950]: 2026/09/23 16:00:20 INFO Signed narinfos id=12 count=1 worker1 # [ 50.626416] nix-grpc-daemon[917]: time=2026-09-23T16:00:19.836Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.616100] niks3-server[950]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 50.621845] niks3-server[950]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 50.626926] niks3-server[950]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 50.633954] niks3-server[950]: 2026/09/23 16:00:20 INFO Received complete push request method=POST path=/api/pushes/12/complete worker1 # [ 50.653519] nix-grpc-daemon[917]: time=2026-09-23T16:00:19.863Z level=INFO msg="Upload complete. (174ms)" lb # [ 50.640148] niks3-server[950]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker1 # [ 50.657477] nix-grpc-daemon[512]: ts=2026-09-23T16:00:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker1 # [ 50.668662] nix-grpc-daemon[512]: ts=2026-09-23T16:00:19Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker1 # [ 50.673638] nix-grpc-daemon[512]: ts=2026-09-23T16:00:19Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 50.676956] nix-grpc-daemon[512]: ts=2026-09-23T16:00:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 50.682741] nix-daemon[865]: reaped child process 967, status = succeeded worker1 # [ 50.684173] nix-grpc-daemon[512]: ts=2026-09-23T16:00:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 50.689816] nix-grpc-daemon[917]: time=2026-09-23T16:00:19.900Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 50.695155] nix-grpc-daemon[512]: ts=2026-09-23T16:00:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker1 # [ 50.700155] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 50.784044] nix-daemon[865]: accepted connection from pid 994, user nix-grpc-daemon (trusted) worker1 # [ 50.798190] nix-daemon[865]: reaped child process 997, status = succeeded lb # [ 50.787193] niks3-server[950]: 2026/09/23 16:00:20 INFO Received push request method=POST path=/api/pushes worker1 # [ 50.811194] nix-grpc-daemon[917]: time=2026-09-23T16:00:20.021Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 50.812769] nix-grpc-daemon[917]: time=2026-09-23T16:00:20.022Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 50.817477] niks3-server[950]: 2026/09/23 16:00:20 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign lb # [ 50.822587] niks3-server[950]: 2026/09/23 16:00:20 INFO Signed narinfos id=13 count=1 worker1 # [ 50.841099] nix-grpc-daemon[917]: time=2026-09-23T16:00:20.051Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.826938] niks3-server[950]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 50.834993] niks3-server[950]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 50.840522] niks3-server[950]: 2026/09/23 16:00:20 INFO Received complete push request method=POST path=/api/pushes/13/complete worker1 # [ 50.859448] nix-grpc-daemon[917]: time=2026-09-23T16:00:20.069Z level=INFO msg="Upload complete. (153ms)" worker1 # [ 50.862367] nix-grpc-daemon[512]: ts=2026-09-23T16:00:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 50.847049] niks3-server[950]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker1 # [ 50.865232] nix-grpc-daemon[512]: ts=2026-09-23T16:00:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 50.873162] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 50.874468] nix-daemon[865]: reaped child process 992, status = succeeded worker1 # [ 50.879639] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... client # farm-top> node-a: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker1 # [ 51.720709] nix-daemon[865]: reaped child process 1001, status = succeeded worker1 # [ 51.798354] nix-daemon[865]: accepted connection from pid 1017, user nix-grpc-daemon (trusted) worker1 # [ 51.811746] nix-daemon[865]: reaped child process 1020, status = succeeded lb # [ 51.802659] niks3-server[950]: 2026/09/23 16:00:21 INFO Received push request method=POST path=/api/pushes worker1 # [ 51.826631] nix-grpc-daemon[917]: time=2026-09-23T16:00:21.036Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 51.828146] nix-grpc-daemon[917]: time=2026-09-23T16:00:21.038Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 51.843295] niks3-server[950]: 2026/09/23 16:00:21 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 51.851654] niks3-server[950]: 2026/09/23 16:00:21 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign lb # [ 51.857151] niks3-server[950]: 2026/09/23 16:00:21 INFO Signed narinfos id=14 count=1 worker1 # [ 51.878302] nix-grpc-daemon[917]: time=2026-09-23T16:00:21.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.865227] niks3-server[950]: 2026/09/23 16:00:21 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 51.870159] niks3-server[950]: 2026/09/23 16:00:21 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 51.880731] niks3-server[950]: 2026/09/23 16:00:21 INFO Received complete push request method=POST path=/api/pushes/14/complete lb # [ 51.888537] niks3-server[950]: 2026/09/23 16:00:21 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker1 # [ 51.903138] nix-grpc-daemon[917]: time=2026-09-23T16:00:21.113Z level=INFO msg="Upload complete. (216ms)" worker1 # [ 51.909668] nix-grpc-daemon[512]: ts=2026-09-23T16:00:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 worker1 # [ 51.925748] nix-daemon[865]: reaped child process 999, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 4.76 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.12 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 52.170352] nix-grpc-daemon[512]: ts=2026-09-23T16:00:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:34274 worker1 # [ 52.176794] nix-grpc-daemon[512]: ts=2026-09-23T16:00:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:34274 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.12 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 52.319798] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52084 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 52.343536] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52084 worker2 # [ 52.350395] nix-grpc-daemon[801]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker2 # [ 52.364830] nix-grpc-daemon[801]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker2 # [ 52.377618] nix-grpc-daemon[801]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.20 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/886" client # removing stale temporary roots file "/nix/var/nix/temproots/878" client # removing stale temporary roots file "/nix/var/nix/temproots/845" client # removing stale temporary roots file "/nix/var/nix/temproots/824" client # removing stale temporary roots file "/nix/var/nix/temproots/808" client # removing stale temporary roots file "/nix/var/nix/temproots/857" client # removing stale temporary roots file "/nix/var/nix/temproots/865" client # removing stale temporary roots file "/nix/var/nix/temproots/901" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker2 # [ 52.659210] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 52.637840] nix-grpc-daemon[512]: ts=2026-09-23T16:00:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 52.646920] nix-grpc-daemon[917]: time=2026-09-23T16:00:21.857Z level=INFO msg="All 1 paths already cached" worker2 # [ 52.678434] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 52.685783] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42452 client # copying 3 paths... worker2 # [ 52.695808] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42452 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker2 # [ 52.711847] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 52.717483] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 52.723949] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 52.728294] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 52.733705] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 52.737590] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.35 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 5.55 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 52.751578] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 1c389f50430b43f694bd28b2dc0e9073 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 52.878860] nix[954]: don't know how to build these paths: client # [ 52.879745] nix[954]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 52.915194] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 52.899357] nix-grpc-daemon[512]: ts=2026-09-23T16:00:22Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 52.926208] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 52.903592] nix-grpc-daemon[512]: ts=2026-09-23T16:00:22Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 52.937832] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 client # [ 52.910103] nix[954]: copying 1 paths to 'lb:50051'... client # [ 52.910901] nix[954]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 52.948984] nix-grpc-daemon[801]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 52.957877] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 53.071142] nix-daemon[858]: accepted connection from pid 1021, user nix-grpc-daemon (trusted) worker2 # [ 53.085400] nix-daemon[858]: reaped child process 1024, status = succeeded lb # [ 53.054369] niks3-server[950]: 2026/09/23 16:00:23 INFO Received push request method=POST path=/api/pushes worker2 # [ 53.103388] nix-grpc-daemon[871]: time=2026-09-23T16:00:23.107Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 53.105367] nix-grpc-daemon[871]: time=2026-09-23T16:00:23.109Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 53.085479] niks3-server[950]: 2026/09/23 16:00:23 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign worker2 # [ 53.135488] nix-grpc-daemon[871]: time=2026-09-23T16:00:23.140Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.094877] niks3-server[950]: 2026/09/23 16:00:23 INFO Signed narinfos id=15 count=1 lb # [ 53.102166] niks3-server[950]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 53.108534] niks3-server[950]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 53.119136] niks3-server[950]: 2026/09/23 16:00:23 INFO Received complete push request method=POST path=/api/pushes/15/complete worker2 # [ 53.168084] nix-grpc-daemon[871]: time=2026-09-23T16:00:23.172Z level=INFO msg="Upload complete. (195ms)" lb # [ 53.128870] niks3-server[950]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 53.172140] nix-grpc-daemon[801]: ts=2026-09-23T16:00:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 53.176912] nix-grpc-daemon[801]: ts=2026-09-23T16:00:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 53.187147] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 53.196132] nix-daemon[858]: reaped child process 1019, status = succeeded worker2 # [ 53.199749] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) client # [ 53.161934] nix[954]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 53.805942] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: fba723f66fc844858b5db91d78f8b01b client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.07 seconds) client: must succeed: sleep 2 worker2 # [ 54.011584] nix-grpc-daemon[801]: ts=2026-09-23T16:00:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42452 client # [ 53.984345] nix[970]: this derivation will be built: worker2 # [ 54.024968] nix-grpc-daemon[801]: ts=2026-09-23T16:00:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42452 client # [ 53.990437] nix[970]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 54.038840] nix-grpc-daemon[801]: ts=2026-09-23T16:00:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 54.012848] nix-grpc-daemon[512]: ts=2026-09-23T16:00:23Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 client # [ 54.003650] nix[970]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: (finished: must succeed: sleep 2, in 2.05 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 56.234315] nix-daemon[858]: reaped child process 1028, status = succeeded worker2 # [ 56.320961] nix-daemon[858]: accepted connection from pid 1054, user nix-grpc-daemon (trusted) worker2 # [ 56.334734] nix-daemon[858]: reaped child process 1057, status = succeeded lb # [ 56.302990] niks3-server[950]: 2026/09/23 16:00:26 INFO Received push request method=POST path=/api/pushes worker2 # [ 56.352323] nix-grpc-daemon[871]: time=2026-09-23T16:00:26.356Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 56.353958] nix-grpc-daemon[871]: time=2026-09-23T16:00:26.358Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 56.349864] niks3-server[950]: 2026/09/23 16:00:26 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign lb # [ 56.357336] niks3-server[950]: 2026/09/23 16:00:26 INFO Signed narinfos id=16 count=1 worker2 # [ 56.401755] nix-grpc-daemon[871]: time=2026-09-23T16:00:26.406Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.363706] niks3-server[950]: 2026/09/23 16:00:26 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 56.369782] niks3-server[950]: 2026/09/23 16:00:26 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 56.373395] niks3-server[950]: 2026/09/23 16:00:26 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 56.381905] niks3-server[950]: 2026/09/23 16:00:26 INFO Received complete push request method=POST path=/api/pushes/16/complete lb # [ 56.388575] niks3-server[950]: 2026/09/23 16:00:26 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 56.432359] nix-grpc-daemon[871]: time=2026-09-23T16:00:26.436Z level=INFO msg="Upload complete. (222ms)" worker2 # [ 56.439931] nix-grpc-daemon[801]: ts=2026-09-23T16:00:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 56.447514] nix-grpc-daemon[801]: ts=2026-09-23T16:00:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=2 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 56.460642] nix-daemon[858]: reaped child process 1026, status = succeeded client # [ 56.446678] systemd[1]: dedup2.service: Deactivated successfully. client # [ 56.450871] systemd[1]: dedup2.service: Consumed 136ms CPU time over 2.643s wall clock time, 33.4M memory peak, 6.5K incoming IP traffic, 5.9K outgoing IP traffic. client # [ 56.457294] systemd[1]: dedup1.service: Deactivated successfully. client # [ 56.460681] systemd[1]: dedup1.service: Consumed 113ms CPU time over 3.708s wall clock time, 41.5M memory peak, 7.1K incoming IP traffic, 8.3K outgoing IP traffic. lb # [ 56.818238] envoy[918]: conn peer=[2001:db8:1::1]:45390 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4221 tx=1896 ms=1974 lb # [ 56.821893] envoy[918]: conn peer=[2001:db8:1::1]:45406 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9507 tx=4355 ms=4592 lb # [ 56.825609] envoy[918]: conn peer=[2001:db8:1::1]:45422 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1034 tx=2870 ms=101 lb # [ 56.829136] envoy[918]: conn peer=[2001:db8:1::1]:45436 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=384 tx=410 ms=46 lb # [ 56.833202] envoy[918]: conn peer=[2001:db8:1::1]:45446 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=329 ms=33 lb # [ 56.836568] envoy[918]: conn peer=[2001:db8:1::1]:45440 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=376 ms=40 lb # [ 56.840087] envoy[918]: conn peer=[2001:db8:1::1]:34666 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2981 tx=1521 ms=3537 lb # [ 56.843569] envoy[918]: conn peer=[2001:db8:1::1]:34678 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1576 tx=1595 ms=2441 client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 4.65 seconds) subtest: --timeout and --max-silent-time reach the builder worker1 # [ 57.530803] nix-grpc-daemon[512]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 57.541941] nix-grpc-daemon[512]: ts=2026-09-23T16:00:26Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker1 # [ 57.547867] nix-grpc-daemon[512]: ts=2026-09-23T16:00:26Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 57.553126] nix-grpc-daemon[512]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 57.564693] nix-grpc-daemon[512]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 57.576165] nix-grpc-daemon[512]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 57.584669] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 57.681913] nix-daemon[865]: accepted connection from pid 1047, user nix-grpc-daemon (trusted) worker1 # [ 57.694542] nix-daemon[865]: reaped child process 1050, status = succeeded lb # [ 57.686873] niks3-server[950]: 2026/09/23 16:00:27 INFO Received push request method=POST path=/api/pushes worker1 # [ 57.711743] nix-grpc-daemon[917]: time=2026-09-23T16:00:26.921Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 57.713736] nix-grpc-daemon[917]: time=2026-09-23T16:00:26.923Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 57.717424] niks3-server[950]: 2026/09/23 16:00:27 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign lb # [ 57.728820] niks3-server[950]: 2026/09/23 16:00:27 INFO Signed narinfos id=17 count=1 worker1 # [ 57.748225] nix-grpc-daemon[917]: time=2026-09-23T16:00:26.958Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.733641] niks3-server[950]: 2026/09/23 16:00:27 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 57.742723] niks3-server[950]: 2026/09/23 16:00:27 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 57.751964] niks3-server[950]: 2026/09/23 16:00:27 INFO Received complete push request method=POST path=/api/pushes/17/complete lb # [ 57.761758] niks3-server[950]: 2026/09/23 16:00:27 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker1 # [ 57.776951] nix-grpc-daemon[917]: time=2026-09-23T16:00:26.987Z level=INFO msg="Upload complete. (179ms)" worker1 # [ 57.781835] nix-grpc-daemon[512]: ts=2026-09-23T16:00:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 57.787712] nix-grpc-daemon[512]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 57.800116] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 57.809758] nix-daemon[865]: reaped child process 1045, status = succeeded worker1 # [ 57.812568] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 63.624242] nix-grpc-daemon[512]: ts=2026-09-23T16:00:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=5 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker1 # [ 63.636295] nix-daemon[865]: reaped child process 1052, status = succeeded worker1 # [ 63.637528] nix-daemon[865]: reaped child process 1054, status = succeeded worker2 # [ 63.808951] nix-grpc-daemon[801]: ts=2026-09-23T16:00:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 63.799183] nix-grpc-daemon[512]: ts=2026-09-23T16:00:33Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker2 # [ 63.826585] nix-grpc-daemon[801]: ts=2026-09-23T16:00:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 63.803761] nix-grpc-daemon[512]: ts=2026-09-23T16:00:33Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 63.839320] nix-grpc-daemon[801]: ts=2026-09-23T16:00:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 63.850467] nix-grpc-daemon[801]: ts=2026-09-23T16:00:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 63.861821] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 63.973368] nix-daemon[858]: accepted connection from pid 1070, user nix-grpc-daemon (trusted) worker2 # [ 63.988700] nix-daemon[858]: reaped child process 1073, status = succeeded lb # [ 63.955653] niks3-server[950]: 2026/09/23 16:00:34 INFO Received push request method=POST path=/api/pushes worker2 # [ 64.005248] nix-grpc-daemon[871]: time=2026-09-23T16:00:34.009Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 64.006731] nix-grpc-daemon[871]: time=2026-09-23T16:00:34.009Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 63.988178] niks3-server[950]: 2026/09/23 16:00:34 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign worker2 # [ 64.038157] nix-grpc-daemon[871]: time=2026-09-23T16:00:34.042Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.997331] niks3-server[950]: 2026/09/23 16:00:34 INFO Signed narinfos id=18 count=1 lb # [ 64.006078] niks3-server[950]: 2026/09/23 16:00:34 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 64.012159] niks3-server[950]: 2026/09/23 16:00:34 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 64.025103] niks3-server[950]: 2026/09/23 16:00:34 INFO Received complete push request method=POST path=/api/pushes/18/complete lb # [ 64.033797] niks3-server[950]: 2026/09/23 16:00:34 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker2 # [ 64.079055] nix-grpc-daemon[871]: time=2026-09-23T16:00:34.083Z level=INFO msg="Upload complete. (205ms)" worker2 # [ 64.084151] nix-grpc-daemon[801]: ts=2026-09-23T16:00:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 64.090333] nix-grpc-daemon[801]: ts=2026-09-23T16:00:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 64.102114] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 64.113191] nix-daemon[858]: reaped child process 1068, status = succeeded worker2 # [ 64.116575] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) lb # [ 66.819166] envoy[918]: conn peer=[2001:db8:1::1]:34686 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=933 ms=6108 worker2 # [ 70.330912] nix-grpc-daemon[801]: ts=2026-09-23T16:00:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=6 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker2 # [ 70.356444] nix-daemon[858]: reaped child process 1075, status = succeeded worker2 # [ 70.358842] nix-daemon[858]: reaped child process 1077, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.04 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 70.460899] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 28c973019cab43d6afe276e62d8a64c8 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share worker2 # [ 70.640310] nix-grpc-daemon[801]: ts=2026-09-23T16:00:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42452 client # [ 70.608775] nix[1043]: don't know how to build these paths: client # [ 70.609665] nix[1043]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 70.631326] nix-grpc-daemon[512]: ts=2026-09-23T16:00:39Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 70.637212] nix-grpc-daemon[512]: ts=2026-09-23T16:00:39Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 70.641617] nix-grpc-daemon[512]: ts=2026-09-23T16:00:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 70.653695] nix-grpc-daemon[512]: ts=2026-09-23T16:00:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 client # [ 70.650957] nix[1043]: copying 1 paths to 'lb:50051'... client # [ 70.651799] nix[1043]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker1 # [ 70.664731] nix-grpc-daemon[512]: ts=2026-09-23T16:00:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 70.675672] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 70.775716] nix-daemon[865]: accepted connection from pid 1081, user nix-grpc-daemon (trusted) worker1 # [ 70.788522] nix-daemon[865]: reaped child process 1084, status = succeeded lb # [ 70.781203] niks3-server[950]: 2026/09/23 16:00:40 INFO Received push request method=POST path=/api/pushes worker1 # [ 70.808580] nix-grpc-daemon[917]: time=2026-09-23T16:00:40.018Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 70.809985] nix-grpc-daemon[917]: time=2026-09-23T16:00:40.018Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 70.814160] niks3-server[950]: 2026/09/23 16:00:40 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign worker1 # [ 70.839222] nix-grpc-daemon[917]: time=2026-09-23T16:00:40.049Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.823246] niks3-server[950]: 2026/09/23 16:00:40 INFO Signed narinfos id=19 count=1 lb # [ 70.830819] niks3-server[950]: 2026/09/23 16:00:40 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 70.839734] niks3-server[950]: 2026/09/23 16:00:40 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 70.852784] niks3-server[950]: 2026/09/23 16:00:40 INFO Received complete push request method=POST path=/api/pushes/19/complete worker1 # [ 70.875418] nix-grpc-daemon[917]: time=2026-09-23T16:00:40.085Z level=INFO msg="Upload complete. (188ms)" lb # [ 70.860153] niks3-server[950]: 2026/09/23 16:00:40 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker1 # [ 70.879542] nix-grpc-daemon[512]: ts=2026-09-23T16:00:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 70.886342] nix-grpc-daemon[512]: ts=2026-09-23T16:00:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 70.895760] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 70.905827] nix-daemon[865]: reaped child process 1079, status = succeeded worker1 # [ 70.909811] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) client # [ 70.896951] nix[1043]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 71.528578] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 82fc203aeb764286a25346f020234109 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds) client: must succeed: sleep 2; systemctl kill -s INT share1 worker2 # [ 71.722811] nix-grpc-daemon[801]: ts=2026-09-23T16:00:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42452 client # [ 71.690954] nix[1059]: don't know how to build these paths: client # [ 71.691852] nix[1059]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker1 # [ 71.710133] nix-grpc-daemon[512]: ts=2026-09-23T16:00:40Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 71.714445] nix-grpc-daemon[512]: ts=2026-09-23T16:00:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 client # [ 71.704284] nix[1059]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client # [ 73.688568] systemd[1]: share1.service: Sent signal SIGINT to main process 1043 (nix) on client request. client # [ 73.696113] nix[1043]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 73.703477] nix[1043]: error: interrupted by the user client # [ 73.744749] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 73.746159] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 73.747772] systemd[1]: share1.service: Consumed 114ms CPU time over 3.283s wall clock time, 41.4M memory peak, 6K incoming IP traffic, 8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds) client: waiting for success: ! systemctl is-active share2 worker1 # [ 75.156552] nix-daemon[865]: reaped child process 1088, status = succeeded worker1 # [ 75.238879] nix-daemon[865]: accepted connection from pid 1120, user nix-grpc-daemon (trusted) worker1 # [ 75.252947] nix-daemon[865]: reaped child process 1123, status = succeeded lb # [ 75.244162] niks3-server[950]: 2026/09/23 16:00:45 INFO Received push request method=POST path=/api/pushes worker1 # [ 75.268054] nix-grpc-daemon[917]: time=2026-09-23T16:00:44.478Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 75.270910] nix-grpc-daemon[917]: time=2026-09-23T16:00:44.479Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 75.289066] niks3-server[950]: 2026/09/23 16:00:45 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls lb # [ 75.293434] niks3-server[950]: 2026/09/23 16:00:45 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 75.302231] niks3-server[950]: 2026/09/23 16:00:45 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign lb # [ 75.309265] niks3-server[950]: 2026/09/23 16:00:45 INFO Signed narinfos id=20 count=1 worker1 # [ 75.325753] nix-grpc-daemon[917]: time=2026-09-23T16:00:44.535Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.315140] niks3-server[950]: 2026/09/23 16:00:45 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 75.325298] niks3-server[950]: 2026/09/23 16:00:45 INFO Received complete push request method=POST path=/api/pushes/20/complete lb # [ 75.330400] niks3-server[950]: 2026/09/23 16:00:45 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker1 # [ 75.345818] nix-grpc-daemon[917]: time=2026-09-23T16:00:44.556Z level=INFO msg="Upload complete. (224ms)" worker1 # [ 75.353777] nix-grpc-daemon[512]: ts=2026-09-23T16:00:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker1 # [ 75.360620] nix-grpc-daemon[512]: ts=2026-09-23T16:00:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=3 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker1 # [ 75.373751] nix-daemon[865]: reaped child process 1086, status = succeeded client # [ 75.377176] systemd[1]: share2.service: Deactivated successfully. client # [ 75.380776] systemd[1]: share2.service: Consumed 124ms CPU time over 3.851s wall clock time, 37.5M memory peak, 6.1K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 5.66 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 76.163910] systemd[1]: Started Nix Daemon. client # [ 76.251675] nix-daemon[1111]: accepted connection from pid 1108, user root (trusted) worker2 # [ 76.403456] nix-grpc-daemon[801]: ts=2026-09-23T16:00:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 76.387202] nix-grpc-daemon[512]: ts=2026-09-23T16:00:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 76.403586] nix-grpc-daemon[512]: ts=2026-09-23T16:00:45Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 76.431362] nix-grpc-daemon[801]: ts=2026-09-23T16:00:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 76.408177] nix-grpc-daemon[512]: ts=2026-09-23T16:00:45Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 76.445526] nix-grpc-daemon[801]: ts=2026-09-23T16:00:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 76.457127] nix-grpc-daemon[801]: ts=2026-09-23T16:00:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 76.468479] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 76.577273] nix-daemon[858]: accepted connection from pid 1112, user nix-grpc-daemon (trusted) worker2 # [ 76.591469] nix-daemon[858]: reaped child process 1115, status = succeeded lb # [ 76.560308] niks3-server[950]: 2026/09/23 16:00:46 INFO Received push request method=POST path=/api/pushes worker2 # [ 76.608592] nix-grpc-daemon[871]: time=2026-09-23T16:00:46.613Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 76.610525] nix-grpc-daemon[871]: time=2026-09-23T16:00:46.614Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 76.587432] niks3-server[950]: 2026/09/23 16:00:46 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign worker2 # [ 76.639619] nix-grpc-daemon[871]: time=2026-09-23T16:00:46.644Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.598750] niks3-server[950]: 2026/09/23 16:00:46 INFO Signed narinfos id=21 count=1 lb # [ 76.605487] niks3-server[950]: 2026/09/23 16:00:46 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 76.611102] niks3-server[950]: 2026/09/23 16:00:46 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 76.621153] niks3-server[950]: 2026/09/23 16:00:46 INFO Received complete push request method=POST path=/api/pushes/21/complete worker2 # [ 76.665530] nix-grpc-daemon[871]: time=2026-09-23T16:00:46.670Z level=INFO msg="Upload complete. (185ms)" lb # [ 76.627233] niks3-server[950]: 2026/09/23 16:00:46 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker2 # [ 76.669571] nix-grpc-daemon[801]: ts=2026-09-23T16:00:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 76.675253] nix-grpc-daemon[801]: ts=2026-09-23T16:00:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 76.684481] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 76.691151] nix-daemon[858]: reaped child process 1110, status = succeeded worker2 # [ 76.694056] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) lb # [ 76.819657] envoy[918]: conn peer=[2001:db8:1::1]:33220 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=936 ms=6534 lb # [ 76.823453] envoy[918]: conn peer=[2001:db8:1::1]:33232 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=770 ms=3115 lb # [ 76.827153] envoy[918]: conn peer=[2001:db8:1::1]:33234 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1197 ms=3672 worker2 # [ 77.733283] nix-daemon[858]: reaped child process 1119, status = succeeded worker2 # [ 77.816921] nix-daemon[858]: accepted connection from pid 1135, user nix-grpc-daemon (trusted) worker2 # [ 77.830728] nix-daemon[858]: reaped child process 1138, status = succeeded lb # [ 77.798256] niks3-server[950]: 2026/09/23 16:00:47 INFO Received push request method=POST path=/api/pushes worker2 # [ 77.847209] nix-grpc-daemon[871]: time=2026-09-23T16:00:47.851Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 77.848710] nix-grpc-daemon[871]: time=2026-09-23T16:00:47.853Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 77.841784] niks3-server[950]: 2026/09/23 16:00:47 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign lb # [ 77.847428] niks3-server[950]: 2026/09/23 16:00:47 INFO Signed narinfos id=22 count=1 worker2 # [ 77.890701] nix-grpc-daemon[871]: time=2026-09-23T16:00:47.895Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.856778] niks3-server[950]: 2026/09/23 16:00:47 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 77.862789] niks3-server[950]: 2026/09/23 16:00:47 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 77.867459] niks3-server[950]: 2026/09/23 16:00:47 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 77.874275] niks3-server[950]: 2026/09/23 16:00:47 INFO Received complete push request method=POST path=/api/pushes/22/complete worker2 # [ 77.921292] nix-grpc-daemon[871]: time=2026-09-23T16:00:47.925Z level=INFO msg="Upload complete. (220ms)" lb # [ 77.883611] niks3-server[950]: 2026/09/23 16:00:47 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker2 # [ 77.927423] nix-grpc-daemon[801]: ts=2026-09-23T16:00:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker1 # [ 77.908249] nix-grpc-daemon[512]: ts=2026-09-23T16:00:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:45556 worker2 # [ 77.941583] nix-daemon[858]: reaped child process 1117, status = succeeded worker1 # [ 77.918382] nix-grpc-daemon[512]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker2 # [ 77.966692] nix-grpc-daemon[801]: ts=2026-09-23T16:00:47Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 77.972128] nix-grpc-daemon[801]: ts=2026-09-23T16:00:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 78.117864] nix-grpc-daemon[512]: ts=2026-09-23T16:00:47Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 78.125696] nix-grpc-daemon[512]: ts=2026-09-23T16:00:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 78.137432] nix-grpc-daemon[917]: time=2026-09-23T16:00:47.347Z level=INFO msg="All 1 paths already cached" worker1 # [ 78.151918] nix-grpc-daemon[512]: ts=2026-09-23T16:00:47Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 78.156937] nix-grpc-daemon[512]: ts=2026-09-23T16:00:47Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 78.184393] nix-grpc-daemon[801]: ts=2026-09-23T16:00:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 78.197171] nix-grpc-daemon[801]: ts=2026-09-23T16:00:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 78.209759] nix-grpc-daemon[871]: time=2026-09-23T16:00:48.214Z level=INFO msg="All 1 paths already cached" worker2 # [ 78.217322] nix-grpc-daemon[801]: ts=2026-09-23T16:00:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 78.225647] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 78.338281] nix-daemon[858]: accepted connection from pid 1142, user nix-grpc-daemon (trusted) worker2 # [ 78.352823] nix-daemon[858]: reaped child process 1145, status = succeeded lb # [ 78.319962] niks3-server[950]: 2026/09/23 16:00:48 INFO Received push request method=POST path=/api/pushes worker2 # [ 78.369965] nix-grpc-daemon[871]: time=2026-09-23T16:00:48.374Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 78.371482] nix-grpc-daemon[871]: time=2026-09-23T16:00:48.376Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 78.351781] niks3-server[950]: 2026/09/23 16:00:48 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign worker2 # [ 78.399424] nix-grpc-daemon[871]: time=2026-09-23T16:00:48.404Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.359282] niks3-server[950]: 2026/09/23 16:00:48 INFO Signed narinfos id=23 count=1 lb # [ 78.368156] niks3-server[950]: 2026/09/23 16:00:48 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 78.373562] niks3-server[950]: 2026/09/23 16:00:48 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 78.387140] niks3-server[950]: 2026/09/23 16:00:48 INFO Received complete push request method=POST path=/api/pushes/23/complete lb # [ 78.394161] niks3-server[950]: 2026/09/23 16:00:48 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker2 # [ 78.434479] nix-grpc-daemon[871]: time=2026-09-23T16:00:48.439Z level=INFO msg="Upload complete. (194ms)" worker2 # [ 78.438564] nix-grpc-daemon[801]: ts=2026-09-23T16:00:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 78.445181] nix-grpc-daemon[801]: ts=2026-09-23T16:00:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 78.452619] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 78.463116] nix-daemon[858]: reaped child process 1140, status = succeeded worker2 # [ 78.466332] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 79.682827] nix-daemon[858]: reaped child process 1149, status = succeeded worker2 # [ 79.765184] nix-daemon[858]: accepted connection from pid 1165, user nix-grpc-daemon (trusted) worker2 # [ 79.778914] nix-daemon[858]: reaped child process 1168, status = succeeded lb # [ 79.746872] niks3-server[950]: 2026/09/23 16:00:49 INFO Received push request method=POST path=/api/pushes worker2 # [ 79.796341] nix-grpc-daemon[871]: time=2026-09-23T16:00:49.800Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 79.797988] nix-grpc-daemon[871]: time=2026-09-23T16:00:49.802Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 79.792535] niks3-server[950]: 2026/09/23 16:00:49 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 79.798356] niks3-server[950]: 2026/09/23 16:00:49 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign lb # [ 79.803349] niks3-server[950]: 2026/09/23 16:00:49 INFO Signed narinfos id=24 count=1 worker2 # [ 79.847292] nix-grpc-daemon[871]: time=2026-09-23T16:00:49.851Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.808744] niks3-server[950]: 2026/09/23 16:00:49 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 79.816139] niks3-server[950]: 2026/09/23 16:00:49 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 79.826283] niks3-server[950]: 2026/09/23 16:00:49 INFO Received complete push request method=POST path=/api/pushes/24/complete worker2 # [ 79.873460] nix-grpc-daemon[871]: time=2026-09-23T16:00:49.878Z level=INFO msg="Upload complete. (199ms)" lb # [ 79.833503] niks3-server[950]: 2026/09/23 16:00:49 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker2 # [ 79.876408] nix-grpc-daemon[801]: ts=2026-09-23T16:00:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker2 # [ 79.883913] nix-daemon[858]: reaped child process 1147, status = succeeded worker1 # [ 79.859285] nix-grpc-daemon[512]: ts=2026-09-23T16:00:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 79.867487] nix-grpc-daemon[512]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker2 # [ 79.914377] nix-grpc-daemon[801]: ts=2026-09-23T16:00:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 79.916501] nix-grpc-daemon[801]: ts=2026-09-23T16:00:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 80.081337] nix-grpc-daemon[801]: ts=2026-09-23T16:00:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 80.060088] nix-grpc-daemon[512]: ts=2026-09-23T16:00:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 80.070665] nix-grpc-daemon[917]: time=2026-09-23T16:00:49.280Z level=INFO msg="All 2 paths already cached" worker1 # [ 80.085214] nix-grpc-daemon[512]: ts=2026-09-23T16:00:49Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 80.116520] nix-grpc-daemon[801]: ts=2026-09-23T16:00:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 80.089802] nix-grpc-daemon[512]: ts=2026-09-23T16:00:49Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 80.125142] nix-grpc-daemon[801]: ts=2026-09-23T16:00:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 80.134464] nix-grpc-daemon[871]: time=2026-09-23T16:00:50.139Z level=INFO msg="All 2 paths already cached" worker2 # [ 80.139289] nix-grpc-daemon[801]: ts=2026-09-23T16:00:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 80.142919] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 80.235317] nix-daemon[858]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker2 # [ 80.248329] nix-daemon[858]: reaped child process 1175, status = succeeded lb # [ 80.216719] niks3-server[950]: 2026/09/23 16:00:50 INFO Received push request method=POST path=/api/pushes worker2 # [ 80.266210] nix-grpc-daemon[871]: time=2026-09-23T16:00:50.270Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 80.267934] nix-grpc-daemon[871]: time=2026-09-23T16:00:50.272Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 80.253324] niks3-server[950]: 2026/09/23 16:00:50 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 80.261302] niks3-server[950]: 2026/09/23 16:00:50 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign lb # [ 80.266987] niks3-server[950]: 2026/09/23 16:00:50 INFO Signed narinfos id=25 count=1 worker2 # [ 80.310965] nix-grpc-daemon[871]: time=2026-09-23T16:00:50.315Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.274351] niks3-server[950]: 2026/09/23 16:00:50 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 80.285238] niks3-server[950]: 2026/09/23 16:00:50 INFO Received complete push request method=POST path=/api/pushes/25/complete worker2 # [ 80.335079] nix-grpc-daemon[871]: time=2026-09-23T16:00:50.339Z level=INFO msg="Upload complete. (185ms)" lb # [ 80.296037] niks3-server[950]: 2026/09/23 16:00:50 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker2 # [ 80.337279] nix-grpc-daemon[801]: ts=2026-09-23T16:00:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 80.341659] nix-grpc-daemon[801]: ts=2026-09-23T16:00:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 80.349098] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 80.350394] nix-daemon[858]: reaped child process 1170, status = succeeded worker2 # [ 80.355680] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 81.599721] nix-daemon[858]: reaped child process 1179, status = succeeded worker2 # [ 81.682106] nix-daemon[858]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 81.694751] nix-daemon[858]: reaped child process 1198, status = succeeded lb # [ 81.662613] niks3-server[950]: 2026/09/23 16:00:51 INFO Received push request method=POST path=/api/pushes worker2 # [ 81.713887] nix-grpc-daemon[871]: time=2026-09-23T16:00:51.718Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 81.715436] nix-grpc-daemon[871]: time=2026-09-23T16:00:51.720Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 81.707217] niks3-server[950]: 2026/09/23 16:00:51 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign worker2 # [ 81.754466] nix-grpc-daemon[871]: time=2026-09-23T16:00:51.759Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.713681] niks3-server[950]: 2026/09/23 16:00:51 INFO Signed narinfos id=26 count=1 lb # [ 81.722290] niks3-server[950]: 2026/09/23 16:00:51 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 81.728196] niks3-server[950]: 2026/09/23 16:00:51 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 81.738436] niks3-server[950]: 2026/09/23 16:00:51 INFO Received complete push request method=POST path=/api/pushes/26/complete worker2 # [ 81.787284] nix-grpc-daemon[871]: time=2026-09-23T16:00:51.791Z level=INFO msg="Upload complete. (223ms)" lb # [ 81.748185] niks3-server[950]: 2026/09/23 16:00:51 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo lb # [ 81.751044] niks3-server[950]: 2026/09/23 16:00:51 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker2 # [ 81.795159] nix-grpc-daemon[801]: ts=2026-09-23T16:00:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 worker1 # [ 81.776594] nix-grpc-daemon[512]: ts=2026-09-23T16:00:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:45556 worker2 # [ 81.809930] nix-daemon[858]: reaped child process 1177, status = succeeded worker1 # [ 81.784282] nix-grpc-daemon[512]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker2 # [ 81.833605] nix-grpc-daemon[801]: ts=2026-09-23T16:00:51Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 81.838809] nix-grpc-daemon[801]: ts=2026-09-23T16:00:51Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_out=232 client # [ 81.872201] nix-daemon[1111]: reaped child process 1113, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.81 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.86 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.24 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.10 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 82.547911] nix-daemon[1111]: accepted connection from pid 1193, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 82.702182] nix-grpc-daemon[801]: ts=2026-09-23T16:00:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42452 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 82.685742] nix-grpc-daemon[512]: ts=2026-09-23T16:00:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 82.793693] nix-daemon[865]: accepted connection from pid 1139, user nix-grpc-daemon (trusted) worker1 # [ 82.806457] nix-daemon[865]: reaped child process 1142, status = succeeded lb # [ 82.799523] niks3-server[950]: 2026/09/23 16:00:52 INFO Received push request method=POST path=/api/pushes worker1 # [ 82.823858] nix-grpc-daemon[917]: time=2026-09-23T16:00:52.033Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 82.825822] nix-grpc-daemon[917]: time=2026-09-23T16:00:52.035Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 82.832817] niks3-server[950]: 2026/09/23 16:00:52 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign lb # [ 82.842334] niks3-server[950]: 2026/09/23 16:00:52 INFO Signed narinfos id=27 count=1 worker1 # [ 82.861607] nix-grpc-daemon[917]: time=2026-09-23T16:00:52.071Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.846069] niks3-server[950]: 2026/09/23 16:00:52 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 82.851271] niks3-server[950]: 2026/09/23 16:00:52 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 82.867157] niks3-server[950]: 2026/09/23 16:00:52 INFO Received complete push request method=POST path=/api/pushes/27/complete worker1 # [ 82.892786] nix-grpc-daemon[917]: time=2026-09-23T16:00:52.103Z level=INFO msg="Upload complete. (202ms)" lb # [ 82.877862] niks3-server[950]: 2026/09/23 16:00:52 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker1 # [ 82.911601] nix-grpc-daemon[512]: ts=2026-09-23T16:00:52Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker1 # [ 82.917371] nix-grpc-daemon[512]: ts=2026-09-23T16:00:52Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 82.923752] nix-grpc-daemon[512]: ts=2026-09-23T16:00:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 82.933930] nix-grpc-daemon[512]: ts=2026-09-23T16:00:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 client # copying 2 paths to 'lb:50051'... worker1 # [ 82.947908] nix-grpc-daemon[512]: ts=2026-09-23T16:00:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 82.957876] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 83.054197] nix-daemon[865]: accepted connection from pid 1148, user nix-grpc-daemon (trusted) worker1 # [ 83.067627] nix-daemon[865]: reaped child process 1151, status = succeeded lb # [ 83.060068] niks3-server[950]: 2026/09/23 16:00:53 INFO Received push request method=POST path=/api/pushes worker1 # [ 83.084807] nix-grpc-daemon[917]: time=2026-09-23T16:00:52.295Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 83.086860] nix-grpc-daemon[917]: time=2026-09-23T16:00:52.296Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" worker1 # [ 83.088556] nix-grpc-daemon[917]: time=2026-09-23T16:00:52.296Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" lb # [ 83.108706] niks3-server[950]: 2026/09/23 16:00:53 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls lb # [ 83.118411] niks3-server[950]: 2026/09/23 16:00:53 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign lb # [ 83.122449] niks3-server[950]: 2026/09/23 16:00:53 INFO Signed narinfos id=28 count=2 worker1 # [ 83.140981] nix-grpc-daemon[917]: time=2026-09-23T16:00:52.351Z level=INFO msg="Uploading 2 narinfos" lb # [ 83.130120] niks3-server[950]: 2026/09/23 16:00:53 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 83.134787] niks3-server[950]: 2026/09/23 16:00:53 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 83.143959] niks3-server[950]: 2026/09/23 16:00:53 INFO Received complete push request method=POST path=/api/pushes/28/complete lb # [ 83.152769] niks3-server[950]: 2026/09/23 16:00:53 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst worker1 # [ 83.167297] nix-grpc-daemon[917]: time=2026-09-23T16:00:52.377Z level=INFO msg="Upload complete. (197ms)" lb # [ 83.155200] niks3-server[950]: 2026/09/23 16:00:53 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 83.157771] niks3-server[950]: 2026/09/23 16:00:53 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo worker1 # [ 83.172869] nix-grpc-daemon[512]: ts=2026-09-23T16:00:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=0 paths=2 nar_bytes_in=976 worker1 # [ 83.179850] nix-grpc-daemon[512]: ts=2026-09-23T16:00:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 83.190474] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 83.199945] nix-daemon[865]: reaped child process 1146, status = succeeded worker1 # [ 83.205481] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 84.421347] nix-daemon[865]: reaped child process 1155, status = succeeded worker1 # [ 84.497413] nix-daemon[865]: accepted connection from pid 1171, user nix-grpc-daemon (trusted) worker1 # [ 84.511155] nix-daemon[865]: reaped child process 1174, status = succeeded lb # [ 84.503227] niks3-server[950]: 2026/09/23 16:00:54 INFO Received push request method=POST path=/api/pushes worker1 # [ 84.527302] nix-grpc-daemon[917]: time=2026-09-23T16:00:53.737Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 84.533580] niks3-server[950]: 2026/09/23 16:00:54 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign worker1 # [ 84.559117] nix-grpc-daemon[917]: time=2026-09-23T16:00:53.769Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.543312] niks3-server[950]: 2026/09/23 16:00:54 INFO Signed narinfos id=29 count=1 lb # [ 84.549420] niks3-server[950]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 84.554853] niks3-server[950]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 84.567140] niks3-server[950]: 2026/09/23 16:00:54 INFO Received complete push request method=POST path=/api/pushes/29/complete lb # [ 84.574775] niks3-server[950]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker1 # [ 84.594688] nix-grpc-daemon[917]: time=2026-09-23T16:00:53.804Z level=INFO msg="Upload complete. (182ms)" client # copying 1 paths... worker1 # [ 84.601760] nix-grpc-daemon[512]: ts=2026-09-23T16:00:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 worker1 # [ 84.607094] nix-grpc-daemon[512]: ts=2026-09-23T16:00:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:45556 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 84.616661] nix-daemon[865]: reaped child process 1153, status = succeeded worker2 # [ 84.653361] nix-grpc-daemon[801]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 84.664482] nix-grpc-daemon[801]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'... worker2 # [ 84.677623] nix-grpc-daemon[801]: ts=2026-09-23T16:00:54Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_out=120 client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.29 seconds) client # [ 84.714365] nix-daemon[1111]: reaped child process 1196, status = succeeded client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 84.807811] nix-daemon[1111]: accepted connection from pid 1215, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker1 # [ 84.937172] nix-grpc-daemon[512]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:45556 client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 84.965861] nix-grpc-daemon[801]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 84.965244] nix-grpc-daemon[512]: ts=2026-09-23T16:00:54Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker1 # [ 84.969377] nix-grpc-daemon[512]: ts=2026-09-23T16:00:54Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 85.002260] nix-grpc-daemon[801]: ts=2026-09-23T16:00:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 85.014396] nix-grpc-daemon[801]: ts=2026-09-23T16:00:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 85.033324] nix-grpc-daemon[801]: ts=2026-09-23T16:00:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 85.044195] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 85.060762] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 1/5) worker2 # [ 85.130534] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 116 ms (attempt 2/5) worker2 # [ 85.248751] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 341 ms (attempt 3/5) worker2 # [ 85.597735] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 453 ms (attempt 4/5) worker2 # [ 86.053865] nix-grpc-daemon[801]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 86.057910] nix-grpc-daemon[801]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 86.063318] nix-grpc-daemon[801]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 86.185129] nix-daemon[858]: accepted connection from pid 1211, user nix-grpc-daemon (trusted) worker2 # [ 86.196983] nix-daemon[858]: reaped child process 1214, status = succeeded lb # [ 86.165812] niks3-server[950]: 2026/09/23 16:00:56 INFO Received push request method=POST path=/api/pushes worker2 # [ 86.215163] nix-grpc-daemon[871]: time=2026-09-23T16:00:56.219Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 86.217146] nix-grpc-daemon[871]: time=2026-09-23T16:00:56.221Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 86.196334] niks3-server[950]: 2026/09/23 16:00:56 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign worker2 # [ 86.244187] nix-grpc-daemon[871]: time=2026-09-23T16:00:56.248Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.203938] niks3-server[950]: 2026/09/23 16:00:56 INFO Signed narinfos id=30 count=1 lb # [ 86.211219] niks3-server[950]: 2026/09/23 16:00:56 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 86.218546] niks3-server[950]: 2026/09/23 16:00:56 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 86.229327] niks3-server[950]: 2026/09/23 16:00:56 INFO Received complete push request method=POST path=/api/pushes/30/complete worker2 # [ 86.280644] nix-grpc-daemon[871]: time=2026-09-23T16:00:56.285Z level=INFO msg="Upload complete. (198ms)" lb # [ 86.243268] niks3-server[950]: 2026/09/23 16:00:56 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker2 # [ 86.285344] nix-grpc-daemon[801]: ts=2026-09-23T16:00:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=1 paths=1 nar_bytes_in=560 worker2 # [ 86.292214] nix-grpc-daemon[801]: ts=2026-09-23T16:00:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 86.305180] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) worker2 # [ 86.313761] nix-daemon[858]: reaped child process 1204, status = succeeded worker2 # [ 86.317414] nix-grpc-daemon[801]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 86.327451] nix-daemon[858]: accepted connection from pid 801, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 86.820733] envoy[918]: conn peer=[2001:db8:1::1]:47182 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=24 lb # [ 86.824450] envoy[918]: conn peer=[2001:db8:1::1]:47176 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3412 tx=1924 ms=1592 lb # [ 86.827956] envoy[918]: conn peer=[2001:db8:1::1]:47188 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3833 tx=2149 ms=1785 lb # [ 86.831528] envoy[918]: conn peer=[2001:db8:1::1]:47194 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=378 ms=13 lb # [ 86.835288] envoy[918]: conn peer=[2001:db8:1::1]:47206 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4325 tx=2373 ms=1768 lb # [ 86.839558] envoy[918]: conn peer=[2001:db8:1::1]:47222 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=411 tx=410 ms=19 lb # [ 86.843099] envoy[918]: conn peer=[2001:db8:1::1]:47226 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3867 tx=2039 ms=1987 lb # [ 86.846586] envoy[918]: conn peer=[2001:db8:1::1]:42256 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=329 ms=39 client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 87.567743] nix-daemon[858]: reaped child process 1219, status = succeeded worker2 # [ 87.658651] nix-daemon[858]: accepted connection from pid 1235, user nix-grpc-daemon (trusted) worker2 # [ 87.671268] nix-daemon[858]: reaped child process 1238, status = succeeded lb # [ 87.638899] niks3-server[950]: 2026/09/23 16:00:57 INFO Received push request method=POST path=/api/pushes worker2 # [ 87.688160] nix-grpc-daemon[871]: time=2026-09-23T16:00:57.692Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 87.668218] niks3-server[950]: 2026/09/23 16:00:57 INFO Received sign narinfos request method=POST path=/api/pushes/31/sign lb # [ 87.670293] niks3-server[950]: 2026/09/23 16:00:57 INFO Signed narinfos id=31 count=1 worker2 # [ 87.710992] nix-grpc-daemon[871]: time=2026-09-23T16:00:57.715Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.674123] niks3-server[950]: 2026/09/23 16:00:57 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 87.680412] niks3-server[950]: 2026/09/23 16:00:57 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 87.682515] niks3-server[950]: 2026/09/23 16:00:57 INFO Received complete push request method=POST path=/api/pushes/31/complete worker2 # [ 87.728220] nix-grpc-daemon[871]: time=2026-09-23T16:00:57.732Z level=INFO msg="Upload complete. (191ms)" lb # [ 87.689593] niks3-server[950]: 2026/09/23 16:00:57 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker2 # [ 87.730988] nix-grpc-daemon[801]: ts=2026-09-23T16:00:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 client # copying 1 paths... worker2 # [ 87.738467] nix-daemon[858]: reaped child process 1216, status = succeeded worker1 # [ 87.715772] nix-grpc-daemon[512]: ts=2026-09-23T16:00:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 87.724517] nix-grpc-daemon[512]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 87.775316] nix-grpc-daemon[801]: ts=2026-09-23T16:00:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 87.780248] nix-grpc-daemon[801]: ts=2026-09-23T16:00:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42452 duration_s=0 paths=1 nar_bytes_out=120 client # [ 87.813464] nix-daemon[1111]: reaped child process 1218, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.10 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 87.910753] nix-daemon[1111]: accepted connection from pid 1237, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker2 # [ 88.060769] nix-grpc-daemon[801]: ts=2026-09-23T16:00:58Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42452 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 88.068507] nix-grpc-daemon[801]: ts=2026-09-23T16:00:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42452 worker2 # [ 88.078368] nix-grpc-daemon[871]: time=2026-09-23T16:00:58.083Z level=INFO msg="All 1 paths already cached" worker1 # [ 88.068170] nix-grpc-daemon[512]: ts=2026-09-23T16:00:57Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker1 # [ 88.074630] nix-grpc-daemon[512]: ts=2026-09-23T16:00:57Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 88.080257] nix-grpc-daemon[512]: ts=2026-09-23T16:00:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 88.091676] nix-grpc-daemon[512]: ts=2026-09-23T16:00:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45556 client # copying 1 paths to 'lb:50051'... worker1 # [ 88.106072] nix-grpc-daemon[917]: time=2026-09-23T16:00:57.315Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 88.111633] nix-grpc-daemon[512]: ts=2026-09-23T16:00:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 88.122710] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 88.219197] nix-daemon[865]: accepted connection from pid 1183, user nix-grpc-daemon (trusted) worker1 # [ 88.232493] nix-daemon[865]: reaped child process 1186, status = succeeded lb # [ 88.223758] niks3-server[950]: 2026/09/23 16:00:58 INFO Received push request method=POST path=/api/pushes worker1 # [ 88.249615] nix-grpc-daemon[917]: time=2026-09-23T16:00:57.459Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 88.251031] nix-grpc-daemon[917]: time=2026-09-23T16:00:57.459Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 88.255057] niks3-server[950]: 2026/09/23 16:00:58 INFO Received sign narinfos request method=POST path=/api/pushes/32/sign lb # [ 88.261186] niks3-server[950]: 2026/09/23 16:00:58 INFO Signed narinfos id=32 count=1 worker1 # [ 88.282270] nix-grpc-daemon[917]: time=2026-09-23T16:00:57.492Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.268148] niks3-server[950]: 2026/09/23 16:00:58 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 88.275098] niks3-server[950]: 2026/09/23 16:00:58 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 88.285365] niks3-server[950]: 2026/09/23 16:00:58 INFO Received complete push request method=POST path=/api/pushes/32/complete worker1 # [ 88.304265] nix-grpc-daemon[917]: time=2026-09-23T16:00:57.514Z level=INFO msg="Upload complete. (170ms)" lb # [ 88.289656] niks3-server[950]: 2026/09/23 16:00:58 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker1 # [ 88.308263] nix-grpc-daemon[512]: ts=2026-09-23T16:00:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=0 paths=1 nar_bytes_in=560 worker1 # [ 88.312993] nix-grpc-daemon[512]: ts=2026-09-23T16:00:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 88.322533] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) worker1 # [ 88.328191] nix-daemon[865]: reaped child process 1181, status = succeeded worker1 # [ 88.333250] nix-daemon[865]: accepted connection from pid 512, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 89.171860] nix-daemon[865]: reaped child process 1190, status = succeeded worker1 # [ 89.251536] nix-daemon[865]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 89.264407] nix-daemon[865]: reaped child process 1209, status = succeeded lb # [ 89.256782] niks3-server[950]: 2026/09/23 16:00:59 INFO Received push request method=POST path=/api/pushes worker1 # [ 89.282323] nix-grpc-daemon[917]: time=2026-09-23T16:00:58.492Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 89.292578] niks3-server[950]: 2026/09/23 16:00:59 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 89.296136] niks3-server[950]: 2026/09/23 16:00:59 INFO Received sign narinfos request method=POST path=/api/pushes/33/sign lb # [ 89.301077] niks3-server[950]: 2026/09/23 16:00:59 INFO Signed narinfos id=33 count=1 worker1 # [ 89.320058] nix-grpc-daemon[917]: time=2026-09-23T16:00:58.530Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.313645] niks3-server[950]: 2026/09/23 16:00:59 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 89.325448] niks3-server[950]: 2026/09/23 16:00:59 INFO Received complete push request method=POST path=/api/pushes/33/complete lb # [ 89.333733] niks3-server[950]: 2026/09/23 16:00:59 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo worker1 # [ 89.353357] nix-grpc-daemon[917]: time=2026-09-23T16:00:58.563Z level=INFO msg="Upload complete. (212ms)" worker1 # [ 89.359707] nix-grpc-daemon[512]: ts=2026-09-23T16:00:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 client # copying 1 paths... worker2 # [ 89.395934] nix-grpc-daemon[801]: ts=2026-09-23T16:00:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42452 worker1 # [ 89.376578] nix-daemon[865]: reaped child process 1188, status = succeeded worker2 # [ 89.410140] nix-grpc-daemon[801]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 89.414602] nix-grpc-daemon[512]: ts=2026-09-23T16:00:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45556 worker1 # [ 89.420682] nix-grpc-daemon[512]: ts=2026-09-23T16:00:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45556 duration_s=0 paths=1 nar_bytes_out=120 client # [ 89.475650] nix-daemon[1111]: reaped child process 1240, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.66 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 7.54 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds) worker2 # [ 90.260192] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 90.808666] nix-grpc-daemon[801]: ts=2026-09-23T16:01:00Z level=info event=signal_exit worker1 # [ 92.776780] nix-grpc-daemon[512]: ts=2026-09-23T16:01:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56024 worker1 # [ 92.783618] nix-grpc-daemon[512]: ts=2026-09-23T16:01:01Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 92.799817] nix-grpc-daemon[801]: ts=2026-09-23T16:01:02Z level=info event=scheduler_restarting worker2 # [ 92.819569] nix-grpc-daemon[801]: ts=2026-09-23T16:01:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 92.841201] nix-daemon[858]: reaped child process 860, status = succeeded worker2 # [ 93.476874] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 93.481194] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 93.485847] systemd[1]: nix-grpc-daemon.service: Consumed 2.330s CPU time over 1min 1.843s wall clock time, 65.7M memory peak, 178.6K incoming IP traffic, 239.7K outgoing IP traffic. lb: waiting until exactly ['worker1'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly ['worker1'] are healthy members of x86_64-linux, in 0.06 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 93.678265] nix-grpc-daemon[512]: ts=2026-09-23T16:01:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45556 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker1 # [ 93.683615] nix-grpc-daemon[512]: ts=2026-09-23T16:01:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:45556 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 93.789761] systemd[1]: Starting scheduler-token.service... worker2 # [ 93.829705] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 93.831401] systemd[1]: Finished scheduler-token.service. worker2 # [ 93.832741] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 41ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 93.837097] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 93.923292] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:03Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 93.927795] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 93.931427] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 93.933414] nix-grpc-daemon[1263]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 93.934698] nix-grpc-daemon[1263]: E0000 00:00:1790179263.935338 1263 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 93.938172] nix-grpc-daemon[1263]: E0000 00:00:1790179263.942779 1263 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 93.946061] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:03Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 93.948969] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 93.951114] nix-grpc-daemon[1263]: E0000 00:00:1790179263.954937 1306 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 93.966094] nix-grpc-daemon[1263]: E0000 00:00:1790179263.969241 1306 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 93.970143] nix-grpc-daemon[1263]: E0000 00:00:1790179263.969556 1306 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 93.979727] nix-grpc-daemon[1263]: E0000 00:00:1790179263.984401 1306 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 93.990268] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.970517] nix-grpc-daemon[512]: ts=2026-09-23T16:01:03Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56024 worker1 # [ 93.978657] nix-grpc-daemon[512]: ts=2026-09-23T16:01:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 94.000842] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 94.834710] nix-grpc-daemon[512]: ts=2026-09-23T16:01:04Z level=info event=signal_exit lb # [ 95.787898] niks3-server[950]: 2026/09/23 16:01:05 INFO lead: released remote=192.168.1.3:54832 worker1 # [ 96.804930] nix-grpc-daemon[512]: ts=2026-09-23T16:01:06Z level=info event=scheduler_restarting lb # [ 96.787838] envoy[918]: [2026-09-23 16:01:06.867][918][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker2 # [ 96.837965] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:06Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 96.813673] nix-grpc-daemon[512]: ts=2026-09-23T16:01:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56024 worker1 # [ 96.818248] nix-grpc-daemon[512]: ts=2026-09-23T16:01:06Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 96.822487] nix-grpc-daemon[512]: ts=2026-09-23T16:01:06Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 96.826340] nix-grpc-daemon[512]: ts=2026-09-23T16:01:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56024 worker1 # [ 96.829824] nix-grpc-daemon[512]: ts=2026-09-23T16:01:06Z level=info event=worker_gone addr=192.168.1.3:50051 lb # [ 96.823148] envoy[918]: conn peer=[2001:db8:1::1]:42264 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3745 tx=2124 ms=2829 lb # [ 96.826811] envoy[918]: conn peer=[2001:db8:1::1]:42278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=15 lb # [ 96.830340] envoy[918]: conn peer=[2001:db8:1::1]:42292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=17 lb # [ 96.833832] envoy[918]: conn peer=[2001:db8:1::1]:42286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3730 tx=2084 ms=1396 worker1 # [ 96.853089] nix-daemon[865]: reaped child process 867, status = succeeded lb # [ 96.838693] envoy[918]: conn peer=[2001:db8:1::4]:38626 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=3121 tx=1072 ms=60972 lb # [ 96.843240] envoy[918]: conn peer=[2001:db8:1::1]:53508 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=16 worker2 # [ 97.038407] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.042994] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.028294] nix-grpc-daemon[512]: ts=2026-09-23T16:01:06Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 97.244285] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.248358] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.412329] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 97.416114] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 97.420575] systemd[1]: nix-grpc-daemon.service: Consumed 2.068s CPU time over 1min 28.866s wall clock time, 64.8M memory peak, 531.1K incoming IP traffic, 261K outgoing IP traffic. worker2 # [ 97.449620] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.453781] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: waiting until exactly ['worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker2'] are healthy members of x86_64-linux, in 0.05 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 97.655178] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.662359] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.666984] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39208 worker2 # [ 97.677819] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) worker2 # [ 97.695834] nix-grpc-daemon[1263]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5) worker2 # [ 97.754130] nix-grpc-daemon[1263]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 2/5) worker2 # [ 97.776675] nix-grpc-daemon[1263]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 362 ms (attempt 3/5) worker2 # [ 97.861977] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.865982] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.066977] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.071211] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.141109] nix-grpc-daemon[1263]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 634 ms (attempt 4/5) worker2 # [ 98.272448] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.276695] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.478091] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.482245] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.683562] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.687905] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 98.777822] nix-grpc-daemon[1263]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 98.781193] nix-grpc-daemon[1263]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 98.806782] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39208 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 98.820393] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) worker2 # [ 98.843171] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=niks3_push_started pid=1323 worker2 # [ 98.890599] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.892523] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 98.908424] niks3-server[950]: 2026/09/23 16:01:08 INFO lead: acquired remote=192.168.1.4:55434 worker2 # [ 98.952082] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:08Z level=info event=scheduler_take_over worker2 # [ 98.966956] nix-grpc-daemon[1323]: time=2026-09-23T16:01:08.971Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 99.071982] nix-daemon[858]: accepted connection from pid 1336, user nix-grpc-daemon (trusted) worker2 # [ 99.085252] nix-daemon[858]: reaped child process 1339, status = succeeded worker2 # [ 99.092932] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:09Z level=info event=scheduler_connected addr=lb:50051 lb # [ 99.052075] niks3-server[950]: 2026/09/23 16:01:09 INFO Received push request method=POST path=/api/pushes worker2 # [ 99.108106] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:09Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 99.109955] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:09Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:39220 worker2 # [ 99.113061] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 99.115470] nix-grpc-daemon[1323]: time=2026-09-23T16:01:09.116Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 99.116898] nix-grpc-daemon[1323]: time=2026-09-23T16:01:09.117Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" worker2 # [ 99.118542] nix-grpc-daemon[1323]: time=2026-09-23T16:01:09.117Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" lb # [ 99.125910] niks3-server[950]: 2026/09/23 16:01:09 INFO Received sign narinfos request method=POST path=/api/pushes/34/sign lb # [ 99.128285] niks3-server[950]: 2026/09/23 16:01:09 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 99.132089] niks3-server[950]: 2026/09/23 16:01:09 INFO Signed narinfos id=34 count=2 worker2 # [ 99.173398] nix-grpc-daemon[1323]: time=2026-09-23T16:01:09.177Z level=INFO msg="Uploading 2 narinfos" lb # [ 99.134559] niks3-server[950]: 2026/09/23 16:01:09 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 99.149958] niks3-server[950]: 2026/09/23 16:01:09 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 99.154640] niks3-server[950]: 2026/09/23 16:01:09 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 99.157943] niks3-server[950]: 2026/09/23 16:01:09 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 99.160702] niks3-server[950]: 2026/09/23 16:01:09 INFO Received complete push request method=POST path=/api/pushes/34/complete lb # [ 99.165921] niks3-server[950]: 2026/09/23 16:01:09 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo worker2 # [ 99.211354] nix-grpc-daemon[1323]: time=2026-09-23T16:01:09.215Z level=INFO msg="Upload complete. (240ms)" worker2 # [ 99.216677] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39208 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 99.230324] nix-daemon[858]: reaped child process 1321, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.74 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker1 # [ 99.292371] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 99.386354] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 99.388547] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 99.392365] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 99.396050] nix-grpc-daemon[1232]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 99.397368] nix-grpc-daemon[1232]: E0000 00:00:1790179268.606350 1232 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 99.401465] nix-grpc-daemon[1232]: E0000 00:00:1790179268.611700 1232 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 99.406050] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:08Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 99.411346] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 99.414095] nix-grpc-daemon[1232]: E0000 00:00:1790179268.623570 1275 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 99.427271] nix-grpc-daemon[1232]: E0000 00:00:1790179268.637535 1275 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 99.430155] nix-grpc-daemon[1232]: E0000 00:00:1790179268.639759 1275 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 99.441783] nix-grpc-daemon[1232]: E0000 00:00:1790179268.652069 1275 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 99.456544] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 99.483334] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:09Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:39220 worker2 # [ 99.487185] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 1.10 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.04 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 100.592930] niks3-server[950]: 2026/09/23 16:01:10 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 100.597355] systemd[1]: Stopping niks3 server... lb # [ 100.600853] niks3-server[950]: 2026/09/23 16:01:10 INFO lead: released remote=192.168.1.4:55434 worker2 # [ 100.642584] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:10Z level=info event=scheduler_lock_lost status=200 worker1 # [ 100.618274] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:09Z level=info event=scheduler_lock_lost status=200 lb # [ 100.613149] systemd[1]: niks3.service: Deactivated successfully. lb # [ 100.615235] systemd[1]: Stopped niks3 server. lb # [ 100.615900] systemd[1]: niks3.service: Consumed 769ms CPU time over 1min 23.056s wall clock time, 28.8M memory peak, 97K incoming IP traffic, 139.7K outgoing IP traffic. lb # [ 100.623349] systemd[1]: Starting niks3 server... lb # [ 100.675364] niks3-server[1128]: 2026/09/23 16:01:10 goose: no migrations to run. current version: 20260923120000 lb # [ 100.682186] niks3-server[1128]: 2026/09/23 16:01:10 OK 1_commit_pending_closure.sql (4.92ms) lb # [ 100.685791] niks3-server[1128]: 2026/09/23 16:01:10 OK 2_object_stats_trigger.sql (2.3ms) lb # [ 100.688925] niks3-server[1128]: 2026/09/23 16:01:10 OK 3_commit_push.sql (3.19ms) lb # [ 100.690451] niks3-server[1128]: 2026/09/23 16:01:10 goose: up to current file version: 3 lb # [ 100.692158] niks3-server[1128]: 2026/09/23 16:01:10 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 100.703698] niks3-server[1128]: 2026/09/23 16:01:10 INFO Read proxy enabled — serving cache objects from S3 lb # [ 100.705216] niks3-server[1128]: 2026/09/23 16:01:10 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 100.707133] systemd[1]: Started niks3 server. lb # [ 100.708246] niks3-server[1128]: 2026/09/23 16:01:10 INFO systemd watchdog enabled interval=15s lb # [ 100.711941] niks3-server[1128]: 2026/09/23 16:01:10 INFO Starting HTTP server address=0.0.0.0:5751 lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 101.064150] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 101.076389] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker1 # [ 101.091368] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 101.101782] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5) worker1 # [ 101.164171] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 2/5) worker1 # [ 101.211943] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 210 ms (attempt 3/5) worker1 # [ 101.423980] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 585 ms (attempt 4/5) lb # [ 101.608806] niks3-server[1128]: 2026/09/23 16:01:11 INFO lead: acquired remote=192.168.1.4:55490 worker1 # [ 102.011858] nix-grpc-daemon[1232]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 102.015835] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 102.080547] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:12Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker2 # [ 102.082774] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:12Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 102.085373] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39208 worker2 # [ 102.095187] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39208 client # copying 1 paths to 'lb:50051'... worker2 # [ 102.104562] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39208 client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker2 # [ 102.111697] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) worker2 # [ 102.205628] nix-daemon[858]: accepted connection from pid 1358, user nix-grpc-daemon (trusted) worker2 # [ 102.218458] nix-daemon[858]: reaped child process 1361, status = succeeded lb # [ 102.187812] niks3-server[1128]: 2026/09/23 16:01:12 INFO Received push request method=POST path=/api/pushes worker2 # [ 102.241621] nix-grpc-daemon[1323]: time=2026-09-23T16:01:12.246Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 102.243841] nix-grpc-daemon[1323]: time=2026-09-23T16:01:12.247Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 102.230708] niks3-server[1128]: 2026/09/23 16:01:12 INFO Received sign narinfos request method=POST path=/api/pushes/35/sign lb # [ 102.258954] niks3-server[1128]: 2026/09/23 16:01:12 INFO Signed narinfos id=35 count=1 lb # [ 102.260598] niks3-server[1128]: 2026/09/23 16:01:12 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst worker2 # [ 102.301791] nix-grpc-daemon[1323]: time=2026-09-23T16:01:12.305Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.263737] niks3-server[1128]: 2026/09/23 16:01:12 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 102.269532] niks3-server[1128]: 2026/09/23 16:01:12 INFO Received complete push request method=POST path=/api/pushes/35/complete lb # [ 102.277083] niks3-server[1128]: 2026/09/23 16:01:12 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker2 # [ 102.321254] nix-grpc-daemon[1323]: time=2026-09-23T16:01:12.325Z level=INFO msg="Upload complete. (204ms)" worker2 # [ 102.323488] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39208 duration_s=0 paths=1 nar_bytes_in=536 worker2 # [ 102.326654] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39208 worker2 # [ 102.334042] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) worker2 # [ 102.336689] nix-daemon[858]: reaped child process 1356, status = succeeded worker2 # [ 102.341673] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 103.156747] nix-daemon[858]: reaped child process 1365, status = succeeded worker2 # [ 103.238560] nix-daemon[858]: accepted connection from pid 1381, user nix-grpc-daemon (trusted) worker2 # [ 103.252913] nix-daemon[858]: reaped child process 1384, status = succeeded lb # [ 103.219322] niks3-server[1128]: 2026/09/23 16:01:13 INFO Received push request method=POST path=/api/pushes worker2 # [ 103.269429] nix-grpc-daemon[1323]: time=2026-09-23T16:01:13.273Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 103.270956] nix-grpc-daemon[1323]: time=2026-09-23T16:01:13.275Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 103.269163] niks3-server[1128]: 2026/09/23 16:01:13 INFO Received sign narinfos request method=POST path=/api/pushes/36/sign lb # [ 103.275437] niks3-server[1128]: 2026/09/23 16:01:13 INFO Signed narinfos id=36 count=1 worker2 # [ 103.318732] nix-grpc-daemon[1323]: time=2026-09-23T16:01:13.323Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.278604] niks3-server[1128]: 2026/09/23 16:01:13 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 103.288906] niks3-server[1128]: 2026/09/23 16:01:13 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 103.293330] niks3-server[1128]: 2026/09/23 16:01:13 INFO Received complete push request method=POST path=/api/pushes/36/complete lb # [ 103.304376] niks3-server[1128]: 2026/09/23 16:01:13 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 103.310587] niks3-server[1128]: 2026/09/23 16:01:13 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker2 # [ 103.353793] nix-grpc-daemon[1323]: time=2026-09-23T16:01:13.358Z level=INFO msg="Upload complete. (206ms)" worker2 # [ 103.356727] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39208 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker2 # [ 103.364443] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:13Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker2 # [ 103.367188] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:13Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 103.368965] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39208 worker2 # [ 103.375226] nix-daemon[858]: reaped child process 1363, status = succeeded worker2 # [ 103.376790] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39208 worker2 # [ 103.383092] nix-grpc-daemon[1323]: time=2026-09-23T16:01:13.387Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 103.388125] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39208 client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker2 # [ 103.393145] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) worker2 # [ 103.484971] nix-daemon[858]: accepted connection from pid 1390, user nix-grpc-daemon (trusted) worker2 # [ 103.498140] nix-daemon[858]: reaped child process 1393, status = succeeded lb # [ 103.466149] niks3-server[1128]: 2026/09/23 16:01:13 INFO Received push request method=POST path=/api/pushes worker2 # [ 103.518131] nix-grpc-daemon[1323]: time=2026-09-23T16:01:13.522Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 103.520142] nix-grpc-daemon[1323]: time=2026-09-23T16:01:13.524Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 103.502232] niks3-server[1128]: 2026/09/23 16:01:13 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 103.508509] niks3-server[1128]: 2026/09/23 16:01:13 INFO Received sign narinfos request method=POST path=/api/pushes/37/sign lb # [ 103.513494] niks3-server[1128]: 2026/09/23 16:01:13 INFO Signed narinfos id=37 count=1 worker2 # [ 103.557358] nix-grpc-daemon[1323]: time=2026-09-23T16:01:13.561Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.526579] niks3-server[1128]: 2026/09/23 16:01:13 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 103.532724] niks3-server[1128]: 2026/09/23 16:01:13 INFO Received complete push request method=POST path=/api/pushes/37/complete lb # [ 103.542482] niks3-server[1128]: 2026/09/23 16:01:13 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker2 # [ 103.586686] nix-grpc-daemon[1323]: time=2026-09-23T16:01:13.591Z level=INFO msg="Upload complete. (187ms)" worker2 # [ 103.588890] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39208 duration_s=0 paths=1 nar_bytes_in=656 worker2 # [ 103.591990] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39208 worker2 # [ 103.598929] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) worker2 # [ 103.603082] nix-daemon[858]: reaped child process 1388, status = succeeded worker2 # [ 103.607329] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 104.365219] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:14Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:48214 client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 104.622534] nix-daemon[858]: reaped child process 1397, status = succeeded worker2 # [ 104.704759] nix-daemon[858]: accepted connection from pid 1413, user nix-grpc-daemon (trusted) worker2 # [ 104.718219] nix-daemon[858]: reaped child process 1416, status = succeeded lb # [ 104.686976] niks3-server[1128]: 2026/09/23 16:01:14 INFO Received push request method=POST path=/api/pushes worker2 # [ 104.739529] nix-grpc-daemon[1323]: time=2026-09-23T16:01:14.744Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 104.741658] nix-grpc-daemon[1323]: time=2026-09-23T16:01:14.745Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 104.733096] niks3-server[1128]: 2026/09/23 16:01:14 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 104.738600] niks3-server[1128]: 2026/09/23 16:01:14 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 104.741876] niks3-server[1128]: 2026/09/23 16:01:14 INFO Received sign narinfos request method=POST path=/api/pushes/38/sign worker2 # [ 104.789685] nix-grpc-daemon[1323]: time=2026-09-23T16:01:14.794Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.748849] niks3-server[1128]: 2026/09/23 16:01:14 INFO Signed narinfos id=38 count=1 lb # [ 104.754307] niks3-server[1128]: 2026/09/23 16:01:14 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 104.765181] niks3-server[1128]: 2026/09/23 16:01:14 INFO Received complete push request method=POST path=/api/pushes/38/complete worker2 # [ 104.809482] nix-grpc-daemon[1323]: time=2026-09-23T16:01:14.814Z level=INFO msg="Upload complete. (194ms)" lb # [ 104.770038] niks3-server[1128]: 2026/09/23 16:01:14 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker2 # [ 104.812228] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39208 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker2 # [ 104.818317] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:14Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker2 # [ 104.820900] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:14Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 104.823468] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39208 worker2 # [ 104.829364] nix-daemon[858]: reaped child process 1395, status = succeeded worker2 # [ 104.833165] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39208 worker2 # [ 104.839592] nix-grpc-daemon[1323]: time=2026-09-23T16:01:14.844Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 104.844834] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39208 client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker2 # [ 104.849941] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) worker2 # [ 104.942101] nix-daemon[858]: accepted connection from pid 1422, user nix-grpc-daemon (trusted) worker2 # [ 104.955719] nix-daemon[858]: reaped child process 1425, status = succeeded lb # [ 104.923342] niks3-server[1128]: 2026/09/23 16:01:15 INFO Received push request method=POST path=/api/pushes worker2 # [ 104.974062] nix-grpc-daemon[1323]: time=2026-09-23T16:01:14.978Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 104.975884] nix-grpc-daemon[1323]: time=2026-09-23T16:01:14.980Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 104.960696] niks3-server[1128]: 2026/09/23 16:01:15 INFO Received sign narinfos request method=POST path=/api/pushes/39/sign lb # [ 104.966923] niks3-server[1128]: 2026/09/23 16:01:15 INFO Signed narinfos id=39 count=1 worker2 # [ 105.010302] nix-grpc-daemon[1323]: time=2026-09-23T16:01:15.014Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.976964] niks3-server[1128]: 2026/09/23 16:01:15 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 104.987347] niks3-server[1128]: 2026/09/23 16:01:15 INFO Received complete push request method=POST path=/api/pushes/39/complete lb # [ 104.991583] niks3-server[1128]: 2026/09/23 16:01:15 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst worker2 # [ 105.036397] nix-grpc-daemon[1323]: time=2026-09-23T16:01:15.041Z level=INFO msg="Upload complete. (180ms)" worker2 # [ 105.038481] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39208 duration_s=0 paths=1 nar_bytes_in=784 lb # [ 105.000130] niks3-server[1128]: 2026/09/23 16:01:15 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker2 # [ 105.043326] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39208 worker2 # [ 105.049529] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) worker2 # [ 105.051917] nix-daemon[858]: reaped child process 1420, status = succeeded worker2 # [ 105.057207] nix-daemon[858]: accepted connection from pid 1263, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 106.273691] nix-daemon[858]: reaped child process 1429, status = succeeded worker2 # [ 106.354908] nix-daemon[858]: accepted connection from pid 1445, user nix-grpc-daemon (trusted) worker2 # [ 106.368476] nix-daemon[858]: reaped child process 1448, status = succeeded lb # [ 106.338523] niks3-server[1128]: 2026/09/23 16:01:16 INFO Received push request method=POST path=/api/pushes worker2 # [ 106.389960] nix-grpc-daemon[1323]: time=2026-09-23T16:01:16.394Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 106.391785] nix-grpc-daemon[1323]: time=2026-09-23T16:01:16.396Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 106.382167] niks3-server[1128]: 2026/09/23 16:01:16 INFO Received sign narinfos request method=POST path=/api/pushes/40/sign worker2 # [ 106.433297] nix-grpc-daemon[1323]: time=2026-09-23T16:01:16.437Z level=INFO msg="Uploading 1 narinfos" lb # [ 106.392331] niks3-server[1128]: 2026/09/23 16:01:16 INFO Signed narinfos id=40 count=1 lb # [ 106.396968] niks3-server[1128]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 106.401626] niks3-server[1128]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 106.406642] niks3-server[1128]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 106.414270] niks3-server[1128]: 2026/09/23 16:01:16 INFO Received complete push request method=POST path=/api/pushes/40/complete worker2 # [ 106.459824] nix-grpc-daemon[1323]: time=2026-09-23T16:01:16.464Z level=INFO msg="Upload complete. (196ms)" lb # [ 106.420247] niks3-server[1128]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker2 # [ 106.462665] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39208 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker2 # [ 106.471480] nix-daemon[858]: reaped child process 1427, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 5.56 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.12 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.05 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 106.759904] systemd[1]: Stopping Nix worker-protocol over gRPC... lb # [ 106.824481] envoy[918]: conn peer=[2001:db8:1::3]:37446 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2093 tx=969 ms=64652 lb # [ 106.828286] envoy[918]: conn peer=[2001:db8:1::1]:53520 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1009 tx=282 ms=1576 lb # [ 106.831745] envoy[918]: conn peer=[2001:db8:1::1]:53532 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9679 tx=4420 ms=5392 worker2 # [ 106.946368] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:16Z level=info event=signal_exit lb # [ 107.612951] niks3-server[1128]: 2026/09/23 16:01:17 INFO lead: released remote=192.168.1.4:55490 worker2 # [ 108.651511] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:18Z level=info event=scheduler_restarting lb # [ 108.612754] envoy[918]: [2026-09-23 16:01:18.691][918][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker2 # [ 108.660168] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:18Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 108.663150] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39220 worker1 # [ 108.637760] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:17Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 108.664679] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:18Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 108.666082] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39220 worker2 # [ 108.667669] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:18Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 108.681757] nix-daemon[858]: reaped child process 1315, status = succeeded worker1 # [ 108.837666] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.866903] nix-grpc-daemon[1263]: ts=2026-09-23T16:01:18Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 108.841782] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.042750] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.048302] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.248657] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.252796] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.453708] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.457661] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.659547] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.663414] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.864323] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.868321] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.068814] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.072669] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.273727] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.277782] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.478546] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.482519] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.684429] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.688372] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.867174] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 110.868919] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 110.870818] systemd[1]: nix-grpc-daemon.service: Consumed 872ms CPU time over 17.031s wall clock time, 38.6M memory peak, 200.6K incoming IP traffic, 124K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 110.890431] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.894341] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 111.094842] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.098946] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.299620] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.303539] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.504628] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.508616] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.626653] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_take_over lb # [ 111.610811] niks3-server[1128]: 2026/09/23 16:01:21 INFO lead: acquired remote=192.168.1.3:33758 worker1 # [ 111.710424] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.714254] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.915171] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.919236] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 112.119839] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.132184] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:21Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57352 worker1 # [ 112.135729] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 worker1 # [ 113.171200] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55576 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker1 # [ 113.179830] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 113.203075] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker1 # [ 113.209529] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 113.214491] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 113.225209] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55576 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker1 # [ 113.237352] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 113.248258] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker1 # [ 113.265619] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=info event=niks3_push_started pid=1311 worker1 # [ 113.366367] nix-grpc-daemon[1311]: time=2026-09-23T16:01:22.576Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 113.456548] nix-daemon[865]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) worker1 # [ 113.468646] nix-daemon[865]: reaped child process 1327, status = succeeded lb # [ 113.462401] niks3-server[1128]: 2026/09/23 16:01:23 INFO Received push request method=POST path=/api/pushes worker1 # [ 113.487091] nix-grpc-daemon[1311]: time=2026-09-23T16:01:22.697Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 113.488592] nix-grpc-daemon[1311]: time=2026-09-23T16:01:22.698Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 113.501895] niks3-server[1128]: 2026/09/23 16:01:23 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 113.508147] niks3-server[1128]: 2026/09/23 16:01:23 INFO Received sign narinfos request method=POST path=/api/pushes/41/sign lb # [ 113.513504] niks3-server[1128]: 2026/09/23 16:01:23 INFO Signed narinfos id=41 count=1 worker1 # [ 113.533047] nix-grpc-daemon[1311]: time=2026-09-23T16:01:22.743Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.525984] niks3-server[1128]: 2026/09/23 16:01:23 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 113.537536] niks3-server[1128]: 2026/09/23 16:01:23 INFO Received complete push request method=POST path=/api/pushes/41/complete worker1 # [ 113.561939] nix-grpc-daemon[1311]: time=2026-09-23T16:01:22.772Z level=INFO msg="Upload complete. (192ms)" lb # [ 113.548239] niks3-server[1128]: 2026/09/23 16:01:23 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo worker1 # [ 113.565349] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55576 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 113.570621] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 113.580111] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker1 # [ 113.585520] nix-daemon[865]: reaped child process 1309, status = succeeded worker1 # [ 113.590343] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 114.624600] nix-daemon[865]: reaped child process 1331, status = succeeded worker1 # [ 114.713639] nix-daemon[865]: accepted connection from pid 1347, user nix-grpc-daemon (trusted) worker1 # [ 114.724475] nix-daemon[865]: reaped child process 1350, status = succeeded lb # [ 114.718268] niks3-server[1128]: 2026/09/23 16:01:24 INFO Received push request method=POST path=/api/pushes worker1 # [ 114.743597] nix-grpc-daemon[1311]: time=2026-09-23T16:01:23.953Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 114.747473] nix-grpc-daemon[1311]: time=2026-09-23T16:01:23.955Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 114.764634] niks3-server[1128]: 2026/09/23 16:01:24 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 114.773256] niks3-server[1128]: 2026/09/23 16:01:24 INFO Received sign narinfos request method=POST path=/api/pushes/42/sign worker1 # [ 114.795064] nix-grpc-daemon[1311]: time=2026-09-23T16:01:24.005Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.778898] niks3-server[1128]: 2026/09/23 16:01:24 INFO Signed narinfos id=42 count=1 lb # [ 114.783093] niks3-server[1128]: 2026/09/23 16:01:24 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 114.788407] niks3-server[1128]: 2026/09/23 16:01:24 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 114.798158] niks3-server[1128]: 2026/09/23 16:01:24 INFO Received complete push request method=POST path=/api/pushes/42/complete lb # [ 114.805812] niks3-server[1128]: 2026/09/23 16:01:24 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker1 # [ 114.820214] nix-grpc-daemon[1311]: time=2026-09-23T16:01:24.030Z level=INFO msg="Upload complete. (222ms)" worker1 # [ 114.826607] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker1 # [ 114.841329] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:24Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker1 # [ 114.845497] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:24Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 114.849408] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 114.859292] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 114.862047] nix-daemon[865]: reaped child process 1329, status = succeeded worker1 # [ 114.867996] nix-grpc-daemon[1311]: time=2026-09-23T16:01:24.078Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 114.873745] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55576 client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker1 # [ 114.878836] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker1 # [ 114.964936] nix-daemon[865]: accepted connection from pid 1356, user nix-grpc-daemon (trusted) worker1 # [ 114.977967] nix-daemon[865]: reaped child process 1359, status = succeeded lb # [ 114.970147] niks3-server[1128]: 2026/09/23 16:01:25 INFO Received push request method=POST path=/api/pushes worker1 # [ 114.996939] nix-grpc-daemon[1311]: time=2026-09-23T16:01:24.207Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 114.998992] nix-grpc-daemon[1311]: time=2026-09-23T16:01:24.208Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 115.008404] niks3-server[1128]: 2026/09/23 16:01:25 INFO Received sign narinfos request method=POST path=/api/pushes/43/sign worker1 # [ 115.030244] nix-grpc-daemon[1311]: time=2026-09-23T16:01:24.240Z level=INFO msg="Uploading 1 narinfos" lb # [ 115.014186] niks3-server[1128]: 2026/09/23 16:01:25 INFO Signed narinfos id=43 count=1 lb # [ 115.022580] niks3-server[1128]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 115.026994] niks3-server[1128]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 115.039074] niks3-server[1128]: 2026/09/23 16:01:25 INFO Received complete push request method=POST path=/api/pushes/43/complete lb # [ 115.044405] niks3-server[1128]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker1 # [ 115.059509] nix-grpc-daemon[1311]: time=2026-09-23T16:01:24.269Z level=INFO msg="Upload complete. (175ms)" worker1 # [ 115.063555] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55576 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 115.068180] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 115.080135] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker1 # [ 115.083592] nix-daemon[865]: reaped child process 1354, status = succeeded worker1 # [ 115.088503] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 116.324781] nix-daemon[865]: reaped child process 1363, status = succeeded worker1 # [ 116.412134] nix-daemon[865]: accepted connection from pid 1379, user nix-grpc-daemon (trusted) worker1 # [ 116.425788] nix-daemon[865]: reaped child process 1382, status = succeeded lb # [ 116.415689] niks3-server[1128]: 2026/09/23 16:01:26 INFO Received push request method=POST path=/api/pushes worker1 # [ 116.442576] nix-grpc-daemon[1311]: time=2026-09-23T16:01:25.652Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 116.444048] nix-grpc-daemon[1311]: time=2026-09-23T16:01:25.654Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 116.452086] niks3-server[1128]: 2026/09/23 16:01:26 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 116.465839] niks3-server[1128]: 2026/09/23 16:01:26 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 116.472668] niks3-server[1128]: 2026/09/23 16:01:26 INFO Received sign narinfos request method=POST path=/api/pushes/44/sign lb # [ 116.479686] niks3-server[1128]: 2026/09/23 16:01:26 INFO Signed narinfos id=44 count=1 worker1 # [ 116.496080] nix-grpc-daemon[1311]: time=2026-09-23T16:01:25.705Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.487878] niks3-server[1128]: 2026/09/23 16:01:26 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 116.495714] niks3-server[1128]: 2026/09/23 16:01:26 INFO Received complete push request method=POST path=/api/pushes/44/complete lb # [ 116.503704] niks3-server[1128]: 2026/09/23 16:01:26 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker1 # [ 116.518397] nix-grpc-daemon[1311]: time=2026-09-23T16:01:25.728Z level=INFO msg="Upload complete. (221ms)" worker1 # [ 116.524615] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker1 # [ 116.536827] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:25Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker1 # [ 116.541780] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:25Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 116.546281] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 116.556545] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 116.559584] nix-daemon[865]: reaped child process 1361, status = succeeded worker1 # [ 116.565052] nix-grpc-daemon[1311]: time=2026-09-23T16:01:25.775Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 116.570751] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55576 client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker1 # [ 116.577096] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker1 # [ 116.662308] nix-daemon[865]: accepted connection from pid 1388, user nix-grpc-daemon (trusted) worker1 # [ 116.675933] nix-daemon[865]: reaped child process 1391, status = succeeded lb # [ 116.666427] niks3-server[1128]: 2026/09/23 16:01:26 INFO Received push request method=POST path=/api/pushes worker1 # [ 116.690584] nix-grpc-daemon[1311]: time=2026-09-23T16:01:25.900Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 116.692594] nix-grpc-daemon[1311]: time=2026-09-23T16:01:25.902Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 116.695578] niks3-server[1128]: 2026/09/23 16:01:26 INFO Received sign narinfos request method=POST path=/api/pushes/45/sign worker1 # [ 116.716997] nix-grpc-daemon[1311]: time=2026-09-23T16:01:25.927Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.700816] niks3-server[1128]: 2026/09/23 16:01:26 INFO Signed narinfos id=45 count=1 lb # [ 116.711235] niks3-server[1128]: 2026/09/23 16:01:26 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 116.720239] niks3-server[1128]: 2026/09/23 16:01:26 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 116.726899] niks3-server[1128]: 2026/09/23 16:01:26 INFO Received complete push request method=POST path=/api/pushes/45/complete worker1 # [ 116.751330] nix-grpc-daemon[1311]: time=2026-09-23T16:01:25.961Z level=INFO msg="Upload complete. (169ms)" lb # [ 116.737822] niks3-server[1128]: 2026/09/23 16:01:26 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker1 # [ 116.754823] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55576 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 116.759678] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 116.768673] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker1 # [ 116.774539] nix-daemon[865]: reaped child process 1386, status = succeeded worker1 # [ 116.779435] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 116.824712] envoy[918]: conn peer=[2001:db8:1::4]:34320 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=10946 tx=959 ms=14878 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 117.994627] nix-daemon[865]: reaped child process 1395, status = succeeded worker1 # [ 118.071716] nix-daemon[865]: accepted connection from pid 1411, user nix-grpc-daemon (trusted) worker1 # [ 118.085526] nix-daemon[865]: reaped child process 1414, status = succeeded lb # [ 118.076744] niks3-server[1128]: 2026/09/23 16:01:28 INFO Received push request method=POST path=/api/pushes worker1 # [ 118.101426] nix-grpc-daemon[1311]: time=2026-09-23T16:01:27.311Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 118.102905] nix-grpc-daemon[1311]: time=2026-09-23T16:01:27.313Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 118.117934] niks3-server[1128]: 2026/09/23 16:01:28 INFO Received sign narinfos request method=POST path=/api/pushes/46/sign worker1 # [ 118.138812] nix-grpc-daemon[1311]: time=2026-09-23T16:01:27.348Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.123160] niks3-server[1128]: 2026/09/23 16:01:28 INFO Signed narinfos id=46 count=1 lb # [ 118.133677] niks3-server[1128]: 2026/09/23 16:01:28 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 118.147955] niks3-server[1128]: 2026/09/23 16:01:28 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 118.151920] niks3-server[1128]: 2026/09/23 16:01:28 INFO Received complete push request method=POST path=/api/pushes/46/complete worker1 # [ 118.175338] nix-grpc-daemon[1311]: time=2026-09-23T16:01:27.385Z level=INFO msg="Upload complete. (188ms)" lb # [ 118.160493] niks3-server[1128]: 2026/09/23 16:01:28 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo lb # [ 118.164246] niks3-server[1128]: 2026/09/23 16:01:28 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst worker1 # [ 118.181606] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker1 # [ 118.197740] nix-daemon[865]: reaped child process 1393, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.19 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.11 seconds) worker2 # [ 118.413493] systemd[1]: Starting scheduler-token.service... worker2 # [ 118.460974] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 118.462662] systemd[1]: Finished scheduler-token.service. worker2 # [ 118.463892] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 49ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 118.468345] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 118.552154] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 118.554177] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 118.557887] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 118.562057] nix-grpc-daemon[1469]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 118.563421] nix-grpc-daemon[1469]: E0000 00:00:1790179288.566355 1469 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 118.567061] nix-grpc-daemon[1469]: E0000 00:00:1790179288.571684 1469 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 118.572108] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:28Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 118.575494] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 118.579096] nix-grpc-daemon[1469]: E0000 00:00:1790179288.583465 1511 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 118.592863] nix-grpc-daemon[1469]: E0000 00:00:1790179288.597541 1511 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 118.597156] nix-grpc-daemon[1469]: E0000 00:00:1790179288.599796 1511 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 118.607409] nix-grpc-daemon[1469]: E0000 00:00:1790179288.612081 1511 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 118.619206] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.604178] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:27Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 118.607325] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:27Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57352 worker1 # [ 118.611655] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.20 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 118.815614] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 579572c43ed84a2caaf70cec484cf716 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) client # [ 118.954727] nix[1364]: don't know how to build these paths: client # [ 118.955595] nix[1364]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker1 # [ 118.966466] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 118.979136] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:28Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker1 # [ 118.983961] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:28Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 118.989944] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 119.001927] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55576 client # [ 118.998901] nix[1364]: copying 1 paths to 'lb:50051'... client # [ 118.999770] nix[1364]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker1 # [ 119.012957] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 119.023731] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker1 # [ 119.120883] nix-daemon[865]: accepted connection from pid 1427, user nix-grpc-daemon (trusted) worker1 # [ 119.134608] nix-daemon[865]: reaped child process 1430, status = succeeded lb # [ 119.125362] niks3-server[1128]: 2026/09/23 16:01:29 INFO Received push request method=POST path=/api/pushes worker1 # [ 119.154230] nix-grpc-daemon[1311]: time=2026-09-23T16:01:28.363Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 119.155612] nix-grpc-daemon[1311]: time=2026-09-23T16:01:28.364Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 119.159698] niks3-server[1128]: 2026/09/23 16:01:29 INFO Received sign narinfos request method=POST path=/api/pushes/47/sign worker1 # [ 119.180900] nix-grpc-daemon[1311]: time=2026-09-23T16:01:28.391Z level=INFO msg="Uploading 1 narinfos" lb # [ 119.165471] niks3-server[1128]: 2026/09/23 16:01:29 INFO Signed narinfos id=47 count=1 lb # [ 119.172859] niks3-server[1128]: 2026/09/23 16:01:29 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 119.182046] niks3-server[1128]: 2026/09/23 16:01:29 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 119.189712] niks3-server[1128]: 2026/09/23 16:01:29 INFO Received complete push request method=POST path=/api/pushes/47/complete lb # [ 119.198748] niks3-server[1128]: 2026/09/23 16:01:29 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 119.218188] nix-grpc-daemon[1311]: time=2026-09-23T16:01:28.428Z level=INFO msg="Upload complete. (183ms)" worker1 # [ 119.223471] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55576 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 119.230353] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 worker1 # [ 119.241135] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker1 # [ 119.252128] nix-daemon[865]: reaped child process 1425, status = succeeded worker1 # [ 119.255274] nix-daemon[865]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) client # [ 119.242421] nix[1364]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 121.549539] systemd-journald[284]: Received client request to rotate journal, rotating. worker2 # [ 121.569617] systemd-journald[284]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ad8a82e305c049cea52ff8c75b5ac7c1. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 121.451290] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds) client: must succeed: sleep 5.0 worker1 # [ 122.413727] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:31Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 126.677525] nix-daemon[865]: reaped child process 1434, status = succeeded worker1 # [ 126.754062] nix-daemon[865]: accepted connection from pid 1475, user nix-grpc-daemon (trusted) worker1 # [ 126.765857] nix-daemon[865]: reaped child process 1478, status = succeeded lb # [ 126.760166] niks3-server[1128]: 2026/09/23 16:01:36 INFO Received push request method=POST path=/api/pushes worker1 # [ 126.783090] nix-grpc-daemon[1311]: time=2026-09-23T16:01:35.993Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 126.784795] nix-grpc-daemon[1311]: time=2026-09-23T16:01:35.994Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 126.802075] niks3-server[1128]: 2026/09/23 16:01:36 INFO Received sign narinfos request method=POST path=/api/pushes/48/sign worker1 # [ 126.830188] nix-grpc-daemon[1311]: time=2026-09-23T16:01:36.040Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.814387] niks3-server[1128]: 2026/09/23 16:01:36 INFO Signed narinfos id=48 count=1 lb # [ 126.825101] niks3-server[1128]: 2026/09/23 16:01:36 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 126.828833] envoy[918]: conn peer=[2001:db8:1::1]:45224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9633 tx=4403 ms=5027 lb # [ 126.834451] niks3-server[1128]: 2026/09/23 16:01:36 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 126.841904] niks3-server[1128]: 2026/09/23 16:01:36 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 126.845589] niks3-server[1128]: 2026/09/23 16:01:36 INFO Received complete push request method=POST path=/api/pushes/48/complete lb # [ 126.851558] niks3-server[1128]: 2026/09/23 16:01:36 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 126.870809] nix-grpc-daemon[1311]: time=2026-09-23T16:01:36.081Z level=INFO msg="Upload complete. (202ms)" worker1 # [ 126.878821] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55576 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 126.894155] nix-daemon[865]: reaped child process 1432, status = succeeded client # [ 126.899956] systemd[1]: rs.service: Deactivated successfully. client # [ 126.903719] systemd[1]: rs.service: Consumed 124ms CPU time over 8.087s wall clock time, 43.4M memory peak, 7.2K incoming IP traffic, 8.3K outgoing IP traffic. worker1 # [ 127.417084] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:36Z level=info event=signal_exit lb # [ 127.615331] niks3-server[1128]: 2026/09/23 16:01:37 INFO lead: released remote=192.168.1.3:33758 lb # [ 128.540827] niks3-server[1128]: 2026/09/23 16:01:38 INFO lead: acquired remote=192.168.1.4:54032 worker2 # [ 128.585331] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:38Z level=info event=scheduler_take_over worker2 # [ 128.657465] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:38Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 128.630641] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:37Z level=info event=scheduler_restarting worker1 # [ 128.640770] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57352 worker1 # [ 128.644328] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:37Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 128.647553] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:37Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 128.650782] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57352 worker1 # [ 128.654432] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:37Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 128.669662] nix-daemon[865]: reaped child process 1284, status = succeeded worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.11 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker2 # [ 128.859171] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.863224] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.848820] nix-grpc-daemon[1232]: ts=2026-09-23T16:01:38Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 129.064291] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.068328] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.269540] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.273672] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.474912] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.478944] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.681201] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.685188] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.886680] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.890689] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2 # [ 130.091538] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 130.104142] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:40Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 130.108158] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:40Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53892 worker2 # [ 130.112177] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:40Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 130.698951] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 130.702162] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 130.705340] systemd[1]: nix-grpc-daemon.service: Consumed 1.078s CPU time over 31.405s wall clock time, 37.3M memory peak, 97.3K incoming IP traffic, 149.8K outgoing IP traffic. worker1 # [ 130.720158] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 130.810700] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 130.815189] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 130.820051] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 130.822031] nix-grpc-daemon[1486]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 130.823352] nix-grpc-daemon[1486]: E0000 00:00:1790179300.028107 1486 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 130.825674] nix-grpc-daemon[1486]: E0000 00:00:1790179300.035936 1486 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 130.832462] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:40Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 130.834536] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 130.836142] nix-grpc-daemon[1486]: E0000 00:00:1790179300.045876 1529 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 130.847512] nix-grpc-daemon[1486]: E0000 00:00:1790179300.057790 1529 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 130.852061] nix-grpc-daemon[1486]: E0000 00:00:1790179300.060106 1529 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 130.861452] nix-grpc-daemon[1486]: E0000 00:00:1790179300.071741 1529 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 130.870728] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 130.898448] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:40Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53892 worker2 # [ 130.902734] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.32 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 131.130919] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 0eeafa19ecef434e82388c7e68e01e33 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds) worker2 # [ 131.226504] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:41Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:53900 worker2 # [ 131.310599] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53902 worker2 # [ 131.322160] nix-daemon[858]: accepted connection from pid 1469, user nix-grpc-daemon (trusted) client # [ 131.295416] nix[1400]: don't know how to build these paths: client # [ 131.296358] nix[1400]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker2 # [ 131.339135] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:41Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 131.343100] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:41Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 131.348339] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53902 worker2 # [ 131.355757] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker2 # [ 131.445441] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 2/5) worker2 # [ 131.514688] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 106 ms (attempt 3/5) worker2 # [ 131.622775] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 562 ms (attempt 4/5) worker2 # [ 132.187905] nix-grpc-daemon[1469]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 132.192178] nix-grpc-daemon[1469]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 132.210469] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53902 client # [ 132.182799] nix[1400]: copying 1 paths to 'lb:50051'... client # [ 132.187135] nix[1400]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker2 # [ 132.227153] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53902 worker2 # [ 132.236168] nix-daemon[858]: accepted connection from pid 1469, user nix-grpc-daemon (trusted) worker2 # [ 132.259226] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:42Z level=info event=niks3_push_started pid=1591 worker2 # [ 132.374429] nix-grpc-daemon[1591]: time=2026-09-23T16:01:42.378Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 132.469449] nix-daemon[858]: accepted connection from pid 1608, user nix-grpc-daemon (trusted) worker2 # [ 132.482713] nix-daemon[858]: reaped child process 1611, status = succeeded lb # [ 132.447743] niks3-server[1128]: 2026/09/23 16:01:42 INFO Received push request method=POST path=/api/pushes worker2 # [ 132.498077] nix-grpc-daemon[1591]: time=2026-09-23T16:01:42.501Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 132.499470] nix-grpc-daemon[1591]: time=2026-09-23T16:01:42.501Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 132.485518] niks3-server[1128]: 2026/09/23 16:01:42 INFO Received sign narinfos request method=POST path=/api/pushes/49/sign lb # [ 132.492299] niks3-server[1128]: 2026/09/23 16:01:42 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 132.499308] niks3-server[1128]: 2026/09/23 16:01:42 INFO Signed narinfos id=49 count=1 worker2 # [ 132.543836] nix-grpc-daemon[1591]: time=2026-09-23T16:01:42.547Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.503102] niks3-server[1128]: 2026/09/23 16:01:42 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 132.517183] niks3-server[1128]: 2026/09/23 16:01:42 INFO Received complete push request method=POST path=/api/pushes/49/complete worker2 # [ 132.569416] nix-grpc-daemon[1591]: time=2026-09-23T16:01:42.574Z level=INFO msg="Upload complete. (192ms)" lb # [ 132.530321] niks3-server[1128]: 2026/09/23 16:01:42 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker2 # [ 132.572190] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53902 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 132.577764] nix-grpc-daemon[1469]: ts=2026-09-23T16:01:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53902 worker2 # [ 132.588871] nix-daemon[858]: accepted connection from pid 1469, user nix-grpc-daemon (trusted) worker2 # [ 132.595463] nix-daemon[858]: reaped child process 1589, status = succeeded worker2 # [ 132.598311] nix-daemon[858]: accepted connection from pid 1469, user nix-grpc-daemon (trusted) client # [ 132.561394] nix[1400]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 133.715283] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1469 (nix-grpc-daemon) on client request. worker2 # [ 133.719382] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 133.688277] niks3-server[1128]: 2026/09/23 16:01:43 INFO lead: released remote=192.168.1.4:54032 client # [ 133.698669] nix[1400]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again lb # [ 133.694149] envoy[918]: [2026-09-23 16:01:43.771][918][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 13, upstream_reset_after_response_started{connection_termination} worker2 # [ 133.740321] systemd[1]: Starting scheduler-token.service... worker1 # [ 133.711565] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker2 # [ 133.741130] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 133.742445] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. client # [ 133.703366] nix[1400]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 133.745106] systemd[1]: nix-grpc-daemon.service: Consumed 405ms CPU time over 15.269s wall clock time, 36M memory peak, 159.8K incoming IP traffic, 57.1K outgoing IP traffic. worker2 # [ 133.771658] nix-daemon[858]: reaped child process 1613, status = succeeded worker2 # [ 133.773402] nix-daemon[858]: reaped child process 1581, status = succeeded worker2 # [ 133.781272] nix-daemon[1615]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 133.791181] nix-daemon[858]: reaped child process 1615, status = failed with exit code 1 worker2 # [ 133.803180] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 133.804701] systemd[1]: Finished scheduler-token.service. worker2 # [ 133.806176] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 67ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 133.809071] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 133.812777] systemd[1]: Starting scheduler-token.service... worker2 # [ 133.847833] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 133.849441] systemd[1]: Finished scheduler-token.service. worker2 # [ 133.851159] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 36ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 133.855316] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 133.933396] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:43Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 133.935403] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 133.911832] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 133.939253] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 133.944054] nix-grpc-daemon[1654]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 133.945354] nix-grpc-daemon[1654]: E0000 00:00:1790179303.948396 1654 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 133.948649] nix-grpc-daemon[1654]: E0000 00:00:1790179303.953288 1654 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 133.952465] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:43Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 133.955429] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 133.962074] nix-grpc-daemon[1654]: E0000 00:00:1790179303.965239 1696 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 133.921310] niks3-server[1128]: 2026/09/23 16:01:44 INFO lead: acquired remote=192.168.1.4:48604 worker2 # [ 133.965097] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:43Z level=info event=scheduler_take_over worker2 # [ 133.975291] nix-grpc-daemon[1654]: E0000 00:00:1790179303.980026 1696 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.29 seconds) worker2 # [ 133.979207] nix-grpc-daemon[1654]: E0000 00:00:1790179303.982549 1696 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. client: must succeed: sleep 5.0 worker2 # [ 133.984512] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:43Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56938 worker2 # [ 133.987093] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 133.996157] nix-grpc-daemon[1654]: E0000 00:00:1790179304.000786 1696 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 134.005231] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.010057] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:44Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 134.011500] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:44Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56938 worker2 # [ 134.012998] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:44Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 134.250384] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:44Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker2 # [ 134.255181] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:44Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 134.240848] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52334 worker1 # [ 134.252460] nix-daemon[865]: accepted connection from pid 1486, user nix-grpc-daemon (trusted) worker1 # [ 134.268762] nix-grpc-daemon[1486]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 1/5) worker2 # [ 134.312573] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:44Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:56972 worker1 # [ 134.371486] nix-grpc-daemon[1486]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 106 ms (attempt 2/5) worker1 # [ 134.485259] nix-grpc-daemon[1486]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 255 ms (attempt 3/5) worker1 # [ 134.743230] nix-grpc-daemon[1486]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 391 ms (attempt 4/5) worker1 # [ 135.135827] nix-grpc-daemon[1486]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 135.139323] nix-grpc-daemon[1486]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 135.154479] nix-grpc-daemon[1486]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'... worker1 # [ 135.176914] nix-daemon[865]: accepted connection from pid 1486, user nix-grpc-daemon (trusted) client # [ 135.179653] nix[1400]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 135.192736] nix-daemon[865]: accepted connection from pid 1486, user nix-grpc-daemon (trusted) lb # [ 136.825099] envoy[918]: conn peer=[2001:db8:1::1]:45232 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2943 tx=1497 ms=7929 lb # [ 136.829470] envoy[918]: conn peer=[2001:db8:1::3]:44112 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4857 tx=1250 ms=29390 lb # [ 136.833201] envoy[918]: conn peer=[2001:db8:1::4]:49786 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7013 tx=556 ms=15122 client: (finished: must succeed: sleep 5.0, in 5.03 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 139.212660] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:48Z level=info event=niks3_push_started pid=1588 worker1 # [ 139.237918] nix-daemon[865]: reaped child process 1563, status = succeeded worker1 # [ 139.320609] nix-grpc-daemon[1588]: time=2026-09-23T16:01:48.530Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 139.409334] nix-daemon[865]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 139.422473] nix-daemon[865]: reaped child process 1604, status = succeeded lb # [ 139.416680] niks3-server[1128]: 2026/09/23 16:01:49 INFO Received push request method=POST path=/api/pushes worker1 # [ 139.442756] nix-grpc-daemon[1588]: time=2026-09-23T16:01:48.653Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.444312] nix-grpc-daemon[1588]: time=2026-09-23T16:01:48.654Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 139.466664] niks3-server[1128]: 2026/09/23 16:01:49 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 139.473454] niks3-server[1128]: 2026/09/23 16:01:49 INFO Received sign narinfos request method=POST path=/api/pushes/50/sign worker1 # [ 139.497494] nix-grpc-daemon[1588]: time=2026-09-23T16:01:48.707Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.481969] niks3-server[1128]: 2026/09/23 16:01:49 INFO Signed narinfos id=50 count=1 lb # [ 139.493359] niks3-server[1128]: 2026/09/23 16:01:49 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 139.501175] niks3-server[1128]: 2026/09/23 16:01:49 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 139.506575] niks3-server[1128]: 2026/09/23 16:01:49 INFO Received complete push request method=POST path=/api/pushes/50/complete worker1 # [ 139.529406] nix-grpc-daemon[1588]: time=2026-09-23T16:01:48.739Z level=INFO msg="Upload complete. (205ms)" worker1 # [ 139.535531] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52334 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 139.549563] nix-daemon[865]: reaped child process 1561, status = succeeded client # [ 139.555439] systemd[1]: mid.service: Deactivated successfully. client # [ 139.559207] systemd[1]: mid.service: Consumed 142ms CPU time over 8.427s wall clock time, 43.5M memory peak, 8.6K incoming IP traffic, 10.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.18 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 140.284402] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: a88ccb2047e747d6bdec3da8649f5eaa client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker2 # [ 140.445709] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 140.454826] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # [ 140.427661] nix[1436]: don't know how to build these paths: client # [ 140.428635] nix[1436]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker2 # [ 140.471771] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:50Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker2 # [ 140.475187] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:50Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 140.480980] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 140.485857] nix-grpc-daemon[1654]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5) worker2 # [ 140.492793] nix-grpc-daemon[1654]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 2/5) worker2 # [ 140.583334] nix-grpc-daemon[1654]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 301 ms (attempt 3/5) worker2 # [ 140.892109] nix-grpc-daemon[1654]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 742 ms (attempt 4/5) worker2 # [ 141.658978] nix-grpc-daemon[1654]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 141.662739] nix-grpc-daemon[1654]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 141.679729] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 client # [ 141.652631] nix[1436]: copying 1 paths to 'lb:50051'... client # [ 141.655904] nix[1436]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 141.694073] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 141.705494] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 141.726252] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:51Z level=info event=niks3_push_started pid=1734 worker2 # [ 141.832350] nix-grpc-daemon[1734]: time=2026-09-23T16:01:51.835Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 141.919147] nix-daemon[858]: accepted connection from pid 1747, user nix-grpc-daemon (trusted) worker2 # [ 141.931963] nix-daemon[858]: reaped child process 1750, status = succeeded lb # [ 141.899224] niks3-server[1128]: 2026/09/23 16:01:51 INFO Received push request method=POST path=/api/pushes worker2 # [ 141.951514] nix-grpc-daemon[1734]: time=2026-09-23T16:01:51.956Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 141.953044] nix-grpc-daemon[1734]: time=2026-09-23T16:01:51.957Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 141.942429] niks3-server[1128]: 2026/09/23 16:01:52 INFO Received sign narinfos request method=POST path=/api/pushes/51/sign lb # [ 141.954153] niks3-server[1128]: 2026/09/23 16:01:52 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 141.961232] niks3-server[1128]: 2026/09/23 16:01:52 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst worker2 # [ 142.013201] nix-grpc-daemon[1734]: time=2026-09-23T16:01:52.017Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.972293] niks3-server[1128]: 2026/09/23 16:01:52 INFO Signed narinfos id=51 count=1 lb # [ 141.983727] niks3-server[1128]: 2026/09/23 16:01:52 INFO Received complete push request method=POST path=/api/pushes/51/complete lb # [ 141.994773] niks3-server[1128]: 2026/09/23 16:01:52 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo worker2 # [ 142.039751] nix-grpc-daemon[1734]: time=2026-09-23T16:01:52.044Z level=INFO msg="Upload complete. (207ms)" worker2 # [ 142.044096] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 142.050246] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 142.059259] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 142.067373] nix-daemon[858]: reaped child process 1732, status = succeeded worker2 # [ 142.070088] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # [ 142.032405] nix[1436]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 143.712993] systemd[1]: intr.service: Sent signal SIGINT to main process 1436 (nix) on client request. worker2 # [ 143.753222] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:53Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 143.719691] nix[1436]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 143.724769] nix[1436]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds) client # [ 143.752843] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 143.755716] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 143.759448] systemd[1]: intr.service: Consumed 117ms CPU time over 3.471s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 143.890461] nix-daemon[1754]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 143.895186] nix-daemon[858]: reaped child process 1752, status = succeeded worker2 # [ 143.896338] nix-daemon[858]: reaped child process 1754, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 4.65 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 144.958154] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 49b13b30de344a0f8ad9e5c254823c7d client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.06 seconds) client # [ 145.084591] nix[1456]: don't know how to build these paths: client # [ 145.085482] nix[1456]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker2 # [ 145.121556] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 145.134158] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:55Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 145.138327] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:55Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 145.121546] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52334 worker1 # [ 145.134796] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52334 client # [ 145.131984] nix[1456]: copying 1 paths to 'lb:50051'... client # [ 145.132878] nix[1456]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 145.146136] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52334 worker1 # [ 145.156797] nix-daemon[865]: accepted connection from pid 1486, user nix-grpc-daemon (trusted) worker1 # [ 145.258437] nix-daemon[865]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker1 # [ 145.271153] nix-daemon[865]: reaped child process 1639, status = succeeded lb # [ 145.263728] niks3-server[1128]: 2026/09/23 16:01:55 INFO Received push request method=POST path=/api/pushes worker1 # [ 145.290534] nix-grpc-daemon[1588]: time=2026-09-23T16:01:54.500Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.291998] nix-grpc-daemon[1588]: time=2026-09-23T16:01:54.500Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 145.292717] niks3-server[1128]: 2026/09/23 16:01:55 INFO Received sign narinfos request method=POST path=/api/pushes/52/sign lb # [ 145.298974] niks3-server[1128]: 2026/09/23 16:01:55 INFO Signed narinfos id=52 count=1 worker1 # [ 145.318624] nix-grpc-daemon[1588]: time=2026-09-23T16:01:54.528Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.308334] niks3-server[1128]: 2026/09/23 16:01:55 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 145.317908] niks3-server[1128]: 2026/09/23 16:01:55 INFO Received complete push request method=POST path=/api/pushes/52/complete lb # [ 145.330260] niks3-server[1128]: 2026/09/23 16:01:55 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst worker1 # [ 145.351926] nix-grpc-daemon[1588]: time=2026-09-23T16:01:54.562Z level=INFO msg="Upload complete. (183ms)" lb # [ 145.340054] niks3-server[1128]: 2026/09/23 16:01:55 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 145.356703] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52334 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 145.361395] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52334 worker1 # [ 145.373141] nix-daemon[865]: accepted connection from pid 1486, user nix-grpc-daemon (trusted) worker1 # [ 145.376353] nix-daemon[865]: reaped child process 1634, status = succeeded worker1 # [ 145.381627] nix-daemon[865]: accepted connection from pid 1486, user nix-grpc-daemon (trusted) client # [ 145.368634] nix[1456]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... lb # [ 146.825650] envoy[918]: conn peer=[2001:db8:1::1]:49242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3878 tx=1973 ms=8265 lb # [ 146.830509] envoy[918]: conn peer=[2001:db8:1::1]:34486 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2980 tx=829 ms=3336 worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 147.404208] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 147.432677] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 worker2 # [ 147.639569] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56980 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 147.650805] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 147.672723] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:57Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker2 # [ 147.677709] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:57Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 147.683661] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 147.694728] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 client # copying 1 paths to 'lb:50051'... worker2 # [ 147.705991] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 147.724276] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 147.821597] nix-daemon[858]: accepted connection from pid 1809, user nix-grpc-daemon (trusted) worker2 # [ 147.835362] nix-daemon[858]: reaped child process 1812, status = succeeded lb # [ 147.802597] niks3-server[1128]: 2026/09/23 16:01:57 INFO Received push request method=POST path=/api/pushes worker2 # [ 147.851855] nix-grpc-daemon[1734]: time=2026-09-23T16:01:57.856Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 147.853684] nix-grpc-daemon[1734]: time=2026-09-23T16:01:57.858Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" worker1 # [ 147.836785] nix-grpc-daemon[1486]: ts=2026-09-23T16:01:57Z level=info event=draining lb # [ 147.842181] niks3-server[1128]: 2026/09/23 16:01:57 INFO Received sign narinfos request method=POST path=/api/pushes/53/sign worker2 # [ 147.891579] nix-grpc-daemon[1734]: time=2026-09-23T16:01:57.895Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.850411] niks3-server[1128]: 2026/09/23 16:01:57 INFO Signed narinfos id=53 count=1 lb # [ 147.859832] niks3-server[1128]: 2026/09/23 16:01:57 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 147.864217] niks3-server[1128]: 2026/09/23 16:01:57 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 147.877654] niks3-server[1128]: 2026/09/23 16:01:57 INFO Received complete push request method=POST path=/api/pushes/53/complete lb # [ 147.881793] niks3-server[1128]: 2026/09/23 16:01:57 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 147.921320] nix-grpc-daemon[1734]: time=2026-09-23T16:01:57.925Z level=INFO msg="Upload complete. (185ms)" worker2 # [ 147.926624] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 147.932490] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 147.944158] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 147.952034] nix-daemon[858]: reaped child process 1807, status = succeeded client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... worker2 # [ 147.957570] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 149.194746] nix-daemon[858]: reaped child process 1816, status = succeeded worker2 # [ 149.274095] nix-daemon[858]: accepted connection from pid 1832, user nix-grpc-daemon (trusted) worker2 # [ 149.286787] nix-daemon[858]: reaped child process 1835, status = succeeded lb # [ 149.253655] niks3-server[1128]: 2026/09/23 16:01:59 INFO Received push request method=POST path=/api/pushes worker2 # [ 149.303248] nix-grpc-daemon[1734]: time=2026-09-23T16:01:59.307Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 149.306037] nix-grpc-daemon[1734]: time=2026-09-23T16:01:59.309Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 149.290396] niks3-server[1128]: 2026/09/23 16:01:59 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 149.302452] niks3-server[1128]: 2026/09/23 16:01:59 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 149.311170] niks3-server[1128]: 2026/09/23 16:01:59 INFO Received sign narinfos request method=POST path=/api/pushes/54/sign lb # [ 149.316362] niks3-server[1128]: 2026/09/23 16:01:59 INFO Signed narinfos id=54 count=1 worker2 # [ 149.356804] nix-grpc-daemon[1734]: time=2026-09-23T16:01:59.361Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.325625] niks3-server[1128]: 2026/09/23 16:01:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 149.334751] niks3-server[1128]: 2026/09/23 16:01:59 INFO Received complete push request method=POST path=/api/pushes/54/complete lb # [ 149.339334] niks3-server[1128]: 2026/09/23 16:01:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 149.378620] nix-grpc-daemon[1734]: time=2026-09-23T16:01:59.383Z level=INFO msg="Upload complete. (213ms)" worker2 # [ 149.385980] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker2 # [ 149.397763] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:59Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker2 # [ 149.402244] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:59Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 149.407212] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 149.417318] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 149.419970] nix-daemon[858]: reaped child process 1814, status = succeeded worker2 # [ 149.425868] nix-grpc-daemon[1734]: time=2026-09-23T16:01:59.430Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 149.431721] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 149.447526] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 149.535213] nix-daemon[858]: accepted connection from pid 1841, user nix-grpc-daemon (trusted) worker2 # [ 149.549439] nix-daemon[858]: reaped child process 1844, status = succeeded lb # [ 149.515965] niks3-server[1128]: 2026/09/23 16:01:59 INFO Received push request method=POST path=/api/pushes worker2 # [ 149.565254] nix-grpc-daemon[1734]: time=2026-09-23T16:01:59.569Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 149.567143] nix-grpc-daemon[1734]: time=2026-09-23T16:01:59.571Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 149.547992] niks3-server[1128]: 2026/09/23 16:01:59 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 149.554495] niks3-server[1128]: 2026/09/23 16:01:59 INFO Received sign narinfos request method=POST path=/api/pushes/55/sign lb # [ 149.561216] niks3-server[1128]: 2026/09/23 16:01:59 INFO Signed narinfos id=55 count=1 worker2 # [ 149.605733] nix-grpc-daemon[1734]: time=2026-09-23T16:01:59.610Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.568931] niks3-server[1128]: 2026/09/23 16:01:59 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 149.582771] niks3-server[1128]: 2026/09/23 16:01:59 INFO Received complete push request method=POST path=/api/pushes/55/complete lb # [ 149.594913] niks3-server[1128]: 2026/09/23 16:01:59 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 149.633918] nix-grpc-daemon[1734]: time=2026-09-23T16:01:59.638Z level=INFO msg="Upload complete. (180ms)" worker2 # [ 149.638702] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 149.644266] nix-grpc-daemon[1654]: ts=2026-09-23T16:01:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 149.656129] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 149.663128] nix-daemon[858]: reaped child process 1839, status = succeeded worker2 # [ 149.666374] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 150.302985] nix-daemon[858]: reaped child process 1848, status = succeeded worker2 # [ 150.388219] nix-daemon[858]: accepted connection from pid 1864, user nix-grpc-daemon (trusted) worker2 # [ 150.402056] nix-daemon[858]: reaped child process 1867, status = succeeded lb # [ 150.369726] niks3-server[1128]: 2026/09/23 16:02:00 INFO Received push request method=POST path=/api/pushes worker2 # [ 150.419136] nix-grpc-daemon[1734]: time=2026-09-23T16:02:00.423Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 150.420827] nix-grpc-daemon[1734]: time=2026-09-23T16:02:00.425Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 150.413453] niks3-server[1128]: 2026/09/23 16:02:00 INFO Received sign narinfos request method=POST path=/api/pushes/56/sign lb # [ 150.424495] niks3-server[1128]: 2026/09/23 16:02:00 INFO Signed narinfos id=56 count=1 worker2 # [ 150.467711] nix-grpc-daemon[1734]: time=2026-09-23T16:02:00.472Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.429578] niks3-server[1128]: 2026/09/23 16:02:00 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 150.433976] niks3-server[1128]: 2026/09/23 16:02:00 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 150.438975] niks3-server[1128]: 2026/09/23 16:02:00 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 150.446862] niks3-server[1128]: 2026/09/23 16:02:00 INFO Received complete push request method=POST path=/api/pushes/56/complete lb # [ 150.453785] niks3-server[1128]: 2026/09/23 16:02:00 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 150.493276] nix-grpc-daemon[1734]: time=2026-09-23T16:02:00.497Z level=INFO msg="Upload complete. (218ms)" worker2 # [ 150.500570] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker2 # [ 150.511606] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:00Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker2 # [ 150.515872] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:00Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 150.520249] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 150.530377] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 150.533366] nix-daemon[858]: reaped child process 1846, status = succeeded worker2 # [ 150.538147] nix-grpc-daemon[1734]: time=2026-09-23T16:02:00.542Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 150.544255] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 150.562475] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 150.647563] nix-daemon[858]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 150.662231] nix-daemon[858]: reaped child process 1876, status = succeeded lb # [ 150.627493] niks3-server[1128]: 2026/09/23 16:02:00 INFO Received push request method=POST path=/api/pushes worker2 # [ 150.676064] nix-grpc-daemon[1734]: time=2026-09-23T16:02:00.680Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 150.677703] nix-grpc-daemon[1734]: time=2026-09-23T16:02:00.682Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 150.657928] niks3-server[1128]: 2026/09/23 16:02:00 INFO Received sign narinfos request method=POST path=/api/pushes/57/sign worker2 # [ 150.705133] nix-grpc-daemon[1734]: time=2026-09-23T16:02:00.709Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.664350] niks3-server[1128]: 2026/09/23 16:02:00 INFO Signed narinfos id=57 count=1 lb # [ 150.673763] niks3-server[1128]: 2026/09/23 16:02:00 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 150.684607] niks3-server[1128]: 2026/09/23 16:02:00 INFO Received complete push request method=POST path=/api/pushes/57/complete worker2 # [ 150.736294] nix-grpc-daemon[1734]: time=2026-09-23T16:02:00.740Z level=INFO msg="Upload complete. (167ms)" lb # [ 150.696595] niks3-server[1128]: 2026/09/23 16:02:00 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 150.700916] niks3-server[1128]: 2026/09/23 16:02:00 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 150.739391] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 150.744224] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 150.753872] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 150.760219] nix-daemon[858]: reaped child process 1871, status = succeeded worker2 # [ 150.764186] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 151.782175] nix-daemon[858]: reaped child process 1880, status = succeeded worker2 # [ 151.856888] nix-daemon[858]: accepted connection from pid 1896, user nix-grpc-daemon (trusted) worker2 # [ 151.871296] nix-daemon[858]: reaped child process 1899, status = succeeded lb # [ 151.837913] niks3-server[1128]: 2026/09/23 16:02:01 INFO Received push request method=POST path=/api/pushes worker2 # [ 151.890126] nix-grpc-daemon[1734]: time=2026-09-23T16:02:01.894Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 151.891618] nix-grpc-daemon[1734]: time=2026-09-23T16:02:01.896Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 151.885190] niks3-server[1128]: 2026/09/23 16:02:01 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 151.889609] niks3-server[1128]: 2026/09/23 16:02:01 INFO Received sign narinfos request method=POST path=/api/pushes/58/sign lb # [ 151.892634] niks3-server[1128]: 2026/09/23 16:02:01 INFO Signed narinfos id=58 count=1 worker2 # [ 151.934811] nix-grpc-daemon[1734]: time=2026-09-23T16:02:01.939Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.897226] niks3-server[1128]: 2026/09/23 16:02:01 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 151.900988] niks3-server[1128]: 2026/09/23 16:02:01 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 151.904932] niks3-server[1128]: 2026/09/23 16:02:01 INFO Received complete push request method=POST path=/api/pushes/58/complete lb # [ 151.912399] niks3-server[1128]: 2026/09/23 16:02:01 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 151.952488] nix-grpc-daemon[1734]: time=2026-09-23T16:02:01.957Z level=INFO msg="Upload complete. (181ms)" worker2 # [ 151.959704] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker2 # [ 151.972084] nix-daemon[858]: reaped child process 1878, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.50 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.11 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 152.201878] nix-daemon[865]: reaped child process 1643, status = succeeded worker1 # [ 152.278866] nix-daemon[865]: accepted connection from pid 1684, user nix-grpc-daemon (trusted) worker1 # [ 152.291780] nix-daemon[865]: reaped child process 1687, status = succeeded lb # [ 152.283536] niks3-server[1128]: 2026/09/23 16:02:02 INFO Received push request method=POST path=/api/pushes worker1 # [ 152.308659] nix-grpc-daemon[1588]: time=2026-09-23T16:02:01.518Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.310554] nix-grpc-daemon[1588]: time=2026-09-23T16:02:01.520Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 152.320305] niks3-server[1128]: 2026/09/23 16:02:02 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 152.332155] niks3-server[1128]: 2026/09/23 16:02:02 INFO Received sign narinfos request method=POST path=/api/pushes/59/sign lb # [ 152.341202] niks3-server[1128]: 2026/09/23 16:02:02 INFO Signed narinfos id=59 count=1 worker1 # [ 152.360990] nix-grpc-daemon[1588]: time=2026-09-23T16:02:01.571Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.345196] niks3-server[1128]: 2026/09/23 16:02:02 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 152.350456] niks3-server[1128]: 2026/09/23 16:02:02 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 152.360678] niks3-server[1128]: 2026/09/23 16:02:02 INFO Received complete push request method=POST path=/api/pushes/59/complete lb # [ 152.367190] niks3-server[1128]: 2026/09/23 16:02:02 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 152.386873] nix-grpc-daemon[1588]: time=2026-09-23T16:02:01.597Z level=INFO msg="Upload complete. (191ms)" worker1 # [ 152.393597] nix-grpc-daemon[1486]: ts=2026-09-23T16:02:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52334 duration_s=7 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 152.408513] nix-daemon[865]: reaped child process 1641, status = succeeded client # [ 152.412575] systemd[1]: sw.service: Deactivated successfully. client # [ 152.417164] systemd[1]: sw.service: Consumed 121ms CPU time over 7.458s wall clock time, 43.4M memory peak, 7K incoming IP traffic, 8.3K outgoing IP traffic. worker1 # [ 152.838624] nix-grpc-daemon[1486]: ts=2026-09-23T16:02:02Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 154.870374] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56938 worker2 # [ 154.876961] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:04Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 154.848385] nix-grpc-daemon[1486]: ts=2026-09-23T16:02:04Z level=info event=scheduler_restarting worker1 # [ 154.861539] nix-grpc-daemon[1486]: ts=2026-09-23T16:02:04Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 154.881532] nix-daemon[865]: reaped child process 1554, status = succeeded lb # [ 156.825968] envoy[918]: conn peer=[2001:db8:1::1]:55690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9564 tx=4348 ms=4334 lb # [ 156.829776] envoy[918]: conn peer=[2001:db8:1::1]:55676 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2958 tx=1498 ms=7306 lb # [ 156.833328] envoy[918]: conn peer=[2001:db8:1::3]:55914 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1148 tx=459 ms=23979 worker1 # [ 156.867547] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 156.871600] systemd[1]: nix-grpc-daemon.service: Consumed 580ms CPU time over 26.150s wall clock time, 34.5M memory peak, 47.8K incoming IP traffic, 57.1K outgoing IP traffic. worker1 # [ 156.884825] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker1 # [ 156.894773] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 156.984158] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:06Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 156.986129] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 156.989315] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 156.993571] nix-grpc-daemon[1702]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 156.994913] nix-grpc-daemon[1702]: E0000 00:00:1790179326.203685 1702 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 156.998772] nix-grpc-daemon[1702]: E0000 00:00:1790179326.208938 1702 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 157.001689] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:06Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 157.005829] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 157.011092] nix-grpc-daemon[1702]: E0000 00:00:1790179326.220989 1744 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 157.025078] nix-grpc-daemon[1702]: E0000 00:00:1790179326.234847 1744 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.81 seconds) lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 157.029127] nix-grpc-daemon[1702]: E0000 00:00:1790179326.234958 1744 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 157.038833] nix-grpc-daemon[1702]: E0000 00:00:1790179326.249115 1744 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 157.050336] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 157.077849] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56938 worker2 # [ 157.082296] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 12.23 seconds) subtest: queue gauges show a burst while every build blocks lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]' client # [ 157.279997] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]". client # Running as unit: burst.service; invocation ID: d8d6c6b137894f6caa574e5ef9b0cb96 client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 157.429755] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 157.441455] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) client # [ 157.440778] nix[1512]: don't know how to build these paths: client # [ 157.441659] nix[1512]: /nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv client # [ 157.442585] nix[1512]: /nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv client # [ 157.444108] nix[1512]: /nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv client # [ 157.445084] nix[1512]: /nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker2 # [ 157.491282] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=want client=5 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv cached=0 worker2 # [ 157.495270] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=assigned drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv worker=192.168.1.4:50051 clients=1 worker1 # [ 157.478327] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2 # [ 157.501460] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=want client=5 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv cached=0 worker2 # [ 157.507376] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=assigned drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 157.512123] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=want client=5 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv cached=0 worker2 # [ 157.515917] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=want client=5 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv cached=0 worker1 # [ 157.489510] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 1/5) worker2 # [ 157.519362] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 157.529226] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 client # [ 157.500229] nix[1512]: copying 1 paths to 'lb:50051'... worker2 # [ 157.538749] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 client # [ 157.502368] nix[1512]: copying path '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' to 'lb:50051'... worker2 # [ 157.547913] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker1 # [ 157.521706] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 137 ms (attempt 2/5) worker2 # [ 157.638858] nix-daemon[858]: accepted connection from pid 1914, user nix-grpc-daemon (trusted) worker2 # [ 157.653590] nix-daemon[858]: reaped child process 1917, status = succeeded lb # [ 157.618771] niks3-server[1128]: 2026/09/23 16:02:07 INFO Received push request method=POST path=/api/pushes worker2 # [ 157.667971] nix-grpc-daemon[1734]: time=2026-09-23T16:02:07.672Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 157.669464] nix-grpc-daemon[1734]: time=2026-09-23T16:02:07.672Z level=INFO msg="Uploading 2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv (416B)" worker1 # [ 157.660936] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 209 ms (attempt 3/5) lb # [ 157.648666] niks3-server[1128]: 2026/09/23 16:02:07 INFO Received sign narinfos request method=POST path=/api/pushes/60/sign worker2 # [ 157.694991] nix-grpc-daemon[1734]: time=2026-09-23T16:02:07.699Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.654125] niks3-server[1128]: 2026/09/23 16:02:07 INFO Signed narinfos id=60 count=1 lb # [ 157.664066] niks3-server[1128]: 2026/09/23 16:02:07 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.ls lb # [ 157.674755] niks3-server[1128]: 2026/09/23 16:02:07 INFO Registered completed upload object_key=nar/0raymp7y3ngiv7lj2qq6nkp63sms2510yhhlnr7hnz7ldnl7b3qc.nar.zst lb # [ 157.686050] niks3-server[1128]: 2026/09/23 16:02:07 INFO Received complete push request method=POST path=/api/pushes/60/complete lb # [ 157.692786] niks3-server[1128]: 2026/09/23 16:02:07 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.narinfo worker2 # [ 157.732729] nix-grpc-daemon[1734]: time=2026-09-23T16:02:07.737Z level=INFO msg="Upload complete. (174ms)" worker2 # [ 157.737933] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 157.743729] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 157.756120] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 157.760804] nix-daemon[858]: reaped child process 1912, status = succeeded worker2 # [ 157.765744] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # [ 157.727920] nix[1512]: building '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' on lb:50051... worker1 # [ 157.872262] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 524 ms (attempt 4/5) worker1 # [ 158.400428] nix-grpc-daemon[1702]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 158.404067] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 158.423439] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 lb: must succeed: curl -sf localhost:9901/clusters client # [ 158.421293] nix[1512]: copying 1 paths to 'lb:50051'... worker1 # [ 158.435314] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 client # [ 158.425180] nix[1512]: copying path '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' to 'lb:50051'... worker1 # [ 158.447204] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 158.467491] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:07Z level=info event=niks3_push_started pid=1762 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 158.575522] nix-grpc-daemon[1762]: time=2026-09-23T16:02:07.785Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 158.671961] nix-daemon[865]: accepted connection from pid 1778, user nix-grpc-daemon (trusted) worker1 # [ 158.683290] nix-daemon[865]: reaped child process 1781, status = succeeded lb # [ 158.678988] niks3-server[1128]: 2026/09/23 16:02:08 INFO Received push request method=POST path=/api/pushes worker1 # [ 158.703092] nix-grpc-daemon[1762]: time=2026-09-23T16:02:07.913Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.704614] nix-grpc-daemon[1762]: time=2026-09-23T16:02:07.914Z level=INFO msg="Uploading 885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv (416B)" lb # [ 158.715148] niks3-server[1128]: 2026/09/23 16:02:08 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.ls lb # [ 158.719597] niks3-server[1128]: 2026/09/23 16:02:08 INFO Received sign narinfos request method=POST path=/api/pushes/61/sign lb # [ 158.725357] niks3-server[1128]: 2026/09/23 16:02:08 INFO Signed narinfos id=61 count=1 worker1 # [ 158.743509] nix-grpc-daemon[1762]: time=2026-09-23T16:02:07.953Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.733509] niks3-server[1128]: 2026/09/23 16:02:08 INFO Registered completed upload object_key=nar/0mmcg3cvna05ngbx6v5vspkmc5gj8lna2zc48rllhxr0g8i9mg6y.nar.zst lb # [ 158.743386] niks3-server[1128]: 2026/09/23 16:02:08 INFO Received complete push request method=POST path=/api/pushes/61/complete worker1 # [ 158.763203] nix-grpc-daemon[1762]: time=2026-09-23T16:02:07.973Z level=INFO msg="Upload complete. (184ms)" lb # [ 158.748073] niks3-server[1128]: 2026/09/23 16:02:08 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.narinfo worker1 # [ 158.765504] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 158.768518] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 158.776391] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 158.778366] nix-daemon[865]: reaped child process 1760, status = succeeded worker1 # [ 158.783459] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) client # [ 158.770851] nix[1512]: building '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' on lb:50051... worker2 # [ 160.006601] nix-daemon[858]: reaped child process 1921, status = succeeded worker2 # [ 160.084092] nix-daemon[858]: accepted connection from pid 1949, user nix-grpc-daemon (trusted) worker2 # [ 160.096920] nix-daemon[858]: reaped child process 1952, status = succeeded lb # [ 160.064673] niks3-server[1128]: 2026/09/23 16:02:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 160.112459] nix-grpc-daemon[1734]: time=2026-09-23T16:02:10.116Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 160.114406] nix-grpc-daemon[1734]: time=2026-09-23T16:02:10.118Z level=INFO msg="Uploading vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq-slow-q3 (120B)" lb # [ 160.109132] niks3-server[1128]: 2026/09/23 16:02:10 INFO Received sign narinfos request method=POST path=/api/pushes/62/sign lb # [ 160.114128] niks3-server[1128]: 2026/09/23 16:02:10 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst worker2 # [ 160.159820] nix-grpc-daemon[1734]: time=2026-09-23T16:02:10.164Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.119204] niks3-server[1128]: 2026/09/23 16:02:10 INFO Signed narinfos id=62 count=1 lb # [ 160.125779] niks3-server[1128]: 2026/09/23 16:02:10 INFO Registered completed upload object_key=log/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv lb # [ 160.130961] niks3-server[1128]: 2026/09/23 16:02:10 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.ls lb # [ 160.139534] niks3-server[1128]: 2026/09/23 16:02:10 INFO Received complete push request method=POST path=/api/pushes/62/complete worker2 # [ 160.184137] nix-grpc-daemon[1734]: time=2026-09-23T16:02:10.188Z level=INFO msg="Upload complete. (209ms)" lb # [ 160.144708] niks3-server[1128]: 2026/09/23 16:02:10 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.narinfo worker2 # [ 160.191422] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=2 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv assign_id=7 outputs=1 worker2 # [ 160.197275] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:10Z level=debug event=assigned drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 160.201566] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 160.210353] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 160.213051] nix-daemon[858]: reaped child process 1919, status = succeeded client # [ 160.178796] nix[1512]: copying 1 paths to 'lb:50051'... worker2 # [ 160.218914] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 client # [ 160.181724] nix[1512]: copying path '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' to 'lb:50051'... worker2 # [ 160.225400] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 160.310168] nix-daemon[858]: accepted connection from pid 1956, user nix-grpc-daemon (trusted) worker2 # [ 160.324767] nix-daemon[858]: reaped child process 1959, status = succeeded lb # [ 160.289157] niks3-server[1128]: 2026/09/23 16:02:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 160.338332] nix-grpc-daemon[1734]: time=2026-09-23T16:02:10.343Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 160.340157] nix-grpc-daemon[1734]: time=2026-09-23T16:02:10.344Z level=INFO msg="Uploading 8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv (416B)" lb # [ 160.317174] niks3-server[1128]: 2026/09/23 16:02:10 INFO Received sign narinfos request method=POST path=/api/pushes/63/sign worker2 # [ 160.362477] nix-grpc-daemon[1734]: time=2026-09-23T16:02:10.367Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.322162] niks3-server[1128]: 2026/09/23 16:02:10 INFO Signed narinfos id=63 count=1 lb # [ 160.335416] niks3-server[1128]: 2026/09/23 16:02:10 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.ls lb # [ 160.339877] niks3-server[1128]: 2026/09/23 16:02:10 INFO Registered completed upload object_key=nar/1xibay372y9by9a678y9h7bfzwahsxi0vq51acgywak31q6q2m87.nar.zst lb # [ 160.349691] niks3-server[1128]: 2026/09/23 16:02:10 INFO Received complete push request method=POST path=/api/pushes/63/complete worker2 # [ 160.397858] nix-grpc-daemon[1734]: time=2026-09-23T16:02:10.402Z level=INFO msg="Upload complete. (166ms)" lb # [ 160.357955] niks3-server[1128]: 2026/09/23 16:02:10 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.narinfo worker2 # [ 160.400503] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 160.403171] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 160.409789] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 160.417707] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # [ 160.379706] nix[1512]: building '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' on lb:50051... worker2 # [ 160.419909] nix-daemon[858]: reaped child process 1954, status = succeeded worker1 # [ 161.015631] nix-daemon[865]: reaped child process 1785, status = succeeded worker1 # [ 161.092957] nix-daemon[865]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 161.105869] nix-daemon[865]: reaped child process 1813, status = succeeded lb # [ 161.100706] niks3-server[1128]: 2026/09/23 16:02:11 INFO Received push request method=POST path=/api/pushes worker1 # [ 161.125178] nix-grpc-daemon[1762]: time=2026-09-23T16:02:10.335Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 161.127431] nix-grpc-daemon[1762]: time=2026-09-23T16:02:10.336Z level=INFO msg="Uploading nv0kp5b571hsjibnd9v06981i024iima-slow-q2 (120B)" lb # [ 161.144985] niks3-server[1128]: 2026/09/23 16:02:11 INFO Received sign narinfos request method=POST path=/api/pushes/64/sign lb # [ 161.150653] niks3-server[1128]: 2026/09/23 16:02:11 INFO Signed narinfos id=64 count=1 worker1 # [ 161.169313] nix-grpc-daemon[1762]: time=2026-09-23T16:02:10.379Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.155598] niks3-server[1128]: 2026/09/23 16:02:11 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst lb # [ 161.160881] niks3-server[1128]: 2026/09/23 16:02:11 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.ls lb # [ 161.169491] niks3-server[1128]: 2026/09/23 16:02:11 INFO Received complete push request method=POST path=/api/pushes/64/complete lb # [ 161.175877] niks3-server[1128]: 2026/09/23 16:02:11 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.narinfo worker1 # [ 161.191055] nix-grpc-daemon[1762]: time=2026-09-23T16:02:10.401Z level=INFO msg="Upload complete. (199ms)" lb # [ 161.178375] niks3-server[1128]: 2026/09/23 16:02:11 INFO Registered completed upload object_key=log/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker1 # [ 161.195931] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=2 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv assign_id=8 outputs=1 worker2 # [ 161.222926] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:11Z level=debug event=assigned drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.205773] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 161.211050] nix-daemon[865]: reaped child process 1783, status = succeeded worker1 # [ 161.214740] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 161.220324] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 client # [ 161.207857] nix[1512]: copying 1 paths to 'lb:50051'... worker1 # [ 161.225169] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) client # [ 161.210589] nix[1512]: copying path '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' to 'lb:50051'... worker1 # [ 161.311497] nix-daemon[865]: accepted connection from pid 1817, user nix-grpc-daemon (trusted) worker1 # [ 161.325426] nix-daemon[865]: reaped child process 1820, status = succeeded lb # [ 161.315382] niks3-server[1128]: 2026/09/23 16:02:11 INFO Received push request method=POST path=/api/pushes worker1 # [ 161.339163] nix-grpc-daemon[1762]: time=2026-09-23T16:02:10.549Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 161.341090] nix-grpc-daemon[1762]: time=2026-09-23T16:02:10.550Z level=INFO msg="Uploading qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv (416B)" lb # [ 161.346861] niks3-server[1128]: 2026/09/23 16:02:11 INFO Received sign narinfos request method=POST path=/api/pushes/65/sign lb # [ 161.353086] niks3-server[1128]: 2026/09/23 16:02:11 INFO Signed narinfos id=65 count=1 worker1 # [ 161.372569] nix-grpc-daemon[1762]: time=2026-09-23T16:02:10.582Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.357970] niks3-server[1128]: 2026/09/23 16:02:11 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.ls lb # [ 161.363517] niks3-server[1128]: 2026/09/23 16:02:11 INFO Registered completed upload object_key=nar/1spxkiwzvlj9sgbjal4jf4p68h5kbylxymfww73s5va157qxgafi.nar.zst lb # [ 161.376447] niks3-server[1128]: 2026/09/23 16:02:11 INFO Received complete push request method=POST path=/api/pushes/65/complete worker1 # [ 161.402460] nix-grpc-daemon[1762]: time=2026-09-23T16:02:10.612Z level=INFO msg="Upload complete. (171ms)" lb # [ 161.387805] niks3-server[1128]: 2026/09/23 16:02:11 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.narinfo worker1 # [ 161.404573] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 161.409462] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 161.415260] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 161.417528] nix-daemon[865]: reaped child process 1815, status = succeeded worker1 # [ 161.422635] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) client # [ 161.409475] nix[1512]: building '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' on lb:50051... worker2 # [ 162.269214] nix-daemon[858]: reaped child process 1963, status = succeeded worker2 # [ 162.333942] nix-daemon[858]: accepted connection from pid 1988, user nix-grpc-daemon (trusted) worker2 # [ 162.348162] nix-daemon[858]: reaped child process 1991, status = succeeded lb # [ 162.313885] niks3-server[1128]: 2026/09/23 16:02:12 INFO Received push request method=POST path=/api/pushes worker2 # [ 162.363120] nix-grpc-daemon[1734]: time=2026-09-23T16:02:12.367Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 162.364556] nix-grpc-daemon[1734]: time=2026-09-23T16:02:12.369Z level=INFO msg="Uploading wmw8972gq2nf739xhg7is7lylxf8299y-slow-q0 (120B)" lb # [ 162.358699] niks3-server[1128]: 2026/09/23 16:02:12 INFO Received sign narinfos request method=POST path=/api/pushes/66/sign lb # [ 162.367555] niks3-server[1128]: 2026/09/23 16:02:12 INFO Registered completed upload object_key=log/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker2 # [ 162.417735] nix-grpc-daemon[1734]: time=2026-09-23T16:02:12.422Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.376531] niks3-server[1128]: 2026/09/23 16:02:12 INFO Signed narinfos id=66 count=1 lb # [ 162.380469] niks3-server[1128]: 2026/09/23 16:02:12 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst lb # [ 162.384411] niks3-server[1128]: 2026/09/23 16:02:12 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.ls lb # [ 162.394893] niks3-server[1128]: 2026/09/23 16:02:12 INFO Received complete push request method=POST path=/api/pushes/66/complete lb # [ 162.403770] niks3-server[1128]: 2026/09/23 16:02:12 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.narinfo worker2 # [ 162.443879] nix-grpc-daemon[1734]: time=2026-09-23T16:02:12.448Z level=INFO msg="Upload complete. (213ms)" worker2 # [ 162.449903] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=2 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv assign_id=9 outputs=1 worker2 # [ 162.461993] nix-daemon[858]: reaped child process 1961, status = succeeded worker1 # [ 163.261844] nix-daemon[865]: reaped child process 1824, status = succeeded worker1 # [ 163.333826] nix-daemon[865]: accepted connection from pid 1849, user nix-grpc-daemon (trusted) worker1 # [ 163.345134] nix-daemon[865]: reaped child process 1852, status = succeeded lb # [ 163.338437] niks3-server[1128]: 2026/09/23 16:02:13 INFO Received push request method=POST path=/api/pushes worker1 # [ 163.362980] nix-grpc-daemon[1762]: time=2026-09-23T16:02:12.573Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 163.364885] nix-grpc-daemon[1762]: time=2026-09-23T16:02:12.574Z level=INFO msg="Uploading 106i40yblbkazayvn9ppswrq6kqs26sj-slow-q1 (120B)" lb # [ 163.381703] niks3-server[1128]: 2026/09/23 16:02:13 INFO Received sign narinfos request method=POST path=/api/pushes/67/sign worker1 # [ 163.403479] nix-grpc-daemon[1762]: time=2026-09-23T16:02:12.613Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.387283] niks3-server[1128]: 2026/09/23 16:02:13 INFO Signed narinfos id=67 count=1 lb # [ 163.395378] niks3-server[1128]: 2026/09/23 16:02:13 INFO Registered completed upload object_key=log/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv lb # [ 163.401522] niks3-server[1128]: 2026/09/23 16:02:13 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst lb # [ 163.407072] niks3-server[1128]: 2026/09/23 16:02:13 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.ls lb # [ 163.416132] niks3-server[1128]: 2026/09/23 16:02:13 INFO Received complete push request method=POST path=/api/pushes/67/complete worker1 # [ 163.440120] nix-grpc-daemon[1762]: time=2026-09-23T16:02:12.650Z level=INFO msg="Upload complete. (209ms)" lb # [ 163.425940] niks3-server[1128]: 2026/09/23 16:02:13 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.narinfo worker1 # [ 163.446873] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=2 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv assign_id=10 outputs=1 worker1 # [ 163.460940] nix-daemon[865]: reaped child process 1822, status = succeeded client # [ 163.465279] systemd[1]: burst.service: Deactivated successfully. client # [ 163.468301] systemd[1]: burst.service: Consumed 160ms CPU time over 6.184s wall clock time, 51.9M memory peak, 14K incoming IP traffic, 19K outgoing IP traffic. client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; } client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: queue gauges show a burst while every build blocks, in 7.37 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 164.660912] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 164.667265] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2 # [ 164.734939] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:14Z level=debug event=want client=6 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 164.739698] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:14Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.717178] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2 # [ 164.744166] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:14Z level=debug event=want client=6 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 164.748093] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:14Z level=debug event=want client=6 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 164.729911] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 164.741720] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 164.750700] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 164.855984] nix-daemon[865]: accepted connection from pid 1861, user nix-grpc-daemon (trusted) worker1 # [ 164.868972] nix-daemon[865]: reaped child process 1864, status = succeeded lb # [ 164.861788] niks3-server[1128]: 2026/09/23 16:02:14 INFO Received push request method=POST path=/api/pushes worker1 # [ 164.887251] nix-grpc-daemon[1762]: time=2026-09-23T16:02:14.097Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 164.889292] nix-grpc-daemon[1762]: time=2026-09-23T16:02:14.099Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 164.896921] niks3-server[1128]: 2026/09/23 16:02:14 INFO Received sign narinfos request method=POST path=/api/pushes/68/sign worker1 # [ 164.917080] nix-grpc-daemon[1762]: time=2026-09-23T16:02:14.127Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.900753] niks3-server[1128]: 2026/09/23 16:02:14 INFO Signed narinfos id=68 count=1 lb # [ 164.909492] niks3-server[1128]: 2026/09/23 16:02:14 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 164.916510] niks3-server[1128]: 2026/09/23 16:02:14 INFO Received complete push request method=POST path=/api/pushes/68/complete worker1 # [ 164.939279] nix-grpc-daemon[1762]: time=2026-09-23T16:02:14.149Z level=INFO msg="Upload complete. (174ms)" lb # [ 164.924890] niks3-server[1128]: 2026/09/23 16:02:15 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst worker1 # [ 164.941406] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 164.927843] niks3-server[1128]: 2026/09/23 16:02:15 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 164.946596] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 164.953072] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 164.954389] nix-daemon[865]: reaped child process 1858, status = succeeded worker1 # [ 164.959550] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 166.175885] nix-daemon[865]: reaped child process 1868, status = succeeded worker1 # [ 166.252659] nix-daemon[865]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) worker1 # [ 166.264346] nix-daemon[865]: reaped child process 1887, status = succeeded lb # [ 166.256599] niks3-server[1128]: 2026/09/23 16:02:16 INFO Received push request method=POST path=/api/pushes worker1 # [ 166.280780] nix-grpc-daemon[1762]: time=2026-09-23T16:02:15.490Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 166.282440] nix-grpc-daemon[1762]: time=2026-09-23T16:02:15.492Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 166.302319] niks3-server[1128]: 2026/09/23 16:02:16 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 166.307274] niks3-server[1128]: 2026/09/23 16:02:16 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 166.311672] niks3-server[1128]: 2026/09/23 16:02:16 INFO Received sign narinfos request method=POST path=/api/pushes/69/sign lb # [ 166.317351] niks3-server[1128]: 2026/09/23 16:02:16 INFO Signed narinfos id=69 count=1 worker1 # [ 166.332962] nix-grpc-daemon[1762]: time=2026-09-23T16:02:15.543Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.323686] niks3-server[1128]: 2026/09/23 16:02:16 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 166.332578] niks3-server[1128]: 2026/09/23 16:02:16 INFO Received complete push request method=POST path=/api/pushes/69/complete lb # [ 166.339295] niks3-server[1128]: 2026/09/23 16:02:16 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 166.353573] nix-grpc-daemon[1762]: time=2026-09-23T16:02:15.563Z level=INFO msg="Upload complete. (186ms)" worker1 # [ 166.360089] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=11 outputs=1 worker2 # [ 166.389586] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:16Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 166.370335] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2 # [ 166.395465] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:16Z level=debug event=want client=6 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 166.379703] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 166.387725] nix-daemon[865]: reaped child process 1866, status = succeeded worker1 # [ 166.390064] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 166.393914] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 166.480541] nix-daemon[865]: accepted connection from pid 1891, user nix-grpc-daemon (trusted) worker1 # [ 166.494323] nix-daemon[865]: reaped child process 1894, status = succeeded lb # [ 166.484532] niks3-server[1128]: 2026/09/23 16:02:16 INFO Received push request method=POST path=/api/pushes worker1 # [ 166.508056] nix-grpc-daemon[1762]: time=2026-09-23T16:02:15.718Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 166.510067] nix-grpc-daemon[1762]: time=2026-09-23T16:02:15.719Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 166.511979] niks3-server[1128]: 2026/09/23 16:02:16 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 166.519644] niks3-server[1128]: 2026/09/23 16:02:16 INFO Received sign narinfos request method=POST path=/api/pushes/70/sign lb # [ 166.525207] niks3-server[1128]: 2026/09/23 16:02:16 INFO Signed narinfos id=70 count=1 worker1 # [ 166.545062] nix-grpc-daemon[1762]: time=2026-09-23T16:02:15.755Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.538181] niks3-server[1128]: 2026/09/23 16:02:16 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 166.544708] niks3-server[1128]: 2026/09/23 16:02:16 INFO Received complete push request method=POST path=/api/pushes/70/complete lb # [ 166.555948] niks3-server[1128]: 2026/09/23 16:02:16 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 166.571153] nix-grpc-daemon[1762]: time=2026-09-23T16:02:15.781Z level=INFO msg="Upload complete. (171ms)" worker1 # [ 166.575096] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 166.580247] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 166.589649] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 166.595130] nix-daemon[865]: reaped child process 1889, status = succeeded worker1 # [ 166.599540] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) lb # [ 166.827343] envoy[918]: conn peer=[2001:db8:1::1]:60992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9647 tx=5187 ms=6031 worker1 # [ 167.640596] nix-daemon[865]: reaped child process 1898, status = succeeded worker1 # [ 167.723334] nix-daemon[865]: accepted connection from pid 1914, user nix-grpc-daemon (trusted) worker1 # [ 167.736084] nix-daemon[865]: reaped child process 1917, status = succeeded lb # [ 167.728500] niks3-server[1128]: 2026/09/23 16:02:17 INFO Received push request method=POST path=/api/pushes worker1 # [ 167.755409] nix-grpc-daemon[1762]: time=2026-09-23T16:02:16.965Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 167.756941] nix-grpc-daemon[1762]: time=2026-09-23T16:02:16.967Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 167.778864] niks3-server[1128]: 2026/09/23 16:02:17 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 167.782759] niks3-server[1128]: 2026/09/23 16:02:17 INFO Received sign narinfos request method=POST path=/api/pushes/71/sign worker1 # [ 167.802998] nix-grpc-daemon[1762]: time=2026-09-23T16:02:17.013Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.787417] niks3-server[1128]: 2026/09/23 16:02:17 INFO Signed narinfos id=71 count=1 lb # [ 167.792520] niks3-server[1128]: 2026/09/23 16:02:17 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 167.804499] niks3-server[1128]: 2026/09/23 16:02:17 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 167.811250] niks3-server[1128]: 2026/09/23 16:02:17 INFO Received complete push request method=POST path=/api/pushes/71/complete lb # [ 167.820587] niks3-server[1128]: 2026/09/23 16:02:17 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 167.835553] nix-grpc-daemon[1762]: time=2026-09-23T16:02:17.045Z level=INFO msg="Upload complete. (228ms)" worker1 # [ 167.841603] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=12 outputs=1 worker2 # [ 167.871212] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:17Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 167.850358] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2 # [ 167.877094] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:17Z level=debug event=want client=6 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 167.862056] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 167.870357] nix-daemon[865]: reaped child process 1896, status = succeeded worker1 # [ 167.873145] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 167.881070] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 167.965228] nix-daemon[865]: accepted connection from pid 1921, user nix-grpc-daemon (trusted) worker1 # [ 167.978377] nix-daemon[865]: reaped child process 1924, status = succeeded lb # [ 167.969221] niks3-server[1128]: 2026/09/23 16:02:18 INFO Received push request method=POST path=/api/pushes worker1 # [ 167.993351] nix-grpc-daemon[1762]: time=2026-09-23T16:02:17.203Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 167.994843] nix-grpc-daemon[1762]: time=2026-09-23T16:02:17.205Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 167.996272] niks3-server[1128]: 2026/09/23 16:02:18 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 168.006360] niks3-server[1128]: 2026/09/23 16:02:18 INFO Received sign narinfos request method=POST path=/api/pushes/72/sign lb # [ 168.010691] niks3-server[1128]: 2026/09/23 16:02:18 INFO Signed narinfos id=72 count=1 worker1 # [ 168.029629] nix-grpc-daemon[1762]: time=2026-09-23T16:02:17.239Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.020530] niks3-server[1128]: 2026/09/23 16:02:18 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 168.032311] niks3-server[1128]: 2026/09/23 16:02:18 INFO Received complete push request method=POST path=/api/pushes/72/complete worker1 # [ 168.054735] nix-grpc-daemon[1762]: time=2026-09-23T16:02:17.265Z level=INFO msg="Upload complete. (169ms)" lb # [ 168.040565] niks3-server[1128]: 2026/09/23 16:02:18 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo worker1 # [ 168.057928] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 168.063457] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 168.071974] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 168.077425] nix-daemon[865]: reaped child process 1919, status = succeeded worker1 # [ 168.083785] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 169.116423] nix-daemon[865]: reaped child process 1928, status = succeeded worker1 # [ 169.195091] nix-daemon[865]: accepted connection from pid 1944, user nix-grpc-daemon (trusted) worker1 # [ 169.208088] nix-daemon[865]: reaped child process 1947, status = succeeded lb # [ 169.199963] niks3-server[1128]: 2026/09/23 16:02:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 169.222206] nix-grpc-daemon[1762]: time=2026-09-23T16:02:18.432Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 169.225151] nix-grpc-daemon[1762]: time=2026-09-23T16:02:18.434Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 169.239165] niks3-server[1128]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 169.242864] niks3-server[1128]: 2026/09/23 16:02:19 INFO Received sign narinfos request method=POST path=/api/pushes/73/sign worker1 # [ 169.264696] nix-grpc-daemon[1762]: time=2026-09-23T16:02:18.474Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.248950] niks3-server[1128]: 2026/09/23 16:02:19 INFO Signed narinfos id=73 count=1 lb # [ 169.254858] niks3-server[1128]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 169.259502] niks3-server[1128]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 169.267056] niks3-server[1128]: 2026/09/23 16:02:19 INFO Received complete push request method=POST path=/api/pushes/73/complete lb # [ 169.273333] niks3-server[1128]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 169.288592] nix-grpc-daemon[1762]: time=2026-09-23T16:02:18.498Z level=INFO msg="Upload complete. (198ms)" worker1 # [ 169.293777] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=13 outputs=1 worker1 # [ 169.300735] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2 # [ 169.323622] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:19Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 169.329391] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:19Z level=debug event=want client=6 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 169.311287] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 169.315163] nix-daemon[865]: reaped child process 1926, status = succeeded worker1 # [ 169.317381] nix-grpc-daemon[1762]: time=2026-09-23T16:02:18.527Z level=INFO msg="All 1 paths already cached" worker1 # [ 169.321537] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 169.326258] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 169.411294] nix-daemon[865]: accepted connection from pid 1951, user nix-grpc-daemon (trusted) worker1 # [ 169.426946] nix-daemon[865]: reaped child process 1954, status = succeeded lb # [ 169.415969] niks3-server[1128]: 2026/09/23 16:02:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 169.439518] nix-grpc-daemon[1762]: time=2026-09-23T16:02:18.649Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 169.440990] nix-grpc-daemon[1762]: time=2026-09-23T16:02:18.651Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 169.450660] niks3-server[1128]: 2026/09/23 16:02:19 INFO Received sign narinfos request method=POST path=/api/pushes/74/sign lb # [ 169.457160] niks3-server[1128]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 169.463295] niks3-server[1128]: 2026/09/23 16:02:19 INFO Signed narinfos id=74 count=1 worker1 # [ 169.482541] nix-grpc-daemon[1762]: time=2026-09-23T16:02:18.692Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.470413] niks3-server[1128]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 169.480819] niks3-server[1128]: 2026/09/23 16:02:19 INFO Received complete push request method=POST path=/api/pushes/74/complete worker1 # [ 169.505976] nix-grpc-daemon[1762]: time=2026-09-23T16:02:18.716Z level=INFO msg="Upload complete. (175ms)" lb # [ 169.492062] niks3-server[1128]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 169.510064] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 169.515189] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 169.524514] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 169.533193] nix-daemon[865]: reaped child process 1949, status = succeeded worker1 # [ 169.538214] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 170.564958] nix-daemon[865]: reaped child process 1958, status = succeeded worker1 # [ 170.638280] nix-daemon[865]: accepted connection from pid 1974, user nix-grpc-daemon (trusted) worker1 # [ 170.649528] nix-daemon[865]: reaped child process 1977, status = succeeded lb # [ 170.644362] niks3-server[1128]: 2026/09/23 16:02:20 INFO Received push request method=POST path=/api/pushes worker1 # [ 170.667412] nix-grpc-daemon[1762]: time=2026-09-23T16:02:19.877Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 170.669065] nix-grpc-daemon[1762]: time=2026-09-23T16:02:19.879Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 170.687583] niks3-server[1128]: 2026/09/23 16:02:20 INFO Received sign narinfos request method=POST path=/api/pushes/75/sign lb # [ 170.695742] niks3-server[1128]: 2026/09/23 16:02:20 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls worker1 # [ 170.716868] nix-grpc-daemon[1762]: time=2026-09-23T16:02:19.927Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.701683] niks3-server[1128]: 2026/09/23 16:02:20 INFO Signed narinfos id=75 count=1 lb # [ 170.705190] niks3-server[1128]: 2026/09/23 16:02:20 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 170.711989] niks3-server[1128]: 2026/09/23 16:02:20 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 170.724542] niks3-server[1128]: 2026/09/23 16:02:20 INFO Received complete push request method=POST path=/api/pushes/75/complete worker1 # [ 170.745559] nix-grpc-daemon[1762]: time=2026-09-23T16:02:19.955Z level=INFO msg="Upload complete. (200ms)" lb # [ 170.731251] niks3-server[1128]: 2026/09/23 16:02:20 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 170.751915] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=14 outputs=1 worker2 # [ 170.781295] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:20Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 170.760707] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2 # [ 170.787196] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:20Z level=debug event=want client=6 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 170.770870] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 170.780199] nix-daemon[865]: reaped child process 1956, status = succeeded worker1 # [ 170.782190] nix-grpc-daemon[1762]: time=2026-09-23T16:02:19.992Z level=INFO msg="All 1 paths already cached" worker1 # [ 170.786777] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 170.791170] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 170.877232] nix-daemon[865]: accepted connection from pid 1981, user nix-grpc-daemon (trusted) worker1 # [ 170.890288] nix-daemon[865]: reaped child process 1984, status = succeeded lb # [ 170.881862] niks3-server[1128]: 2026/09/23 16:02:20 INFO Received push request method=POST path=/api/pushes worker1 # [ 170.905560] nix-grpc-daemon[1762]: time=2026-09-23T16:02:20.115Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 170.907518] nix-grpc-daemon[1762]: time=2026-09-23T16:02:20.117Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 170.910266] niks3-server[1128]: 2026/09/23 16:02:20 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 170.922709] niks3-server[1128]: 2026/09/23 16:02:21 INFO Received sign narinfos request method=POST path=/api/pushes/76/sign worker1 # [ 170.943769] nix-grpc-daemon[1762]: time=2026-09-23T16:02:20.153Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.928137] niks3-server[1128]: 2026/09/23 16:02:21 INFO Signed narinfos id=76 count=1 lb # [ 170.933609] niks3-server[1128]: 2026/09/23 16:02:21 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 170.947099] niks3-server[1128]: 2026/09/23 16:02:21 INFO Received complete push request method=POST path=/api/pushes/76/complete lb # [ 170.956052] niks3-server[1128]: 2026/09/23 16:02:21 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 170.975817] nix-grpc-daemon[1762]: time=2026-09-23T16:02:20.186Z level=INFO msg="Upload complete. (178ms)" worker1 # [ 170.980517] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 170.987243] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 170.996484] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 171.008392] nix-daemon[865]: reaped child process 1979, status = succeeded worker1 # [ 171.012130] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 172.451256] nix-daemon[865]: reaped child process 1988, status = succeeded worker1 # [ 172.534888] nix-daemon[865]: accepted connection from pid 2004, user nix-grpc-daemon (trusted) worker1 # [ 172.548086] nix-daemon[865]: reaped child process 2007, status = succeeded lb # [ 172.540665] niks3-server[1128]: 2026/09/23 16:02:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 172.565177] nix-grpc-daemon[1762]: time=2026-09-23T16:02:21.775Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 172.566888] nix-grpc-daemon[1762]: time=2026-09-23T16:02:21.777Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 172.584528] niks3-server[1128]: 2026/09/23 16:02:22 INFO Received sign narinfos request method=POST path=/api/pushes/77/sign lb # [ 172.593053] niks3-server[1128]: 2026/09/23 16:02:22 INFO Signed narinfos id=77 count=1 worker1 # [ 172.612162] nix-grpc-daemon[1762]: time=2026-09-23T16:02:21.822Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.603052] niks3-server[1128]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 172.608384] niks3-server[1128]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 172.615060] niks3-server[1128]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 172.623061] niks3-server[1128]: 2026/09/23 16:02:22 INFO Received complete push request method=POST path=/api/pushes/77/complete worker1 # [ 172.642454] nix-grpc-daemon[1762]: time=2026-09-23T16:02:21.852Z level=INFO msg="Upload complete. (222ms)" lb # [ 172.629097] niks3-server[1128]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 172.648479] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=15 outputs=1 worker2 # [ 172.677946] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:22Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 172.658370] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2 # [ 172.683966] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:22Z level=debug event=want client=6 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 172.668295] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 172.677130] nix-daemon[865]: reaped child process 1986, status = succeeded worker1 # [ 172.679300] nix-grpc-daemon[1762]: time=2026-09-23T16:02:21.887Z level=INFO msg="All 1 paths already cached" worker1 # [ 172.681881] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 172.686604] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 172.771979] nix-daemon[865]: accepted connection from pid 2011, user nix-grpc-daemon (trusted) worker1 # [ 172.786122] nix-daemon[865]: reaped child process 2014, status = succeeded lb # [ 172.775490] niks3-server[1128]: 2026/09/23 16:02:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 172.799457] nix-grpc-daemon[1762]: time=2026-09-23T16:02:22.009Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 172.801443] nix-grpc-daemon[1762]: time=2026-09-23T16:02:22.011Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 172.804433] niks3-server[1128]: 2026/09/23 16:02:22 INFO Received sign narinfos request method=POST path=/api/pushes/78/sign worker1 # [ 172.829120] nix-grpc-daemon[1762]: time=2026-09-23T16:02:22.039Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.814340] niks3-server[1128]: 2026/09/23 16:02:22 INFO Signed narinfos id=78 count=1 lb # [ 172.818555] niks3-server[1128]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 172.825402] niks3-server[1128]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 172.837218] niks3-server[1128]: 2026/09/23 16:02:22 INFO Received complete push request method=POST path=/api/pushes/78/complete worker1 # [ 172.861357] nix-grpc-daemon[1762]: time=2026-09-23T16:02:22.071Z level=INFO msg="Upload complete. (170ms)" lb # [ 172.846190] niks3-server[1128]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 172.864998] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 172.869914] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 172.880791] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 172.884810] nix-daemon[865]: reaped child process 2009, status = succeeded worker1 # [ 172.889707] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 174.127633] nix-daemon[865]: reaped child process 2018, status = succeeded worker1 # [ 174.214435] nix-daemon[865]: accepted connection from pid 2034, user nix-grpc-daemon (trusted) worker1 # [ 174.225525] nix-daemon[865]: reaped child process 2037, status = succeeded lb # [ 174.219541] niks3-server[1128]: 2026/09/23 16:02:24 INFO Received push request method=POST path=/api/pushes worker1 # [ 174.243858] nix-grpc-daemon[1762]: time=2026-09-23T16:02:23.453Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 174.246578] nix-grpc-daemon[1762]: time=2026-09-23T16:02:23.455Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 174.258195] niks3-server[1128]: 2026/09/23 16:02:24 INFO Received sign narinfos request method=POST path=/api/pushes/79/sign worker1 # [ 174.280943] nix-grpc-daemon[1762]: time=2026-09-23T16:02:23.491Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.264721] niks3-server[1128]: 2026/09/23 16:02:24 INFO Signed narinfos id=79 count=1 lb # [ 174.274476] niks3-server[1128]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 174.278887] niks3-server[1128]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 174.290412] niks3-server[1128]: 2026/09/23 16:02:24 INFO Received complete push request method=POST path=/api/pushes/79/complete lb # [ 174.293916] niks3-server[1128]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 174.301278] niks3-server[1128]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 174.316329] nix-grpc-daemon[1762]: time=2026-09-23T16:02:23.526Z level=INFO msg="Upload complete. (218ms)" worker1 # [ 174.322630] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=16 outputs=1 worker2 # [ 174.352547] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:24Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 174.332321] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2 # [ 174.358696] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:24Z level=debug event=want client=6 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 174.344514] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 174.350715] nix-daemon[865]: reaped child process 2016, status = succeeded worker1 # [ 174.356889] nix-grpc-daemon[1762]: time=2026-09-23T16:02:23.567Z level=INFO msg="All 2 paths already cached" worker1 # [ 174.363826] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 174.370390] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 174.457403] nix-daemon[865]: accepted connection from pid 2041, user nix-grpc-daemon (trusted) worker1 # [ 174.471833] nix-daemon[865]: reaped child process 2044, status = succeeded lb # [ 174.463066] niks3-server[1128]: 2026/09/23 16:02:24 INFO Received push request method=POST path=/api/pushes worker1 # [ 174.486908] nix-grpc-daemon[1762]: time=2026-09-23T16:02:23.697Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 174.489026] nix-grpc-daemon[1762]: time=2026-09-23T16:02:23.698Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 174.491692] niks3-server[1128]: 2026/09/23 16:02:24 INFO Received sign narinfos request method=POST path=/api/pushes/80/sign worker1 # [ 174.513097] nix-grpc-daemon[1762]: time=2026-09-23T16:02:23.723Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.497144] niks3-server[1128]: 2026/09/23 16:02:24 INFO Signed narinfos id=80 count=1 lb # [ 174.505143] niks3-server[1128]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 174.518948] niks3-server[1128]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 174.524539] niks3-server[1128]: 2026/09/23 16:02:24 INFO Received complete push request method=POST path=/api/pushes/80/complete worker1 # [ 174.548106] nix-grpc-daemon[1762]: time=2026-09-23T16:02:23.758Z level=INFO msg="Upload complete. (171ms)" lb # [ 174.533895] niks3-server[1128]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 174.551740] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 174.556704] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 174.566479] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 174.571790] nix-daemon[865]: reaped child process 2039, status = succeeded worker1 # [ 174.576463] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 175.811539] nix-daemon[865]: reaped child process 2048, status = succeeded worker1 # [ 175.892728] nix-daemon[865]: accepted connection from pid 2064, user nix-grpc-daemon (trusted) worker1 # [ 175.905610] nix-daemon[865]: reaped child process 2067, status = succeeded lb # [ 175.897640] niks3-server[1128]: 2026/09/23 16:02:25 INFO Received push request method=POST path=/api/pushes worker1 # [ 175.923781] nix-grpc-daemon[1762]: time=2026-09-23T16:02:25.133Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 175.926061] nix-grpc-daemon[1762]: time=2026-09-23T16:02:25.135Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 175.940712] niks3-server[1128]: 2026/09/23 16:02:26 INFO Received sign narinfos request method=POST path=/api/pushes/81/sign worker1 # [ 175.961726] nix-grpc-daemon[1762]: time=2026-09-23T16:02:25.171Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.945614] niks3-server[1128]: 2026/09/23 16:02:26 INFO Signed narinfos id=81 count=1 lb # [ 175.952934] niks3-server[1128]: 2026/09/23 16:02:26 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 175.960962] niks3-server[1128]: 2026/09/23 16:02:26 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 175.963426] niks3-server[1128]: 2026/09/23 16:02:26 INFO Received complete push request method=POST path=/api/pushes/81/complete worker1 # [ 175.984702] nix-grpc-daemon[1762]: time=2026-09-23T16:02:25.194Z level=INFO msg="Upload complete. (198ms)" lb # [ 175.969965] niks3-server[1128]: 2026/09/23 16:02:26 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 175.972867] niks3-server[1128]: 2026/09/23 16:02:26 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker1 # [ 175.991129] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=17 outputs=1 worker2 # [ 176.017872] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:26Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 175.997429] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 176.008059] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 176.010378] nix-daemon[865]: reaped child process 2046, status = succeeded worker1 # [ 176.014656] nix-grpc-daemon[1762]: time=2026-09-23T16:02:25.225Z level=INFO msg="All 2 paths already cached" worker1 # [ 176.018967] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 176.023846] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 176.107981] nix-daemon[865]: accepted connection from pid 2071, user nix-grpc-daemon (trusted) worker1 # [ 176.121922] nix-daemon[865]: reaped child process 2074, status = succeeded lb # [ 176.113454] niks3-server[1128]: 2026/09/23 16:02:26 INFO Received push request method=POST path=/api/pushes worker1 # [ 176.137936] nix-grpc-daemon[1762]: time=2026-09-23T16:02:25.348Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 176.139932] nix-grpc-daemon[1762]: time=2026-09-23T16:02:25.349Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 176.144145] niks3-server[1128]: 2026/09/23 16:02:26 INFO Received sign narinfos request method=POST path=/api/pushes/82/sign lb # [ 176.148699] niks3-server[1128]: 2026/09/23 16:02:26 INFO Signed narinfos id=82 count=1 worker1 # [ 176.167125] nix-grpc-daemon[1762]: time=2026-09-23T16:02:25.377Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.154187] niks3-server[1128]: 2026/09/23 16:02:26 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 176.164172] niks3-server[1128]: 2026/09/23 16:02:26 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 176.167533] niks3-server[1128]: 2026/09/23 16:02:26 INFO Received complete push request method=POST path=/api/pushes/82/complete worker1 # [ 176.188144] nix-grpc-daemon[1762]: time=2026-09-23T16:02:25.398Z level=INFO msg="Upload complete. (159ms)" worker1 # [ 176.190115] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 176.174837] niks3-server[1128]: 2026/09/23 16:02:26 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 176.192926] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 176.200157] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 176.203551] nix-daemon[865]: reaped child process 2069, status = succeeded worker1 # [ 176.207493] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 177.446782] nix-daemon[865]: reaped child process 2078, status = succeeded worker1 # [ 177.529404] nix-daemon[865]: accepted connection from pid 2094, user nix-grpc-daemon (trusted) worker1 # [ 177.542549] nix-daemon[865]: reaped child process 2097, status = succeeded lb # [ 177.534339] niks3-server[1128]: 2026/09/23 16:02:27 INFO Received push request method=POST path=/api/pushes worker1 # [ 177.559226] nix-grpc-daemon[1762]: time=2026-09-23T16:02:26.769Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 177.560701] nix-grpc-daemon[1762]: time=2026-09-23T16:02:26.771Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 177.576368] niks3-server[1128]: 2026/09/23 16:02:27 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 177.580923] niks3-server[1128]: 2026/09/23 16:02:27 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 177.587136] niks3-server[1128]: 2026/09/23 16:02:27 INFO Received sign narinfos request method=POST path=/api/pushes/83/sign worker1 # [ 177.607573] nix-grpc-daemon[1762]: time=2026-09-23T16:02:26.817Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.592099] niks3-server[1128]: 2026/09/23 16:02:27 INFO Signed narinfos id=83 count=1 lb # [ 177.597074] niks3-server[1128]: 2026/09/23 16:02:27 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 177.602762] niks3-server[1128]: 2026/09/23 16:02:27 INFO Received complete push request method=POST path=/api/pushes/83/complete worker1 # [ 177.623140] nix-grpc-daemon[1762]: time=2026-09-23T16:02:26.833Z level=INFO msg="Upload complete. (208ms)" lb # [ 177.608870] niks3-server[1128]: 2026/09/23 16:02:27 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 177.628942] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=18 outputs=1 worker2 # [ 177.655703] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:27Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 177.637364] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 177.648525] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 177.652113] nix-daemon[865]: reaped child process 2076, status = succeeded worker1 # [ 177.656303] nix-grpc-daemon[1762]: time=2026-09-23T16:02:26.866Z level=INFO msg="All 2 paths already cached" worker1 # [ 177.660488] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 177.664435] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 177.750135] nix-daemon[865]: accepted connection from pid 2101, user nix-grpc-daemon (trusted) worker1 # [ 177.764395] nix-daemon[865]: reaped child process 2104, status = succeeded lb # [ 177.753558] niks3-server[1128]: 2026/09/23 16:02:27 INFO Received push request method=POST path=/api/pushes worker1 # [ 177.777926] nix-grpc-daemon[1762]: time=2026-09-23T16:02:26.988Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 177.779976] nix-grpc-daemon[1762]: time=2026-09-23T16:02:26.989Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 177.785318] niks3-server[1128]: 2026/09/23 16:02:27 INFO Received sign narinfos request method=POST path=/api/pushes/84/sign lb # [ 177.792651] niks3-server[1128]: 2026/09/23 16:02:27 INFO Signed narinfos id=84 count=1 worker1 # [ 177.811979] nix-grpc-daemon[1762]: time=2026-09-23T16:02:27.022Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.797994] niks3-server[1128]: 2026/09/23 16:02:27 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 177.804764] niks3-server[1128]: 2026/09/23 16:02:27 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 177.815213] niks3-server[1128]: 2026/09/23 16:02:27 INFO Received complete push request method=POST path=/api/pushes/84/complete worker1 # [ 177.835020] nix-grpc-daemon[1762]: time=2026-09-23T16:02:27.045Z level=INFO msg="Upload complete. (165ms)" lb # [ 177.821344] niks3-server[1128]: 2026/09/23 16:02:27 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 177.837159] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 177.842088] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 worker1 # [ 177.851910] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 177.856963] nix-daemon[865]: reaped child process 2099, status = succeeded worker1 # [ 177.860272] nix-daemon[865]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 178.674939] nix-daemon[865]: reaped child process 2108, status = succeeded worker1 # [ 178.753091] nix-daemon[865]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) worker1 # [ 178.765390] nix-daemon[865]: reaped child process 2127, status = succeeded lb # [ 178.757790] niks3-server[1128]: 2026/09/23 16:02:28 INFO Received push request method=POST path=/api/pushes worker1 # [ 178.781853] nix-grpc-daemon[1762]: time=2026-09-23T16:02:27.991Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 178.784060] nix-grpc-daemon[1762]: time=2026-09-23T16:02:27.993Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 178.799360] niks3-server[1128]: 2026/09/23 16:02:28 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 178.808076] niks3-server[1128]: 2026/09/23 16:02:28 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 178.812327] niks3-server[1128]: 2026/09/23 16:02:28 INFO Received sign narinfos request method=POST path=/api/pushes/85/sign lb # [ 178.819502] niks3-server[1128]: 2026/09/23 16:02:28 INFO Signed narinfos id=85 count=1 worker1 # [ 178.835946] nix-grpc-daemon[1762]: time=2026-09-23T16:02:28.045Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.825228] niks3-server[1128]: 2026/09/23 16:02:28 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 178.835161] niks3-server[1128]: 2026/09/23 16:02:28 INFO Received complete push request method=POST path=/api/pushes/85/complete worker1 # [ 178.856350] nix-grpc-daemon[1762]: time=2026-09-23T16:02:28.066Z level=INFO msg="Upload complete. (189ms)" lb # [ 178.841316] niks3-server[1128]: 2026/09/23 16:02:28 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo worker1 # [ 178.861878] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37790 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=19 outputs=1 worker1 # [ 178.876515] nix-daemon[865]: reaped child process 2106, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 14.39 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 178.979737] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 5db48ed53a084288add6f21fc6538049 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics client # [ 179.114792] nix[1586]: don't know how to build these paths: client # [ 179.115648] nix[1586]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker1 # [ 179.126499] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37790 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 179.132405] nix-grpc-daemon[1702]: ts=2026-09-23T16:02:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37790 client # [ 179.140250] nix[1586]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker worker2 # [ 179.177894] nix-grpc-daemon[1654]: ts=2026-09-23T16:02:29Z level=debug event=want client=7 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 186.828211] envoy[918]: conn peer=[2001:db8:1::1]:53720 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27094 tx=12312 ms=14218 client # [ 209.141413] nix[1586]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 209.152352] nix[1586]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 209.186609] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 209.190570] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 209.194452] systemd[1]: gpu.service: Consumed 153ms CPU time over 30.206s wall clock time, 37.6M memory peak, 5.6K incoming IP traffic, 5.3K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.43 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.32 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.94 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 211.022508] nix-grpc-daemon[1702]: ts=2026-09-23T16:03:00Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker2 # [ 212.034416] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 212.040917] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 212.062182] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:02Z level=debug event=want client=8 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 212.067982] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:02Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 212.073418] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 212.084747] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 212.096543] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 212.109140] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 212.208935] nix-daemon[858]: accepted connection from pid 2033, user nix-grpc-daemon (trusted) worker2 # [ 212.224179] nix-daemon[858]: reaped child process 2036, status = succeeded lb # [ 212.191275] niks3-server[1128]: 2026/09/23 16:03:02 INFO Received push request method=POST path=/api/pushes worker2 # [ 212.242321] nix-grpc-daemon[1734]: time=2026-09-23T16:03:02.246Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 212.244447] nix-grpc-daemon[1734]: time=2026-09-23T16:03:02.248Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 212.233813] niks3-server[1128]: 2026/09/23 16:03:02 INFO Received sign narinfos request method=POST path=/api/pushes/86/sign worker2 # [ 212.280435] nix-grpc-daemon[1734]: time=2026-09-23T16:03:02.284Z level=INFO msg="Uploading 1 narinfos" lb # [ 212.241120] niks3-server[1128]: 2026/09/23 16:03:02 INFO Signed narinfos id=86 count=1 lb # [ 212.246265] niks3-server[1128]: 2026/09/23 16:03:02 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 212.260238] niks3-server[1128]: 2026/09/23 16:03:02 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 212.266364] niks3-server[1128]: 2026/09/23 16:03:02 INFO Received complete push request method=POST path=/api/pushes/86/complete lb # [ 212.271291] niks3-server[1128]: 2026/09/23 16:03:02 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 212.315553] nix-grpc-daemon[1734]: time=2026-09-23T16:03:02.320Z level=INFO msg="Upload complete. (196ms)" worker2 # [ 212.321146] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 212.327095] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 212.340121] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 212.348823] nix-daemon[858]: reaped child process 2031, status = succeeded worker2 # [ 212.353984] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 212.968521] nix-daemon[858]: reaped child process 2040, status = succeeded worker2 # [ 213.050778] nix-daemon[858]: accepted connection from pid 2056, user nix-grpc-daemon (trusted) worker2 # [ 213.063666] nix-daemon[858]: reaped child process 2059, status = succeeded lb # [ 213.030411] niks3-server[1128]: 2026/09/23 16:03:03 INFO Received push request method=POST path=/api/pushes worker2 # [ 213.081351] nix-grpc-daemon[1734]: time=2026-09-23T16:03:03.086Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 213.082898] nix-grpc-daemon[1734]: time=2026-09-23T16:03:03.087Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 213.073064] niks3-server[1128]: 2026/09/23 16:03:03 INFO Received sign narinfos request method=POST path=/api/pushes/87/sign lb # [ 213.080646] niks3-server[1128]: 2026/09/23 16:03:03 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker2 # [ 213.125190] nix-grpc-daemon[1734]: time=2026-09-23T16:03:03.129Z level=INFO msg="Uploading 1 narinfos" lb # [ 213.084724] niks3-server[1128]: 2026/09/23 16:03:03 INFO Signed narinfos id=87 count=1 lb # [ 213.089492] niks3-server[1128]: 2026/09/23 16:03:03 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 213.093668] niks3-server[1128]: 2026/09/23 16:03:03 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 213.100083] niks3-server[1128]: 2026/09/23 16:03:03 INFO Received complete push request method=POST path=/api/pushes/87/complete lb # [ 213.107099] niks3-server[1128]: 2026/09/23 16:03:03 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 213.147209] nix-grpc-daemon[1734]: time=2026-09-23T16:03:03.151Z level=INFO msg="Upload complete. (187ms)" worker2 # [ 213.155405] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=20 outputs=1 worker2 # [ 213.164886] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:03Z level=debug event=want client=8 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 213.169502] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:03Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 213.171786] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 213.178770] nix-daemon[858]: reaped child process 2038, status = succeeded worker2 # [ 213.180648] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 213.185904] nix-grpc-daemon[1734]: time=2026-09-23T16:03:03.190Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 213.191109] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 213.197427] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 213.287566] nix-daemon[858]: accepted connection from pid 2065, user nix-grpc-daemon (trusted) worker2 # [ 213.302047] nix-daemon[858]: reaped child process 2068, status = succeeded lb # [ 213.269380] niks3-server[1128]: 2026/09/23 16:03:03 INFO Received push request method=POST path=/api/pushes worker2 # [ 213.319416] nix-grpc-daemon[1734]: time=2026-09-23T16:03:03.323Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 213.321540] nix-grpc-daemon[1734]: time=2026-09-23T16:03:03.325Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 213.299216] niks3-server[1128]: 2026/09/23 16:03:03 INFO Received sign narinfos request method=POST path=/api/pushes/88/sign worker2 # [ 213.345648] nix-grpc-daemon[1734]: time=2026-09-23T16:03:03.350Z level=INFO msg="Uploading 1 narinfos" lb # [ 213.304952] niks3-server[1128]: 2026/09/23 16:03:03 INFO Signed narinfos id=88 count=1 lb # [ 213.311090] niks3-server[1128]: 2026/09/23 16:03:03 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 213.316786] niks3-server[1128]: 2026/09/23 16:03:03 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 213.324059] niks3-server[1128]: 2026/09/23 16:03:03 INFO Received complete push request method=POST path=/api/pushes/88/complete worker2 # [ 213.369351] nix-grpc-daemon[1734]: time=2026-09-23T16:03:03.374Z level=INFO msg="Upload complete. (166ms)" lb # [ 213.329909] niks3-server[1128]: 2026/09/23 16:03:03 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 213.371548] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 213.375098] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 213.383772] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 213.385491] nix-daemon[858]: reaped child process 2063, status = succeeded worker2 # [ 213.390804] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 214.832264] nix-daemon[858]: reaped child process 2072, status = succeeded worker2 # [ 214.919620] nix-daemon[858]: accepted connection from pid 2088, user nix-grpc-daemon (trusted) worker2 # [ 214.933929] nix-daemon[858]: reaped child process 2091, status = succeeded lb # [ 214.902283] niks3-server[1128]: 2026/09/23 16:03:04 INFO Received push request method=POST path=/api/pushes worker2 # [ 214.951509] nix-grpc-daemon[1734]: time=2026-09-23T16:03:04.955Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 214.954638] nix-grpc-daemon[1734]: time=2026-09-23T16:03:04.957Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 214.942839] niks3-server[1128]: 2026/09/23 16:03:05 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 214.955206] niks3-server[1128]: 2026/09/23 16:03:05 INFO Received sign narinfos request method=POST path=/api/pushes/89/sign worker2 # [ 215.003384] nix-grpc-daemon[1734]: time=2026-09-23T16:03:05.007Z level=INFO msg="Uploading 1 narinfos" lb # [ 214.962992] niks3-server[1128]: 2026/09/23 16:03:05 INFO Signed narinfos id=89 count=1 lb # [ 214.967148] niks3-server[1128]: 2026/09/23 16:03:05 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 214.972924] niks3-server[1128]: 2026/09/23 16:03:05 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 214.982181] niks3-server[1128]: 2026/09/23 16:03:05 INFO Received complete push request method=POST path=/api/pushes/89/complete worker2 # [ 215.027295] nix-grpc-daemon[1734]: time=2026-09-23T16:03:05.031Z level=INFO msg="Upload complete. (226ms)" lb # [ 214.988523] niks3-server[1128]: 2026/09/23 16:03:05 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 215.035398] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=21 outputs=1 worker2 # [ 215.046788] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:05Z level=debug event=want client=8 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 215.051574] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:05Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 215.055249] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 215.062932] nix-daemon[858]: reaped child process 2070, status = succeeded worker2 # [ 215.064525] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 215.071105] nix-grpc-daemon[1734]: time=2026-09-23T16:03:05.075Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 215.077501] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 215.082643] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 215.175932] nix-daemon[858]: accepted connection from pid 2097, user nix-grpc-daemon (trusted) worker2 # [ 215.191508] nix-daemon[858]: reaped child process 2100, status = succeeded lb # [ 215.158475] niks3-server[1128]: 2026/09/23 16:03:05 INFO Received push request method=POST path=/api/pushes worker2 # [ 215.207805] nix-grpc-daemon[1734]: time=2026-09-23T16:03:05.212Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 215.209936] nix-grpc-daemon[1734]: time=2026-09-23T16:03:05.214Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 215.190537] niks3-server[1128]: 2026/09/23 16:03:05 INFO Received sign narinfos request method=POST path=/api/pushes/90/sign lb # [ 215.195907] niks3-server[1128]: 2026/09/23 16:03:05 INFO Signed narinfos id=90 count=1 worker2 # [ 215.239941] nix-grpc-daemon[1734]: time=2026-09-23T16:03:05.244Z level=INFO msg="Uploading 1 narinfos" lb # [ 215.205731] niks3-server[1128]: 2026/09/23 16:03:05 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 215.211504] niks3-server[1128]: 2026/09/23 16:03:05 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 215.223123] niks3-server[1128]: 2026/09/23 16:03:05 INFO Received complete push request method=POST path=/api/pushes/90/complete worker2 # [ 215.270213] nix-grpc-daemon[1734]: time=2026-09-23T16:03:05.274Z level=INFO msg="Upload complete. (181ms)" lb # [ 215.232103] niks3-server[1128]: 2026/09/23 16:03:05 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 215.274417] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 215.280265] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 worker2 # [ 215.288738] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 215.296922] nix-daemon[858]: reaped child process 2095, status = succeeded worker2 # [ 215.300845] nix-daemon[858]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 216.739570] nix-daemon[858]: reaped child process 2104, status = succeeded worker2 # [ 216.829155] nix-daemon[858]: accepted connection from pid 2120, user nix-grpc-daemon (trusted) worker2 # [ 216.843395] nix-daemon[858]: reaped child process 2123, status = succeeded lb # [ 216.811373] niks3-server[1128]: 2026/09/23 16:03:06 INFO Received push request method=POST path=/api/pushes worker2 # [ 216.861387] nix-grpc-daemon[1734]: time=2026-09-23T16:03:06.865Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 216.862958] nix-grpc-daemon[1734]: time=2026-09-23T16:03:06.867Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 216.828939] envoy[918]: conn peer=[2001:db8:1::1]:35474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=929 tx=596 ms=30052 lb # [ 216.858147] niks3-server[1128]: 2026/09/23 16:03:06 INFO Received sign narinfos request method=POST path=/api/pushes/91/sign worker2 # [ 216.903270] nix-grpc-daemon[1734]: time=2026-09-23T16:03:06.907Z level=INFO msg="Uploading 1 narinfos" lb # [ 216.863117] niks3-server[1128]: 2026/09/23 16:03:06 INFO Signed narinfos id=91 count=1 lb # [ 216.867594] niks3-server[1128]: 2026/09/23 16:03:06 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 216.875411] niks3-server[1128]: 2026/09/23 16:03:06 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 216.882902] niks3-server[1128]: 2026/09/23 16:03:06 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 216.888179] niks3-server[1128]: 2026/09/23 16:03:06 INFO Received complete push request method=POST path=/api/pushes/91/complete worker2 # [ 216.933802] nix-grpc-daemon[1734]: time=2026-09-23T16:03:06.938Z level=INFO msg="Upload complete. (225ms)" lb # [ 216.894693] niks3-server[1128]: 2026/09/23 16:03:06 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 216.940959] nix-grpc-daemon[1654]: ts=2026-09-23T16:03:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56980 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=22 outputs=1 worker2 # [ 216.956621] nix-daemon[858]: reaped child process 2102, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.09 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.11 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 218.026673] nix-grpc-daemon[1702]: ts=2026-09-23T16:03:07Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 8.49 seconds) (finished: run the VM test script, in 219.25 seconds) test script finished in 219.42s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-23T16:03:08Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-23T16:03:08Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-23T16:03:08Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-23T16:03:09Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-23T16:03:09Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-23T16:03:09Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-23T16:03:09Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-23T16:03:09Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-23T16:03:09Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-23T16:03:09Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-23T16:03:09Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-23T16:03:09Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.08 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh