tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.bSsJETmhH5', fmt=raw size=1073741824 client: QEMU running (pid 49) worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 51) client # mke2fs 1.47.4 (6-Mar-2025) lb: QEMU running (pid 50) worker2 # Disk image does not exist, creating the virtualisation disk image... worker1 # Formatting '/build/vm-state-worker1/tmp.KxsjmRpxYH', fmt=raw size=1073741824 lb # Disk image does not exist, creating the virtualisation disk image... worker2 # Formatting '/build/vm-state-worker2/tmp.gFq2ay4We5', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2: QEMU running (pid 52) worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done lb # Formatting '/build/vm-state-lb/tmp.Ig69nvJVHX', fmt=raw size=1073741824 client # Discarding device blocks: 0/262144 done worker2 # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: a6ecff3c-92fe-436f-87f9-7ba7358fceec worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: 617606b7-6b13-41d5-879e-78f08e71f5dc worker1 # Superblock backups stored on blocks: lb # mke2fs 1.47.4 (6-Mar-2025) worker2 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 lb # Discarding device blocks: 0/262144 done worker2 # 32768, 98304, 163840, 229376 worker1 # lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done lb # Filesystem UUID: 11545468-e34f-4655-b646-834c34ea92d8 (finished: start all VMs, in 0.27 seconds) client # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Superblock backups stored on blocks: client: waiting for unit network-addresses-eth1.service client # Filesystem UUID: 88b9297a-0752-4a49-bb7a-2b420a5d11a9 lb # 32768, 98304, 163840, 229376 client: waiting for the VM to finish booting client # Superblock backups stored on blocks: lb # worker2 # Allocating group tables: 0/8 done lb # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done client # 32768, 98304, 163840, 229376 worker1 # Creating journal (8192 blocks): done lb # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done client # worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Allocating group tables: 0/8 done worker1 # lb # Writing superblocks and filesystem accounting information: 0/8 done worker2 # client # Writing inode tables: 0/8 done worker1 # Virtualisation disk image created. lb # worker2 # Virtualisation disk image created. client # Creating journal (8192 blocks): done worker1 # Starting virtiofs daemons... lb # Virtualisation disk image created. worker2 # Starting virtiofs daemons... client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # Starting virtiofs daemons... worker2 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # worker1 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Virtualisation disk image created. worker1 # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Starting virtiofs daemons... worker1 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T14:50:30Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T14:50:30Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T14:50:30Z INFO virtiofsd] Client connected, servicing requests worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # client # lb # lb # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 worker2 # worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker1 # worker1 # client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 lb # lb # lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00 client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # worker1 # Booting from ROM... client # Booting from ROM... lb # Booting from ROM... worker2 # Booting from ROM... worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b5wjb92n6pk0dvawkzyxrvwqjkpdl5dh-nixos-system-worker1-test/init regInfo=/nix/store/rimqqvv97hgfqmwpzjdxhyp5f1xkg23w-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test/init regInfo=/nix/store/8yv2mzydx25rdvyb7iz1gsd7iqxlkjg4-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] kvm-clock: using sched offset of 449023645 cycles client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000806] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000834] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000837] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.002738] Using GB pages for direct mapping client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.002868] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3x9dnnqnj54467v5gvfcy6bbd182ar8b-nixos-system-worker2-test/init regInfo=/nix/store/000yyak5fh8kvhsg7sjzgbzg7ffh39qz-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.002877] ACPI: Early table checksum verification disabled client # [ 0.000000] NX (Execute Disable) protection: active client # [ 0.000000] APIC: Static calls initialized worker1 # [ 0.002880] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test/init regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.002884] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.002889] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] DMI: Memory slots populated: 1/1 lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.002896] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.002898] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.002900] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.000000] kvm-clock: using sched offset of 464914187 cycles worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.002901] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000004] tsc: Detected 2400.012 MHz processor worker1 # [ 0.002903] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved client # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.002904] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.002906] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.000000] APIC: Static calls initialized client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.002907] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] client # [ 0.002734] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.002746] Using GB pages for direct mapping worker1 # [ 0.002907] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.002909] RAMDISK: [mem 0x5e370000-0x5ffcffff] worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.002908] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.002917] ACPI: Early table checksum verification disabled worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002908] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.002920] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.002909] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.000000] SMBIOS 2.8 present. client # [ 0.002924] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000001] kvm-clock: using sched offset of 448238059 cycles worker1 # [ 0.002909] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.003137] No NUMA configuration found client # [ 0.002928] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.003138] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor client # [ 0.002936] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.003140] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.002938] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.005367] Zone ranges: worker2 # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.005369] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.002939] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.005370] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.005371] Normal empty client # [ 0.002941] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000000] kvm-clock: using sched offset of 466496707 cycles worker1 # [ 0.005372] Device empty worker2 # [ 0.002737] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker1 # [ 0.005373] Movable zone start for each node client # [ 0.002942] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002748] Using GB pages for direct mapping worker1 # [ 0.005374] Early memory node ranges worker2 # [ 0.002845] RAMDISK: [mem 0x5e36f000-0x5ffcffff] lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.005374] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.002944] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002853] ACPI: Early table checksum verification disabled lb # [ 0.000005] tsc: Detected 2400.012 MHz processor worker1 # [ 0.005375] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] client # [ 0.002945] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker2 # [ 0.002856] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) lb # [ 0.000818] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.005376] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.002946] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker2 # [ 0.002860] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.005396] On node 0, zone DMA: 1 pages in unavailable ranges lb # [ 0.000846] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.002947] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.005654] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.002865] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.000848] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT client # [ 0.002947] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker1 # [ 0.031353] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.002871] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002948] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.031812] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.002873] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.002749] Using GB pages for direct mapping worker1 # [ 0.031825] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.002948] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] lb # [ 0.002911] RAMDISK: [mem 0x5e36e000-0x5ffcffff] worker1 # [ 0.031853] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker2 # [ 0.002875] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002949] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.002920] ACPI: Early table checksum verification disabled worker1 # [ 0.031855] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) client # [ 0.003175] No NUMA configuration found worker2 # [ 0.002876] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002924] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.031857] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.003176] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.002878] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.003178] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.031858] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.002928] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005337] Zone ranges: worker2 # [ 0.002879] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.031860] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.005338] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.002933] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.031860] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.005339] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] worker2 # [ 0.002881] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] client # [ 0.005340] Normal empty client # [ 0.005341] Device empty worker2 # [ 0.002882] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.031863] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.002940] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005342] Movable zone start for each node worker1 # [ 0.031864] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.002942] ACPI: FACS 0x000000005FFE0000 000040 worker2 # [ 0.002882] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] client # [ 0.005342] Early memory node ranges worker1 # [ 0.031868] TSC deadline timer available client # [ 0.005343] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.031872] CPU topo: Max. logical packages: 1 worker2 # [ 0.002883] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] lb # [ 0.002943] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.031873] CPU topo: Max. logical dies: 1 client # [ 0.005344] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.002883] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] worker1 # [ 0.031873] CPU topo: Max. dies per package: 1 lb # [ 0.002945] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.005345] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.031877] CPU topo: Max. threads per core: 1 worker2 # [ 0.002884] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker1 # [ 0.031877] CPU topo: Num. cores per package: 1 client # [ 0.005364] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.002884] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] lb # [ 0.002946] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.031878] CPU topo: Num. threads per package: 1 client # [ 0.005616] On node 0, zone DMA: 97 pages in unavailable ranges worker2 # [ 0.003110] No NUMA configuration found worker1 # [ 0.031878] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.031393] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.002948] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.003111] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.031888] ACPI: PM-Timer IO Port: 0x608 worker1 # [ 0.031903] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.003113] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.005386] Zone ranges: client # [ 0.031901] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.002949] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d] worker1 # [ 0.031942] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.005387] DMA [mem 0x0000000000001000-0x0000000000ffffff] client # [ 0.031927] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.002950] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219] worker1 # [ 0.031944] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.005388] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.031930] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.005390] Normal empty worker1 # [ 0.031945] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.002951] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.005391] Device empty client # [ 0.031932] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker1 # [ 0.031947] Booting paravirtualized kernel on KVM worker2 # [ 0.005391] Movable zone start for each node lb # [ 0.002951] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385] worker2 # [ 0.005392] Early memory node ranges client # [ 0.031933] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.031950] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker2 # [ 0.005392] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.002951] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd] client # [ 0.031934] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.005393] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.036435] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.031935] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.002952] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9] worker2 # [ 0.005394] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.038530] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.031937] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.002952] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421] worker1 # [ 0.038573] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.005414] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.031938] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.003186] No NUMA configuration found client # [ 0.031942] TSC deadline timer available worker2 # [ 0.005677] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.031946] CPU topo: Max. logical packages: 1 lb # [ 0.003186] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker2 # [ 0.032165] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.031947] CPU topo: Max. logical dies: 1 worker2 # [ 0.032618] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.003189] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] client # [ 0.031948] CPU topo: Max. dies per package: 1 lb # [ 0.005439] Zone ranges: worker2 # [ 0.032630] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) client # [ 0.031951] CPU topo: Max. threads per core: 1 client # [ 0.031951] CPU topo: Num. cores per package: 1 worker2 # [ 0.032660] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.005440] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.038574] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b5wjb92n6pk0dvawkzyxrvwqjkpdl5dh-nixos-system-worker1-test/init regInfo=/nix/store/rimqqvv97hgfqmwpzjdxhyp5f1xkg23w-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.031952] CPU topo: Num. threads per package: 1 worker2 # [ 0.032663] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.005442] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.031952] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.005444] Normal empty worker2 # [ 0.032665] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.005444] Device empty worker1 # [ 0.038668] Unknown kernel command line parameters "regInfo=/nix/store/rimqqvv97hgfqmwpzjdxhyp5f1xkg23w-closure-info/registration", will be passed to user space. client # [ 0.031973] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.032666] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) lb # [ 0.005445] Movable zone start for each node worker1 # [ 0.038681] random: crng init done lb # [ 0.005446] Early memory node ranges client # [ 0.032004] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.032667] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.038682] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.005446] node 0: [mem 0x0000000000001000-0x000000000009efff] client # [ 0.032006] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.032667] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.040759] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.032007] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.005447] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.032670] ACPI: Using ACPI (MADT) for SMP configuration information client # [ 0.032009] Booting paravirtualized kernel on KVM worker1 # [ 0.041987] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.032671] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.005448] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.042021] Fallback order for Node 0: 0 worker2 # [ 0.032674] TSC deadline timer available client # [ 0.032012] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.005469] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.042024] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.032678] CPU topo: Max. logical packages: 1 worker1 # [ 0.042025] Policy zone: DMA32 worker2 # [ 0.032679] CPU topo: Max. logical dies: 1 lb # [ 0.005733] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.036502] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.032679] CPU topo: Max. dies per package: 1 worker1 # [ 0.044449] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.032682] CPU topo: Max. threads per core: 1 client # [ 0.038826] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.032209] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.047605] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.032683] CPU topo: Num. cores per package: 1 lb # [ 0.032661] ACPI: PM-Timer IO Port: 0x608 client # [ 0.038869] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.050828] allocated 3145728 bytes of page_ext worker2 # [ 0.032683] CPU topo: Num. threads per package: 1 lb # [ 0.032674] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.060661] ftrace: allocating 48787 entries in 192 pages worker2 # [ 0.032684] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.060663] ftrace: allocated 192 pages with 2 groups lb # [ 0.032701] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.061531] Dynamic Preempt: lazy worker2 # [ 0.032703] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.061662] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.032704] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.032734] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.061662] rcu: RCU event tracing is enabled. lb # [ 0.032705] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.038870] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test/init regInfo=/nix/store/8yv2mzydx25rdvyb7iz1gsd7iqxlkjg4-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.061663] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.032736] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.061664] Trampoline variant of Tasks RCU enabled. lb # [ 0.032707] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.032737] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.061665] Rude variant of Tasks RCU enabled. worker2 # [ 0.032739] Booting paravirtualized kernel on KVM client # [ 0.038964] Unknown kernel command line parameters "regInfo=/nix/store/8yv2mzydx25rdvyb7iz1gsd7iqxlkjg4-closure-info/registration", will be passed to user space. lb # [ 0.032708] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.061665] Tracing variant of Tasks RCU enabled. client # [ 0.038978] random: crng init done lb # [ 0.032708] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.032742] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.061666] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.038979] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes lb # [ 0.032711] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.061666] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.037227] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.041067] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.032712] ACPI: HPET id: 0x8086a201 base: 0xfed00000 worker2 # [ 0.039394] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker1 # [ 0.061715] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.042104] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.032716] TSC deadline timer available worker2 # [ 0.039437] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.042138] Fallback order for Node 0: 0 lb # [ 0.032720] CPU topo: Max. logical packages: 1 worker1 # [ 0.061717] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.042141] Built 1 zonelists, mobility grouping on. Total pages: 393078 lb # [ 0.032721] CPU topo: Max. logical dies: 1 client # [ 0.042142] Policy zone: DMA32 lb # [ 0.032721] CPU topo: Max. dies per package: 1 worker1 # [ 0.061718] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.044584] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.066072] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.032724] CPU topo: Max. threads per core: 1 client # [ 0.047809] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.032725] CPU topo: Num. cores per package: 1 worker1 # [ 0.066578] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.051247] allocated 3145728 bytes of page_ext worker2 # [ 0.039438] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3x9dnnqnj54467v5gvfcy6bbd182ar8b-nixos-system-worker2-test/init regInfo=/nix/store/000yyak5fh8kvhsg7sjzgbzg7ffh39qz-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.032725] CPU topo: Num. threads per package: 1 client # [ 0.060959] ftrace: allocating 48787 entries in 192 pages worker1 # [ 0.066585] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.032725] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.060961] ftrace: allocated 192 pages with 2 groups client # [ 0.061764] Dynamic Preempt: lazy worker2 # [ 0.039533] Unknown kernel command line parameters "regInfo=/nix/store/000yyak5fh8kvhsg7sjzgbzg7ffh39qz-closure-info/registration", will be passed to user space. worker1 # [ 0.066688] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.032745] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.061927] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.039546] random: crng init done worker1 # [ 0.070224] Console: colour VGA+ 80x25 client # [ 0.061928] rcu: RCU event tracing is enabled. worker1 # [ 0.070227] printk: legacy console [tty0] enabled lb # [ 0.032777] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.039546] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker1 # [ 0.099686] printk: legacy console [ttyS0] enabled client # [ 0.061928] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.041671] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.061930] Trampoline variant of Tasks RCU enabled. lb # [ 0.032779] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker1 # [ 0.196275] ACPI: Core revision 20250807 client # [ 0.061930] Rude variant of Tasks RCU enabled. lb # [ 0.032780] [mem 0x60000000-0xafffffff] available for PCI devices worker2 # [ 0.042731] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.061930] Tracing variant of Tasks RCU enabled. worker2 # [ 0.042761] Fallback order for Node 0: 0 lb # [ 0.032782] Booting paravirtualized kernel on KVM worker1 # [ 0.197139] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.061931] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.042763] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.042765] Policy zone: DMA32 worker1 # [ 0.198608] APIC: Switch to symmetric I/O mode setup client # [ 0.061932] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.032786] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.199534] x2apic enabled worker2 # [ 0.045635] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.061954] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.037295] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.048822] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.200264] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.052131] allocated 3145728 bytes of page_ext client # [ 0.061956] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.039477] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.062021] ftrace: allocating 48787 entries in 192 pages lb # [ 0.039519] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.062024] ftrace: allocated 192 pages with 2 groups client # [ 0.061957] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.062872] Dynamic Preempt: lazy worker1 # [ 0.202055] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 client # [ 0.066324] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.063050] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.063051] rcu: RCU event tracing is enabled. client # [ 0.066600] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.203011] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker2 # [ 0.063052] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.066605] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.063053] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.204638] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.063054] Rude variant of Tasks RCU enabled. client # [ 0.066707] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.063054] Tracing variant of Tasks RCU enabled. lb # [ 0.039520] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test/init regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.070246] Console: colour VGA+ 80x25 worker1 # [ 0.205721] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.070249] printk: legacy console [tty0] enabled worker2 # [ 0.063054] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.206754] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.099813] printk: legacy console [ttyS0] enabled worker2 # [ 0.063055] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.039617] Unknown kernel command line parameters "regInfo=/nix/store/s1480xaqc00gh7hz31b4z2fwjpnxi3sa-closure-info/registration", will be passed to user space. client # [ 0.196119] ACPI: Core revision 20250807 worker1 # [ 0.207636] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.039630] random: crng init done worker2 # [ 0.063070] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.039631] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes worker2 # [ 0.063072] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.197018] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.208639] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.041752] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.198510] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.063072] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.209636] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.199429] x2apic enabled worker2 # [ 0.067436] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.043000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.043037] Fallback order for Node 0: 0 worker1 # [ 0.210636] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.067729] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.200153] APIC: Switched APIC routing to: physical x2apic lb # [ 0.043040] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.211636] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.067736] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.043042] Policy zone: DMA32 client # [ 0.201905] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.212636] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.045521] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.067841] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.071360] Console: colour VGA+ 80x25 lb # [ 0.048814] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.071363] printk: legacy console [tty0] enabled client # [ 0.202843] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.052145] allocated 3145728 bytes of page_ext worker2 # [ 0.101144] printk: legacy console [ttyS0] enabled lb # [ 0.062163] ftrace: allocating 48787 entries in 192 pages client # [ 0.204425] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.197559] ACPI: Core revision 20250807 lb # [ 0.062165] ftrace: allocated 192 pages with 2 groups lb # [ 0.063012] Dynamic Preempt: lazy worker1 # [ 0.213635] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.206514] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.063196] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.198469] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.215642] Spectre V2 : Enabling IBPB for BPF client # [ 0.207590] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.063197] rcu: RCU event tracing is enabled. worker2 # [ 0.200009] APIC: Switch to symmetric I/O mode setup worker1 # [ 0.216637] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.208423] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.063198] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.200993] x2apic enabled lb # [ 0.063199] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.217636] active return thunk: srso_alias_return_thunk lb # [ 0.063200] Rude variant of Tasks RCU enabled. worker2 # [ 0.201781] APIC: Switched APIC routing to: physical x2apic lb # [ 0.063200] Tracing variant of Tasks RCU enabled. client # [ 0.209426] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker1 # [ 0.218656] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.063201] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.210422] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.219635] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.203581] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.063201] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.211423] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.220635] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.063218] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.212422] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.204557] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.221635] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.063220] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.213422] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.222635] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.206213] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) lb # [ 0.063221] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.067898] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.223635] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.207298] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.068183] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.224635] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.208337] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.068189] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker1 # [ 0.225636] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.209899] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 client # [ 0.214422] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.068298] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.216429] Spectre V2 : Enabling IBPB for BPF worker1 # [ 0.227341] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.071803] Console: colour VGA+ 80x25 worker2 # [ 0.210215] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.071805] printk: legacy console [tty0] enabled worker1 # [ 0.227636] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.101254] printk: legacy console [ttyS0] enabled client # [ 0.217126] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.228635] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.212210] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl lb # [ 0.212102] ACPI: Core revision 20250807 client # [ 0.218424] active return thunk: srso_alias_return_thunk worker1 # [ 0.229635] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.213211] Transient Scheduler Attacks: Vulnerable: No microcode lb # [ 0.212978] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns client # [ 0.219451] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.214210] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker1 # [ 0.230635] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.214459] APIC: Switch to symmetric I/O mode setup client # [ 0.220424] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.215210] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.215390] x2apic enabled client # [ 0.221424] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.216140] APIC: Switched APIC routing to: physical x2apic client # [ 0.222423] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.224289] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.217907] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.216210] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization client # [ 0.225218] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.218218] Spectre V2 : Enabling IBPB for BPF lb # [ 0.218884] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.226213] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.220489] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) worker2 # [ 0.219211] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.227423] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.220211] active return thunk: srso_alias_return_thunk lb # [ 0.221573] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.228422] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.222665] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.229422] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.221871] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' client # [ 0.230422] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.223486] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.223103] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.231422] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.223947] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.224489] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.224950] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.232422] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.225486] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker2 # [ 0.225976] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.226486] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.226965] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.227486] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.228017] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.228486] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.229211] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.230211] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.231210] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.232210] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 lb # [ 0.229485] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker2 # [ 0.233210] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.231493] Spectre V2 : Enabling IBPB for BPF lb # [ 0.232207] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker2 # [ 0.234210] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. lb # [ 0.233486] active return thunk: srso_alias_return_thunk lb # [ 0.234328] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.235485] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.236485] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.237486] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.238485] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' lb # [ 0.239428] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.240260] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.241486] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.242485] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.243486] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.263872] Freeing SMP alternatives memory: 44K lb # [ 0.244485] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.264639] pid_max: default: 32768 minimum: 301 lb # [ 0.245406] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker1 # [ 0.265453] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.266509] landlock: Up and running. lb # [ 0.246197] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.267084] Yama: becoming mindful. worker1 # [ 0.267847] LSM support for eBPF active worker1 # [ 0.268735] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.269678] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.272835] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.274166] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.274645] ... version: 2 worker1 # [ 0.275385] ... bit width: 48 client # [ 0.266637] Freeing SMP alternatives memory: 44K worker1 # [ 0.275638] ... generic counters: 6 client # [ 0.267425] pid_max: default: 32768 minimum: 301 worker1 # [ 0.276364] ... generic bitmap: 000000000000003f client # [ 0.268274] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.276638] ... fixed-purpose counters: 0 client # [ 0.269442] landlock: Up and running. worker1 # [ 0.277404] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.270084] Yama: becoming mindful. client # [ 0.270642] LSM support for eBPF active worker1 # [ 0.277638] ... value mask: 0000ffffffffffff worker1 # [ 0.278577] ... max period: 00007fffffffffff client # [ 0.271524] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.279383] ... global_ctrl mask: 000000000000003f client # [ 0.272460] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.279743] signal: max sigframe size: 3376 worker1 # [ 0.280557] rcu: Hierarchical SRCU implementation. worker1 # [ 0.281262] rcu: Max phase no-delay instances is 400. client # [ 0.275210] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker2 # [ 0.268923] Freeing SMP alternatives memory: 44K worker2 # [ 0.269214] pid_max: default: 32768 minimum: 301 client # [ 0.275942] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.276427] ... version: 2 worker2 # [ 0.270313] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.277150] ... bit width: 48 worker2 # [ 0.271315] landlock: Up and running. worker2 # [ 0.272211] Yama: becoming mindful. client # [ 0.277425] ... generic counters: 6 worker1 # [ 0.286072] smp: Bringing up secondary CPUs ... worker2 # [ 0.273300] LSM support for eBPF active client # [ 0.278159] ... generic bitmap: 000000000000003f worker1 # [ 0.286651] smp: Brought up 1 node, 1 CPU client # [ 0.278434] ... fixed-purpose counters: 0 worker2 # [ 0.274065] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.287317] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.279155] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.279425] ... value mask: 0000ffffffffffff worker2 # [ 0.275251] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.280358] ... max period: 00007fffffffffff worker1 # [ 0.287856] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) client # [ 0.281158] ... global_ctrl mask: 000000000000003f worker1 # [ 0.288857] devtmpfs: initialized worker2 # [ 0.277650] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.281542] signal: max sigframe size: 3376 worker1 # [ 0.289658] x86/mm: Memory block size: 128MB client # [ 0.282336] rcu: Hierarchical SRCU implementation. worker2 # [ 0.278798] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.283042] rcu: Max phase no-delay instances is 400. worker2 # [ 0.279216] ... version: 2 worker1 # [ 0.291391] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.279961] ... bit width: 48 worker2 # [ 0.280213] ... generic counters: 6 lb # [ 0.280350] Freeing SMP alternatives memory: 44K worker1 # [ 0.292603] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.280906] ... generic bitmap: 000000000000003f lb # [ 0.281026] pid_max: default: 32768 minimum: 301 worker1 # [ 0.293736] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.281218] ... fixed-purpose counters: 0 lb # [ 0.281586] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.294824] PM: RTC time: 14:50:31, date: 2026-09-22 worker2 # [ 0.281947] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.282589] landlock: Up and running. lb # [ 0.283486] Yama: becoming mindful. client # [ 0.287936] smp: Bringing up secondary CPUs ... worker2 # [ 0.282213] ... value mask: 0000ffffffffffff client # [ 0.288439] smp: Brought up 1 node, 1 CPU lb # [ 0.284267] LSM support for eBPF active worker2 # [ 0.283111] ... max period: 00007fffffffffff client # [ 0.289125] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker2 # [ 0.283907] ... global_ctrl mask: 000000000000003f lb # [ 0.285058] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.284340] signal: max sigframe size: 3376 worker1 # [ 0.298338] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.285530] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.285098] rcu: Hierarchical SRCU implementation. client # [ 0.289574] Memory: 1454580K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved) worker2 # [ 0.285786] rcu: Max phase no-delay instances is 400. worker1 # [ 0.299137] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.290647] devtmpfs: initialized lb # [ 0.288565] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.299664] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.291521] x86/mm: Memory block size: 128MB worker1 # [ 0.300915] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.290090] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.290494] ... version: 2 client # [ 0.293258] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.301647] audit: initializing netlink subsys (disabled) lb # [ 0.291161] ... bit width: 48 lb # [ 0.291488] ... generic counters: 6 worker1 # [ 0.302809] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.294366] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.290779] smp: Bringing up secondary CPUs ... lb # [ 0.292175] ... generic bitmap: 000000000000003f worker1 # [ 0.302811] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.295517] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.291227] smp: Brought up 1 node, 1 CPU lb # [ 0.292488] ... fixed-purpose counters: 0 worker1 # [ 0.303639] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.296603] PM: RTC time: 14:50:30, date: 2026-09-22 worker2 # [ 0.291872] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.293161] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.304525] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.293488] ... value mask: 0000ffffffffffff lb # [ 0.294348] ... max period: 00007fffffffffff worker1 # [ 0.305377] audit: type=2000 audit(1790088631.634:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.292384] Memory: 1454588K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved) lb # [ 0.295134] ... global_ctrl mask: 000000000000003f worker2 # [ 0.293510] devtmpfs: initialized worker1 # [ 0.306641] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.295584] signal: max sigframe size: 3376 worker1 # [ 0.306654] cpuidle: using governor menu client # [ 0.300398] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.294329] x86/mm: Memory block size: 128MB lb # [ 0.296338] rcu: Hierarchical SRCU implementation. lb # [ 0.297049] rcu: Max phase no-delay instances is 400. worker1 # [ 0.308839] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.301630] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.296100] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.302444] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.309847] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.297145] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.310641] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.303701] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.298300] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.311650] PCI: Using configuration type 1 for base access client # [ 0.304435] audit: initializing netlink subsys (disabled) worker2 # [ 0.299477] PM: RTC time: 14:50:31, date: 2026-09-22 client # [ 0.305591] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.302041] smp: Bringing up secondary CPUs ... worker1 # [ 0.312779] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.302501] smp: Brought up 1 node, 1 CPU client # [ 0.305593] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.303140] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) client # [ 0.306426] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.307379] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.302980] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.303659] Memory: 1454600K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved) client # [ 0.308164] audit: type=2000 audit(1790088631.649:1): state=initialized audit_enabled=0 res=1 lb # [ 0.304748] devtmpfs: initialized worker2 # [ 0.303726] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.309428] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.317859] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.305615] x86/mm: Memory block size: 128MB client # [ 0.309441] cpuidle: using governor menu worker2 # [ 0.304238] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.318638] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.311606] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.305495] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.307426] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.306223] audit: initializing netlink subsys (disabled) client # [ 0.312659] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.308370] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.307379] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.313427] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.309559] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.307381] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.314436] PCI: Using configuration type 1 for base access lb # [ 0.310680] PM: RTC time: 14:50:30, date: 2026-09-22 worker1 # [ 0.323640] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.308214] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.315527] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.324638] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.309185] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.309954] audit: type=2000 audit(1790088631.658:1): state=initialized audit_enabled=0 res=1 lb # [ 0.314323] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.311216] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.311242] cpuidle: using governor menu lb # [ 0.315658] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.313472] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.316510] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.314454] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.317764] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.322707] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.315216] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.318498] audit: initializing netlink subsys (disabled) client # [ 0.323426] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.316225] PCI: Using configuration type 1 for base access lb # [ 0.319587] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.319590] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.334980] ACPI: Added _OSI(Module Device) worker2 # [ 0.317353] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.320489] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.335640] ACPI: Added _OSI(Processor Device) lb # [ 0.321403] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.336355] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.322195] audit: type=2000 audit(1790088631.657:1): state=initialized audit_enabled=0 res=1 client # [ 0.328426] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.323492] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.329426] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.323506] cpuidle: using governor menu lb # [ 0.325682] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker2 # [ 0.324403] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.326744] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.325214] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.327491] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.328500] PCI: Using configuration type 1 for base access lb # [ 0.329565] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.345204] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.338040] ACPI: Added _OSI(Module Device) worker1 # [ 0.346598] ACPI: Interpreter enabled client # [ 0.338426] ACPI: Added _OSI(Processor Device) worker1 # [ 0.347157] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.330214] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.339152] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.331214] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.349639] ACPI: Using IOAPIC for interrupt routing lb # [ 0.334737] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.335489] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.350502] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.353638] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.354783] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.346039] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.340489] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.341489] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.341610] ACPI: Added _OSI(Module Device) worker2 # [ 0.342214] ACPI: Added _OSI(Processor Device) client # [ 0.349307] ACPI: Interpreter enabled client # [ 0.349878] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.342971] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.350425] ACPI: Using IOAPIC for interrupt routing client # [ 0.351338] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.363431] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.365133] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.356425] PCI: Using E820 reservations for host bridge windows lb # [ 0.351887] ACPI: Added _OSI(Module Device) worker1 # [ 0.365717] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.357559] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.352490] ACPI: Added _OSI(Processor Device) lb # [ 0.353218] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.366762] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.351562] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.367978] PCI host bridge to bus 0000:00 worker2 # [ 0.353174] ACPI: Interpreter enabled worker1 # [ 0.368642] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.353689] ACPI: PM: (supports S0 S3 S4 S5) worker1 # [ 0.369639] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.370638] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.356214] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.371638] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.357111] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.372638] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.366196] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.373639] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.374639] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.362086] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.367729] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.360213] PCI: Using E820 reservations for host bridge windows worker1 # [ 0.375592] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.361319] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.363420] ACPI: Interpreter enabled client # [ 0.368502] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.363931] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.369546] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.377094] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.370787] PCI host bridge to bus 0000:00 client # [ 0.371430] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.366490] ACPI: Using IOAPIC for interrupt routing client # [ 0.372425] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.367375] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug client # [ 0.373425] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.374425] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.369117] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.370489] PCI: Using E820 reservations for host bridge windows client # [ 0.375425] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.371585] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.379719] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.370002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] client # [ 0.376425] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.380650] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.377425] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.371291] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.381643] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.378384] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.372336] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.373600] PCI host bridge to bus 0000:00 worker1 # [ 0.383051] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.379880] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker2 # [ 0.374218] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.375213] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.384381] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.376216] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.377213] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.380172] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.386673] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.378213] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.387553] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.381184] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker2 # [ 0.379213] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.388408] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.382567] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.382490] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.380214] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.388644] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.383438] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.383614] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.381166] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.384384] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.384873] PCI host bridge to bus 0000:00 worker1 # [ 0.390204] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.382649] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.385493] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.385470] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.386489] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.391683] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.387488] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.392578] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.387323] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.388488] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.393390] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.389488] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.394167] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.390452] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.390489] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] client # [ 0.391290] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.391488] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.392207] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.385373] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.392536] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.393265] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.386296] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.396704] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.387238] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.393994] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.397645] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.394757] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.388570] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.398660] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] client # [ 0.396439] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.400222] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.389939] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.397291] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.398198] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.401646] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker2 # [ 0.392253] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker1 # [ 0.402644] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.399883] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.393136] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.396552] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.403600] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.397500] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.393970] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.404433] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.398476] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.394219] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.406169] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.399497] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.402440] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.395786] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.403432] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.407489] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.401186] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.404416] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.408407] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.398252] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] client # [ 0.405832] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.399206] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker1 # [ 0.410111] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.403504] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.399991] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.404338] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.407433] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.411677] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.405266] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.401680] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.408265] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.406297] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.412638] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] client # [ 0.409128] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.409443] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.407761] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.414189] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.404411] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.410970] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.415456] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker2 # [ 0.405219] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] lb # [ 0.409504] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.416418] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.406193] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.410331] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.412438] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.411232] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.418052] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.413414] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker2 # [ 0.407652] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.412039] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.414800] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.419651] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.409249] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] worker1 # [ 0.420606] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.410131] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] client # [ 0.416437] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.410990] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.422513] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.417435] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.414497] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.412094] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.415494] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.424678] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.419002] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.416458] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.413826] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.425535] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.426415] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.420447] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.417839] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.415046] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.421380] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.415973] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.428032] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.419505] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.422833] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.416843] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.420361] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.421235] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.429672] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.424439] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.421494] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.418227] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.430644] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.425402] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.431582] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.419189] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.423510] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.426968] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.433052] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.420742] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.425421] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker1 # [ 0.434197] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.428440] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.422003] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.426271] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.429250] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.434837] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.422923] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.430171] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.427855] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.436190] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker2 # [ 0.423751] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.430981] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.429503] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.436838] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.430473] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.425259] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.438392] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker2 # [ 0.426235] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.432656] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] lb # [ 0.432379] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.433432] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.427796] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.434447] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.434241] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.434511] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.429255] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.435979] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.430093] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] lb # [ 0.436063] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.437127] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.430954] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] client # [ 0.437626] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.437501] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker2 # [ 0.432614] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.438416] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.439051] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.439623] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.439877] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.434255] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.438938] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.435220] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.441121] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.441167] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.442496] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.436202] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.443341] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.441890] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.444275] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker2 # [ 0.437678] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.442922] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.438737] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.445912] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.443907] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.439413] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.445577] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.440773] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.447516] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.446292] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.448497] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker2 # [ 0.441428] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.446951] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint lb # [ 0.449472] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.442759] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.448222] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.450955] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.441653] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.452071] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] client # [ 0.444073] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.451622] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.452692] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.444713] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.452468] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.454063] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.453645] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.445710] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.454680] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.454680] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.455715] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.446698] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.456450] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.456730] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.448453] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.457737] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.449375] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.458736] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.459674] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.443502] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.450547] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.460606] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.445760] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker1 # [ 0.461382] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.452319] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.462388] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.446457] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.462652] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.447529] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.463651] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker1 # [ 0.464625] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.448460] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.456719] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.465404] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 client # [ 0.457529] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.450262] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.466665] iommu: Default domain type: Translated lb # [ 0.457377] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.458521] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker2 # [ 0.451105] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.467451] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.459552] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.468749] ACPI: bus type USB registered lb # [ 0.459315] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.452254] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.460525] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.469472] usbcore: registered new interface driver usbfs lb # [ 0.460511] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker2 # [ 0.453793] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.470334] usbcore: registered new interface driver hub client # [ 0.461535] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.470648] usbcore: registered new device driver usb client # [ 0.462525] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 lb # [ 0.461785] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO client # [ 0.463524] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.472374] NetLabel: Initializing worker1 # [ 0.472644] NetLabel: domain hash size = 128 lb # [ 0.462783] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint client # [ 0.464463] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.473373] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.457224] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.465441] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 lb # [ 0.464383] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.473695] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.458318] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.466438] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.474588] PCI: Using ACPI for IRQ routing lb # [ 0.465087] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] worker2 # [ 0.459314] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.467437] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.460314] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.465808] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.468443] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.461314] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 client # [ 0.469441] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.467286] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.462309] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.470440] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.463312] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.471440] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.464312] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.473497] iommu: Default domain type: Translated worker2 # [ 0.465256] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.466196] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.474307] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.471219] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.475440] ACPI: bus type USB registered worker2 # [ 0.466936] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 lb # [ 0.471597] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 client # [ 0.476169] usbcore: registered new interface driver usbfs worker2 # [ 0.467226] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.472585] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.476438] usbcore: registered new interface driver hub worker2 # [ 0.468197] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.473585] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 client # [ 0.477296] usbcore: registered new device driver usb worker2 # [ 0.468930] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.474597] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.469226] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.478896] NetLabel: Initializing lb # [ 0.475584] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 client # [ 0.479426] NetLabel: domain hash size = 128 worker2 # [ 0.470162] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.476590] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.480121] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.477586] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.480461] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.471953] iommu: Default domain type: Translated client # [ 0.481349] PCI: Using ACPI for IRQ routing lb # [ 0.478522] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.472221] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.479443] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.473410] ACPI: bus type USB registered worker2 # [ 0.474147] usbcore: registered new interface driver usbfs lb # [ 0.480285] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.474883] usbcore: registered new interface driver hub lb # [ 0.481398] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker2 # [ 0.475221] usbcore: registered new device driver usb lb # [ 0.482271] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.476896] NetLabel: Initializing lb # [ 0.483258] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.477214] NetLabel: domain hash size = 128 lb # [ 0.483504] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.477933] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.484478] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.478297] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.479161] PCI: Using ACPI for IRQ routing lb # [ 0.486435] iommu: Default domain type: Translated lb # [ 0.487134] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.487758] ACPI: bus type USB registered lb # [ 0.488519] usbcore: registered new interface driver usbfs lb # [ 0.489458] usbcore: registered new interface driver hub lb # [ 0.490183] usbcore: registered new device driver usb lb # [ 0.491321] NetLabel: Initializing lb # [ 0.491957] NetLabel: domain hash size = 128 lb # [ 0.492488] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.493446] NetLabel: unlabeled traffic allowed by default lb # [ 0.494201] PCI: Using ACPI for IRQ routing worker1 # [ 0.517853] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.518634] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.518634] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.518645] vgaarb: loaded worker1 # [ 0.519346] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.519640] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.523719] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.527061] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.527748] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.529124] pnp: PnP ACPI init worker1 # [ 0.529865] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.525387] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.530758] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.525421] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.532292] pnp: PnP ACPI: found 5 devices client # [ 0.525421] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.525429] vgaarb: loaded client # [ 0.526171] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.526425] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.522945] pci 0000:00:01.0: vgaarb: setting as boot VGA device client # [ 0.529510] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.523209] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.539838] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.541285] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.523209] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker2 # [ 0.523217] vgaarb: loaded worker1 # [ 0.542235] NET: Registered PF_INET protocol family client # [ 0.533047] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.523941] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.543373] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.524215] hpet0: 3 comparators, 64-bit 100.000000 MHz counter client # [ 0.533752] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.535075] pnp: PnP ACPI init client # [ 0.535874] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.536867] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.538426] pnp: PnP ACPI: found 5 devices lb # [ 0.537374] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker2 # [ 0.529318] clocksource: Switched to clocksource kvm-clock lb # [ 0.537484] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.537484] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none lb # [ 0.537493] vgaarb: loaded lb # [ 0.538236] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker2 # [ 0.532836] VFS: Disk quotas dquot_6.6.0 lb # [ 0.538488] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker2 # [ 0.533587] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.534925] pnp: PnP ACPI init worker2 # [ 0.535712] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.546036] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.547440] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.536677] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.541583] clocksource: Switched to clocksource kvm-clock client # [ 0.548407] NET: Registered PF_INET protocol family worker2 # [ 0.538204] pnp: PnP ACPI: found 5 devices lb # [ 0.543269] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.559496] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.549569] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.560969] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.545842] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.562263] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.547154] pnp: PnP ACPI init worker1 # [ 0.563573] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.547912] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.564850] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.548823] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.566014] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.550322] pnp: PnP ACPI: found 5 devices worker2 # [ 0.545791] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.567303] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.547217] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.568396] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.548211] NET: Registered PF_INET protocol family worker1 # [ 0.569598] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.570566] NET: Registered PF_XDP protocol family worker2 # [ 0.549364] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.571407] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker1 # [ 0.572438] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker1 # [ 0.573488] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.557917] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker1 # [ 0.574629] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.559318] clocksource: Switched to clocksource acpi_pm worker1 # [ 0.575738] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] client # [ 0.565688] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.560251] NET: Registered PF_INET protocol family worker1 # [ 0.576819] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.567202] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.561420] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.578573] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.568537] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.569945] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.580718] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.571273] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.582633] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.572481] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.573806] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.584554] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.574966] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.586250] PCI: CLS 0 bytes, default 64 client # [ 0.576233] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.587177] Trying to unpack rootfs image as initramfs... client # [ 0.577260] NET: Registered PF_XDP protocol family worker2 # [ 0.566142] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.578110] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.567706] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.579153] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.569077] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.580196] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.581312] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.570503] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.591213] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns client # [ 0.582442] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.571762] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.583557] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.572936] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.577893] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.585287] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.574212] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.579400] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.575329] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.580670] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.576607] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.587787] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.577575] NET: Registered PF_XDP protocol family lb # [ 0.581953] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.578413] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.589706] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.583161] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.579440] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] lb # [ 0.584379] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.580511] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.591595] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.585746] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.581602] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.593314] PCI: CLS 0 bytes, default 64 lb # [ 0.586933] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.582722] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.588180] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.583810] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] client # [ 0.594206] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.589139] NET: Registered PF_XDP protocol family client # [ 0.595947] Trying to unpack rootfs image as initramfs... worker2 # [ 0.585534] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.590036] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.591061] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.587745] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.592124] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.593274] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker2 # [ 0.589681] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.594465] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.595621] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.591647] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.597397] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.593319] PCI: CLS 0 bytes, default 64 worker2 # [ 0.594244] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns lb # [ 0.599678] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.596037] Trying to unpack rootfs image as initramfs... lb # [ 0.601722] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.603719] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.605429] PCI: CLS 0 bytes, default 64 lb # [ 0.606423] Trying to unpack rootfs image as initramfs... lb # [ 0.610810] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns worker1 # [ 0.632840] Initialise system trusted keyrings worker1 # [ 0.636120] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.641272] Initialise system trusted keyrings client # [ 0.644897] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.655341] Key type asymmetric registered worker1 # [ 0.660083] Asymmetric key parser 'x509' registered worker2 # [ 0.640581] Initialise system trusted keyrings worker1 # [ 0.660947] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.664176] io scheduler mq-deadline registered worker2 # [ 0.643556] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.664972] io scheduler kyber registered worker1 # [ 0.667600] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.651739] Initialise system trusted keyrings lb # [ 0.652720] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.668873] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.674827] Linux agpgart interface v0.103 worker1 # [ 0.675624] ACPI: bus type drm_connector registered client # [ 0.666278] Key type asymmetric registered worker1 # [ 0.678204] usbcore: registered new interface driver usbserial_generic client # [ 0.668855] Asymmetric key parser 'x509' registered worker1 # [ 0.679330] usbserial: USB Serial support registered for generic client # [ 0.669715] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.682092] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.672992] io scheduler mq-deadline registered worker1 # [ 0.682092] Please enable it if your BIOS has the CPPC option. client # [ 0.673795] io scheduler kyber registered worker1 # [ 0.684403] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.664772] Key type asymmetric registered worker2 # [ 0.665718] Asymmetric key parser 'x509' registered client # [ 0.676461] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.677729] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.688221] drop_monitor: Initializing network drop monitor service worker1 # [ 0.689453] NET: Registered PF_INET6 protocol family worker2 # [ 0.668545] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.671543] io scheduler mq-deadline registered lb # [ 0.676555] Key type asymmetric registered worker2 # [ 0.672367] io scheduler kyber registered client # [ 0.683519] Linux agpgart interface v0.103 lb # [ 0.677276] Asymmetric key parser 'x509' registered worker1 # [ 0.694182] Segment Routing with IPv6 client # [ 0.684282] ACPI: bus type drm_connector registered worker1 # [ 0.694880] In-situ OAM (IOAM) with IPv6 lb # [ 0.678134] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker2 # [ 0.675106] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.697349] IPI shorthand broadcast: enabled client # [ 0.687314] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.676441] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.681469] io scheduler mq-deadline registered lb # [ 0.682218] io scheduler kyber registered client # [ 0.688384] usbserial: USB Serial support registered for generic lb # [ 0.684946] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.690854] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.690854] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.681920] Linux agpgart interface v0.103 lb # [ 0.686193] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.682688] ACPI: bus type drm_connector registered client # [ 0.693128] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.704548] sched_clock: Marking stable (570014752, 134050340)->(776993345, -72928253) worker2 # [ 0.685955] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.687074] usbserial: USB Serial support registered for generic lb # [ 0.691870] Linux agpgart interface v0.103 client # [ 0.698026] drop_monitor: Initializing network drop monitor service lb # [ 0.692636] ACPI: bus type drm_connector registered client # [ 0.699254] NET: Registered PF_INET6 protocol family worker1 # [ 0.710152] registered taskstats version 1 worker2 # [ 0.689506] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker1 # [ 0.711153] Loading compiled-in X.509 certificates worker2 # [ 0.689506] Please enable it if your BIOS has the CPPC option. client # [ 0.702303] Segment Routing with IPv6 lb # [ 0.695785] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.691786] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.696813] usbserial: USB Serial support registered for generic client # [ 0.704862] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.694647] drop_monitor: Initializing network drop monitor service client # [ 0.705935] IPI shorthand broadcast: enabled lb # [ 0.699337] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.695832] NET: Registered PF_INET6 protocol family lb # [ 0.699337] Please enable it if your BIOS has the CPPC option. lb # [ 0.701588] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.704443] drop_monitor: Initializing network drop monitor service worker2 # [ 0.700970] Segment Routing with IPv6 lb # [ 0.705650] NET: Registered PF_INET6 protocol family worker2 # [ 0.701635] In-situ OAM (IOAM) with IPv6 client # [ 0.714111] sched_clock: Marking stable (580013925, 133816340)->(784696106, -70865841) worker2 # [ 0.704785] IPI shorthand broadcast: enabled lb # [ 0.710807] Segment Routing with IPv6 worker1 # [ 0.727511] Demotion targets for Node 0: null client # [ 0.718101] registered taskstats version 1 client # [ 0.719203] Loading compiled-in X.509 certificates lb # [ 0.713344] In-situ OAM (IOAM) with IPv6 lb # [ 0.714416] IPI shorthand broadcast: enabled worker1 # [ 0.731111] Key type .fscrypt registered worker1 # [ 0.731802] Key type fscrypt-provisioning registered worker1 # [ 0.732755] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.713152] sched_clock: Marking stable (578013983, 134474038)->(786426667, -73938646) worker1 # [ 0.735076] ima: Allocated hash algorithm: sha1 worker1 # [ 0.735860] ima: No architecture policies found worker2 # [ 0.716696] registered taskstats version 1 worker1 # [ 0.738075] PM: Magic number: 10:943:839 worker2 # [ 0.717740] Loading compiled-in X.509 certificates lb # [ 0.722688] sched_clock: Marking stable (574013951, 148295899)->(790798886, -68489036) worker1 # [ 0.739680] RAS: Correctable Errors collector initialized. lb # [ 0.727508] registered taskstats version 1 lb # [ 0.728595] Loading compiled-in X.509 certificates client # [ 0.737423] Demotion targets for Node 0: null worker1 # [ 0.748726] clk: Disabling unused clocks client # [ 0.740885] Key type .fscrypt registered client # [ 0.741616] Key type fscrypt-provisioning registered client # [ 0.742590] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.753100] PM: genpd: Disabling unused power domains client # [ 0.744843] ima: Allocated hash algorithm: sha1 client # [ 0.745678] ima: No architecture policies found worker2 # [ 0.736508] Demotion targets for Node 0: null client # [ 0.747843] PM: Magic number: 10:943:839 worker2 # [ 0.737400] Key type .fscrypt registered client # [ 0.749546] RAS: Correctable Errors collector initialized. worker2 # [ 0.740493] Key type fscrypt-provisioning registered worker2 # [ 0.741468] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.742432] ima: Allocated hash algorithm: sha1 lb # [ 0.747318] Demotion targets for Node 0: null lb # [ 0.748189] Key type .fscrypt registered worker2 # [ 0.744523] ima: No architecture policies found lb # [ 0.750321] Key type fscrypt-provisioning registered lb # [ 0.751328] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.747504] PM: Magic number: 10:943:839 lb # [ 0.752271] ima: Allocated hash algorithm: sha1 worker2 # [ 0.749143] RAS: Correctable Errors collector initialized. client # [ 0.760642] clk: Disabling unused clocks lb # [ 0.756352] ima: No architecture policies found client # [ 0.762870] PM: genpd: Disabling unused power domains lb # [ 0.757385] PM: Magic number: 10:943:839 lb # [ 0.759182] RAS: Correctable Errors collector initialized. worker2 # [ 0.758262] clk: Disabling unused clocks worker2 # [ 0.761523] PM: genpd: Disabling unused power domains lb # [ 0.767994] clk: Disabling unused clocks lb # [ 0.772343] PM: genpd: Disabling unused power domains worker1 # [ 0.914189] Freeing initrd memory: 29056K worker1 # [ 0.917386] Freeing unused decrypted memory: 2028K worker1 # [ 0.919977] Freeing unused kernel image (initmem) memory: 3652K worker1 # [ 0.921116] Write protecting the kernel read-only data: 32768k worker1 # [ 0.922959] Freeing unused kernel image (text/rodata gap) memory: 1184K worker1 # [ 0.924510] Freeing unused kernel image (rodata/data gap) memory: 720K client # [ 0.922721] Freeing initrd memory: 29056K client # [ 0.925875] Freeing unused decrypted memory: 2028K client # [ 0.928476] Freeing unused kernel image (initmem) memory: 3652K client # [ 0.929574] Write protecting the kernel read-only data: 32768k client # [ 0.931415] Freeing unused kernel image (text/rodata gap) memory: 1184K client # [ 0.932961] Freeing unused kernel image (rodata/data gap) memory: 720K worker2 # [ 0.924518] Freeing initrd memory: 29060K worker2 # [ 0.927872] Freeing unused decrypted memory: 2028K worker2 # [ 0.930660] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.935410] Freeing initrd memory: 29064K worker2 # [ 0.931761] Write protecting the kernel read-only data: 32768k worker2 # [ 0.933681] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.938721] Freeing unused decrypted memory: 2028K worker2 # [ 0.935220] Freeing unused kernel image (rodata/data gap) memory: 720K lb # [ 0.941492] Freeing unused kernel image (initmem) memory: 3652K lb # [ 0.942606] Write protecting the kernel read-only data: 32768k lb # [ 0.944491] Freeing unused kernel image (text/rodata gap) memory: 1184K lb # [ 0.946044] Freeing unused kernel image (rodata/data gap) memory: 720K worker1 # [ 0.975474] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.976573] Run /init as init process worker1 # [ 0.987016] systemd[1]: Inserted module 'autofs4' client # [ 0.983841] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.984952] Run /init as init process client # [ 0.995796] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.006654] fuse: init (API version 7.45) worker2 # [ 0.986338] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 0.987509] Run /init as init process lb # [ 0.996799] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 0.997816] Run /init as init process worker1 # [ 1.014261] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.016496] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 0.998351] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.019454] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.021347] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.008580] systemd[1]: Inserted module 'autofs4' client # [ 1.015480] fuse: init (API version 7.45) worker1 # [ 1.026571] virtiofs virtio5: discovered new tag: nix-store worker1 # [ 1.028162] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.022868] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.035255] virtiofs virtio6: discovered new tag: shared client # [ 1.025372] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.036898] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.028689] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.018284] fuse: init (API version 7.45) worker1 # [ 1.040940] virtiofs virtio7: discovered new tag: xchg client # [ 1.030964] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.042480] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.028611] fuse: init (API version 7.45) client # [ 1.036213] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.025848] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.037792] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.028221] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker2 # [ 1.031082] ACPI: \_SB_.GSIE: Enabled at IRQ 20 lb # [ 1.035938] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker2 # [ 1.033115] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.038477] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.046306] virtiofs virtio6: discovered new tag: shared lb # [ 1.041543] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.047976] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker2 # [ 1.038245] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.043498] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.039862] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.051355] virtiofs virtio7: discovered new tag: xchg client # [ 1.052895] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 1.063830] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.048954] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.050589] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.047922] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.049739] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.057748] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.053555] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.055113] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.059504] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.062925] virtiofs virtio7: discovered new tag: xchg lb # [ 1.064385] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.078596] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.076599] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.085420] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.399373] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.407366] systemd[1]: Detected virtualization kvm. worker1 # [ 1.409499] systemd[1]: Detected architecture x86-64. worker1 # [ 1.411643] systemd[1]: Running in initrd. worker1 # [ 1.414226] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.417309] systemd[1]: Hostname set to . client # [ 1.414137] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.419193] systemd[1]: Detected virtualization kvm. client # [ 1.420070] systemd[1]: Detected architecture x86-64. client # [ 1.421004] systemd[1]: Running in initrd. client # [ 1.422115] systemd[1]: Initializing machine ID from random generator. client # [ 1.423352] systemd[1]: Hostname set to . worker2 # [ 1.413809] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.427137] systemd[1]: Detected virtualization kvm. lb # [ 1.422007] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.429401] systemd[1]: Detected architecture x86-64. worker2 # [ 1.430570] systemd[1]: Running in initrd. lb # [ 1.434006] systemd[1]: Detected virtualization kvm. worker2 # [ 1.432016] systemd[1]: Initializing machine ID from random generator. lb # [ 1.436205] systemd[1]: Detected architecture x86-64. worker2 # [ 1.433639] systemd[1]: Hostname set to . lb # [ 1.438367] systemd[1]: Running in initrd. lb # [ 1.440885] systemd[1]: Initializing machine ID from random generator. lb # [ 1.443774] systemd[1]: Hostname set to . client # [ 1.620789] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.652688] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.652011] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.651366] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.664358] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.668153] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.669328] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.670687] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.671767] systemd[1]: Reached target Path Units. client # [ 1.672600] systemd[1]: Reached target Slice Units. client # [ 1.673504] systemd[1]: Reached target Swaps. client # [ 1.674281] systemd[1]: Reached target Timer Units. client # [ 1.675247] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.676440] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.677568] systemd[1]: Listening on Journal Sockets. client # [ 1.678518] systemd[1]: Listening on udev Control Socket. client # [ 1.679479] systemd[1]: Listening on udev Kernel Socket. client # [ 1.680394] systemd[1]: Reached target Socket Units. client # [ 1.682162] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.685902] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.691818] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.695738] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.696985] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.713915] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.698416] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.699525] systemd[1]: Reached target Path Units. lb # [ 1.700456] systemd[1]: Reached target Slice Units. client # [ 1.695061] systemd[1]: Starting Journal Service... lb # [ 1.701364] systemd[1]: Reached target Swaps. worker1 # [ 1.718342] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.702184] systemd[1]: Reached target Timer Units. lb # [ 1.703188] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.719505] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.704425] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.720857] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.721925] systemd[1]: Reached target Path Units. lb # [ 1.705603] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.701049] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.722790] systemd[1]: Reached target Slice Units. lb # [ 1.706649] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.723702] systemd[1]: Reached target Swaps. lb # [ 1.707695] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.724512] systemd[1]: Reached target Timer Units. lb # [ 1.708676] systemd[1]: Reached target Socket Units. worker1 # [ 1.725474] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.704878] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.726684] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.710522] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.706011] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.727830] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.707391] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.728866] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.708446] systemd[1]: Reached target Path Units. worker1 # [ 1.729963] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.709381] systemd[1]: Reached target Slice Units. lb # [ 1.714156] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.710223] systemd[1]: Reached target Swaps. worker1 # [ 1.730966] systemd[1]: Reached target Socket Units. client # [ 1.721029] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.710970] systemd[1]: Reached target Timer Units. worker2 # [ 1.711898] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.732742] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.713052] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.714146] systemd[1]: Listening on Journal Sockets. client # [ 1.724944] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.715101] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.716069] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.737130] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.716976] systemd[1]: Reached target Socket Units. worker2 # [ 1.718782] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.732905] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.722399] systemd[1]: Starting Load Kernel Module configfs... lb # [ 1.725032] systemd[1]: Starting Journal Service... client # [ 1.744393] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.745800] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.748139] systemd[1]: Starting Journal Service... client # [ 1.753280] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.731560] systemd[1]: Starting Journal Service... lb # [ 1.748927] systemd[1]: Starting Load Kernel Modules... client # [ 1.758948] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.753440] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.773258] systemd[1]: Starting Load Kernel Modules... client # [ 1.764254] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.777166] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.758120] systemd[1]: Starting Load Kernel Modules... lb # [ 1.762565] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.762627] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.787259] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.777898] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.773873] systemd-journald[66]: Collecting audit messages is disabled. worker2 # [ 1.772317] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.778378] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.784255] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.795871] systemd-journald[66]: Collecting audit messages is disabled. lb # [ 1.780995] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.803138] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.782597] systemd-journald[66]: Collecting audit messages is disabled. client # [ 1.795021] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.789750] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.786569] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.809763] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 1.791756] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.796752] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.816513] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.797893] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.822494] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.808385] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.803887] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.818405] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.816167] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.835175] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.815685] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.827045] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.827502] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.843469] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.838355] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.827844] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.851378] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.846228] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.836538] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.849977] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.864651] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.858509] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.732437] systemd-modules-load[68]: Inserted module 'dm_mod' worker2 # [ 1.858095] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.736383] systemd-modules-load[68]: Inserted module 'virtio_balloon' client # [ 1.737461] systemd-modules-load[68]: Inserted module 'virtio_gpu' worker1 # [ 1.882152] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.873642] systemd[1]: Started Journal Service. worker1 # [ 1.888598] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.872460] systemd[1]: Finished Load Kernel Modules. client # [ 1.747182] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.871571] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.750903] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.880509] systemd[1]: Starting Apply Kernel Variables... client # [ 1.753905] systemd[1]: Reached target Local File Systems. client # [ 1.755153] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.899135] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.879029] systemd[1]: Finished Load Kernel Modules. client # [ 1.762504] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.907658] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.895448] systemd[1]: Started Journal Service. worker2 # [ 1.891725] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.916386] systemd[1]: Started Journal Service. lb # [ 1.750856] systemd-modules-load[67]: Inserted module 'dm_mod' worker1 # [ 1.780813] systemd-modules-load[68]: Inserted module 'dm_mod' worker1 # [ 1.786139] systemd-modules-load[68]: Inserted module 'virtio_balloon' lb # [ 1.756087] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker1 # [ 1.787302] systemd-modules-load[68]: Inserted module 'virtio_gpu' lb # [ 1.757262] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker2 # [ 1.768568] systemd-modules-load[67]: Inserted module 'dm_mod'[ 1.904146] systemd[1]: Started Journal Service. lb # [ 1.762917] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # client # [ 1.785169] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.773838] systemd-modules-load[67]: Inserted module 'virtio_balloon' worker2 # [ 1.774909] systemd-modules-load[67]: Inserted module 'virtio_gpu' worker1 # [ 1.796622] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.766917] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.771063] systemd[1]: Reached target Local File Systems. lb # [ 1.773127] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.805661] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.777633] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.810344] systemd[1]: Reached target Local File Systems. worker1 # [ 1.812103] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.793103] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.784817] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.794129] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.795120] systemd[1]: Reached target Local File Systems. worker1 # [ 1.819103] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.810187] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker2 # [ 1.800918] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.805960] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.828066] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.811170] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.806538] systemd[1]: Finished Create System Files and Directories. client # [ 1.834613] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.849434] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.839177] systemd[1]: Finished Create System Files and Directories. lb # [ 1.834346] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker1 # [ 1.873316] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 1.863272] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 1.857289] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.895637] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 1.891796] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.892795] systemd[1]: Reached target System Initialization. client # [ 1.893639] systemd[1]: Reached target Basic System. worker2 # [ 1.886376] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 1.944179] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.913766] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.914724] systemd[1]: Reached target System Initialization. worker1 # [ 1.945436] systemd[1]: Reached target System Initialization. lb # [ 1.915529] systemd[1]: Reached target Basic System. worker1 # [ 1.947344] systemd[1]: Reached target Basic System. worker2 # [ 1.942066] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.942939] systemd[1]: Reached target System Initialization. worker2 # [ 1.943792] systemd[1]: Reached target Basic System. client # [ 2.189675] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.208428] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.231283] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.240736] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.241492] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 client # [ 2.243479] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker2 # [ 2.234179] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.249490] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.250279] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.251334] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.253476] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.256866] usb usb1: Product: EHCI Host Controller worker2 # [ 2.245893] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.257558] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd client # [ 2.259185] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.260944] hub 1-0:1.0: USB hub found worker1 # [ 2.270686] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 lb # [ 2.254912] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.262237] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.263196] hub 1-0:1.0: 6 ports detected worker1 # [ 2.275084] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 2.260687] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 client # [ 2.268798] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.265194] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.283604] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.286167] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.286853] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.273874] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.274571] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.292729] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.283310] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.293645] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.295522] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.302162] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.282156] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.287422] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.303641] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.282954] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 lb # [ 2.288182] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.304775] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.295246] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.305926] usb usb1: Product: EHCI Host Controller lb # [ 2.290091] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 worker1 # [ 2.307471] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd worker1 # [ 2.310396] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.289963] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.311369] hub 1-0:1.0: USB hub found worker1 # [ 2.311919] hub 1-0:1.0: 6 ports detected lb # [ 2.297358] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.303963] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 lb # [ 2.298671] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.299807] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.297124] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.298623] serio: i8042 KBD port at 0x60,0x64 irq 1 lb # [ 2.303315] usb usb1: Product: EHCI Host Controller worker2 # [ 2.299333] serio: i8042 AUX port at 0x60,0x64 irq 12 lb # [ 2.303999] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.306338] usb usb1: SerialNumber: 0000:00:1d.7 lb # [ 2.307866] hub 1-0:1.0: USB hub found worker1 # [ 2.324374] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.314207] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.303963] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.325128] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 lb # [ 2.309163] hub 1-0:1.0: 6 ports detected client # [ 2.315379] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.310308] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.311991] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.319411] uhci_hcd 0000:00:1d.0: UHCI Host Controller lb # [ 2.320163] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.337897] uhci_hcd 0000:00:1d.0: detected 2 ports worker2 # [ 2.317836] usb usb1: Product: UHCI Host Controller client # [ 2.195070] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.339031] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.322749] usb usb1: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.344943] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.326255] usb usb1: SerialNumber: 0000:00:1d.0 worker2 # [ 2.330214] hub 1-0:1.0: USB hub found lb # [ 2.337139] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.344867] usb usb2: Product: UHCI Host Controller worker2 # [ 2.334405] hub 1-0:1.0: 2 ports detected client # [ 2.345603] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.357250] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.341629] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.214730] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.339719] ehci-pci 0000:00:1d.7: EHCI Host Controller client # [ 2.216777] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.340537] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 worker2 # [ 2.342295] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 client # [ 2.220369] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.367074] usb usb2: Product: UHCI Host Controller worker1 # [ 2.367793] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.351258] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.348526] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.350740] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.351873] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.355201] usb usb2: Product: EHCI Host Controller client # [ 2.232336] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.243319] systemd[1]: Starting Virtual Console Setup... client # [ 2.233873] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.356783] usb usb2: Manufacturer: Linux 6.18.52 ehci_hcd lb # [ 2.361567] SCSI subsystem initialized worker1 # [ 2.378551] SCSI subsystem initialized client # [ 2.368471] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.358498] usb usb2: SerialNumber: 0000:00:1d.7 client # [ 2.371286] SCSI subsystem initialized worker2 # [ 2.360623] hub 2-0:1.0: USB hub found worker2 # [ 2.362511] hub 2-0:1.0: 6 ports detected lb # [ 2.367062] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.368230] usb usb2: Product: UHCI Host Controller client # [ 2.375397] hub 2-0:1.0: USB hub found lb # [ 2.368994] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.254523] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.379841] hub 2-0:1.0: 2 ports detected lb # [ 2.374409] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.236542] (udev-worker)[85]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.392121] usb usb2: SerialNumber: 0000:00:1d.0 lb # [ 2.229074] systemd[1]: Starting Virtual Console Setup... client # [ 2.384008] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.241070] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.244407] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.257237] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.236625] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.259124] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.247690] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.387414] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.261335] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.386946] hub 1-0:1.0: USB hub found worker1 # [ 2.274242] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.388804] hub 1-0:1.0: 2 ports detected lb # [ 2.244742] (udev-worker)[90]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.276218] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.412111] hub 2-0:1.0: USB hub found lb # [ 2.247749] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.403407] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.404184] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.280972] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.284546] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.419434] hub 2-0:1.0: 2 ports detected worker2 # [ 2.403509] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.408494] hub 2-0:1.0: USB hub found worker2 # [ 2.404272] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.417513] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.419008] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 lb # [ 2.415609] hub 2-0:1.0: 2 ports detected client # [ 2.422084] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.434259] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.424955] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.271101] systemd-vconsole-setup[99]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.427015] usb usb3: Product: UHCI Host Controller worker2 # [ 2.281424] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.437457] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.427712] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.438218] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.284873] systemd[1]: Finished Virtual Console Setup. client # [ 2.431470] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.434297] hub 3-0:1.0: USB hub found worker2 # [ 2.424632] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.301617] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.425448] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 client # [ 2.436879] hub 3-0:1.0: 2 ports detected lb # [ 2.284619] systemd[1]: Finished Virtual Console Setup. client # [ 2.306638] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.451148] uhci_hcd 0000:00:1d.1: detected 2 ports worker1 # [ 2.451932] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.320088] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.321271] systemd[1]: Reached target Initrd Root Device. client # [ 2.446093] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.441360] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.447882] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.442087] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker1 # [ 2.325057] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.450947] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.439901] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.451718] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.441023] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.462168] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.463891] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.448132] uhci_hcd 0000:00:1d.1: detected 2 ports worker2 # [ 2.309178] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.464916] usb usb3: Product: UHCI Host Controller lb # [ 2.448928] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.310188] systemd[1]: Reached target Initrd Root Device. client # [ 2.455061] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.467064] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.467826] usb usb3: SerialNumber: 0000:00:1d.1 client # [ 2.457888] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.314068] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.459489] usb usb4: Product: UHCI Host Controller lb # [ 2.307613] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.308733] systemd[1]: Reached target Initrd Root Device. lb # [ 2.457833] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.475270] hub 3-0:1.0: USB hub found client # [ 2.465250] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd lb # [ 2.458952] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.454616] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 client # [ 2.466047] usb usb4: SerialNumber: 0000:00:1d.2 worker1 # [ 2.477312] hub 3-0:1.0: 2 ports detected lb # [ 2.312929] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 2.470107] hub 4-0:1.0: USB hub found client # [ 2.472536] hub 4-0:1.0: 2 ports detected worker1 # [ 2.482817] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.467325] usb usb3: Product: UHCI Host Controller lb # [ 2.468039] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.484266] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.465618] usb usb3: Product: UHCI Host Controller worker1 # [ 2.487149] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.466318] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd worker1 # [ 2.487935] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.473346] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.492359] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.472511] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.495093] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.479389] hub 3-0:1.0: USB hub found lb # [ 2.480749] hub 3-0:1.0: 2 ports detected worker2 # [ 2.476430] hub 3-0:1.0: USB hub found worker1 # [ 2.497144] usb usb4: Product: UHCI Host Controller worker1 # [ 2.497886] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd worker2 # [ 2.481574] hub 3-0:1.0: 2 ports detected lb # [ 2.486526] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.369603] systemd-fsck[106]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 2.487283] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.349182] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.496272] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.491388] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.373649] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.492174] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker1 # [ 2.510019] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.354849] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 2.511253] hub 4-0:1.0: USB hub found lb # [ 2.495474] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.502658] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.492176] uhci_hcd 0000:00:1d.2: UHCI Host Controller client # [ 2.503508] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.514075] hub 4-0:1.0: 2 ports detected client # [ 2.504857] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.495552] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 client # [ 2.509420] scsi host0: ahci worker2 # [ 2.498672] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.511141] scsi host1: ahci lb # [ 2.504571] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.501153] SCSI subsystem initialized lb # [ 2.505810] usb usb4: Product: UHCI Host Controller client # [ 2.512694] scsi host2: ahci lb # [ 2.507394] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.514259] scsi host3: ahci lb # [ 2.508182] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.503554] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.516132] scsi host4: ahci worker2 # [ 2.504921] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.362403] systemd-fsck[107]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.517691] scsi host5: ahci lb # [ 2.512868] hub 4-0:1.0: USB hub found client # [ 2.518704] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.508927] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.520387] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 client # [ 2.521551] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.511624] usb usb4: Product: UHCI Host Controller lb # [ 2.367648] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 2.512357] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd client # [ 2.522773] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 client # [ 2.524000] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 client # [ 2.525162] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.519389] hub 4-0:1.0: 2 ports detected worker2 # [ 2.517795] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.519830] hub 4-0:1.0: USB hub found worker1 # [ 2.541329] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.521534] hub 4-0:1.0: 2 ports detected worker1 # [ 2.542443] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker1 # [ 2.549657] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.535259] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.536387] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.537201] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.554076] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.556704] scsi host0: ahci worker1 # [ 2.558613] scsi host1: ahci worker1 # [ 2.560020] scsi host2: ahci worker1 # [ 2.561819] scsi host3: ahci lb # [ 2.545336] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 2.563438] scsi host4: ahci worker1 # [ 2.565029] scsi host5: ahci worker1 # [ 2.566156] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker1 # [ 2.567824] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker1 # [ 2.569035] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker1 # [ 2.570342] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker1 # [ 2.571500] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker1 # [ 2.572627] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 lb # [ 2.558233] scsi host0: ahci lb # [ 2.559706] scsi host1: ahci lb # [ 2.561544] scsi host2: ahci lb # [ 2.564176] scsi host3: ahci lb # [ 2.567033] scsi host4: ahci lb # [ 2.569642] scsi host5: ahci lb # [ 2.570241] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 lb # [ 2.574394] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 lb # [ 2.575588] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.572002] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.576767] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.573193] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.577933] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.574496] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.579113] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.577567] scsi host0: ahci worker2 # [ 2.579557] scsi host1: ahci worker2 # [ 2.581867] scsi host2: ahci worker2 # [ 2.583721] scsi host3: ahci worker2 # [ 2.585412] scsi host4: ahci worker2 # [ 2.587282] scsi host5: ahci worker2 # [ 2.588385] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 worker2 # [ 2.590078] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 worker2 # [ 2.591294] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 worker2 # [ 2.592576] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 worker2 # [ 2.593759] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 worker2 # [ 2.594927] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 worker2 # [ 2.602516] usb 2-1: new high-speed USB device number 2 using ehci-pci client # [ 2.635157] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.638046] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 client # [ 2.641378] usb 1-1: Product: QEMU USB Tablet client # [ 2.643250] usb 1-1: Manufacturer: QEMU client # [ 2.643803] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 client # [ 2.661680] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.683395] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.686261] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.689454] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.691258] usb 1-1: Manufacturer: QEMU lb # [ 2.675357] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.692848] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.677595] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.680101] usb 1-1: Product: QEMU USB Tablet lb # [ 2.681574] usb 1-1: Manufacturer: QEMU lb # [ 2.682923] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker1 # [ 2.723192] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.712567] hid: raw HID events driver (C) Jiri Kosina client # [ 2.606824] systemd[1]: Mounting /sysroot... worker2 # [ 2.731675] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.732864] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.734269] usb 2-1: Product: QEMU USB Tablet worker2 # [ 2.734899] usb 2-1: Manufacturer: QEMU worker2 # [ 2.735463] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.753868] hid: raw HID events driver (C) Jiri Kosina lb # [ 2.625450] systemd[1]: Mounting /sysroot... worker1 # [ 2.665943] systemd[1]: Mounting /sysroot... worker2 # [ 2.649088] systemd[1]: Mounting /sysroot... client # [ 2.832936] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.841397] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.843589] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.846067] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.848261] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.851047] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.852994] ata3.00: applying bridge limits client # [ 2.855013] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.857196] ata3.00: configured for UDMA/100 client # [ 2.859638] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.879680] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.888997] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.891199] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.893641] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.895921] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.898170] ata3.00: applying bridge limits worker1 # [ 2.900161] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.902405] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.904429] ata3.00: configured for UDMA/100 lb # [ 2.888435] ata1: SATA link down (SStatus 0 SControl 300) lb # [ 2.890719] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.906792] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.893386] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) lb # [ 2.895648] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.897807] ata3.00: applying bridge limits lb # [ 2.899805] ata2: SATA link down (SStatus 0 SControl 300) lb # [ 2.902125] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.904562] ata4: SATA link down (SStatus 0 SControl 300) lb # [ 2.906634] ata3.00: configured for UDMA/100 worker2 # [ 2.904869] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.905929] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 lb # [ 2.909091] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.906986] ata3.00: applying bridge limits worker2 # [ 2.907819] ata3.00: configured for UDMA/100 worker2 # [ 2.908727] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.909652] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.910539] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.911511] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.912402] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.913696] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.935942] usbcore: registered new interface driver usbhid client # [ 2.936706] usbhid: USB HID core driver client # [ 2.955027] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.958876] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.960386] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.980568] usbcore: registered new interface driver usbhid worker1 # [ 2.983396] usbhid: USB HID core driver client # [ 2.977518] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.975597] usbcore: registered new interface driver usbhid worker2 # [ 2.976371] usbhid: USB HID core driver lb # [ 2.985933] usbcore: registered new interface driver usbhid client # [ 2.991392] EXT4-fs (vda): mounted filesystem 88b9297a-0752-4a49-bb7a-2b420a5d11a9 r/w with ordered data mode. Quota mode: none. lb # [ 2.986714] usbhid: USB HID core driver client # [ 2.862329] systemd[1]: Mounted /sysroot. client # [ 2.863516] systemd[1]: Reached target Initrd Root File System. client # [ 2.865673] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.009527] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 3.012325] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 3.016404] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 3.001655] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.878678] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.004129] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 3.026203] cdrom: Uniform CD-ROM driver Revision: 3.20 client # [ 2.884063] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 2.885512] systemd[1]: Reloading... worker2 # [ 3.009402] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 3.031022] EXT4-fs (vda): mounted filesystem a6ecff3c-92fe-436f-87f9-7ba7358fceec r/w with ordered data mode. Quota mode: none. lb # [ 3.014817] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 3.016661] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 worker1 # [ 2.902827] systemd[1]: Mounted /sysroot. worker2 # [ 3.016615] cdrom: Uniform CD-ROM driver Revision: 3.20 lb # [ 3.022304] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker1 # [ 2.904865] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.908551] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.024312] EXT4-fs (vda): mounted filesystem 617606b7-6b13-41d5-879e-78f08e71f5dc r/w with ordered data mode. Quota mode: none. lb # [ 3.033423] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.895029] systemd[1]: Mounted /sysroot. worker2 # [ 2.897423] systemd[1]: Reached target Initrd Root File System. lb # [ 3.037413] EXT4-fs (vda): mounted filesystem 11545468-e34f-4655-b646-834c34ea92d8 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.900560] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 2.922106] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.895183] systemd[1]: Mounted /sysroot. lb # [ 2.896722] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.927064] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 2.928506] systemd[1]: Reloading... worker2 # [ 2.908130] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 2.899744] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.913132] systemd[1]: Mounting /sysroot/run... worker2 # [ 2.922101] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 2.913804] systemd-sysroot-fstab-check[139]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.928153] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 2.919139] systemd[1]: Reload requested from client PID 139 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.920594] systemd[1]: Reloading... worker2 # [ 2.936761] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.962237] systemd[1]: Reloading finished in 78 ms. client # [ 2.970237] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... client # [ 2.975149] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... client # [ 2.977766] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 2.979180] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 2.980241] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 2.981050] systemd-sysroot-fstab-check[144]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.984448] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 2.986356] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 2.987348] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.008631] systemd[1]: Reloading finished in 81 ms. worker2 # [ 2.989084] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 2.989846] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.017075] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker2 # [ 2.999165] systemd[1]: Reload requested from client PID 144 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.021158] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... worker2 # [ 3.000630] systemd[1]: Reloading... worker1 # [ 3.025608] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.026930] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.027971] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.001702] systemd[1]: Reloading finished in 83 ms. lb # [ 3.010207] systemd-sysroot-fstab-check[139]: Requesting initrd-fs.target/start/replace... lb # [ 3.014208] systemd-sysroot-fstab-check[139]: Requesting swap.target/start/replace... lb # [ 3.017706] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.019063] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.020111] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.065734] systemd[1]: Reloading finished in 66 ms. worker2 # [ 3.074289] systemd-sysroot-fstab-check[144]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.077125] systemd-sysroot-fstab-check[144]: Requesting swap.target/start/replace... worker2 # [ 3.078910] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.082480] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.085122] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.086243] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.096218] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.097885] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.608522] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.611160] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.615138] systemd[1]: Mounting /sysroot/run... client # [ 3.618125] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.624321] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.648400] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.628201] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.651798] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.634183] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.656637] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.667087] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.657566] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.670063] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.660807] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.641196] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.673389] systemd[1]: Mounting /sysroot/run... client # [ 3.663632] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.650889] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.676744] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.680089] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.649289] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.674379] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.675775] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.664320] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.710868] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.713588] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.714503] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.716184] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.716904] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.698745] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.719969] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.700368] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.702142] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.704683] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 3.730105] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.700873] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.731531] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.733603] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.703913] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.705938] systemd[1]: Mounted /sysroot/run. lb # [ 3.709824] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.711592] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.715953] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.725857] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.728686] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 3.753219] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 3.754268] systemd[1]: Reached target Initrd File Systems. worker1 # [ 3.755816] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.735538] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.736728] systemd[1]: Reached target Initrd Default Target. lb # [ 3.727382] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.758312] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.728988] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.738440] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.752659] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 3.774391] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.753986] systemd[1]: Stopped target Basic System. worker2 # [ 3.754948] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.757118] systemd[1]: Stopped target Path Units. worker2 # [ 3.757841] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.758863] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.759934] systemd[1]: Stopped target Slice Units. worker1 # [ 3.781781] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.760856] systemd[1]: Stopped target Socket Units. worker2 # [ 3.761542] systemd[1]: Stopped target System Initialization. worker1 # [ 3.783170] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.762323] systemd[1]: Stopped target Swaps. worker2 # [ 3.762963] systemd[1]: Stopped target Timer Units. worker1 # [ 3.784588] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.763624] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.765131] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.765962] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.766959] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.769154] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.770246] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.771526] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 3.772494] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.773819] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.774780] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 3.776107] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 3.798237] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 3.777253] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.799083] systemd[1]: Stopped target Basic System. worker1 # [ 3.799768] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 3.778516] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.800497] systemd[1]: Stopped target Path Units. worker1 # [ 3.801217] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 3.780217] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.802207] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.781291] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 3.803230] systemd[1]: Stopped target Slice Units. worker1 # [ 3.803970] systemd[1]: Stopped target Socket Units. worker2 # [ 3.783110] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.804918] systemd[1]: Stopped target System Initialization. worker2 # [ 3.784287] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.806092] systemd[1]: Stopped target Swaps. worker2 # [ 3.785097] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 3.806901] systemd[1]: Stopped target Timer Units. worker1 # [ 3.807832] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.787163] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 3.809126] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.788190] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 3.809945] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 3.811120] systemd[1]: Stopped Find NixOS closure. worker1 # [ 3.813096] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.814118] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 3.816024] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 3.816781] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.795905] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 3.817869] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 3.819416] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 3.820498] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.800080] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 3.821825] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 3.823106] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 3.824285] systemd[1]: Stopped target Local File Systems. worker1 # [ 3.826606] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.805575] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 3.827520] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 3.828504] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 3.829316] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.809187] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.830587] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.810295] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.832357] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.811382] systemd[1]: Closed udev Control Socket. worker2 # [ 3.813719] systemd[1]: Starting Cleanup udev Database... worker2 # [ 3.814688] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 3.815833] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.837901] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.817221] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 3.818394] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.820187] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 3.821131] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.843102] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 3.821971] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.843989] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 3.824143] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.847487] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 3.850987] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 3.852515] systemd[1]: Closed udev Control Socket. worker1 # [ 3.854232] systemd[1]: Starting Cleanup udev Database... worker1 # [ 3.855111] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 3.857190] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 3.858126] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 3.859940] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 3.860893] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 3.840351] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.861836] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 3.862702] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.841856] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.863675] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.844114] systemd[1]: Reached target Switch Root. worker2 # [ 3.845149] systemd[1]: Starting NixOS Activation... worker1 # [ 3.878265] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 3.879784] systemd[1]: Finished Cleanup udev Database. worker1 # [ 3.881137] systemd[1]: Reached target Switch Root. worker1 # [ 3.882848] systemd[1]: Starting NixOS Activation... worker2 # [ 3.922574] initrd-nixos-activation-start[191]: booting system configuration /nix/store/3x9dnnqnj54467v5gvfcy6bbd182ar8b-nixos-system-worker2-test worker1 # [ 3.947062] initrd-nixos-activation-start[190]: booting system configuration /nix/store/b5wjb92n6pk0dvawkzyxrvwqjkpdl5dh-nixos-system-worker1-test worker2 # [ 3.949995] initrd-nixos-activation-start[191]: running activation script... worker1 # [ 3.974106] initrd-nixos-activation-start[190]: running activation script... worker2 # [ 4.143814] initrd-nixos-activation-start[214]: setting up /etc... worker1 # [ 4.179580] initrd-nixos-activation-start[213]: setting up /etc... worker2 # [ 4.244826] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.247131] systemd[1]: Finished NixOS Activation. worker2 # [ 4.248891] systemd[1]: Starting Switch Root... worker1 # [ 4.282338] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 4.284076] systemd[1]: Finished NixOS Activation. worker2 # [ 4.264362] systemd[1]: Switching root. worker1 # [ 4.286123] systemd[1]: Starting Switch Root... worker1 # [ 4.300753] systemd[1]: Switching root. worker2 # [ 4.529049] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.561883] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.722594] NET: Registered PF_VSOCK protocol family worker1 # [ 4.743375] NET: Registered PF_VSOCK protocol family client # [ 4.609353] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.635345] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.636631] systemd[1]: Reached target Initrd File Systems. client # [ 4.638554] systemd[1]: Starting Find NixOS closure... client # [ 4.642145] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.627523] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.661125] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.664446] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.670538] systemd[1]: Finished Find NixOS closure. client # [ 4.672195] systemd[1]: Reached target Initrd Default Target. client # [ 4.674174] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.686967] systemd[1]: Stopped target Initrd Default Target. client # [ 4.688361] systemd[1]: Stopped target Basic System. client # [ 4.689325] systemd[1]: Stopped target Initrd Root Device. client # [ 4.691057] systemd[1]: Stopped target Path Units. client # [ 4.691739] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.692731] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.693920] systemd[1]: Stopped target Slice Units. client # [ 4.694683] systemd[1]: Stopped target Socket Units. client # [ 4.695495] systemd[1]: Stopped target System Initialization. client # [ 4.696503] systemd[1]: Stopped target Swaps. lb # [ 4.675263] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.697440] systemd[1]: Stopped target Timer Units. lb # [ 4.677373] systemd[1]: Reached target Initrd File Systems. client # [ 4.698405] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.699538] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.679238] systemd[1]: Starting Find NixOS closure... client # [ 4.700583] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.702143] systemd[1]: Stopped Find NixOS closure. lb # [ 4.681838] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.703477] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.704409] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.706315] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.707358] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.709132] systemd[1]: Stopped Load Kernel Modules. client # [ 4.709850] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.710985] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.712055] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.713039] systemd[1]: Stopped Create System Files and Directories. client # [ 4.715093] systemd[1]: Stopped target Local File Systems. client # [ 4.715813] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.716697] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.717645] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.718963] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 4.720062] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.700926] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.722492] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.704456] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.729888] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.710436] systemd[1]: Finished Find NixOS closure. lb # [ 4.712146] systemd[1]: Reached target Initrd Default Target. lb # [ 4.713276] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.734627] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 4.739103] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 4.741409] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 4.743221] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 4.745124] systemd[1]: Closed udev Control Socket. client # [ 4.746209] systemd[1]: Starting Cleanup udev Database... client # [ 4.747082] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 4.749154] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.728338] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.729551] systemd[1]: Stopped target Basic System. client # [ 4.750165] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.730491] systemd[1]: Stopped target Initrd Root Device. client # [ 4.751598] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.731562] systemd[1]: Stopped target Path Units. client # [ 4.753142] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.733110] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.754246] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.734131] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.735154] systemd[1]: Stopped target Slice Units. client # [ 4.755684] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.735978] systemd[1]: Stopped target Socket Units. client # [ 4.757120] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.736691] systemd[1]: Stopped target System Initialization. lb # [ 4.737607] systemd[1]: Stopped target Swaps. lb # [ 4.738565] systemd[1]: Stopped target Timer Units. lb # [ 4.739488] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.740700] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.741672] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.743134] systemd[1]: Stopped Find NixOS closure. lb # [ 4.744616] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.746131] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.747192] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.748203] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.750064] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.750778] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.772202] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.751804] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.773789] systemd[1]: Finished Cleanup udev Database. lb # [ 4.752943] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.753903] systemd[1]: Stopped Create System Files and Directories. client # [ 4.775241] systemd[1]: Reached target Switch Root. lb # [ 4.756098] systemd[1]: Stopped target Local File Systems. client # [ 4.776920] systemd[1]: Starting NixOS Activation... lb # [ 4.756874] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.757768] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.758683] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.761222] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.762263] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.763281] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.772220] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.776181] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.780163] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.782849] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.784930] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.786104] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.787413] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.788484] systemd[1]: Closed udev Control Socket. lb # [ 4.790464] systemd[1]: Starting Cleanup udev Database... lb # [ 4.791315] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.792407] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.794140] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.795230] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.796212] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.797164] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.811274] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.812868] systemd[1]: Finished Cleanup udev Database. lb # [ 4.814989] systemd[1]: Reached target Switch Root. lb # [ 4.816086] systemd[1]: Starting NixOS Activation... client # [ 4.846409] initrd-nixos-activation-start[190]: booting system configuration /nix/store/gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test client # [ 4.869150] initrd-nixos-activation-start[190]: running activation script... lb # [ 4.887713] initrd-nixos-activation-start[191]: booting system configuration /nix/store/qfr7fghmwm537hb3f4f5is3yb8phm6jx-nixos-system-lb-test lb # [ 4.914070] initrd-nixos-activation-start[191]: running activation script... worker1 # [ 5.103707] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.107615] systemd[1]: Detected virtualization kvm. worker1 # [ 5.108328] systemd[1]: Detected architecture x86-64. worker1 # [ 5.109120] systemd[1]: Detected first boot. worker1 # [ 5.111495] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.083002] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.092646] systemd[1]: Detected virtualization kvm. worker2 # [ 5.094396] systemd[1]: Detected architecture x86-64. worker2 # [ 5.096318] systemd[1]: Detected first boot. worker2 # [ 5.100302] systemd[1]: Initializing machine ID from random generator. client # [ 5.045781] initrd-nixos-activation-start[213]: setting up /etc... worker1 # [ 5.215200] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.117992] initrd-nixos-activation-start[214]: setting up /etc... client # [ 5.147734] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.149339] systemd[1]: Finished NixOS Activation. client # [ 5.151282] systemd[1]: Starting Switch Root... worker1 # [ 5.305858] systemd[1]: Applying preset policy. client # [ 5.163678] systemd[1]: Switching root. worker2 # [ 5.339256] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.229464] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.230768] systemd[1]: Finished NixOS Activation. lb # [ 5.232795] systemd[1]: Starting Switch Root... lb # [ 5.244993] systemd[1]: Switching root. client # [ 5.424012] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.482279] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 5.487339] systemd[1]: Applying preset policy. lb # [ 5.519412] systemd-journald[66]: Received SIGTERM from PID 1 (systemd). lb # [ 5.597739] NET: Registered PF_VSOCK protocol family client # [ 5.614249] NET: Registered PF_VSOCK protocol family worker2 # [ 5.661172] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 5.698523] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 5.700474] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.703361] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 5.705568] systemd[1]: Created slice Slice /system/getty. worker1 # [ 5.706931] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.707849] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.709096] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.710181] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 5.710860] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.711609] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 5.712430] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 5.713177] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 5.713946] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 5.714801] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 5.715704] systemd[1]: Reached target Path Units. worker1 # [ 5.716395] systemd[1]: Reached target Remote File Systems. worker1 # [ 5.717184] systemd[1]: Reached target Slice Units. worker1 # [ 5.717872] systemd[1]: Reached target Swaps. worker1 # [ 5.719810] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.722403] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 5.724272] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 5.726239] systemd[1]: Listening on Factory Reset Management. worker1 # [ 5.738543] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 5.741420] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 5.742770] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.745384] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 5.746805] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 5.747915] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.749208] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 5.753430] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 5.754468] systemd[1]: Listening on udev Control Socket. worker1 # [ 5.755350] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 5.757516] systemd[1]: Mounting Huge Pages File System... worker1 # [ 5.761612] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 5.769378] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 5.774597] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 5.782830] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 5.792415] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 5.795141] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.797935] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 5.799637] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.807939] systemd[1]: Mounting FUSE Control File System... worker1 # [ 5.815211] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 5.840904] systemd[1]: Starting Journal Service... worker1 # [ 5.847458] systemd[1]: Starting Load Kernel Modules... worker1 # [ 5.853782] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 5.864586] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 5.867161] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.872433] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 5.854981] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 5.876963] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 5.856382] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 5.879466] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.858874] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 5.881314] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.860919] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.862266] systemd[1]: Created slice User and Session Slice. worker1 # [ 5.884232] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 5.863181] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.864373] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 5.886153] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.865501] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 5.866226] systemd[1]: Expecting device /dev/ttyS0... worker1 # [ 5.887016] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.867008] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 5.867859] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.868616] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.869406] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 5.890810] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 5.870277] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.871193] systemd[1]: Reached target Path Units. worker2 # [ 5.871879] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.872652] systemd[1]: Reached target Slice Units. worker2 # [ 5.873376] systemd[1]: Reached target Swaps. worker2 # [ 5.875114] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 5.896620] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 5.877561] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.892318] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.894243] systemd[1]: Listening on Factory Reset Management. worker2 # [ 5.895178] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.897893] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.899253] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 5.919985] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 5.921611] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 5.901783] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 5.903293] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.904421] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 5.926230] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.905736] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.909594] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.910652] systemd[1]: Listening on udev Control Socket. worker2 # [ 5.911582] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 5.913723] systemd[1]: Mounting Huge Pages File System... worker2 # [ 5.917894] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.923350] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 5.949116] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 5.931413] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.939620] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 5.948126] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.950520] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 5.973105] EXT4-fs (vda): re-mounted a6ecff3c-92fe-436f-87f9-7ba7358fceec. worker2 # [ 5.952301] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 5.954358] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.958268] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 5.980287] systemd-journald[283]: Collecting audit messages is enabled. lb # [ 5.964077] systemd[1]: Detected virtualization kvm. worker1 # [ 5.983146] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 5.965878] systemd[1]: Detected architecture x86-64. lb # [ 5.967832] systemd[1]: Detected first boot. worker1 # [ 5.985382] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 5.987229] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 5.971832] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.969210] systemd[1]: Mounting FUSE Control File System... client # [ 5.974438] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.984013] systemd[1]: Detected virtualization kvm. worker1 # [ 5.995728] loop: module loaded client # [ 5.985755] systemd[1]: Detected architecture x86-64. worker1 # [ 5.997049] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.976094] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 5.987647] systemd[1]: Detected first boot. worker1 # [ 5.999094] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.991932] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.004018] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.009156] systemd[1]: Starting Firewall... worker1 # [ 6.012738] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 5.997584] systemd[1]: Starting Journal Service... worker2 # [ 6.002156] systemd[1]: Starting Load Kernel Modules... worker2 # [ 6.008325] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 6.014805] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.016563] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.022513] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 6.045812] systemd[1]: Started Journal Service. worker2 # [ 6.027174] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 5.912831] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 6.030510] systemd[1]: Mounted Huge Pages File System. worker1 # [ 5.917576] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 6.031413] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.033967] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 5.926078] systemd-modules-load[284]: Inserted module 'loop' worker2 # [ 6.038771] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 6.044037] systemd[1]: Mounted FUSE Control File System. worker1 # [ 5.933175] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 5.934382] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.052956] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 6.057560] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 5.952760] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 5.970063] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 5.973082] systemd[1]: Reached target First Boot Complete. worker2 # [ 6.086922] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 6.089740] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 6.094153] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 5.994511] systemd-oomd[285]: No swap; memory pressure usage will be degraded worker1 # [ 6.000930] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 6.116202] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 6.117121] EXT4-fs (vda): re-mounted 617606b7-6b13-41d5-879e-78f08e71f5dc. worker1 # [ 6.143255] systemd-journald[283]: Received client request to flush runtime journal. worker2 # [ 6.127051] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 6.128781] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 6.131089] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 6.138561] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 6.139386] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.145803] systemd-journald[284]: Collecting audit messages is enabled. worker2 # [ 6.159658] loop: module loaded worker2 # [ 6.168357] systemd[1]: Finished Load Kernel Modules. worker2 # [ 6.171563] systemd[1]: Starting Firewall... worker2 # [ 6.177556] systemd[1]: Starting Apply Kernel Variables... lb # [ 6.210358] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.209398] systemd[1]: Started Journal Service. worker1 # [ 6.097438] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.078298] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 6.100526] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 6.081238] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 6.086199] systemd-modules-load[285]: Inserted module 'loop' client # [ 6.233912] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.113087] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.093515] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 6.115824] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 6.095403] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.121081] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.104063] systemd[1]: Reached target First Boot Complete. worker2 # [ 6.105066] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 6.113133] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 6.148466] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker2 # [ 6.157968] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 6.300647] systemd[1]: Applying preset policy. worker2 # [ 6.166519] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.303641] systemd-journald[284]: Received client request to flush runtime journal. worker1 # [ 6.200487] systemd-udevd[318]: Using default interface naming scheme 'v261'. client # [ 6.335170] systemd[1]: Applying preset policy. worker1 # [ 6.275166] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.312411] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 6.295224] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.297547] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 6.299120] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.300608] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 6.472898] systemd[1]: Populated /etc with preset unit settings. client # [ 6.498159] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.355683] systemd-udevd[316]: Using default interface naming scheme 'v261'. worker1 # [ 6.410807] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.426534] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 6.496368] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 6.492328] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 6.525272] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.547977] (udev-worker)[356]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.667316] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.668691] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.670821] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.678528] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.672775] systemd[1]: Created slice Slice /system/getty. client # [ 6.679875] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.674049] systemd[1]: Created slice User and Session Slice. lb # [ 6.675001] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 6.682248] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.676200] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.677337] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.678039] systemd[1]: Expecting device /dev/ttyS0... client # [ 6.684300] systemd[1]: Created slice Slice /system/getty. lb # [ 6.678775] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.685707] systemd[1]: Created slice User and Session Slice. lb # [ 6.679587] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.561330] (udev-worker)[359]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 6.680401] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.686660] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.681188] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 6.563893] (udev-worker)[359]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.687935] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.682102] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.689007] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.683029] systemd[1]: Reached target Path Units. client # [ 6.689695] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.683723] systemd[1]: Reached target Remote File Systems. client # [ 6.690430] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.684528] systemd[1]: Reached target Slice Units. client # [ 6.691256] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.685242] systemd[1]: Reached target Swaps. client # [ 6.692014] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.568867] systemd[1]: Mounting /run/wrappers... client # [ 6.692780] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 6.687033] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.693610] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.694502] systemd[1]: Reached target Path Units. client # [ 6.695201] systemd[1]: Reached target Remote File Systems. client # [ 6.696013] systemd[1]: Reached target Slice Units. lb # [ 6.689695] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.696701] systemd[1]: Reached target Swaps. lb # [ 6.691507] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 6.698413] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.700716] systemd[1]: Listening on Process Core Dump Socket. lb # [ 6.693402] systemd[1]: Listening on Factory Reset Management. lb # [ 6.705944] systemd[1]: Listening on Hostname Service Socket. client # [ 6.702372] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.708800] systemd[1]: Starting Journal Log Access Socket... client # [ 6.715534] systemd[1]: Listening on Factory Reset Management. client # [ 6.716442] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.710175] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.712847] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.719246] systemd[1]: Starting Journal Log Access Socket... lb # [ 6.714011] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.720633] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.715175] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.716521] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 6.723301] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.724726] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.725879] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.720479] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.727178] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.721531] systemd[1]: Listening on udev Control Socket. lb # [ 6.722425] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.724567] systemd[1]: Mounting Huge Pages File System... client # [ 6.730905] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.732120] systemd[1]: Listening on udev Control Socket. client # [ 6.733028] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.726907] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.735133] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.612528] systemd[1]: Mounted /run/wrappers. worker2 # [ 6.591557] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.737367] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.614289] systemd[1]: Reached target Local File Systems. lb # [ 6.732674] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 6.618137] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 6.744992] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 6.621107] systemd[1]: Starting register-nix-paths.service... lb # [ 6.740459] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 6.625198] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 6.628262] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 6.752846] systemd[1]: Mounting Kernel Trace File System... lb # [ 6.749309] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.633529] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 6.761961] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.639928] systemd[1]: Starting Create System Files and Directories... lb # [ 6.762159] systemd[1]: Starting Load Kernel Module configfs... client # [ 6.773168] systemd[1]: Starting Load Kernel Module configfs... lb # [ 6.771228] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 6.783521] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.781613] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.791962] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 6.787218] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.801086] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.797871] systemd[1]: Mounting FUSE Control File System... worker2 # [ 6.664691] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 6.802360] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.813730] systemd[1]: Mounting FUSE Control File System... client # [ 6.821448] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 6.817491] systemd[1]: Starting Journal Service... lb # [ 6.820439] systemd[1]: Starting Load Kernel Modules... client # [ 6.829652] systemd[1]: Starting Journal Service... lb # [ 6.829787] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.837232] systemd[1]: Starting Load Kernel Modules... lb # [ 6.836700] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.848620] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.842376] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.730187] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 6.711559] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.733261] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.858970] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 6.852861] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.863586] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.862097] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 6.726067] systemd[1]: Mounting /run/wrappers... lb # [ 6.869519] systemd[1]: Mounted Huge Pages File System. client # [ 6.877895] systemd[1]: Starting Coldplug All udev Devices... lb # [ 6.872683] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.874195] systemd-journald[284]: Collecting audit messages is enabled. lb # [ 6.876667] systemd[1]: Mounted Kernel Debug File System. client # [ 6.886719] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.881996] systemd[1]: Mounted Kernel Trace File System. client # [ 6.893007] systemd[1]: Mounted Huge Pages File System. lb # [ 6.887208] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 6.748443] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.896618] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.891736] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 6.899150] systemd[1]: Mounted Kernel Debug File System. client # [ 6.903124] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.897969] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 6.758678] (udev-worker)[358]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 6.760867] (udev-worker)[358]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.784461] systemd[1]: Finished Create System Files and Directories. worker1 # [ 6.790113] systemd[1]: Starting Rebuild Journal Catalog... client # [ 6.914042] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.792988] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 6.772594] systemd[1]: Mounted /run/wrappers. worker2 # [ 6.775136] systemd[1]: Reached target Local File Systems. client # [ 6.920705] systemd-journald[283]: Collecting audit messages is enabled. worker2 # [ 6.775903] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 6.915144] loop: module loaded lb # [ 6.916075] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.923272] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 6.778753] systemd[1]: Starting register-nix-paths.service... lb # [ 6.770850] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 6.781450] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.927966] EXT4-fs (vda): re-mounted 88b9297a-0752-4a49-bb7a-2b420a5d11a9. lb # [ 6.773770] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 6.930228] loop: module loaded worker2 # [ 6.785329] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 6.924751] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.931523] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 6.787116] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 6.777878] systemd-modules-load[285]: Inserted module 'loop' lb # [ 6.927658] systemd[1]: Started Journal Service. worker2 # [ 6.791259] systemd[1]: Starting Create System Files and Directories... client # [ 6.945109] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.790785] systemd[1]: Finished Load Kernel Modules. client # [ 6.951881] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.819671] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.822321] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 6.823837] systemd-modules-load[284]: Inserted module 'loop' client # [ 6.958569] systemd[1]: Started Journal Service. client # [ 6.832459] systemd[1]: Mounted FUSE Control File System. client # [ 6.836288] systemd[1]: Finished Load Kernel Modules. lb # [ 6.966345] EXT4-fs (vda): re-mounted 11545468-e34f-4655-b646-834c34ea92d8. client # [ 6.841297] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 6.821026] systemd[1]: Mounted FUSE Control File System. lb # [ 6.830228] systemd[1]: Starting Firewall... client # [ 6.851521] systemd-oomd[285]: No swap; memory pressure usage will be degraded lb # [ 6.834959] systemd-oomd[286]: No swap; memory pressure usage will be degraded worker1 # [ 6.869511] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 6.839134] systemd[1]: Starting Apply Kernel Variables... client # [ 6.860996] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.865073] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.867190] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.847943] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 6.848835] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.869963] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.855334] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.876264] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 6.868339] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 6.881434] systemd[1]: Starting Apply Kernel Variables... client # [ 6.883587] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.872797] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 6.864871] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 6.865815] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.870134] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 6.871165] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.911897] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 6.913772] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 6.915659] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.918110] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.921281] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 6.924094] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.925817] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.940661] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 6.942990] systemd[1]: Starting Update is Completed... client # [ 7.071434] systemd-journald[283]: Received client request to flush runtime journal. worker2 # [ 6.929080] systemd[1]: Finished Create System Files and Directories. worker2 # [ 6.934337] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 6.936976] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.931545] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.086897] systemd-journald[284]: Received client request to flush runtime journal. worker1 # [ 7.011622] systemd[1]: Finished Update is Completed. worker2 # [ 7.014369] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 7.034989] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.037264] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.039385] systemd[1]: Reached target First Boot Complete. client # [ 7.040314] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.042297] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 7.043454] systemd[1]: Finished Apply Kernel Variables. client # [ 7.046473] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 7.041314] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 7.042411] systemd[1]: Reached target First Boot Complete. lb # [ 7.045170] systemd[1]: Finished Apply Kernel Variables. lb # [ 7.045985] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 7.047351] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 7.051356] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 7.075774] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 7.078789] systemd[1]: Starting Update is Completed... client # [ 7.115528] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.121480] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.122623] systemd[1]: Reached target Preparation for Local File Systems. client # [ 7.125167] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.147347] systemd[1]: Finished Firewall. lb # [ 7.129604] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.156437] systemd-udevd[316]: Using default interface naming scheme 'v261'. lb # [ 7.139458] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 7.141296] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 7.143568] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.172748] systemd[1]: Finished Update is Completed. client # [ 7.188276] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 7.336617] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.186687] systemd-udevd[323]: Using default interface naming scheme 'v261'. worker1 # [ 7.354138] ACPI: button: Power Button [PWRF] worker2 # [ 7.199744] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.200879] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.202740] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.204874] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.208534] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.210415] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.212129] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.384131] mousedev: PS/2 mouse device common for all mice worker1 # [ 7.391397] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 7.236190] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 7.270100] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 7.272409] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.269971] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.410014] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.424699] parport_pc 00:02: reported by Plug and Play ACPI worker1 # [ 7.428634] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.285108] systemd[1]: Finished Firewall. client # [ 7.312071] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 7.444941] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.454963] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 client # [ 7.334334] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 7.352954] (udev-worker)[324]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 7.355149] (udev-worker)[324]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.357105] (udev-worker)[325]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.350477] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.426943] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 7.428168] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.429680] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.419432] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.420740] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.431932] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.433737] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.434995] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.423197] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.444718] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.436268] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T14:50:38 UTC (1790088638) worker1 # [ 7.436345] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.437447] systemd-journald[283]: Time jumped backwards, rotating. worker1 # [ 7.439092] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 7.457816] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 7.631449] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 7.478692] (udev-worker)[347]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.639859] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 lb # [ 7.489310] (udev-worker)[354]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.491752] (udev-worker)[354]: Network interface NamePolicy= disabled on kernel command line. client # [ 7.647631] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 worker1 # [ 7.519879] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 7.609600] Console: switching to colour dummy device 80x25 worker1 # [ 7.613970] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 7.614108] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 7.523787] systemd[1]: Mounting /run/wrappers... client # [ 7.548261] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.680846] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker1 # [ 7.681126] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 7.494942] ACPI: button: Power Button [PWRF] worker2 # [ 7.579313] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.591571] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.607835] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 7.560089] systemd[1]: Mounted /run/wrappers. lb # [ 7.560791] systemd[1]: Reached target Local File Systems. worker1 # [ 7.591943] systemd[1]: Finished register-nix-paths.service. worker1 # [ 7.592965] systemd[1]: Reached target System Initialization. worker1 # [ 7.595318] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 7.565723] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 7.587282] systemd[1]: Mounted /run/wrappers. worker1 # [ 7.597350] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 7.588282] systemd[1]: Reached target Local File Systems. worker1 # [ 7.598291] systemd[1]: Reached target Timer Units. worker1 # [ 7.599232] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 7.569730] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.601194] systemd[1]: Listening on Nix Daemon Socket. lb # [ 7.572158] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 7.593389] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.603589] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 7.573284] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.604465] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 7.605644] systemd[1]: Reached target Socket Units. client # [ 7.595866] systemd[1]: Starting register-nix-paths.service... worker2 # [ 7.607903] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T14:50:39 UTC (1790088639) worker2 # [ 7.607976] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.607090] systemd[1]: Reached target Basic System. worker2 # [ 7.667069] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 client # [ 7.597930] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 7.598725] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.609125] systemd[1]: Started backdoor.service. worker1 # [ 7.611314] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 7.601973] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.617063] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 7.588307] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 7.609211] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.620259] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.623898] systemd[1]: Started Reset console on configuration changes. lb # [ 7.597432] systemd[1]: Starting Create System Files and Directories... worker1 # [ 7.632876] systemd[1]: Starting resolvconf update... worker2 # [ 7.684823] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.684908] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.642536] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 7.688929] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 7.695117] Console: switching to colour dummy device 80x25 worker2 # [ 7.777807] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.777813] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.809834] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 7.809837] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker1 # [ 7.678653] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.798694] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 7.799399] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 7.824557] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.825256] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 7.846934] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.716649] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.729105] systemd[1]: Finished Post-Boot Actions. client # [ 7.725121] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 7.708296] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 7.715065] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.725173] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.726275] systemd[1]: Reached target System Initialization. lb # [ 7.717960] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.727626] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 7.739509] systemd[1]: Finished Create System Files and Directories. worker2 # [ 7.730800] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.732277] systemd[1]: Reached target Timer Units. client # [ 7.745227] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 7.734131] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.665658] ACPI: button: Power Button [PWRF] client # [ 7.667628] mousedev: PS/2 mouse device common for all mice client # [ 7.725632] rtc_cmos PNP0B00:00: RTC can wake from S4 worker2 # [ 7.736450] systemd[1]: Listening on Nix Daemon Socket. worker1 # connecting to host... client # [ 7.750382] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.739115] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 7.761205] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 7.732349] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.763315] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.733312] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.765748] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 7.744251] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.745402] systemd[1]: Reached target Socket Units. worker2 # [ 7.746161] systemd[1]: Reached target Basic System. worker2 # [ 7.746891] systemd[1]: Started backdoor.service. lb # [ 7.738477] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.740223] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.751183] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 7.771759] nsncd[514]: Sep 22 14:50:38.966 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 7.752167] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 7.754131] systemd[1]: Starting Post-Boot Actions... worker1 # [ 7.775433] systemd[1]: Starting User Login Management... lb # [ 7.746582] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 7.756933] systemd[1]: Started Reset console on configuration changes. lb # [ 7.747421] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.748851] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.914057] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 7.750102] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.760915] systemd[1]: Starting resolvconf update... lb # [ 7.755633] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.770577] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.749923] rtc_cmos PNP0B00:00: registered as rtc0 client # [ 7.749990] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T14:50:38 UTC (1790088638) client # [ 7.750061] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 7.804136] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 7.809690] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 7.828695] dbus-broker-launch[518]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.841078] dbus-broker-launch[518]: NSS returned no entry for 'systemd-timesync' client # [ 7.833585] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.843120] dbus-broker-launch[518]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 7.838460] systemd[1]: Starting Update is Completed... worker1 # [ 7.860255] systemd[1]: Started D-Bus System Message Bus. client # [ 7.751071] systemd-journald[283]: Time jumped backwards, rotating. client # [ 7.756088] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.844693] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.860164] systemd[1]: Finished Post-Boot Actions. worker2 # connecting to host... client # [ 7.802630] parport_pc 00:02: reported by Plug and Play ACPI client # [ 7.802722] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] client # [ 7.880774] Console: switching to colour dummy device 80x25 client # [ 7.886248] systemd[1]: Finished Update is Completed. worker1 # [ 7.897278] dbus-broker-launch[518]: Ready client # [ 8.028107] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.883271] systemd[1]: Starting Virtual Console Setup... client # [ 8.028889] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.038037] [drm] Found bochs VGA, ID 0xb0c5. client # [ 8.038450] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.886123] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.919321] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 7.921570] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.901681] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 7.902571] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 7.893431] systemd[1]: Starting Update is Completed... worker2 # [ 7.903479] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 7.926183] systemd[1]: Starting Virtual Console Setup... worker2 # [ 7.907579] systemd[1]: Starting User Login Management... worker2 # [ 7.908619] nsncd[513]: Sep 22 14:50:39.933 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.076384] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 7.954263] systemd-logind[539]: Watching system buttons on /dev/input/event2 (Power Button) worker1 # [ 7.958145] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 7.962158] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 7.942578] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 8.092001] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.965101] systemd-logind[539]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 7.971215] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 7.973483] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.097511] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 lb # [ 7.944157] systemd[1]: Finished Update is Completed. worker2 # [ 7.953695] dbus-broker-launch[517]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.975167] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.100073] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker1 # [ 7.979114] systemd-logind[539]: New seat seat0. worker1 # [ 7.979815] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 7.982072] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 7.982916] systemd[1]: Started User Login Management. worker1 # [ 7.985233] systemd[1]: Starting linger-users.service... lb # [ 8.105821] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker1 # [ 7.989041] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.109740] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 worker2 # [ 7.996568] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 7.997804] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 8.069909] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.145971] Console: switching to colour frame buffer device 160x50 worker2 # [ 8.230291] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.960582] dbus-broker-launch[517]: NSS returned no entry for 'systemd-timesync' worker2 # [ 8.100797] dbus-broker-launch[517]: Invalid user-name in /nix/store/qip1v2bp3gxd2mgy76zm58p8c4nw43qv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 8.109459] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 8.116170] dbus-broker-launch[517]: Ready worker2 # [ 8.119742] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 8.124290] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.135818] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.125170] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 8.126973] systemd[1]: Stopping User and Group Name Lookups... client # [ 8.138928] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.128108] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.246707] Console: switching to colour frame buffer device 160x50 worker2 # [ 8.128952] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.274768] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 8.133249] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 8.134102] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.135219] systemd-logind[540]: New seat seat0. client # [ 8.147068] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.139604] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.140719] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.141420] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.142209] systemd[1]: Started User Login Management. worker2 # [ 8.142937] systemd-logind[540]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 8.144167] systemd-logind[540]: Watching system buttons on /dev/input/event2 (Power Button) worker2 # [ 8.148228] systemd[1]: Starting linger-users.service... worker1 # [ 8.215885] ppdev: user-space parallel port driver worker2 # [ 8.153209] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 8.262983] Console: switching to colour frame buffer device 160x50 worker2 # [ 8.155106] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.156356] nsncd[588]: Sep 22 14:50:40.180 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.159275] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.171186] systemd[1]: Finished resolvconf update. worker2 # [ 8.171950] systemd[1]: Reached target Preparation for Network. worker2 # [ 8.178076] systemd[1]: Starting DHCP Client... worker2 # [ 8.181205] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.187094] systemd[1]: Starting Extra networking commands.... lb # [ 8.123821] ACPI: button: Power Button [PWRF] lb # [ 8.183575] mousedev: PS/2 mouse device common for all mice worker1 # [ 8.333656] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 8.365866] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device client # [ 8.357269] ppdev: user-space parallel port driver worker2 # [ 8.211763] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 8.212782] systemd[1]: Finished linger-users.service. worker1 # [ 8.369164] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 8.039821] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 8.237384] nsncd[592]: Sep 22 14:50:39.241 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 8.241164] systemd[1]: Finished linger-users.service. worker1 # [ 8.243268] network-addresses-eth1-start[619]: adding address 192.168.1.3/24... done worker1 # [ 8.244285] network-addresses-eth1-start[619]: adding address 2001:db8:1::3/64... done worker1 # [ 8.245745] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.189191] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 8.229469] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 8.229538] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T14:50:38 UTC (1790088638) worker1 # [ 8.249782] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.254932] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.261063] systemd-logind[539]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 8.262264] systemd[1]: Finished resolvconf update. client # [ 8.252692] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 8.262959] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.263757] systemd[1]: Starting DHCP Client... client # [ 8.255936] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 8.265726] systemd[1]: Starting Address configuration of eth1... worker1 # [ 8.266856] systemd[1]: Starting Extra networking commands.... worker1 # [ 8.268956] systemd[1]: Finished Address configuration of eth1. client # [ 8.394755] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.421864] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.229629] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 8.230549] systemd-journald[284]: Time jumped backwards, rotating. worker1 # [ 8.305399] systemd[1]: Finished Extra networking commands.. worker1 # [ 8.306974] systemd[1]: Reached target Network. worker1 # [ 8.309637] systemd[1]: Starting Permit User Sessions... client # [ 8.302480] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 8.305055] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.320132] dhcpcd[628]: dhcpcd-10.3.2 starting client # [ 8.313890] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.328213] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.330995] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.333584] systemd[1]: Starting Virtual Console Setup... lb # [ 8.255425] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.255512] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 8.338768] dhcpcd[688]: dev: loaded udev lb # [ 8.310902] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.316460] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 8.491586] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 8.493208] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.343454] network-addresses-eth1-start[616]: adding address 192.168.1.4/24... done lb # [ 8.310111] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 8.323033] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 lb # [ 8.330418] Console: switching to colour dummy device 80x25 worker1 # [ 8.379255] systemd[1]: Finished Permit User Sessions. worker1 # [ 8.381438] systemd[1]: Started Getty on tty1. worker1 # [ 8.382556] systemd[1]: Reached target Login Prompts. worker2 # [ 8.361851] network-addresses-eth1-start[616]: adding address 2001:db8:1::4/64... done lb # [ 8.521127] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 8.386332] systemd[1]: Finished Address configuration of eth1. lb # [ 8.521240] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 8.537212] kvm_amd: TSC scaling supported client # [ 8.537655] kvm_amd: Nested Virtualization enabled client # [ 8.538730] kvm_amd: Nested Paging enabled client # [ 8.539321] kvm_amd: LBR virtualization supported client # [ 8.539978] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 8.540441] kvm_amd: Virtual GIF supported client # [ 8.541377] kvm_amd: Virtual NMI enabled lb # [ 8.393715] systemd[1]: Finished register-nix-paths.service. lb # [ 8.394889] systemd[1]: Reached target System Initialization. lb # [ 8.397758] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.398696] systemd[1]: Started niks3 garbage collection timer. lb # [ 8.399852] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 8.402171] systemd[1]: Reached target Timer Units. lb # [ 8.402923] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 8.440056] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.410837] systemd[1]: Listening on niks3 server socket. lb # [ 8.411615] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.412414] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.413601] systemd[1]: Reached target Socket Units. lb # [ 8.414404] systemd[1]: Reached target Basic System. lb # [ 8.416058] systemd[1]: Started backdoor.service. lb # [ 8.568568] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.569030] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.422141] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 8.430356] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.585649] EDAC MC: Ver: 3.0.0 worker2 # [ 8.444600] systemd-logind[540]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 8.580804] ppdev: user-space parallel port driver lb # [ 8.441143] systemd[1]: Starting Post-Boot Actions... lb # [ 8.598128] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.465076] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.634739] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.622847] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 worker2 # [ 8.483485] systemd-vconsole-setup[599]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.479571] systemd[1]: Starting resolvconf update... lb # [ 8.629095] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 8.491393] systemd[1]: Finished Virtual Console Setup. worker1 # [ 8.648229] kvm_amd: TSC scaling supported worker1 # [ 8.648655] kvm_amd: Nested Virtualization enabled worker1 # [ 8.649454] kvm_amd: Nested Paging enabled worker1 # [ 8.649908] kvm_amd: LBR virtualization supported worker1 # [ 8.650641] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.651635] kvm_amd: Virtual GIF supported worker1 # [ 8.652255] kvm_amd: Virtual NMI enabled worker2 # [ 8.503388] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.504246] systemd[1]: Reached target Network. lb # [ 8.645309] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker2 # [ 8.506689] systemd[1]: Starting Permit User Sessions... lb # [ 8.499763] systemd[1]: Started rustfs.service. worker2 # [ 8.510244] dhcpcd[627]: dhcpcd-10.3.2 starting worker1 # [ 8.670130] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 8.670893] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 8.672680] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 8.673500] cfg80211: failed to load regulatory.db worker2 # [ 8.519218] dhcpcd[687]: dev: loaded udev lb # [ 8.524138] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 8.672004] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 8.672569] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 8.530671] systemd[1]: Finished Firewall. worker1 # [ 8.698279] EDAC MC: Ver: 3.0.0 worker2 # [ 8.548866] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.551743] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.553275] systemd[1]: Stopping Virtual Console Setup... lb # connecting to host... worker2 # [ 8.555088] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.714253] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 8.581348] dhcpcd[688]: eth0: waiting for carrier worker1 # [ 8.582321] dhcpcd[688]: eth0: carrier acquired worker1 # [ 8.587555] dhcpcd[688]: DUID 00:01:00:01:32:45:52:3f:52:54:00:12:34:56 worker1 # [ 8.588534] dhcpcd[688]: eth0: IAID 00:12:34:56 worker1 # [ 8.589597] dhcpcd[688]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 8.579823] systemd[1]: Finished register-nix-paths.service. lb # [ 8.560528] nsncd[517]: Sep 22 14:50:38.978 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.571046] systemd[1]: Finished Post-Boot Actions. lb # [ 8.571790] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.596182] systemd-vconsole-setup[420]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 8.599063] systemd[1]: Finished Virtual Console Setup. client # [ 8.600743] systemd[1]: Reached target System Initialization. client # [ 8.602127] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.603445] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 8.593072] systemd[1]: Finished Permit User Sessions. client # [ 8.604702] systemd[1]: Reached target Timer Units. client # [ 8.606162] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.607202] systemd[1]: Listening on Nix Daemon Socket. client # [ 8.607975] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 8.609715] systemd[1]: Reached target Socket Units. client # [ 8.610475] systemd[1]: Reached target Basic System. client # [ 8.611849] systemd[1]: Started backdoor.service. worker2 # [ 8.601270] systemd[1]: Started Getty on tty1. worker2 # [ 8.603363] systemd[1]: Reached target Login Prompts. client # [ 8.615454] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.619594] systemd[1]: Starting nftables firewall... client # [ 8.627637] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.610592] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 8.641081] systemd-vconsole-setup[690]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.613098] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.643958] systemd[1]: Finished Virtual Console Setup. worker2 # [ 8.757959] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.637774] systemd[1]: Starting Post-Boot Actions... lb # [ 8.622355] systemd[1]: Starting D-Bus System Message Bus... client # [ 8.648428] systemd[1]: Started Reset console on configuration changes. lb # [ 8.636429] systemd[1]: Starting User Login Management... worker2 # [ 8.783491] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 8.661197] systemd[1]: Starting resolvconf update... lb # [ 8.655354] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.672542] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 8.670911] systemd[1]: Finished Import lastlog data into lastlog2 database. client # connecting to host... client # [ 8.701375] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 8.832082] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 8.709220] nsncd[428]: Sep 22 14:50:39.591 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.711200] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.722045] systemd[1]: Finished Post-Boot Actions. client # [ 8.728424] systemd[1]: Reached target Host and Network Name Lookups. client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 8.736435] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.750129] systemd[1]: Starting User Login Management... client # [ 8.754182] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 8.891872] kvm_amd: TSC scaling supported worker2 # [ 8.892299] kvm_amd: Nested Virtualization enabled lb # [ 8.752993] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 8.893050] kvm_amd: Nested Paging enabled lb # [ 8.758713] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.893622] kvm_amd: LBR virtualization supported client: connected to guest root shell worker2 # [ 8.894065] kvm_amd: Virtual VMLOAD VMSAVE supported client: (connecting took 9.46 seconds) worker2 # [ 8.894763] kvm_amd: Virtual GIF supported client: (finished: waiting for the VM to finish booting, in 9.46 seconds) worker2 # [ 8.895170] kvm_amd: Virtual NMI enabled lb # [ 8.770069] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.904660] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.905329] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.908094] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.909047] cfg80211: failed to load regulatory.db worker2 # [ 8.944996] EDAC MC: Ver: 3.0.0 worker2 # [ 8.957895] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 8.824590] dhcpcd[687]: eth0: waiting for carrier worker2 # [ 8.825659] dhcpcd[687]: eth0: carrier acquired worker2 # [ 8.831071] dhcpcd[687]: DUID 00:01:00:01:32:45:52:40:52:54:00:12:34:56 client # [ 8.842726] dbus-broker-launch[439]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 8.832291] dhcpcd[687]: eth0: IAID 00:12:34:56 worker2 # [ 8.833487] dhcpcd[687]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 8.851861] dbus-broker-launch[439]: NSS returned no entry for 'systemd-timesync' client # [ 8.852930] dbus-broker-launch[439]: Invalid user-name in /nix/store/c4mprcfibsx637q0hk2g869f3wvd2k8k-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 8.869368] systemd-logind[457]: New seat seat0. lb # [ 8.851452] dbus-broker-launch[551]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.873923] systemd-logind[457]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.876943] systemd-logind[457]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 8.857137] dbus-broker-launch[551]: NSS returned no entry for 'systemd-timesync' client # [ 8.878164] systemd-logind[457]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) client # [ 8.880322] systemd[1]: Started User Login Management. lb # [ 8.858309] dbus-broker-launch[551]: Invalid user-name in /nix/store/xhp17752g31xx87ahxdgrix2v9kism59-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 8.888177] systemd[1]: Starting linger-users.service... worker2 # [ 8.880754] systemd-vconsole-setup[690]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 8.883215] systemd[1]: Finished Virtual Console Setup. lb # [ 8.875477] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.876689] systemd[1]: Stopping Host and Network Name Lookups... client # [ 8.913193] systemd[1]: Started D-Bus System Message Bus. client # [ 8.933480] dbus-broker-launch[439]: Ready lb # [ 8.979191] Console: switching to colour frame buffer device 160x50 lb # [ 9.065638] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 8.879137] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 8.919812] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.921039] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 8.927689] systemd-logind[552]: Watching system buttons on /dev/input/event2 (Power Button) client # [ 8.954695] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.934459] systemd[1]: nscd.service: Deactivated successfully. lb # [ 8.935470] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 8.936433] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.957727] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 8.937437] systemd-logind[552]: New seat seat0. client # [ 8.958596] systemd[1]: Stopped target User and Group Name Lookups. client # [ 8.960549] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.940204] systemd[1]: Started D-Bus System Message Bus. lb # [ 8.942218] systemd[1]: Started User Login Management. client # [ 8.963120] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 8.967040] systemd[1]: nscd.service: Deactivated successfully. client # [ 8.969687] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 8.952268] systemd[1]: Starting linger-users.service... client # [ 8.980130] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.983124] systemd[1]: Finished linger-users.service. client # [ 8.996206] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.983694] systemd-logind[552]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 8.987408] dbus-broker-launch[551]: Ready lb # [ 9.151238] ppdev: user-space parallel port driver client # [ 9.029488] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 9.030673] nsncd[525]: Sep 22 14:50:39.914 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 9.034153] systemd[1]: Finished resolvconf update. client # [ 9.036142] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.037273] systemd[1]: Reached target User and Group Name Lookups. client # [ 9.040840] systemd[1]: Starting DHCP Client... lb # [ 9.026398] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.027639] nsncd[607]: Sep 22 14:50:39.445 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.031229] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.033354] systemd[1]: Reached target User and Group Name Lookups. lb # [ 9.041400] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.045381] systemd[1]: Finished linger-users.service. lb # [ 9.082422] systemd[1]: Finished resolvconf update. lb # [ 9.086085] systemd[1]: Reached target Preparation for Network. lb # [ 9.093774] systemd[1]: Starting DHCP Client... lb # [ 9.101306] systemd[1]: Starting Address configuration of eth1... lb # [ 9.255605] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 9.111341] systemd[1]: Starting Extra networking commands.... client # [ 9.132883] dhcpcd[554]: dhcpcd-10.3.2 starting client # [ 9.138141] dhcpcd[562]: dev: loaded udev client # [ 9.280571] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.125303] systemd-logind[552]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 9.177179] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.333625] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 9.352572] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 9.368456] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 9.369195] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 9.372863] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 9.373700] cfg80211: failed to load regulatory.db lb # [ 9.218869] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 9.223215] systemd[1]: Stopped Virtual Console Setup. client # [ 9.274192] systemd[1]: Finished nftables firewall. client # [ 9.276910] systemd[1]: Reached target Preparation for Network. client # [ 9.279921] systemd[1]: Starting Address configuration of eth1... client # [ 9.417090] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 9.284665] systemd[1]: Starting Extra networking commands.... client # [ 9.286355] dhcpcd[562]: eth0: waiting for carrier client # [ 9.287095] dhcpcd[562]: eth0: carrier acquired client # [ 9.295792] dhcpcd[562]: DUID 00:01:00:01:32:45:52:40:52:54:00:12:34:56 client # [ 9.297509] dhcpcd[562]: eth0: IAID 00:12:34:56 client # [ 9.298720] dhcpcd[562]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.278071] systemd[1]: Starting Virtual Console Setup... lb # [ 9.288926] network-addresses-eth1-start[644]: adding address 192.168.1.2/24... done client # [ 9.464949] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 9.340942] network-addresses-eth1-start[584]: adding address 192.168.1.1/24... done lb # [ 9.320274] network-addresses-eth1-start[644]: adding address 2001:db8:1::2/64... done client # [ 9.350749] network-addresses-eth1-start[584]: adding address 2001:db8:1::1/64... done client # [ 9.363050] systemd[1]: Finished Address configuration of eth1. client # [ 9.383790] systemd[1]: Finished Extra networking commands.. client # [ 9.385190] systemd[1]: Reached target Network. client # [ 9.387814] systemd[1]: Starting Permit User Sessions... lb # [ 9.370140] systemd[1]: Finished Address configuration of eth1. client # [ 9.402645] systemd[1]: Finished Permit User Sessions. client # [ 9.405849] systemd[1]: Started Getty on tty1. client # [ 9.406965] systemd[1]: Reached target Login Prompts. client # [ 9.417736] dhcpcd[562]: eth0: soliciting a DHCP lease client # [ 9.559271] NET: Registered PF_PACKET protocol family client # [ 9.429493] dhcpcd[562]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 9.431219] dhcpcd[562]: eth0: probing address 10.0.2.15/24 lb # [ 9.458516] dhcpcd[653]: dhcpcd-10.3.2 starting lb # [ 9.620088] kvm_amd: TSC scaling supported lb # [ 9.473625] dhcpcd[715]: dev: loaded udev lb # [ 9.625387] kvm_amd: Nested Virtualization enabled lb # [ 9.625861] kvm_amd: Nested Paging enabled lb # [ 9.628323] kvm_amd: LBR virtualization supported lb # [ 9.628783] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 9.631486] kvm_amd: Virtual GIF supported lb # [ 9.631891] kvm_amd: Virtual NMI enabled lb # [ 9.491392] systemd[1]: Finished Extra networking commands.. lb # [ 9.495326] systemd[1]: Reached target Network. lb # [ 9.502154] systemd[1]: Starting PostgreSQL Server... lb # [ 9.511502] systemd[1]: Starting Permit User Sessions... lb # [ 9.661822] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.662319] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.719522] EDAC MC: Ver: 3.0.0 lb # [ 9.578833] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.593582] systemd[1]: Finished Permit User Sessions. lb # [ 9.603717] systemd[1]: Started Getty on tty1. lb # [ 9.604394] systemd[1]: Reached target Login Prompts. worker2 # [ 9.648552] dhcpcd[687]: eth0: soliciting a DHCP lease worker2 # [ 9.791764] NET: Registered PF_PACKET protocol family worker2 # [ 9.662528] dhcpcd[687]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 9.665518] dhcpcd[687]: eth0: probing address 10.0.2.15/24 lb # [ 9.834972] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 9.866613] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 9.867907] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 9.871435] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 9.872319] cfg80211: failed to load regulatory.db lb # [ 9.948445] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 9.801658] dhcpcd[715]: eth0: waiting for carrier lb # [ 9.803131] dhcpcd[715]: eth0: carrier acquired lb # [ 9.822391] dhcpcd[715]: DUID 00:01:00:01:32:45:52:40:52:54:00:12:34:56 lb # [ 9.824078] dhcpcd[715]: eth0: IAID 00:12:34:56 lb # [ 9.824737] dhcpcd[715]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.832427] postgresql-pre-start[733]: The files belonging to this database system will be owned by user "postgres". lb # [ 9.834256] postgresql-pre-start[733]: This user must also own the server process. lb # [ 9.837125] postgresql-pre-start[733]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 9.838315] postgresql-pre-start[733]: The default database encoding has accordingly been set to "UTF8". lb # [ 9.839464] postgresql-pre-start[733]: The default text search configuration will be set to "english". lb # [ 9.840535] postgresql-pre-start[733]: Data page checksums are enabled. lb # [ 9.841380] postgresql-pre-start[733]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 9.843790] postgresql-pre-start[733]: creating subdirectories ... ok lb # [ 9.844664] postgresql-pre-start[733]: selecting dynamic shared memory implementation ... posix lb # [ 9.928584] postgresql-pre-start[733]: selecting default "max_connections" ... 100 lb # [ 9.962445] systemd-vconsole-setup[658]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.968727] systemd[1]: Finished Virtual Console Setup. client: (finished: waiting for unit network-addresses-eth1.service, in 10.68 seconds) lb # [ 10.015568] postgresql-pre-start[733]: selecting default "shared_buffers" ... 128MB client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb: (finished: waiting for unit network-addresses-eth1.service, in 0.04 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.02 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.01 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service worker1 # [ 10.374101] dhcpcd[688]: eth0: soliciting a DHCP lease worker1 # [ 10.515830] NET: Registered PF_PACKET protocol family worker1 # [ 10.386088] dhcpcd[688]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 10.388142] dhcpcd[688]: eth0: probing address 10.0.2.15/24 worker1 # [ 10.413407] dhcpcd[688]: eth0: soliciting an IPv6 router worker1 # [ 10.414459] dhcpcd[688]: eth0: Router Advertisement from fe80::2 worker1 # [ 10.415423] dhcpcd[688]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 10.416339] dhcpcd[688]: eth0: adding route to fec0::/64 worker1 # [ 10.417105] dhcpcd[688]: eth0: adding default route via fe80::2 lb # [ 10.657750] postgresql-pre-start[733]: selecting default time zone ... UTC lb # [ 10.660469] postgresql-pre-start[733]: creating configuration files ... ok lb # [ 10.824965] postgresql-pre-start[733]: running bootstrap script ... ok worker2 # [ 11.136199] dhcpcd[687]: eth0: soliciting an IPv6 router worker2 # [ 11.138360] dhcpcd[687]: eth0: Router Advertisement from fe80::2 worker2 # [ 11.140397] dhcpcd[687]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 11.142541] dhcpcd[687]: eth0: adding route to fec0::/64 worker2 # [ 11.144430] dhcpcd[687]: eth0: adding default route via fe80::2 lb # [ 11.204512] postgresql-pre-start[733]: performing post-bootstrap initialization ... ok client # [ 11.395603] dhcpcd[562]: eth0: soliciting an IPv6 router client # [ 11.398387] dhcpcd[562]: eth0: Router Advertisement from fe80::2 lb # [ 11.379034] postgresql-pre-start[733]: syncing data to disk ... ok lb # [ 11.379929] postgresql-pre-start[733]: initdb: warning: enabling "trust" authentication for local connections client # [ 11.400479] dhcpcd[562]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 11.381077] postgresql-pre-start[733]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. client # [ 11.402652] dhcpcd[562]: eth0: adding route to fec0::/64 lb # [ 11.382905] postgresql-pre-start[733]: Success. You can now start the database server using: lb # [ 11.383913] postgresql-pre-start[733]: pg_ctl -D /var/lib/postgresql/18 -l logfile start client # [ 11.404556] dhcpcd[562]: eth0: adding default route via fe80::2 lb # [ 11.454479] postgres[786]: [786] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 11.457148] postgres[786]: [786] LOG: listening on IPv6 address "::1", port 5432 lb # [ 11.458522] postgres[786]: [786] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 11.462104] postgres[786]: [786] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 11.473376] postgres[795]: [795] LOG: database system was shut down at 2026-09-22 14:50:41 GMT lb # [ 11.479321] postgres[786]: [786] LOG: database system is ready to accept connections lb # [ 11.483697] systemd[1]: Started PostgreSQL Server. lb # [ 11.489422] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 11.613356] postgresql-setup-start[806]: CREATE DATABASE lb # [ 11.643948] postgresql-setup-start[811]: CREATE ROLE lb # [ 11.654869] postgresql-setup-start[813]: ALTER DATABASE lb # [ 11.659040] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 11.660964] systemd[1]: Reached target PostgreSQL. lb # [ 11.750985] dhcpcd[715]: eth0: soliciting a DHCP lease lb # [ 11.925727] NET: Registered PF_PACKET protocol family lb # [ 11.783681] dhcpcd[715]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 11.786357] dhcpcd[715]: eth0: probing address 10.0.2.15/24 lb # [ 12.481789] dhcpcd[715]: eth0: soliciting an IPv6 router lb # [ 12.484195] dhcpcd[715]: eth0: Router Advertisement from fe80::2 lb # [ 12.487151] dhcpcd[715]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 12.489384] dhcpcd[715]: eth0: adding route to fec0::/64 lb # [ 12.491314] dhcpcd[715]: eth0: adding default route via fe80::2 client # [ 14.525425] dhcpcd[562]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 14.526387] dhcpcd[562]: eth0: adding route to 10.0.2.0/24 client # [ 14.527128] dhcpcd[562]: eth0: adding default route via 10.0.2.2 client # [ 14.583499] systemd[1]: Started DHCP Client. client # [ 14.585345] systemd[1]: Reached target Multi-User System. client # [ 14.586369] systemd[1]: Startup finished in 854ms (kernel) + 4.602s (initrd) + 9.129s (userspace) = 14.586s. worker2 # [ 14.941852] dhcpcd[687]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 14.942913] dhcpcd[687]: eth0: adding route to 10.0.2.0/24 worker2 # [ 14.943740] dhcpcd[687]: eth0: adding default route via 10.0.2.2 worker2 # [ 15.003662] systemd[1]: Started DHCP Client. worker2 # [ 15.005417] systemd[1]: Reached target Multi-User System. worker2 # [ 15.006324] systemd[1]: Startup finished in 856ms (kernel) + 3.707s (initrd) + 10.441s (userspace) = 15.005s. worker1 # [ 15.487577] dhcpcd[688]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 15.490469] dhcpcd[688]: eth0: adding route to 10.0.2.0/24 worker1 # [ 15.492762] dhcpcd[688]: eth0: adding default route via 10.0.2.2 worker1 # [ 15.580810] systemd[1]: Started DHCP Client. worker1 # [ 15.582217] systemd[1]: Reached target Multi-User System. worker1 # [ 15.582973] systemd[1]: Startup finished in 845ms (kernel) + 3.740s (initrd) + 10.995s (userspace) = 15.581s. lb # [ 16.898831] dhcpcd[715]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 16.900992] dhcpcd[715]: eth0: adding route to 10.0.2.0/24 lb # [ 16.904987] dhcpcd[715]: eth0: adding default route via 10.0.2.2 lb # [ 16.986903] systemd[1]: Started DHCP Client. lb # [ 16.988798] systemd[1]: Reached target Network is Online. lb # [ 16.992188] systemd[1]: Started Envoy reverse proxy. lb # [ 16.995066] systemd[1]: Started mock-oidc.service. lb # [ 17.119179] mock-oidc-server[925]: Mock OIDC Server running lb # [ 17.120073] mock-oidc-server[925]: OIDC Address: 192.168.1.2:8080 lb # [ 17.120905] mock-oidc-server[925]: Issue Address: 0.0.0.0:8081 lb # [ 17.121841] mock-oidc-server[925]: Issuer: http://192.168.1.2:8080/oidc lb # [ 17.122868] mock-oidc-server[925]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 17.123969] mock-oidc-server[925]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 17.125426] mock-oidc-server[925]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 17.269571] envoy[924]: [2026-09-22 14:50:47.687][924][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 17.272060] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 17.273433] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 17.275807] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 17.278088] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 17.280591] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 17.283220] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 17.284732] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 17.286234] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 17.287920] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 17.289537] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 17.291846] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 17.294117] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 17.295931] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 17.297576] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 17.313588] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 17.315417] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 17.316982] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 17.318647] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 17.324441] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 17.326086] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 17.328962] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 17.330664] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 17.332601] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 17.334561] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 17.336576] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 17.340625] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 17.342547] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 17.345100] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 17.347517] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 17.349163] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 17.350812] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 17.354380] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 17.356139] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 17.358315] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 17.359961] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 17.363094] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 17.365172] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 17.366825] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 17.369547] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 17.373473] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 17.376544] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 17.378799] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 17.380680] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 17.383468] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 17.386158] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 17.387898] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 17.394095] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 17.396268] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 17.403046] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 17.405365] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 17.409661] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 17.411836] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 17.415240] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 17.419782] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 17.421552] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 17.423080] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 17.424786] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 17.426500] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 17.429333] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 17.432051] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 17.433923] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 17.440030] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 17.441645] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 17.445413] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 17.447232] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 17.450144] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 17.456899] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 17.459044] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 17.460761] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 17.464767] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 17.466209] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 17.468145] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 17.469723] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 17.472078] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 17.473765] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 17.475942] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 17.481186] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 17.482937] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 17.486097] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 17.512231] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 17.514583] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 17.516957] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 17.528055] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 17.529663] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 17.531160] envoy[924]: [2026-09-22 14:50:47.690][924][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 17.533167] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 17.535408] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 17.537484] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 17.539412] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 17.540989] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 17.543477] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 17.545832] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 17.549175] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 17.553435] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 17.555547] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 17.557531] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 17.559321] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 17.560967] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 17.564084] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 17.566625] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 17.570654] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 17.573209] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 17.578506] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 17.580134] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 17.582163] envoy[924]: [2026-09-22 14:50:47.706][924][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 17.583561] envoy[924]: [2026-09-22 14:50:47.730][924][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 17.586091] envoy[924]: [2026-09-22 14:50:47.731][924][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 17.598520] envoy[924]: [2026-09-22 14:50:47.732][924][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 17.599840] envoy[924]: [2026-09-22 14:50:47.732][924][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 17.607102] envoy[924]: [2026-09-22 14:50:47.732][924][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 17.612366] envoy[924]: [2026-09-22 14:50:48.031][924][info][main] [source/server/server.cc:968] runtime: {} lb # [ 17.615201] envoy[924]: [2026-09-22 14:50:48.033][924][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 17.616969] envoy[924]: [2026-09-22 14:50:48.035][924][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 17.618809] envoy[924]: [2026-09-22 14:50:48.037][924][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 17.620655] envoy[924]: [2026-09-22 14:50:48.039][924][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 17.622388] envoy[924]: [2026-09-22 14:50:48.040][924][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 17.623844] envoy[924]: [2026-09-22 14:50:48.040][924][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 17.641446] envoy[924]: [2026-09-22 14:50:48.060][924][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 17.674885] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 17.646652] envoy[924]: [2026-09-22 14:50:48.065][924][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker2 # [ 17.656382] systemd[1]: Reached target Network is Online. lb # [ 17.648730] envoy[924]: [2026-09-22 14:50:48.067][924][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 17.651572] envoy[924]: [2026-09-22 14:50:48.070][924][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 17.661601] systemd[1]: Starting scheduler-token.service... worker2 # [ 17.726316] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 17.730300] systemd[1]: Finished scheduler-token.service. worker2 # [ 17.733233] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 68ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker1 # [ 17.757789] nix-grpc-daemon[781]: ts=2026-09-22T14:50:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 17.738632] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 17.769069] nix-grpc-daemon[781]: ts=2026-09-22T14:50:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 17.771601] nix-grpc-daemon[781]: ts=2026-09-22T14:50:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 17.780059] nix-grpc-daemon[781]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 17.781380] nix-grpc-daemon[781]: E0000 00:00:1790088648.977389 781 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 17.787291] nix-grpc-daemon[781]: E0000 00:00:1790088648.984719 781 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 17.790269] nix-grpc-daemon[781]: ts=2026-09-22T14:50:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 17.793442] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 17.807060] nix-grpc-daemon[781]: E0000 00:00:1790088649.004714 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 17.791216] envoy[924]: [2026-09-22 14:50:48.209][924][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker1 # [ 17.825662] nix-grpc-daemon[781]: E0000 00:00:1790088649.023314 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 17.795088] envoy[924]: [2026-09-22 14:50:48.209][924][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 17.829126] nix-grpc-daemon[781]: E0000 00:00:1790088649.025532 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 17.798932] envoy[924]: [2026-09-22 14:50:48.209][924][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 17.804981] envoy[924]: [2026-09-22 14:50:48.223][924][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 17.841166] nix-grpc-daemon[781]: E0000 00:00:1790088649.038830 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.823873] nix-grpc-daemon[782]: ts=2026-09-22T14:50:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 17.851090] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 17.853566] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 17.835288] nix-grpc-daemon[782]: ts=2026-09-22T14:50:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 17.837959] nix-grpc-daemon[782]: ts=2026-09-22T14:50:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 17.846500] nix-grpc-daemon[782]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 17.848063] nix-grpc-daemon[782]: E0000 00:00:1790088649.872627 782 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.853659] nix-grpc-daemon[782]: E0000 00:00:1790088649.879972 782 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.857334] nix-grpc-daemon[782]: ts=2026-09-22T14:50:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 17.860781] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 17.873067] nix-grpc-daemon[782]: E0000 00:00:1790088649.898943 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.890966] nix-grpc-daemon[782]: E0000 00:00:1790088649.917380 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.896057] nix-grpc-daemon[782]: E0000 00:00:1790088649.919641 824 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 17.906273] nix-grpc-daemon[782]: E0000 00:00:1790088649.932662 824 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 17.916581] nix-grpc-daemon[782]: ts=2026-09-22T14:50:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 17.918177] nix-grpc-daemon[782]: ts=2026-09-22T14:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.054723] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.058708] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.119212] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.121116] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.259533] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.263540] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.321785] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.323571] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.464767] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.468908] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.524352] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.526103] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.669727] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.673670] nix-grpc-daemon[781]: ts=2026-09-22T14:50:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.727502] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.731466] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.875228] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.878970] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.932417] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.934088] nix-grpc-daemon[782]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.079803] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.083593] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.135481] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.139423] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.284284] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.288225] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.340651] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.344453] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.489064] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.493140] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.545769] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.549652] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.693868] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.697825] nix-grpc-daemon[781]: ts=2026-09-22T14:50:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.750869] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.754883] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.900164] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.903370] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.955771] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.957549] nix-grpc-daemon[782]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.100809] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.104602] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.158864] nix-grpc-daemon[782]: ts=2026-09-22T14:50:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.162715] nix-grpc-daemon[782]: ts=2026-09-22T14:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.304935] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.306619] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.363928] nix-grpc-daemon[782]: ts=2026-09-22T14:50:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.367781] nix-grpc-daemon[782]: ts=2026-09-22T14:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.507181] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.508874] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.568870] nix-grpc-daemon[782]: ts=2026-09-22T14:50:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.572713] nix-grpc-daemon[782]: ts=2026-09-22T14:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.709360] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.711202] nix-grpc-daemon[781]: ts=2026-09-22T14:50:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.773382] nix-grpc-daemon[782]: ts=2026-09-22T14:50:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.775212] nix-grpc-daemon[782]: ts=2026-09-22T14:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.913396] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.916817] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.977575] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.980757] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.113589] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.115331] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.179130] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.183092] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.316355] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.320317] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.384124] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.387972] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.520480] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.522465] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.589260] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.593677] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.723747] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.727254] nix-grpc-daemon[781]: ts=2026-09-22T14:50:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.794232] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.798234] nix-grpc-daemon[782]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.929266] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.932962] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.000511] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.003629] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.133807] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.137788] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.201372] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.205382] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.338608] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.342518] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.406451] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.410466] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.543419] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.547221] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.611564] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.615475] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.747994] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.751869] nix-grpc-daemon[781]: ts=2026-09-22T14:50:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.816669] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.820726] nix-grpc-daemon[782]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.953561] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.957302] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.022797] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.026717] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.158058] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.161924] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.227458] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.229494] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.362192] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.363917] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.430145] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.431817] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.564925] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.569097] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.632457] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.634241] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.769939] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.774104] nix-grpc-daemon[781]: ts=2026-09-22T14:50:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.835483] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.839423] nix-grpc-daemon[782]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.976328] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.979503] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.041472] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.045293] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.177049] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.178753] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.242826] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.244511] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.380090] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.384151] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.445207] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.447071] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.584800] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.588644] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.647686] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.649470] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.789429] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.793671] nix-grpc-daemon[781]: ts=2026-09-22T14:50:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.850328] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.852130] nix-grpc-daemon[782]: ts=2026-09-22T14:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.995799] nix-grpc-daemon[781]: ts=2026-09-22T14:50:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.999087] nix-grpc-daemon[781]: ts=2026-09-22T14:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.053173] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.054925] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.199474] nix-grpc-daemon[781]: ts=2026-09-22T14:50:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.201284] nix-grpc-daemon[781]: ts=2026-09-22T14:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.256267] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.260354] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.401924] nix-grpc-daemon[781]: ts=2026-09-22T14:50:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.403875] nix-grpc-daemon[781]: ts=2026-09-22T14:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.461535] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.465487] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.604354] nix-grpc-daemon[781]: ts=2026-09-22T14:50:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.606093] nix-grpc-daemon[781]: ts=2026-09-22T14:50:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.666585] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.670479] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.806501] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.808240] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.871401] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.875299] nix-grpc-daemon[782]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.010123] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.013847] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.077429] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.080961] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.214988] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.219070] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.282321] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.286091] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.419849] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.424286] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.487487] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.491461] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.624913] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.628992] nix-grpc-daemon[781]: ts=2026-09-22T14:50:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.692628] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.696465] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.829510] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.833271] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.897464] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.903613] nix-grpc-daemon[782]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.034743] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.038478] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.104625] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.108122] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.239365] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.243345] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.309549] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.313527] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.444276] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.448171] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.514764] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.518785] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.648881] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.652875] nix-grpc-daemon[781]: ts=2026-09-22T14:50:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.719421] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.721336] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.853500] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.857462] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.921752] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.923451] nix-grpc-daemon[782]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.058412] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.060118] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.124603] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.126428] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.260878] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.264911] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.327797] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.331658] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.465756] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.469550] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.532986] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.536882] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.670506] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.674552] nix-grpc-daemon[781]: ts=2026-09-22T14:50:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.737983] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.742247] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.875166] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.879175] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.942844] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.946680] nix-grpc-daemon[782]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.080822] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.084497] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.148459] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.152124] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.285359] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.289148] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.352526] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.354363] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.373447] rustfs-bucket-start[1044]: mb s3://farm lb # [ 29.380725] systemd[1]: Finished rustfs-bucket.service. lb # [ 29.387067] systemd[1]: Starting niks3 server... worker1 # [ 29.489811] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.493788] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.509412] postgres[1064]: [1064] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 29.511136] postgres[1064]: [1064] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 29.533656] niks3-server[1059]: 2026/09/22 14:50:59 OK 20241026095416_initial_model.sql (12.2ms) lb # [ 29.537300] niks3-server[1059]: 2026/09/22 14:50:59 OK 20251210153512_drop_unused_gin_index.sql (3.81ms) lb # [ 29.543378] niks3-server[1059]: 2026/09/22 14:50:59 OK 20251218171726_add_pins.sql (6.06ms) lb # [ 29.548162] niks3-server[1059]: 2026/09/22 14:50:59 OK 20260628120000_add_object_size_and_stats.sql (4.83ms) worker2 # [ 29.555721] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 lb # [ 29.552614] niks3-server[1059]: 2026/09/22 14:50:59 OK 20260905000000_add_claims.sql (3.01ms) worker2 # [ 29.559694] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.556386] niks3-server[1059]: 2026/09/22 14:50:59 OK 20260920000000_drop_claims.sql (3.81ms) lb # [ 29.557660] niks3-server[1059]: 2026/09/22 14:50:59 goose: successfully migrated database to version: 20260920000000 lb # [ 29.562136] niks3-server[1059]: 2026/09/22 14:50:59 OK 1_commit_pending_closure.sql (3.11ms) lb # [ 29.564968] niks3-server[1059]: 2026/09/22 14:50:59 OK 2_object_stats_trigger.sql (2.74ms) lb # [ 29.566080] niks3-server[1059]: 2026/09/22 14:50:59 goose: up to current file version: 2 lb # [ 29.569218] niks3-server[1059]: 2026/09/22 14:50:59 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 29.598255] niks3-server[1059]: 2026/09/22 14:51:00 INFO Read proxy enabled — serving cache objects from S3 lb # [ 29.600223] niks3-server[1059]: 2026/09/22 14:51:00 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 29.603890] niks3-server[1059]: 2026/09/22 14:51:00 INFO systemd watchdog enabled interval=15s lb # [ 29.605088] niks3-server[1059]: 2026/09/22 14:51:00 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 29.606250] systemd[1]: Started niks3 server. lb # [ 29.606976] systemd[1]: Reached target Multi-User System. lb # [ 29.608863] systemd[1]: Startup finished in 852ms (kernel) + 4.578s (initrd) + 24.177s (userspace) = 29.608s. worker1 # [ 29.694616] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.698662] nix-grpc-daemon[781]: ts=2026-09-22T14:51:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.761113] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.765109] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.899109] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.900976] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.966104] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.969812] nix-grpc-daemon[782]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.103282] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.106379] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.172574] nix-grpc-daemon[782]: ts=2026-09-22T14:51:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.175858] nix-grpc-daemon[782]: ts=2026-09-22T14:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.303921] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.307867] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.373267] nix-grpc-daemon[782]: ts=2026-09-22T14:51:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.375182] nix-grpc-daemon[782]: ts=2026-09-22T14:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 20.26 seconds) worker1 # [ 30.508254] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 lb: waiting for TCP port 5751 on localhost worker1 # [ 30.510062] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.05 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.02 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 30.568396] envoy[924]: conn peer=[::1]:34898 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 worker2 # [ 30.576498] nix-grpc-daemon[782]: ts=2026-09-22T14:51:02Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: waiting for TCP port 50051 on localhost, in 0.02 seconds) worker2 # [ 30.580286] nix-grpc-daemon[782]: ts=2026-09-22T14:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.652605] systemd[1]: Starting scheduler-token.service... worker1 # [ 30.711186] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.715211] nix-grpc-daemon[781]: ts=2026-09-22T14:51:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.698062] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 30.699658] systemd[1]: Finished scheduler-token.service. worker2 # [ 30.702259] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 47ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.05 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2 # [ 30.781361] nix-grpc-daemon[782]: ts=2026-09-22T14:51:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.785183] nix-grpc-daemon[782]: ts=2026-09-22T14:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.915762] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.919932] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.985565] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.987522] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.121614] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.124688] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.188308] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.190146] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.322511] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.326267] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.391637] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.395898] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.526910] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.530992] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.596967] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.600850] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.731376] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.733213] nix-grpc-daemon[781]: ts=2026-09-22T14:51:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 31.802661] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.806771] nix-grpc-daemon[782]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 31.933729] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.935498] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.007461] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.009405] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.136438] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.138301] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.212255] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.215501] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.339031] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.340749] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.413544] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.417526] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.541674] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.545830] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.618265] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.620246] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.746560] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.750437] nix-grpc-daemon[781]: ts=2026-09-22T14:51:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.821316] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.823188] nix-grpc-daemon[782]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 32.951549] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.955421] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.024755] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.028738] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.157274] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.160870] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.231372] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.234515] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.361733] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.365605] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.432413] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.434480] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.566244] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.570170] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.635758] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.640145] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.770434] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.772363] nix-grpc-daemon[781]: ts=2026-09-22T14:51:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.841385] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.845451] nix-grpc-daemon[782]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 33.973695] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.978431] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.046616] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.050627] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.179047] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.180800] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.252808] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.256518] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.381595] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.383620] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.454687] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.458607] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.584548] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.588478] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.659230] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.661175] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.788847] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.790678] nix-grpc-daemon[781]: ts=2026-09-22T14:51:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.861951] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.864202] nix-grpc-daemon[782]: ts=2026-09-22T14:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 34.991674] nix-grpc-daemon[781]: ts=2026-09-22T14:51:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.995544] nix-grpc-daemon[781]: ts=2026-09-22T14:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.065058] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.066978] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.196323] nix-grpc-daemon[781]: ts=2026-09-22T14:51:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.198225] nix-grpc-daemon[781]: ts=2026-09-22T14:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.268299] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.270341] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.399088] nix-grpc-daemon[781]: ts=2026-09-22T14:51:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.402989] nix-grpc-daemon[781]: ts=2026-09-22T14:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.471798] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.475791] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.604128] nix-grpc-daemon[781]: ts=2026-09-22T14:51:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.606494] nix-grpc-daemon[781]: ts=2026-09-22T14:51:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.677123] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.681175] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.806899] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.808797] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.882183] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.886203] nix-grpc-daemon[782]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 36.009720] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.013537] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 36.087325] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.091231] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.215288] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.218852] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.294301] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.297571] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.419870] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.423723] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.495564] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.499620] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.624562] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.628314] nix-grpc-daemon[781]: ts=2026-09-22T14:51:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.700943] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.704980] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.829167] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.833376] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.906229] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.910173] nix-grpc-daemon[782]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.034348] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 37.037997] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 37.111259] nix-grpc-daemon[782]: ts=2026-09-22T14:51:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.115293] nix-grpc-daemon[782]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.239747] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.243582] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.317579] nix-grpc-daemon[782]: ts=2026-09-22T14:51:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.321169] nix-grpc-daemon[782]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.444417] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.448448] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.522084] nix-grpc-daemon[782]: ts=2026-09-22T14:51:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.523928] nix-grpc-daemon[782]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.649166] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.653176] nix-grpc-daemon[781]: ts=2026-09-22T14:51:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.725492] nix-grpc-daemon[782]: ts=2026-09-22T14:51:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.729615] nix-grpc-daemon[782]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.855278] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.859095] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.932478] nix-grpc-daemon[782]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.059785] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.063716] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 38.265433] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.269210] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.335501] nix-grpc-daemon[782]: ts=2026-09-22T14:51:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.338906] nix-grpc-daemon[782]: ts=2026-09-22T14:51:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.470350] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.474433] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.536467] nix-grpc-daemon[782]: ts=2026-09-22T14:51:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.539510] nix-grpc-daemon[782]: ts=2026-09-22T14:51:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.675274] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.679173] nix-grpc-daemon[781]: ts=2026-09-22T14:51:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.741168] nix-grpc-daemon[782]: ts=2026-09-22T14:51:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.745205] nix-grpc-daemon[782]: ts=2026-09-22T14:51:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.879320] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.881163] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.946176] nix-grpc-daemon[782]: ts=2026-09-22T14:51:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.950475] nix-grpc-daemon[782]: ts=2026-09-22T14:51:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.082080] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.086116] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 39.151253] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.153246] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 39.286918] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.288812] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.354777] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.356923] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.489421] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.491186] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.557841] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.559683] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.623323] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_take_over lb # [ 39.614322] niks3-server[1059]: 2026/09/22 14:51:10 INFO lead: acquired remote=192.168.1.4:58196 worker1 # [ 39.692231] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.696154] nix-grpc-daemon[781]: ts=2026-09-22T14:51:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.761277] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.765293] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.896475] nix-grpc-daemon[781]: ts=2026-09-22T14:51:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.898764] nix-grpc-daemon[781]: ts=2026-09-22T14:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.966270] nix-grpc-daemon[782]: ts=2026-09-22T14:51:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.980683] nix-grpc-daemon[782]: ts=2026-09-22T14:51:12Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 39.983633] nix-grpc-daemon[782]: ts=2026-09-22T14:51:12Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:37514 worker2 # [ 39.988180] nix-grpc-daemon[782]: ts=2026-09-22T14:51:12Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 40.099765] nix-grpc-daemon[781]: ts=2026-09-22T14:51:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.080737] nix-grpc-daemon[782]: ts=2026-09-22T14:51:12Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37514 worker2 # [ 40.084514] nix-grpc-daemon[782]: ts=2026-09-22T14:51:12Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 9.78 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 40.682254] nix-grpc-daemon[782]: ts=2026-09-22T14:51:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 40.687410] systemd[1]: Started Nix Daemon. worker2 # [ 40.814832] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 40.830392] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 63 ms (attempt 1/5) worker2 # [ 40.896991] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 108 ms (attempt 2/5) worker2 # [ 41.006322] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 268 ms (attempt 3/5) worker2 # [ 41.275645] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 482 ms (attempt 4/5) worker2 # [ 41.761858] nix-grpc-daemon[782]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 41.770612] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 41.795816] nix-grpc-daemon[782]: ts=2026-09-22T14:51:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 41.804812] nix-grpc-daemon[782]: ts=2026-09-22T14:51:13Z level=debug event=path_info_miss path=gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test error="error: path '/nix/store/gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 41.813885] nix-grpc-daemon[782]: ts=2026-09-22T14:51:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 41.821856] nix-grpc-daemon[782]: ts=2026-09-22T14:51:13Z level=debug event=path_info_miss path=gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test error="error: path '/nix/store/gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.04 seconds) client: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.02 seconds) worker1 # [ 42.042616] nix-grpc-daemon[781]: ts=2026-09-22T14:51:13Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 42.047911] nix-grpc-daemon[781]: ts=2026-09-22T14:51:13Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:57550 worker1 # [ 42.055859] systemd[1]: Started Nix Daemon. worker1 # [ 42.163881] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 42.177962] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5) worker1 # [ 42.198983] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 2/5) worker1 # [ 42.243082] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 3/5) worker1 # [ 42.398326] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 652 ms (attempt 4/5) worker1 # [ 43.054488] nix-grpc-daemon[781]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 43.057711] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 43.074908] nix-grpc-daemon[781]: ts=2026-09-22T14:51:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:57550 worker1 # [ 43.086115] nix-grpc-daemon[781]: ts=2026-09-22T14:51:14Z level=debug event=path_info_miss path=gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test error="error: path '/nix/store/gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 43.075630] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:37526 worker2 # [ 43.085672] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=debug event=path_info_miss path=gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test error="error: path '/nix/store/gf7wpg39jwq284cdjajvxqgxnm2p4dqn-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker1 # [ 43.278168] nix-grpc-daemon[781]: ts=2026-09-22T14:51:14Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 43.392090] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.87 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker2 # [ 43.529189] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37526 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker1 # [ 43.560292] nix-grpc-daemon[781]: ts=2026-09-22T14:51:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 worker2 # [ 43.567374] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=0 worker2 # [ 43.571829] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 43.623068] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 43.636142] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 client # copying 1 paths to 'lb:50051'... worker2 # [ 43.648604] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... worker2 # [ 43.668983] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 43.701201] nix-grpc-daemon[782]: ts=2026-09-22T14:51:15Z level=info event=niks3_push_started pid=884 worker2 # [ 43.847694] nix-grpc-daemon[884]: time=2026-09-22T14:51:15.873Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 43.940466] nix-daemon[869]: accepted connection from pid 897, user nix-grpc-daemon (trusted) worker2 # [ 43.954143] nix-daemon[869]: reaped child process 900, status = succeeded worker2 # [ 44.039578] nix-daemon[869]: accepted connection from pid 902, user nix-grpc-daemon (trusted) worker2 # [ 44.052236] nix-daemon[869]: reaped child process 905, status = succeeded lb # [ 44.050627] niks3-server[1059]: 2026/09/22 14:51:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 44.277888] nix-grpc-daemon[884]: time=2026-09-22T14:51:16.304Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 44.281890] nix-grpc-daemon[884]: time=2026-09-22T14:51:16.306Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" lb # [ 44.304762] niks3-server[1059]: 2026/09/22 14:51:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 44.329918] niks3-server[1059]: 2026/09/22 14:51:14 INFO Signed narinfos id=1 count=1 worker2 # [ 44.342856] nix-grpc-daemon[884]: time=2026-09-22T14:51:16.368Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.351497] niks3-server[1059]: 2026/09/22 14:51:14 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 44.374890] niks3-server[1059]: 2026/09/22 14:51:14 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst lb # [ 44.387815] niks3-server[1059]: 2026/09/22 14:51:14 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo lb # [ 44.393865] niks3-server[1059]: 2026/09/22 14:51:14 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls lb # [ 44.398730] niks3-server[1059]: 2026/09/22 14:51:14 INFO Completed upload id=1 worker2 # [ 44.408347] nix-grpc-daemon[884]: time=2026-09-22T14:51:16.434Z level=INFO msg="Upload complete. (556ms)" worker2 # [ 44.411131] nix-grpc-daemon[782]: ts=2026-09-22T14:51:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 44.413825] nix-grpc-daemon[782]: ts=2026-09-22T14:51:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 44.418609] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 44.424199] nix-daemon[869]: reaped child process 882, status = succeeded client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051... client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker2 # [ 44.431117] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 45.878782] nix-daemon[869]: reaped child process 909, status = succeeded worker2 # [ 45.959795] nix-daemon[869]: accepted connection from pid 925, user nix-grpc-daemon (trusted) worker2 # [ 45.975171] nix-daemon[869]: reaped child process 928, status = succeeded lb # [ 45.972117] niks3-server[1059]: 2026/09/22 14:51:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.987568] nix-grpc-daemon[884]: time=2026-09-22T14:51:18.013Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 45.991060] nix-grpc-daemon[884]: time=2026-09-22T14:51:18.015Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)" lb # [ 46.001141] niks3-server[1059]: 2026/09/22 14:51:16 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv lb # [ 46.013792] niks3-server[1059]: 2026/09/22 14:51:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker2 # [ 46.031354] nix-grpc-daemon[884]: time=2026-09-22T14:51:18.057Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.021834] niks3-server[1059]: 2026/09/22 14:51:16 INFO Signed narinfos id=2 count=1 lb # [ 46.027402] niks3-server[1059]: 2026/09/22 14:51:16 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 46.030145] niks3-server[1059]: 2026/09/22 14:51:16 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls lb # [ 46.034630] niks3-server[1059]: 2026/09/22 14:51:16 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 46.040302] niks3-server[1059]: 2026/09/22 14:51:16 INFO Completed upload id=2 worker2 # [ 46.049870] nix-grpc-daemon[884]: time=2026-09-22T14:51:18.076Z level=INFO msg="Upload complete. (209ms)" lb # [ 46.043264] niks3-server[1059]: 2026/09/22 14:51:16 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo worker2 # [ 46.053807] nix-grpc-daemon[782]: ts=2026-09-22T14:51:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=1 worker2 # [ 46.063981] nix-grpc-daemon[782]: ts=2026-09-22T14:51:18Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=0 worker2 # [ 46.066279] nix-grpc-daemon[782]: ts=2026-09-22T14:51:18Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 46.073225] nix-daemon[869]: reaped child process 907, status = succeeded worker2 # [ 46.108115] nix-grpc-daemon[782]: ts=2026-09-22T14:51:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 46.119459] nix-grpc-daemon[782]: ts=2026-09-22T14:51:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 46.131875] nix-grpc-daemon[884]: time=2026-09-22T14:51:18.158Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 46.139497] nix-grpc-daemon[782]: ts=2026-09-22T14:51:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... worker2 # [ 46.156764] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 46.261581] nix-daemon[869]: accepted connection from pid 934, user nix-grpc-daemon (trusted) worker2 # [ 46.276869] nix-daemon[869]: reaped child process 937, status = succeeded worker2 # [ 46.360853] nix-daemon[869]: accepted connection from pid 939, user nix-grpc-daemon (trusted) worker2 # [ 46.376347] nix-daemon[869]: reaped child process 942, status = succeeded lb # [ 46.372277] niks3-server[1059]: 2026/09/22 14:51:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.525593] nix-grpc-daemon[884]: time=2026-09-22T14:51:18.551Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 46.527080] nix-grpc-daemon[884]: time=2026-09-22T14:51:18.551Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" lb # [ 46.537841] niks3-server[1059]: 2026/09/22 14:51:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker2 # [ 46.556581] nix-grpc-daemon[884]: time=2026-09-22T14:51:18.582Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.546631] niks3-server[1059]: 2026/09/22 14:51:16 INFO Signed narinfos id=3 count=1 lb # [ 46.562453] niks3-server[1059]: 2026/09/22 14:51:16 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 46.570989] niks3-server[1059]: 2026/09/22 14:51:16 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst lb # [ 46.578929] niks3-server[1059]: 2026/09/22 14:51:16 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls lb # [ 46.586702] niks3-server[1059]: 2026/09/22 14:51:17 INFO Completed upload id=3 worker2 # [ 46.598485] nix-grpc-daemon[884]: time=2026-09-22T14:51:18.624Z level=INFO msg="Upload complete. (428ms)" worker2 # [ 46.600872] nix-grpc-daemon[782]: ts=2026-09-22T14:51:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 46.603859] nix-grpc-daemon[782]: ts=2026-09-22T14:51:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 lb # [ 46.597925] niks3-server[1059]: 2026/09/22 14:51:17 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo worker2 # [ 46.611082] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 46.617126] nix-daemon[869]: reaped child process 932, status = succeeded worker2 # [ 46.620824] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051... client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 47.236651] nix-daemon[869]: reaped child process 946, status = succeeded worker2 # [ 47.318939] nix-daemon[869]: accepted connection from pid 962, user nix-grpc-daemon (trusted) worker2 # [ 47.333310] nix-daemon[869]: reaped child process 965, status = succeeded lb # [ 47.331927] niks3-server[1059]: 2026/09/22 14:51:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.352990] nix-grpc-daemon[884]: time=2026-09-22T14:51:19.379Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 47.354504] nix-grpc-daemon[884]: time=2026-09-22T14:51:19.380Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)" lb # [ 47.373807] niks3-server[1059]: 2026/09/22 14:51:17 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst lb # [ 47.385656] niks3-server[1059]: 2026/09/22 14:51:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 47.390426] niks3-server[1059]: 2026/09/22 14:51:17 INFO Signed narinfos id=4 count=1 worker2 # [ 47.403822] nix-grpc-daemon[884]: time=2026-09-22T14:51:19.430Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.399223] niks3-server[1059]: 2026/09/22 14:51:17 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls lb # [ 47.403108] niks3-server[1059]: 2026/09/22 14:51:17 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv lb # [ 47.413296] niks3-server[1059]: 2026/09/22 14:51:17 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 47.416757] niks3-server[1059]: 2026/09/22 14:51:17 INFO Completed upload id=4 worker2 # [ 47.426526] nix-grpc-daemon[884]: time=2026-09-22T14:51:19.452Z level=INFO msg="Upload complete. (199ms)" lb # [ 47.418350] niks3-server[1059]: 2026/09/22 14:51:17 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo worker2 # [ 47.437218] nix-grpc-daemon[782]: ts=2026-09-22T14:51:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=1 worker2 # [ 47.444297] nix-grpc-daemon[782]: ts=2026-09-22T14:51:19Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=0 worker2 # [ 47.448187] nix-grpc-daemon[782]: ts=2026-09-22T14:51:19Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 47.458235] nix-daemon[869]: reaped child process 944, status = succeeded worker2 # [ 47.488521] nix-grpc-daemon[782]: ts=2026-09-22T14:51:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 47.500526] nix-grpc-daemon[782]: ts=2026-09-22T14:51:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 47.514337] nix-grpc-daemon[884]: time=2026-09-22T14:51:19.540Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 47.523355] nix-grpc-daemon[782]: ts=2026-09-22T14:51:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... worker2 # [ 47.546255] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 47.652953] nix-daemon[869]: accepted connection from pid 971, user nix-grpc-daemon (trusted) lb # [ 47.646658] envoy[924]: conn peer=[2001:db8:1::1]:37738 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=1156 lb # [ 47.650458] envoy[924]: conn peer=[2001:db8:1::1]:37750 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=362 ms=1089 lb # [ 47.654121] envoy[924]: conn peer=[2001:db8:1::1]:53566 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=7 worker2 # [ 47.668252] nix-daemon[869]: reaped child process 974, status = succeeded lb # [ 47.657933] envoy[924]: conn peer=[2001:db8:1::1]:53576 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=8 worker2 # [ 47.754148] nix-daemon[869]: accepted connection from pid 976, user nix-grpc-daemon (trusted) worker2 # [ 47.768560] nix-daemon[869]: reaped child process 979, status = succeeded lb # [ 47.765707] niks3-server[1059]: 2026/09/22 14:51:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.783532] nix-grpc-daemon[884]: time=2026-09-22T14:51:19.810Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 47.785091] nix-grpc-daemon[884]: time=2026-09-22T14:51:19.811Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" lb # [ 47.798492] niks3-server[1059]: 2026/09/22 14:51:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 47.804248] niks3-server[1059]: 2026/09/22 14:51:18 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst lb # [ 47.812971] niks3-server[1059]: 2026/09/22 14:51:18 INFO Signed narinfos id=5 count=1 worker2 # [ 47.825970] nix-grpc-daemon[884]: time=2026-09-22T14:51:19.852Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.822504] niks3-server[1059]: 2026/09/22 14:51:18 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls lb # [ 47.833184] niks3-server[1059]: 2026/09/22 14:51:18 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker2 # [ 47.849951] nix-grpc-daemon[884]: time=2026-09-22T14:51:19.876Z level=INFO msg="Upload complete. (288ms)" lb # [ 47.840195] niks3-server[1059]: 2026/09/22 14:51:18 INFO Completed upload id=5 lb # [ 47.844727] niks3-server[1059]: 2026/09/22 14:51:18 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo worker2 # [ 47.854187] nix-grpc-daemon[782]: ts=2026-09-22T14:51:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 47.858895] nix-grpc-daemon[782]: ts=2026-09-22T14:51:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 47.870639] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 47.876133] nix-daemon[869]: reaped child process 969, status = succeeded worker2 # [ 47.879803] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051... client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker2 # [ 49.121282] nix-daemon[869]: reaped child process 983, status = succeeded worker2 # [ 49.193607] nix-daemon[869]: accepted connection from pid 999, user nix-grpc-daemon (trusted) worker2 # [ 49.209198] nix-daemon[869]: reaped child process 1002, status = succeeded lb # [ 49.206900] niks3-server[1059]: 2026/09/22 14:51:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.229983] nix-grpc-daemon[884]: time=2026-09-22T14:51:21.256Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 49.232932] nix-grpc-daemon[884]: time=2026-09-22T14:51:21.257Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)" lb # [ 49.237221] niks3-server[1059]: 2026/09/22 14:51:19 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst lb # [ 49.240530] niks3-server[1059]: 2026/09/22 14:51:19 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv lb # [ 49.247362] niks3-server[1059]: 2026/09/22 14:51:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 49.249452] niks3-server[1059]: 2026/09/22 14:51:19 INFO Signed narinfos id=6 count=1 worker2 # [ 49.259491] nix-grpc-daemon[884]: time=2026-09-22T14:51:21.285Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.252899] niks3-server[1059]: 2026/09/22 14:51:19 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls lb # [ 49.259244] niks3-server[1059]: 2026/09/22 14:51:19 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 49.261608] niks3-server[1059]: 2026/09/22 14:51:19 INFO Completed upload id=6 worker2 # [ 49.272319] nix-grpc-daemon[884]: time=2026-09-22T14:51:21.298Z level=INFO msg="Upload complete. (184ms)" lb # [ 49.264463] niks3-server[1059]: 2026/09/22 14:51:19 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo worker2 # [ 49.275659] nix-grpc-daemon[782]: ts=2026-09-22T14:51:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=1 worker2 # [ 49.284780] nix-daemon[869]: reaped child process 981, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 5.90 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds) client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top client # copying 3 paths... client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.17 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.26 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.18 seconds) worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2 worker1 # [ 50.136297] nix-grpc-daemon[781]: ts=2026-09-22T14:51:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57550 client # don't know how to build these paths: client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker2 # [ 50.123972] nix-grpc-daemon[782]: ts=2026-09-22T14:51:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 50.129691] nix-grpc-daemon[884]: time=2026-09-22T14:51:22.156Z level=INFO msg="All 2 paths already cached" worker2 # [ 50.141930] nix-grpc-daemon[782]: ts=2026-09-22T14:51:22Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.16 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 0.73 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: worker2 # [ 50.574909] nix-grpc-daemon[782]: ts=2026-09-22T14:51:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37526 client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 50.578230] nix-grpc-daemon[782]: ts=2026-09-22T14:51:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 50.935563] nix-grpc-daemon[884]: time=2026-09-22T14:51:22.961Z level=INFO msg="All 2 paths already cached" worker2 # [ 50.952744] nix-grpc-daemon[782]: ts=2026-09-22T14:51:22Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=0 worker2 # [ 50.957843] nix-grpc-daemon[782]: ts=2026-09-22T14:51:22Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 50.997945] nix-grpc-daemon[782]: ts=2026-09-22T14:51:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 51.010672] nix-grpc-daemon[782]: ts=2026-09-22T14:51:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 51.027086] nix-grpc-daemon[884]: time=2026-09-22T14:51:23.053Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'... worker2 # [ 51.036899] nix-grpc-daemon[782]: ts=2026-09-22T14:51:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 51.045842] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 51.151072] nix-daemon[869]: accepted connection from pid 1031, user nix-grpc-daemon (trusted) worker2 # [ 51.165719] nix-daemon[869]: reaped child process 1034, status = succeeded worker2 # [ 51.252581] nix-daemon[869]: accepted connection from pid 1036, user nix-grpc-daemon (trusted) worker2 # [ 51.267205] nix-daemon[869]: reaped child process 1039, status = succeeded lb # [ 51.266996] niks3-server[1059]: 2026/09/22 14:51:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 51.293419] nix-grpc-daemon[884]: time=2026-09-22T14:51:23.319Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 51.295083] nix-grpc-daemon[884]: time=2026-09-22T14:51:23.321Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)" lb # [ 51.305845] niks3-server[1059]: 2026/09/22 14:51:21 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst lb # [ 51.316068] niks3-server[1059]: 2026/09/22 14:51:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 51.323098] niks3-server[1059]: 2026/09/22 14:51:21 INFO Signed narinfos id=7 count=1 worker2 # [ 51.336600] nix-grpc-daemon[884]: time=2026-09-22T14:51:23.363Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.330268] niks3-server[1059]: 2026/09/22 14:51:21 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls lb # [ 51.342557] niks3-server[1059]: 2026/09/22 14:51:21 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 51.349639] niks3-server[1059]: 2026/09/22 14:51:21 INFO Completed upload id=7 worker2 # [ 51.359314] nix-grpc-daemon[884]: time=2026-09-22T14:51:23.385Z level=INFO msg="Upload complete. (298ms)" lb # [ 51.353944] niks3-server[1059]: 2026/09/22 14:51:21 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo worker2 # [ 51.364086] nix-grpc-daemon[782]: ts=2026-09-22T14:51:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 51.370304] nix-grpc-daemon[782]: ts=2026-09-22T14:51:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 51.383428] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 51.393314] nix-daemon[869]: reaped child process 1029, status = succeeded client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051... client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker2 # [ 51.399610] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 52.615773] nix-daemon[869]: reaped child process 1043, status = succeeded worker2 # [ 52.698267] nix-daemon[869]: accepted connection from pid 1059, user nix-grpc-daemon (trusted) worker2 # [ 52.713145] nix-daemon[869]: reaped child process 1062, status = succeeded lb # [ 52.711693] niks3-server[1059]: 2026/09/22 14:51:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 52.730161] nix-grpc-daemon[884]: time=2026-09-22T14:51:24.756Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 52.731677] nix-grpc-daemon[884]: time=2026-09-22T14:51:24.758Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)" lb # [ 52.754809] niks3-server[1059]: 2026/09/22 14:51:23 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst lb # [ 52.761916] niks3-server[1059]: 2026/09/22 14:51:23 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv lb # [ 52.771593] niks3-server[1059]: 2026/09/22 14:51:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 52.777526] niks3-server[1059]: 2026/09/22 14:51:23 INFO Signed narinfos id=8 count=1 worker2 # [ 52.791056] nix-grpc-daemon[884]: time=2026-09-22T14:51:24.817Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.784135] niks3-server[1059]: 2026/09/22 14:51:23 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls lb # [ 52.791054] niks3-server[1059]: 2026/09/22 14:51:23 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 52.794769] niks3-server[1059]: 2026/09/22 14:51:23 INFO Completed upload id=8 lb # [ 52.796728] niks3-server[1059]: 2026/09/22 14:51:23 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo worker2 # [ 52.805850] nix-grpc-daemon[884]: time=2026-09-22T14:51:24.832Z level=INFO msg="Upload complete. (199ms)" worker2 # [ 52.815556] nix-grpc-daemon[782]: ts=2026-09-22T14:51:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 worker2 # [ 52.829274] nix-daemon[869]: reaped child process 1041, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.42 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.12 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.69 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2 client # don't know how to build these paths: client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker1 # [ 53.236311] nix-grpc-daemon[781]: ts=2026-09-22T14:51:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 53.242155] nix-grpc-daemon[781]: ts=2026-09-22T14:51:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 worker2 # [ 53.236208] nix-grpc-daemon[782]: ts=2026-09-22T14:51:25Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker2 # [ 53.240245] nix-grpc-daemon[782]: ts=2026-09-22T14:51:25Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 53.268161] nix-grpc-daemon[781]: ts=2026-09-22T14:51:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 53.279897] nix-grpc-daemon[781]: ts=2026-09-22T14:51:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'... worker1 # [ 53.290881] nix-grpc-daemon[781]: ts=2026-09-22T14:51:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 53.302194] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 53.322971] nix-grpc-daemon[781]: ts=2026-09-22T14:51:24Z level=info event=niks3_push_started pid=874 worker1 # [ 53.450146] nix-grpc-daemon[874]: time=2026-09-22T14:51:24.647Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 53.540135] nix-daemon[849]: accepted connection from pid 887, user nix-grpc-daemon (trusted) worker1 # [ 53.554516] nix-daemon[849]: reaped child process 890, status = succeeded worker1 # [ 53.636674] nix-daemon[849]: accepted connection from pid 892, user nix-grpc-daemon (trusted) worker1 # [ 53.650214] nix-daemon[849]: reaped child process 895, status = succeeded lb # [ 53.624354] niks3-server[1059]: 2026/09/22 14:51:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.663329] nix-grpc-daemon[874]: time=2026-09-22T14:51:24.861Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 53.665650] nix-grpc-daemon[874]: time=2026-09-22T14:51:24.862Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" lb # [ 53.657684] niks3-server[1059]: 2026/09/22 14:51:24 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 53.667424] niks3-server[1059]: 2026/09/22 14:51:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 53.672942] niks3-server[1059]: 2026/09/22 14:51:24 INFO Signed narinfos id=9 count=1 worker1 # [ 53.706694] nix-grpc-daemon[874]: time=2026-09-22T14:51:24.904Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.689676] niks3-server[1059]: 2026/09/22 14:51:24 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 53.697375] niks3-server[1059]: 2026/09/22 14:51:24 INFO Completed upload id=9 worker1 # [ 53.730805] nix-grpc-daemon[874]: time=2026-09-22T14:51:24.928Z level=INFO msg="Upload complete. (276ms)" lb # [ 53.700683] niks3-server[1059]: 2026/09/22 14:51:24 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls worker1 # [ 53.732990] nix-grpc-daemon[781]: ts=2026-09-22T14:51:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=1 nar_bytes_in=504 lb # [ 53.704321] niks3-server[1059]: 2026/09/22 14:51:24 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker1 # [ 53.739597] nix-daemon[849]: reaped child process 872, status = succeeded worker1 # [ 53.741328] nix-grpc-daemon[781]: ts=2026-09-22T14:51:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 53.745332] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051... client # farm-a> node-a: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker1 # [ 53.750715] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker1 # [ 55.166889] nix-daemon[849]: reaped child process 899, status = succeeded worker1 # [ 55.240349] nix-daemon[849]: accepted connection from pid 915, user nix-grpc-daemon (trusted) worker1 # [ 55.252766] nix-daemon[849]: reaped child process 918, status = succeeded lb # [ 55.231793] niks3-server[1059]: 2026/09/22 14:51:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.269864] nix-grpc-daemon[874]: time=2026-09-22T14:51:26.467Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 55.271550] nix-grpc-daemon[874]: time=2026-09-22T14:51:26.469Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 55.270267] niks3-server[1059]: 2026/09/22 14:51:25 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 55.283456] niks3-server[1059]: 2026/09/22 14:51:25 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 55.298551] niks3-server[1059]: 2026/09/22 14:51:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker1 # [ 55.337164] nix-grpc-daemon[874]: time=2026-09-22T14:51:26.534Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.305445] niks3-server[1059]: 2026/09/22 14:51:25 INFO Signed narinfos id=10 count=1 lb # [ 55.312431] niks3-server[1059]: 2026/09/22 14:51:25 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 55.318659] niks3-server[1059]: 2026/09/22 14:51:25 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 55.321551] niks3-server[1059]: 2026/09/22 14:51:25 INFO Completed upload id=10 worker1 # [ 55.353597] nix-grpc-daemon[874]: time=2026-09-22T14:51:26.551Z level=INFO msg="Upload complete. (195ms)" lb # [ 55.323745] niks3-server[1059]: 2026/09/22 14:51:25 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker1 # [ 55.356159] nix-grpc-daemon[781]: ts=2026-09-22T14:51:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 worker1 # [ 55.363213] nix-daemon[849]: reaped child process 897, status = succeeded worker2 # [ 55.344697] nix-grpc-daemon[782]: ts=2026-09-22T14:51:27Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 worker2 # [ 55.348696] nix-grpc-daemon[782]: ts=2026-09-22T14:51:27Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 55.410198] nix-grpc-daemon[781]: ts=2026-09-22T14:51:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 55.422925] nix-grpc-daemon[781]: ts=2026-09-22T14:51:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 55.434791] nix-grpc-daemon[874]: time=2026-09-22T14:51:26.632Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'... worker1 # [ 55.443442] nix-grpc-daemon[781]: ts=2026-09-22T14:51:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 55.457175] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 55.557036] nix-daemon[849]: accepted connection from pid 922, user nix-grpc-daemon (trusted) worker1 # [ 55.571233] nix-daemon[849]: reaped child process 925, status = succeeded worker1 # [ 55.655971] nix-daemon[849]: accepted connection from pid 927, user nix-grpc-daemon (trusted) worker1 # [ 55.670744] nix-daemon[849]: reaped child process 930, status = succeeded lb # [ 55.644179] niks3-server[1059]: 2026/09/22 14:51:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.683492] nix-grpc-daemon[874]: time=2026-09-22T14:51:26.881Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 55.685488] nix-grpc-daemon[874]: time=2026-09-22T14:51:26.882Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" lb # [ 55.671461] niks3-server[1059]: 2026/09/22 14:51:26 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 55.684392] niks3-server[1059]: 2026/09/22 14:51:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 55.722431] nix-grpc-daemon[874]: time=2026-09-22T14:51:26.919Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.691469] niks3-server[1059]: 2026/09/22 14:51:26 INFO Signed narinfos id=11 count=1 lb # [ 55.695696] niks3-server[1059]: 2026/09/22 14:51:26 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 55.707351] niks3-server[1059]: 2026/09/22 14:51:26 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 55.710295] niks3-server[1059]: 2026/09/22 14:51:26 INFO Completed upload id=11 worker1 # [ 55.741293] nix-grpc-daemon[874]: time=2026-09-22T14:51:26.938Z level=INFO msg="Upload complete. (272ms)" worker1 # [ 55.743760] nix-grpc-daemon[781]: ts=2026-09-22T14:51:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 55.713459] niks3-server[1059]: 2026/09/22 14:51:26 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker1 # [ 55.747135] nix-grpc-daemon[781]: ts=2026-09-22T14:51:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 55.755441] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 55.759736] nix-daemon[849]: reaped child process 920, status = succeeded worker1 # [ 55.763711] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051... client # farm-b> node-a: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker1 # [ 57.000670] nix-daemon[849]: reaped child process 934, status = succeeded worker1 # [ 57.079197] nix-daemon[849]: accepted connection from pid 950, user nix-grpc-daemon (trusted) worker1 # [ 57.091817] nix-daemon[849]: reaped child process 953, status = succeeded lb # [ 57.065578] niks3-server[1059]: 2026/09/22 14:51:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.105427] nix-grpc-daemon[874]: time=2026-09-22T14:51:28.302Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 57.107167] nix-grpc-daemon[874]: time=2026-09-22T14:51:28.304Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 57.108753] niks3-server[1059]: 2026/09/22 14:51:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 57.114703] niks3-server[1059]: 2026/09/22 14:51:27 INFO Signed narinfos id=12 count=1 worker1 # [ 57.149598] nix-grpc-daemon[874]: time=2026-09-22T14:51:28.347Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.122071] niks3-server[1059]: 2026/09/22 14:51:27 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 57.128368] niks3-server[1059]: 2026/09/22 14:51:27 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 57.138137] niks3-server[1059]: 2026/09/22 14:51:27 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 57.145212] niks3-server[1059]: 2026/09/22 14:51:27 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 57.152411] niks3-server[1059]: 2026/09/22 14:51:27 INFO Completed upload id=12 worker1 # [ 57.183384] nix-grpc-daemon[874]: time=2026-09-22T14:51:28.380Z level=INFO msg="Upload complete. (212ms)" lb # [ 57.156495] niks3-server[1059]: 2026/09/22 14:51:27 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker1 # [ 57.189672] nix-grpc-daemon[781]: ts=2026-09-22T14:51:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 worker2 # [ 57.174861] nix-grpc-daemon[782]: ts=2026-09-22T14:51:29Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker2 # [ 57.179356] nix-grpc-daemon[782]: ts=2026-09-22T14:51:29Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 57.204970] nix-daemon[849]: reaped child process 932, status = succeeded worker1 # [ 57.244394] nix-grpc-daemon[781]: ts=2026-09-22T14:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 57.256224] nix-grpc-daemon[781]: ts=2026-09-22T14:51:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 57.269083] nix-grpc-daemon[874]: time=2026-09-22T14:51:28.466Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'... worker1 # [ 57.276897] nix-grpc-daemon[781]: ts=2026-09-22T14:51:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 57.284647] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 57.377259] nix-daemon[849]: accepted connection from pid 957, user nix-grpc-daemon (trusted) worker1 # [ 57.390601] nix-daemon[849]: reaped child process 960, status = succeeded worker1 # [ 57.462994] nix-daemon[849]: accepted connection from pid 962, user nix-grpc-daemon (trusted) worker1 # [ 57.476194] nix-daemon[849]: reaped child process 965, status = succeeded lb # [ 57.449256] niks3-server[1059]: 2026/09/22 14:51:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.488381] nix-grpc-daemon[874]: time=2026-09-22T14:51:28.686Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 57.490038] nix-grpc-daemon[874]: time=2026-09-22T14:51:28.687Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" lb # [ 57.479327] niks3-server[1059]: 2026/09/22 14:51:27 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 57.489402] niks3-server[1059]: 2026/09/22 14:51:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 57.494660] niks3-server[1059]: 2026/09/22 14:51:27 INFO Signed narinfos id=13 count=1 worker1 # [ 57.528553] nix-grpc-daemon[874]: time=2026-09-22T14:51:28.726Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.508092] niks3-server[1059]: 2026/09/22 14:51:27 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 57.515144] niks3-server[1059]: 2026/09/22 14:51:27 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete worker1 # [ 57.554243] nix-grpc-daemon[874]: time=2026-09-22T14:51:28.751Z level=INFO msg="Upload complete. (256ms)" lb # [ 57.524043] niks3-server[1059]: 2026/09/22 14:51:27 INFO Completed upload id=13 lb # [ 57.526443] niks3-server[1059]: 2026/09/22 14:51:27 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker1 # [ 57.557642] nix-grpc-daemon[781]: ts=2026-09-22T14:51:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 57.562115] nix-grpc-daemon[781]: ts=2026-09-22T14:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 57.572264] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 57.579106] nix-daemon[849]: reaped child process 955, status = succeeded client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051... worker1 # [ 57.582115] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # farm-top> node-a: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 57.645526] envoy[924]: conn peer=[2001:db8:1::1]:53582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9481 tx=4395 ms=5770 lb # [ 57.648469] envoy[924]: conn peer=[2001:db8:1::1]:53586 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=38 lb # [ 57.651944] envoy[924]: conn peer=[2001:db8:1::1]:53602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4182 tx=1921 ms=2292 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker1 # [ 58.638098] nix-daemon[849]: reaped child process 969, status = succeeded worker1 # [ 58.684966] nix-daemon[849]: accepted connection from pid 985, user nix-grpc-daemon (trusted) worker1 # [ 58.697364] nix-daemon[849]: reaped child process 988, status = succeeded lb # [ 58.672787] niks3-server[1059]: 2026/09/22 14:51:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 58.709100] nix-grpc-daemon[874]: time=2026-09-22T14:51:29.906Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 58.710568] nix-grpc-daemon[874]: time=2026-09-22T14:51:29.908Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 58.694136] niks3-server[1059]: 2026/09/22 14:51:29 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv lb # [ 58.701801] niks3-server[1059]: 2026/09/22 14:51:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 58.705303] niks3-server[1059]: 2026/09/22 14:51:29 INFO Signed narinfos id=14 count=1 worker1 # [ 58.736203] nix-grpc-daemon[874]: time=2026-09-22T14:51:29.933Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.707070] niks3-server[1059]: 2026/09/22 14:51:29 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 58.712828] niks3-server[1059]: 2026/09/22 14:51:29 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 58.717338] niks3-server[1059]: 2026/09/22 14:51:29 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 58.721155] niks3-server[1059]: 2026/09/22 14:51:29 INFO Completed upload id=14 worker1 # [ 58.751928] nix-grpc-daemon[874]: time=2026-09-22T14:51:29.949Z level=INFO msg="Upload complete. (162ms)" worker1 # [ 58.754455] nix-grpc-daemon[781]: ts=2026-09-22T14:51:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 lb # [ 58.724731] niks3-server[1059]: 2026/09/22 14:51:29 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker1 # [ 58.761326] nix-daemon[849]: reaped child process 967, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.68 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.11 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker1 # [ 58.996143] nix-grpc-daemon[781]: ts=2026-09-22T14:51:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:38312 worker1 # [ 59.002557] nix-grpc-daemon[781]: ts=2026-09-22T14:51:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:38312 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.16 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 59.128617] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:34794 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top worker2 # [ 59.157050] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:34794 worker2 # [ 59.162478] nix-grpc-daemon[782]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker2 # [ 59.174728] nix-grpc-daemon[782]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker2 # [ 59.185326] nix-grpc-daemon[782]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.19 seconds) client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/841" client # removing stale temporary roots file "/nix/var/nix/temproots/853" client # removing stale temporary roots file "/nix/var/nix/temproots/882" client # removing stale temporary roots file "/nix/var/nix/temproots/820" client # removing stale temporary roots file "/nix/var/nix/temproots/874" client # removing stale temporary roots file "/nix/var/nix/temproots/806" client # removing stale temporary roots file "/nix/var/nix/temproots/861" client # removing stale temporary roots file "/nix/var/nix/temproots/897" client # deleting specified paths... client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker1 # [ 59.473283] nix-grpc-daemon[781]: ts=2026-09-22T14:51:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 59.480305] nix-grpc-daemon[781]: ts=2026-09-22T14:51:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 59.488888] nix-grpc-daemon[874]: time=2026-09-22T14:51:30.686Z level=INFO msg="All 1 paths already cached" worker2 # [ 59.474274] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37526 worker1 # [ 59.500407] nix-grpc-daemon[781]: ts=2026-09-22T14:51:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57550 client # copying 3 paths... worker2 # [ 59.488902] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37526 client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'... worker1 # [ 59.526369] nix-grpc-daemon[781]: ts=2026-09-22T14:51:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 59.531758] nix-grpc-daemon[781]: ts=2026-09-22T14:51:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 59.512140] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 59.517872] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 59.524285] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 59.528096] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.39 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 6.52 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup client # [ 59.643679] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 876f28ec45d042519fc4a8f06ed17050 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup worker2 # [ 59.755825] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37526 client # [ 59.768846] nix[950]: don't know how to build these paths: client # [ 59.769781] nix[950]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 59.762788] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 59.764982] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 59.767749] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 59.776433] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 client # [ 59.797980] nix[950]: copying 1 paths to 'lb:50051'... client # [ 59.798821] nix[950]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'... worker2 # [ 59.787964] nix-grpc-daemon[782]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 59.799408] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 59.903478] nix-daemon[869]: accepted connection from pid 1082, user nix-grpc-daemon (trusted) worker2 # [ 59.927727] nix-daemon[869]: reaped child process 1085, status = succeeded worker2 # [ 60.003668] nix-daemon[869]: accepted connection from pid 1087, user nix-grpc-daemon (trusted) worker2 # [ 60.022263] nix-daemon[869]: reaped child process 1090, status = succeeded lb # [ 60.018218] niks3-server[1059]: 2026/09/22 14:51:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.035280] nix-grpc-daemon[884]: time=2026-09-22T14:51:32.061Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 60.037136] nix-grpc-daemon[884]: time=2026-09-22T14:51:32.063Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)" lb # [ 60.049948] niks3-server[1059]: 2026/09/22 14:51:30 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst lb # [ 60.058896] niks3-server[1059]: 2026/09/22 14:51:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 60.063847] niks3-server[1059]: 2026/09/22 14:51:30 INFO Signed narinfos id=15 count=1 worker2 # [ 60.077302] nix-grpc-daemon[884]: time=2026-09-22T14:51:32.103Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.073958] niks3-server[1059]: 2026/09/22 14:51:30 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls lb # [ 60.084540] niks3-server[1059]: 2026/09/22 14:51:30 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 60.090514] niks3-server[1059]: 2026/09/22 14:51:30 INFO Completed upload id=15 worker2 # [ 60.100110] nix-grpc-daemon[884]: time=2026-09-22T14:51:32.126Z level=INFO msg="Upload complete. (290ms)" worker2 # [ 60.103631] nix-grpc-daemon[782]: ts=2026-09-22T14:51:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 60.096248] niks3-server[1059]: 2026/09/22 14:51:30 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo worker2 # [ 60.109164] nix-grpc-daemon[782]: ts=2026-09-22T14:51:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 60.121068] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 60.125177] nix-daemon[869]: reaped child process 1080, status = succeeded worker2 # [ 60.130294] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # [ 60.141531] nix[950]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client # [ 60.697628] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: a0c914d0c7ad4225b9e02fc9157b218f client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.06 seconds) worker1 # [ 60.872549] nix-grpc-daemon[781]: ts=2026-09-22T14:51:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57550 client # [ 60.868616] nix[966]: don't know how to build these paths: client # [ 60.869513] nix[966]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker2 # [ 60.866578] nix-grpc-daemon[782]: ts=2026-09-22T14:51:32Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=0 worker2 # [ 60.876444] nix-grpc-daemon[782]: ts=2026-09-22T14:51:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 client # [ 60.893629] nix[966]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.04 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 64.172283] nix-daemon[869]: reaped child process 1094, status = succeeded worker2 # [ 64.251957] nix-daemon[869]: accepted connection from pid 1127, user nix-grpc-daemon (trusted) worker2 # [ 64.265026] nix-daemon[869]: reaped child process 1130, status = succeeded lb # [ 64.263526] niks3-server[1059]: 2026/09/22 14:51:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 64.281682] nix-grpc-daemon[884]: time=2026-09-22T14:51:36.307Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 64.283206] nix-grpc-daemon[884]: time=2026-09-22T14:51:36.309Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)" lb # [ 64.315483] niks3-server[1059]: 2026/09/22 14:51:34 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv lb # [ 64.320726] niks3-server[1059]: 2026/09/22 14:51:34 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 64.333204] niks3-server[1059]: 2026/09/22 14:51:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 64.338115] niks3-server[1059]: 2026/09/22 14:51:34 INFO Signed narinfos id=16 count=1 worker2 # [ 64.347923] nix-grpc-daemon[884]: time=2026-09-22T14:51:36.374Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.347343] niks3-server[1059]: 2026/09/22 14:51:34 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls lb # [ 64.351773] niks3-server[1059]: 2026/09/22 14:51:34 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 64.357087] niks3-server[1059]: 2026/09/22 14:51:34 INFO Completed upload id=16 worker2 # [ 64.366776] nix-grpc-daemon[884]: time=2026-09-22T14:51:36.393Z level=INFO msg="Upload complete. (225ms)" lb # [ 64.358945] niks3-server[1059]: 2026/09/22 14:51:34 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo worker2 # [ 64.374274] nix-grpc-daemon[782]: ts=2026-09-22T14:51:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 64.382261] nix-grpc-daemon[782]: ts=2026-09-22T14:51:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 64.389620] nix-daemon[869]: reaped child process 1092, status = succeeded client # [ 64.419571] systemd[1]: dedup2.service: Deactivated successfully. client # [ 64.422919] systemd[1]: dedup2.service: Consumed 142ms CPU time over 3.721s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client # [ 64.460076] systemd[1]: dedup1.service: Deactivated successfully. client # [ 64.462911] systemd[1]: dedup1.service: Consumed 115ms CPU time over 4.818s wall clock time, 41.5M memory peak, 7.3K incoming IP traffic, 8.5K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.02 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: two clients wanting the same drv build it once, in 5.64 seconds) subtest: --timeout and --max-silent-time reach the builder worker1 # [ 65.409482] nix-grpc-daemon[781]: ts=2026-09-22T14:51:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57550 worker2 # [ 65.401837] nix-grpc-daemon[782]: ts=2026-09-22T14:51:37Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=0 worker2 # [ 65.406499] nix-grpc-daemon[782]: ts=2026-09-22T14:51:37Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 65.430181] nix-grpc-daemon[781]: ts=2026-09-22T14:51:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 65.442365] nix-grpc-daemon[781]: ts=2026-09-22T14:51:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 65.452874] nix-grpc-daemon[781]: ts=2026-09-22T14:51:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 65.463720] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 65.563537] nix-daemon[849]: accepted connection from pid 1013, user nix-grpc-daemon (trusted) worker1 # [ 65.576988] nix-daemon[849]: reaped child process 1016, status = succeeded worker1 # [ 65.659519] nix-daemon[849]: accepted connection from pid 1018, user nix-grpc-daemon (trusted) worker1 # [ 65.671895] nix-daemon[849]: reaped child process 1021, status = succeeded lb # [ 65.648645] niks3-server[1059]: 2026/09/22 14:51:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.688435] nix-grpc-daemon[874]: time=2026-09-22T14:51:36.885Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 65.689761] nix-grpc-daemon[874]: time=2026-09-22T14:51:36.885Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)" lb # [ 65.680919] niks3-server[1059]: 2026/09/22 14:51:36 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst lb # [ 65.689070] niks3-server[1059]: 2026/09/22 14:51:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 65.724863] nix-grpc-daemon[874]: time=2026-09-22T14:51:36.922Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.694815] niks3-server[1059]: 2026/09/22 14:51:36 INFO Signed narinfos id=17 count=1 lb # [ 65.701133] niks3-server[1059]: 2026/09/22 14:51:36 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls lb # [ 65.713839] niks3-server[1059]: 2026/09/22 14:51:36 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 65.720221] niks3-server[1059]: 2026/09/22 14:51:36 INFO Completed upload id=17 worker1 # [ 65.754216] nix-grpc-daemon[874]: time=2026-09-22T14:51:36.951Z level=INFO msg="Upload complete. (279ms)" lb # [ 65.725665] niks3-server[1059]: 2026/09/22 14:51:36 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo worker1 # [ 65.758552] nix-grpc-daemon[781]: ts=2026-09-22T14:51:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 65.763622] nix-grpc-daemon[781]: ts=2026-09-22T14:51:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 65.771141] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 65.780464] nix-daemon[849]: reaped child process 1011, status = succeeded worker1 # [ 65.785149] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) lb # [ 67.646236] envoy[924]: conn peer=[2001:db8:1::1]:36542 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9481 tx=4373 ms=5535 lb # [ 67.648201] envoy[924]: conn peer=[2001:db8:1::1]:36556 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2889 ms=139 lb # [ 67.650072] envoy[924]: conn peer=[2001:db8:1::1]:36562 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=85 lb # [ 67.651774] envoy[924]: conn peer=[2001:db8:1::1]:36592 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=72 lb # [ 67.653437] envoy[924]: conn peer=[2001:db8:1::1]:36576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=80 lb # [ 67.655134] envoy[924]: conn peer=[2001:db8:1::1]:36602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1194 ms=3546 lb # [ 67.656818] envoy[924]: conn peer=[2001:db8:1::1]:36594 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2998 tx=1538 ms=4676 worker1 # [ 71.997693] nix-grpc-daemon[781]: ts=2026-09-22T14:51:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 worker1 # [ 72.008961] nix-daemon[849]: reaped child process 1023, status = succeeded worker1 # [ 72.009968] nix-daemon[849]: reaped child process 1025, status = succeeded worker1 # [ 72.169440] nix-grpc-daemon[781]: ts=2026-09-22T14:51:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57550 worker2 # [ 72.157946] nix-grpc-daemon[782]: ts=2026-09-22T14:51:44Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=0 worker2 # [ 72.166753] nix-grpc-daemon[782]: ts=2026-09-22T14:51:44Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 72.171255] nix-grpc-daemon[782]: ts=2026-09-22T14:51:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 72.182640] nix-grpc-daemon[782]: ts=2026-09-22T14:51:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 72.193784] nix-grpc-daemon[782]: ts=2026-09-22T14:51:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 72.205239] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 72.314892] nix-daemon[869]: accepted connection from pid 1147, user nix-grpc-daemon (trusted) worker2 # [ 72.330536] nix-daemon[869]: reaped child process 1150, status = succeeded worker2 # [ 72.420958] nix-daemon[869]: accepted connection from pid 1152, user nix-grpc-daemon (trusted) worker2 # [ 72.436366] nix-daemon[869]: reaped child process 1155, status = succeeded lb # [ 72.433407] niks3-server[1059]: 2026/09/22 14:51:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 72.452278] nix-grpc-daemon[884]: time=2026-09-22T14:51:44.478Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 72.453875] nix-grpc-daemon[884]: time=2026-09-22T14:51:44.480Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)" lb # [ 72.465911] niks3-server[1059]: 2026/09/22 14:51:42 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst lb # [ 72.480864] niks3-server[1059]: 2026/09/22 14:51:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 72.488846] niks3-server[1059]: 2026/09/22 14:51:42 INFO Signed narinfos id=18 count=1 worker2 # [ 72.502256] nix-grpc-daemon[884]: time=2026-09-22T14:51:44.528Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.496651] niks3-server[1059]: 2026/09/22 14:51:42 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls lb # [ 72.507594] niks3-server[1059]: 2026/09/22 14:51:42 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 72.514086] niks3-server[1059]: 2026/09/22 14:51:42 INFO Completed upload id=18 worker2 # [ 72.523863] nix-grpc-daemon[884]: time=2026-09-22T14:51:44.550Z level=INFO msg="Upload complete. (307ms)" lb # [ 72.516668] niks3-server[1059]: 2026/09/22 14:51:42 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo worker2 # [ 72.528709] nix-grpc-daemon[782]: ts=2026-09-22T14:51:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 72.535059] nix-grpc-daemon[782]: ts=2026-09-22T14:51:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 72.544879] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 72.555917] nix-daemon[869]: reaped child process 1145, status = succeeded worker2 # [ 72.561326] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) lb # [ 77.647226] envoy[924]: conn peer=[2001:db8:1::1]:44932 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3009 tx=975 ms=6604 worker2 # [ 78.774224] nix-grpc-daemon[782]: ts=2026-09-22T14:51:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=6 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 worker2 # [ 78.786618] nix-daemon[869]: reaped child process 1157, status = succeeded worker2 # [ 78.787573] nix-daemon[869]: reaped child process 1159, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.65 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share client # [ 78.952897] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 8c3489ca04d9467d99353f11e6588598 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share worker2 # [ 79.083300] nix-grpc-daemon[782]: ts=2026-09-22T14:51:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37526 client # [ 79.096119] nix[1038]: don't know how to build these paths: client # [ 79.096984] nix[1038]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 79.089339] nix-grpc-daemon[782]: ts=2026-09-22T14:51:51Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker2 # [ 79.091256] nix-grpc-daemon[782]: ts=2026-09-22T14:51:51Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 79.117809] nix-grpc-daemon[781]: ts=2026-09-22T14:51:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 79.130665] nix-grpc-daemon[781]: ts=2026-09-22T14:51:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 client # [ 79.130647] nix[1038]: copying 1 paths to 'lb:50051'... client # [ 79.131557] nix[1038]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'... worker1 # [ 79.141771] nix-grpc-daemon[781]: ts=2026-09-22T14:51:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 79.151970] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 79.251750] nix-daemon[849]: accepted connection from pid 1048, user nix-grpc-daemon (trusted) worker1 # [ 79.263955] nix-daemon[849]: reaped child process 1051, status = succeeded worker1 # [ 79.344352] nix-daemon[849]: accepted connection from pid 1053, user nix-grpc-daemon (trusted) worker1 # [ 79.356926] nix-daemon[849]: reaped child process 1056, status = succeeded lb # [ 79.333070] niks3-server[1059]: 2026/09/22 14:51:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 79.372585] nix-grpc-daemon[874]: time=2026-09-22T14:51:50.569Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 79.374025] nix-grpc-daemon[874]: time=2026-09-22T14:51:50.569Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)" lb # [ 79.361748] niks3-server[1059]: 2026/09/22 14:51:49 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst lb # [ 79.377131] niks3-server[1059]: 2026/09/22 14:51:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign worker1 # [ 79.412674] nix-grpc-daemon[874]: time=2026-09-22T14:51:50.610Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.381637] niks3-server[1059]: 2026/09/22 14:51:49 INFO Signed narinfos id=19 count=1 lb # [ 79.392948] niks3-server[1059]: 2026/09/22 14:51:49 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls lb # [ 79.399873] niks3-server[1059]: 2026/09/22 14:51:49 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete worker1 # [ 79.437516] nix-grpc-daemon[874]: time=2026-09-22T14:51:50.635Z level=INFO msg="Upload complete. (274ms)" lb # [ 79.406877] niks3-server[1059]: 2026/09/22 14:51:49 INFO Completed upload id=19 worker1 # [ 79.439561] nix-grpc-daemon[781]: ts=2026-09-22T14:51:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 79.442670] nix-grpc-daemon[781]: ts=2026-09-22T14:51:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 lb # [ 79.412659] niks3-server[1059]: 2026/09/22 14:51:49 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo worker1 # [ 79.447379] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 79.452977] nix-daemon[849]: reaped child process 1046, status = succeeded client # [ 79.446615] nix[1038]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... worker1 # [ 79.457132] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # [ 80.020510] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 7ef78c3a61434a73962facecd65b14ef client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.06 seconds) worker1 # [ 80.166764] nix-grpc-daemon[781]: ts=2026-09-22T14:51:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57550 client # [ 80.166364] nix[1054]: this derivation will be built: worker1 # [ 80.177320] nix-grpc-daemon[781]: ts=2026-09-22T14:51:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57550 client # [ 80.176613] nix[1054]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker2 # [ 80.170461] nix-grpc-daemon[782]: ts=2026-09-22T14:51:52Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=0 worker1 # [ 80.194071] nix-grpc-daemon[781]: ts=2026-09-22T14:51:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 client # [ 80.189324] nix[1054]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 83.255569] systemd[1]: share1.service: Sent signal SIGINT to main process 1038 (nix) on client request. client # [ 83.261658] nix[1038]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 83.269761] nix[1038]: error: interrupted by the user client # [ 83.312795] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 83.314431] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 83.316232] systemd[1]: share1.service: Consumed 114ms CPU time over 4.362s wall clock time, 41.4M memory peak, 6.2K incoming IP traffic, 8.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.06 seconds) client: waiting for success: ! systemctl is-active share2 worker1 # [ 84.677756] nix-daemon[849]: reaped child process 1060, status = succeeded worker1 # [ 84.750063] nix-daemon[849]: accepted connection from pid 1094, user nix-grpc-daemon (trusted) worker1 # [ 84.763403] nix-daemon[849]: reaped child process 1097, status = succeeded lb # [ 84.737747] niks3-server[1059]: 2026/09/22 14:51:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 84.772767] nix-grpc-daemon[874]: time=2026-09-22T14:51:55.970Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 84.774262] nix-grpc-daemon[874]: time=2026-09-22T14:51:55.971Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)" lb # [ 84.755736] niks3-server[1059]: 2026/09/22 14:51:55 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 84.760153] niks3-server[1059]: 2026/09/22 14:51:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 84.762069] niks3-server[1059]: 2026/09/22 14:51:55 INFO Signed narinfos id=20 count=1 worker1 # [ 84.794086] nix-grpc-daemon[874]: time=2026-09-22T14:51:55.991Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.766600] niks3-server[1059]: 2026/09/22 14:51:55 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv lb # [ 84.771326] niks3-server[1059]: 2026/09/22 14:51:55 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 84.774088] niks3-server[1059]: 2026/09/22 14:51:55 INFO Completed upload id=20 worker1 # [ 84.804735] nix-grpc-daemon[874]: time=2026-09-22T14:51:56.002Z level=INFO msg="Upload complete. (136ms)" lb # [ 84.775555] niks3-server[1059]: 2026/09/22 14:51:55 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls worker1 # [ 84.807549] nix-grpc-daemon[781]: ts=2026-09-22T14:51:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 lb # [ 84.781320] niks3-server[1059]: 2026/09/22 14:51:55 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo worker1 # [ 84.811128] nix-grpc-daemon[781]: ts=2026-09-22T14:51:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 worker1 # [ 84.816618] nix-daemon[849]: reaped child process 1058, status = succeeded client # [ 84.857898] systemd[1]: share2.service: Deactivated successfully. client # [ 84.859072] systemd[1]: share2.service: Consumed 113ms CPU time over 4.838s wall clock time, 35.4M memory peak, 6.6K incoming IP traffic, 6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.06 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds) (finished: subtest: the first client leaving does not fail the second, in 6.68 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 85.672074] systemd[1]: Started Nix Daemon. client # [ 85.750869] nix-daemon[1106]: accepted connection from pid 1103, user root (trusted) worker1 # [ 85.866459] nix-grpc-daemon[781]: ts=2026-09-22T14:51:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:57550 worker2 # [ 85.848364] nix-grpc-daemon[782]: ts=2026-09-22T14:51:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 85.855839] nix-grpc-daemon[782]: ts=2026-09-22T14:51:57Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker2 # [ 85.857970] nix-grpc-daemon[782]: ts=2026-09-22T14:51:57Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 85.860654] nix-grpc-daemon[782]: ts=2026-09-22T14:51:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 85.867481] nix-grpc-daemon[782]: ts=2026-09-22T14:51:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 85.874389] nix-grpc-daemon[782]: ts=2026-09-22T14:51:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 85.879510] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 85.963462] nix-daemon[869]: accepted connection from pid 1204, user nix-grpc-daemon (trusted) worker2 # [ 85.976916] nix-daemon[869]: reaped child process 1207, status = succeeded worker2 # [ 86.059378] nix-daemon[869]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker2 # [ 86.072369] nix-daemon[869]: reaped child process 1212, status = succeeded lb # [ 86.069983] niks3-server[1059]: 2026/09/22 14:51:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.091160] nix-grpc-daemon[884]: time=2026-09-22T14:51:58.117Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 86.092574] nix-grpc-daemon[884]: time=2026-09-22T14:51:58.117Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" lb # [ 86.100599] niks3-server[1059]: 2026/09/22 14:51:56 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 86.117212] niks3-server[1059]: 2026/09/22 14:51:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 86.123112] niks3-server[1059]: 2026/09/22 14:51:56 INFO Signed narinfos id=21 count=1 worker2 # [ 86.135580] nix-grpc-daemon[884]: time=2026-09-22T14:51:58.161Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.136679] niks3-server[1059]: 2026/09/22 14:51:56 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 86.144257] niks3-server[1059]: 2026/09/22 14:51:56 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 86.152175] niks3-server[1059]: 2026/09/22 14:51:56 INFO Completed upload id=21 lb # [ 86.154205] niks3-server[1059]: 2026/09/22 14:51:56 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker2 # [ 86.163310] nix-grpc-daemon[884]: time=2026-09-22T14:51:58.189Z level=INFO msg="Upload complete. (279ms)" worker2 # [ 86.167291] nix-grpc-daemon[782]: ts=2026-09-22T14:51:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 86.172354] nix-grpc-daemon[782]: ts=2026-09-22T14:51:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 86.182870] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 86.193589] nix-daemon[869]: reaped child process 1202, status = succeeded worker2 # [ 86.198188] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 87.242155] nix-daemon[869]: reaped child process 1216, status = succeeded worker2 # [ 87.321603] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted) worker2 # [ 87.334704] nix-daemon[869]: reaped child process 1235, status = succeeded lb # [ 87.331966] niks3-server[1059]: 2026/09/22 14:51:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 87.349349] nix-grpc-daemon[884]: time=2026-09-22T14:51:59.375Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 87.350837] nix-grpc-daemon[884]: time=2026-09-22T14:51:59.377Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 87.371147] niks3-server[1059]: 2026/09/22 14:51:57 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 87.381931] niks3-server[1059]: 2026/09/22 14:51:57 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 87.394363] niks3-server[1059]: 2026/09/22 14:51:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 87.398648] niks3-server[1059]: 2026/09/22 14:51:57 INFO Signed narinfos id=22 count=1 worker2 # [ 87.408415] nix-grpc-daemon[884]: time=2026-09-22T14:51:59.434Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.404396] niks3-server[1059]: 2026/09/22 14:51:57 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 87.412408] niks3-server[1059]: 2026/09/22 14:51:57 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 87.416473] niks3-server[1059]: 2026/09/22 14:51:57 INFO Completed upload id=22 lb # [ 87.418710] niks3-server[1059]: 2026/09/22 14:51:57 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker2 # [ 87.427442] nix-grpc-daemon[884]: time=2026-09-22T14:51:59.453Z level=INFO msg="Upload complete. (221ms)" worker2 # [ 87.433861] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 worker2 # [ 87.447865] nix-daemon[869]: reaped child process 1214, status = succeeded worker2 # [ 87.479959] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 87.498672] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 87.503652] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_out=128 lb # [ 87.647439] envoy[924]: conn peer=[2001:db8:1::1]:44940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2995 tx=953 ms=6640 lb # [ 87.648957] envoy[924]: conn peer=[2001:db8:1::1]:51012 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3008 tx=788 ms=4185 lb # [ 87.650366] envoy[924]: conn peer=[2001:db8:1::1]:51022 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1602 tx=1596 ms=4694 lb # [ 87.651800] envoy[924]: conn peer=[2001:db8:1::1]:33458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=58 lb # [ 87.653282] envoy[924]: conn peer=[2001:db8:1::1]:33442 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3406 tx=1916 ms=1712 worker2 # [ 87.700791] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37526 worker1 # [ 87.724636] nix-grpc-daemon[781]: ts=2026-09-22T14:51:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 worker2 # [ 87.718655] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker2 # [ 87.723301] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 87.727984] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 87.736481] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 87.747575] nix-grpc-daemon[884]: time=2026-09-22T14:51:59.773Z level=INFO msg="All 1 paths already cached" worker2 # [ 87.754546] nix-grpc-daemon[782]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 87.763169] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 87.861037] nix-daemon[869]: accepted connection from pid 1241, user nix-grpc-daemon (trusted) worker2 # [ 87.875052] nix-daemon[869]: reaped child process 1244, status = succeeded worker2 # [ 87.958652] nix-daemon[869]: accepted connection from pid 1246, user nix-grpc-daemon (trusted) worker2 # [ 87.973194] nix-daemon[869]: reaped child process 1249, status = succeeded lb # [ 87.968252] niks3-server[1059]: 2026/09/22 14:51:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 87.985690] nix-grpc-daemon[884]: time=2026-09-22T14:52:00.012Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 87.987162] nix-grpc-daemon[884]: time=2026-09-22T14:52:00.013Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" lb # [ 87.999594] niks3-server[1059]: 2026/09/22 14:51:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker2 # [ 88.015135] nix-grpc-daemon[884]: time=2026-09-22T14:52:00.041Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.005491] niks3-server[1059]: 2026/09/22 14:51:58 INFO Signed narinfos id=23 count=1 lb # [ 88.015529] niks3-server[1059]: 2026/09/22 14:51:58 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 88.022709] niks3-server[1059]: 2026/09/22 14:51:58 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 88.032830] niks3-server[1059]: 2026/09/22 14:51:58 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 88.038893] niks3-server[1059]: 2026/09/22 14:51:58 INFO Completed upload id=23 worker2 # [ 88.048271] nix-grpc-daemon[884]: time=2026-09-22T14:52:00.074Z level=INFO msg="Upload complete. (273ms)" lb # [ 88.041832] niks3-server[1059]: 2026/09/22 14:51:58 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker2 # [ 88.051890] nix-grpc-daemon[782]: ts=2026-09-22T14:52:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 88.057753] nix-grpc-daemon[782]: ts=2026-09-22T14:52:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 88.067290] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 88.073900] nix-daemon[869]: reaped child process 1239, status = succeeded worker2 # [ 88.076899] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 88.706662] nix-daemon[869]: reaped child process 1253, status = succeeded worker2 # [ 88.775608] nix-daemon[869]: accepted connection from pid 1269, user nix-grpc-daemon (trusted) worker2 # [ 88.788732] nix-daemon[869]: reaped child process 1272, status = succeeded lb # [ 88.786958] niks3-server[1059]: 2026/09/22 14:51:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 88.805478] nix-grpc-daemon[884]: time=2026-09-22T14:52:00.831Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 88.808060] nix-grpc-daemon[884]: time=2026-09-22T14:52:00.833Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 88.822174] niks3-server[1059]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 88.840134] niks3-server[1059]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst lb # [ 88.847644] niks3-server[1059]: 2026/09/22 14:51:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 88.854955] niks3-server[1059]: 2026/09/22 14:51:59 INFO Signed narinfos id=24 count=1 worker2 # [ 88.867045] nix-grpc-daemon[884]: time=2026-09-22T14:52:00.893Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.864394] niks3-server[1059]: 2026/09/22 14:51:59 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 88.868322] niks3-server[1059]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 88.872386] niks3-server[1059]: 2026/09/22 14:51:59 INFO Completed upload id=24 lb # [ 88.874156] niks3-server[1059]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker2 # [ 88.883346] nix-grpc-daemon[884]: time=2026-09-22T14:52:00.909Z level=INFO msg="Upload complete. (199ms)" worker2 # [ 88.889969] nix-grpc-daemon[782]: ts=2026-09-22T14:52:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 worker2 # [ 88.898743] nix-grpc-daemon[782]: ts=2026-09-22T14:52:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 88.909804] nix-daemon[869]: reaped child process 1251, status = succeeded worker2 # [ 88.915203] nix-grpc-daemon[782]: ts=2026-09-22T14:52:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 88.918919] nix-grpc-daemon[782]: ts=2026-09-22T14:52:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 89.144592] nix-grpc-daemon[781]: ts=2026-09-22T14:52:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:57550 worker2 # [ 89.125915] nix-grpc-daemon[782]: ts=2026-09-22T14:52:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 89.135233] nix-grpc-daemon[884]: time=2026-09-22T14:52:01.161Z level=INFO msg="All 2 paths already cached" worker2 # [ 89.147544] nix-grpc-daemon[782]: ts=2026-09-22T14:52:01Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker2 # [ 89.153371] nix-grpc-daemon[782]: ts=2026-09-22T14:52:01Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 89.158754] nix-grpc-daemon[782]: ts=2026-09-22T14:52:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 89.167672] nix-grpc-daemon[782]: ts=2026-09-22T14:52:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 89.180287] nix-grpc-daemon[884]: time=2026-09-22T14:52:01.206Z level=INFO msg="All 2 paths already cached" worker2 # [ 89.186922] nix-grpc-daemon[782]: ts=2026-09-22T14:52:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 89.196334] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 89.295740] nix-daemon[869]: accepted connection from pid 1278, user nix-grpc-daemon (trusted) worker2 # [ 89.311231] nix-daemon[869]: reaped child process 1281, status = succeeded worker2 # [ 89.390891] nix-daemon[869]: accepted connection from pid 1283, user nix-grpc-daemon (trusted) worker2 # [ 89.404127] nix-daemon[869]: reaped child process 1286, status = succeeded lb # [ 89.400691] niks3-server[1059]: 2026/09/22 14:51:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 89.418293] nix-grpc-daemon[884]: time=2026-09-22T14:52:01.444Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 89.419655] nix-grpc-daemon[884]: time=2026-09-22T14:52:01.444Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 89.426578] niks3-server[1059]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 89.436267] niks3-server[1059]: 2026/09/22 14:51:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 89.441622] niks3-server[1059]: 2026/09/22 14:51:59 INFO Signed narinfos id=25 count=1 worker2 # [ 89.454083] nix-grpc-daemon[884]: time=2026-09-22T14:52:01.480Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.453110] niks3-server[1059]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 89.461507] niks3-server[1059]: 2026/09/22 14:51:59 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete worker2 # [ 89.478377] nix-grpc-daemon[884]: time=2026-09-22T14:52:01.504Z level=INFO msg="Upload complete. (270ms)" lb # [ 89.469194] niks3-server[1059]: 2026/09/22 14:51:59 INFO Completed upload id=25 worker2 # [ 89.481199] nix-grpc-daemon[782]: ts=2026-09-22T14:52:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 89.473396] niks3-server[1059]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker2 # [ 89.486566] nix-grpc-daemon[782]: ts=2026-09-22T14:52:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 89.495445] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 89.499112] nix-daemon[869]: reaped child process 1276, status = succeeded worker2 # [ 89.502838] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 90.319055] nix-daemon[869]: reaped child process 1290, status = succeeded worker2 # [ 90.390958] nix-daemon[869]: accepted connection from pid 1306, user nix-grpc-daemon (trusted) worker2 # [ 90.404296] nix-daemon[869]: reaped child process 1309, status = succeeded lb # [ 90.401046] niks3-server[1059]: 2026/09/22 14:52:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 90.415282] nix-grpc-daemon[884]: time=2026-09-22T14:52:02.441Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 90.416709] nix-grpc-daemon[884]: time=2026-09-22T14:52:02.443Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" lb # [ 90.422506] niks3-server[1059]: 2026/09/22 14:52:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign worker2 # [ 90.434272] nix-grpc-daemon[884]: time=2026-09-22T14:52:02.460Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.425114] niks3-server[1059]: 2026/09/22 14:52:00 INFO Signed narinfos id=26 count=1 lb # [ 90.427200] niks3-server[1059]: 2026/09/22 14:52:00 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 90.432180] niks3-server[1059]: 2026/09/22 14:52:00 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 90.437206] niks3-server[1059]: 2026/09/22 14:52:00 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls lb # [ 90.442382] niks3-server[1059]: 2026/09/22 14:52:00 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 90.445286] niks3-server[1059]: 2026/09/22 14:52:00 INFO Completed upload id=26 worker2 # [ 90.454661] nix-grpc-daemon[884]: time=2026-09-22T14:52:02.481Z level=INFO msg="Upload complete. (145ms)" worker2 # [ 90.457251] nix-grpc-daemon[782]: ts=2026-09-22T14:52:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 lb # [ 90.449603] niks3-server[1059]: 2026/09/22 14:52:00 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo worker2 # [ 90.462557] nix-grpc-daemon[782]: ts=2026-09-22T14:52:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 90.467266] nix-daemon[869]: reaped child process 1288, status = succeeded worker1 # [ 90.494302] nix-grpc-daemon[781]: ts=2026-09-22T14:52:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 90.504583] nix-grpc-daemon[781]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... worker1 # [ 90.516273] nix-grpc-daemon[781]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'... worker1 # [ 90.525259] nix-grpc-daemon[781]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'... worker1 # [ 90.534993] nix-grpc-daemon[781]: ts=2026-09-22T14:52:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=1 nar_bytes_out=232 client # [ 90.626252] nix-daemon[1106]: reaped child process 1108, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.05 seconds) client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.10 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.21 seconds) client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds) worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 91.251652] nix-daemon[1106]: accepted connection from pid 1189, user root (trusted) client # this derivation will be built: client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker2 # [ 91.356380] nix-grpc-daemon[782]: ts=2026-09-22T14:52:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37526 client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker1 # [ 91.382940] nix-grpc-daemon[781]: ts=2026-09-22T14:52:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 91.487984] nix-daemon[849]: accepted connection from pid 1107, user nix-grpc-daemon (trusted) worker1 # [ 91.500607] nix-daemon[849]: reaped child process 1110, status = succeeded lb # [ 91.476420] niks3-server[1059]: 2026/09/22 14:52:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 91.516624] nix-grpc-daemon[874]: time=2026-09-22T14:52:02.714Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 91.518383] nix-grpc-daemon[874]: time=2026-09-22T14:52:02.715Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)" lb # [ 91.504050] niks3-server[1059]: 2026/09/22 14:52:01 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 91.515396] niks3-server[1059]: 2026/09/22 14:52:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker1 # [ 91.553917] nix-grpc-daemon[874]: time=2026-09-22T14:52:02.751Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.523126] niks3-server[1059]: 2026/09/22 14:52:01 INFO Signed narinfos id=27 count=1 lb # [ 91.530122] niks3-server[1059]: 2026/09/22 14:52:01 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls lb # [ 91.542570] niks3-server[1059]: 2026/09/22 14:52:01 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete worker1 # [ 91.579628] nix-grpc-daemon[874]: time=2026-09-22T14:52:02.777Z level=INFO msg="Upload complete. (192ms)" lb # [ 91.548938] niks3-server[1059]: 2026/09/22 14:52:01 INFO Completed upload id=27 lb # [ 91.553546] niks3-server[1059]: 2026/09/22 14:52:01 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo worker2 # [ 91.572858] nix-grpc-daemon[782]: ts=2026-09-22T14:52:03Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=0 worker2 # [ 91.574865] nix-grpc-daemon[782]: ts=2026-09-22T14:52:03Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 91.638801] nix-grpc-daemon[781]: ts=2026-09-22T14:52:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 91.649602] nix-grpc-daemon[781]: ts=2026-09-22T14:52:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 91.664910] nix-grpc-daemon[781]: ts=2026-09-22T14:52:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 91.673140] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 91.768348] nix-daemon[849]: accepted connection from pid 1114, user nix-grpc-daemon (trusted) worker1 # [ 91.781062] nix-daemon[849]: reaped child process 1117, status = succeeded worker1 # [ 91.854744] nix-daemon[849]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker1 # [ 91.871497] nix-daemon[849]: reaped child process 1122, status = succeeded lb # [ 91.840281] niks3-server[1059]: 2026/09/22 14:52:02 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 91.851802] niks3-server[1059]: 2026/09/22 14:52:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 91.891546] nix-grpc-daemon[874]: time=2026-09-22T14:52:03.089Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 91.892992] nix-grpc-daemon[874]: time=2026-09-22T14:52:03.090Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)" worker1 # [ 91.894706] nix-grpc-daemon[874]: time=2026-09-22T14:52:03.092Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)" lb # [ 91.900092] niks3-server[1059]: 2026/09/22 14:52:02 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst lb # [ 91.903584] niks3-server[1059]: 2026/09/22 14:52:02 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst lb # [ 91.906630] niks3-server[1059]: 2026/09/22 14:52:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 91.909431] niks3-server[1059]: 2026/09/22 14:52:02 INFO Signed narinfos id=29 count=2 lb # [ 91.911995] niks3-server[1059]: 2026/09/22 14:52:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 91.914679] niks3-server[1059]: 2026/09/22 14:52:02 INFO Signed narinfos id=28 count=1 lb # [ 91.916292] niks3-server[1059]: 2026/09/22 14:52:02 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls worker1 # [ 91.947590] nix-grpc-daemon[874]: time=2026-09-22T14:52:03.144Z level=INFO msg="Uploading 3 narinfos" lb # [ 91.920916] niks3-server[1059]: 2026/09/22 14:52:02 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls lb # [ 91.930627] niks3-server[1059]: 2026/09/22 14:52:02 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 91.935443] niks3-server[1059]: 2026/09/22 14:52:02 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 91.939171] niks3-server[1059]: 2026/09/22 14:52:02 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo lb # [ 91.942086] niks3-server[1059]: 2026/09/22 14:52:02 INFO Completed upload id=29 lb # [ 91.943796] niks3-server[1059]: 2026/09/22 14:52:02 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 91.946870] niks3-server[1059]: 2026/09/22 14:52:02 INFO Completed upload id=28 lb # [ 91.949282] niks3-server[1059]: 2026/09/22 14:52:02 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo worker1 # [ 91.978965] nix-grpc-daemon[874]: time=2026-09-22T14:52:03.176Z level=INFO msg="Upload complete. (292ms)" worker1 # [ 91.983754] nix-grpc-daemon[781]: ts=2026-09-22T14:52:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=2 nar_bytes_in=976 worker1 # [ 91.989855] nix-grpc-daemon[781]: ts=2026-09-22T14:52:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 92.001108] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 92.009837] nix-daemon[849]: reaped child process 1112, status = succeeded worker1 # [ 92.016371] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 93.232182] nix-daemon[849]: reaped child process 1126, status = succeeded worker1 # [ 93.300799] nix-daemon[849]: accepted connection from pid 1142, user nix-grpc-daemon (trusted) worker1 # [ 93.313255] nix-daemon[849]: reaped child process 1145, status = succeeded lb # [ 93.287650] niks3-server[1059]: 2026/09/22 14:52:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 93.323678] nix-grpc-daemon[874]: time=2026-09-22T14:52:04.521Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 93.314864] niks3-server[1059]: 2026/09/22 14:52:03 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls lb # [ 93.321070] niks3-server[1059]: 2026/09/22 14:52:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 93.325992] niks3-server[1059]: 2026/09/22 14:52:03 INFO Signed narinfos id=30 count=1 worker1 # [ 93.359800] nix-grpc-daemon[874]: time=2026-09-22T14:52:04.557Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.336585] niks3-server[1059]: 2026/09/22 14:52:03 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv lb # [ 93.344876] niks3-server[1059]: 2026/09/22 14:52:03 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 93.352121] niks3-server[1059]: 2026/09/22 14:52:03 INFO Completed upload id=30 worker1 # [ 93.385118] nix-grpc-daemon[874]: time=2026-09-22T14:52:04.582Z level=INFO msg="Upload complete. (160ms)" lb # [ 93.359153] niks3-server[1059]: 2026/09/22 14:52:03 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo worker1 # [ 93.388821] nix-grpc-daemon[781]: ts=2026-09-22T14:52:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 client # copying 1 paths... worker1 # [ 93.397557] nix-grpc-daemon[781]: ts=2026-09-22T14:52:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57550 client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 93.405599] nix-daemon[849]: reaped child process 1124, status = succeeded worker1 # [ 93.414319] nix-grpc-daemon[781]: ts=2026-09-22T14:52:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 93.416680] nix-grpc-daemon[781]: ts=2026-09-22T14:52:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=1 nar_bytes_out=120 client # [ 93.515600] nix-daemon[1106]: reaped child process 1192, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.38 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 93.620114] nix-daemon[1106]: accepted connection from pid 1211, user root (trusted) client # this derivation will be built: client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 93.726469] nix-grpc-daemon[782]: ts=2026-09-22T14:52:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 93.732586] nix-grpc-daemon[782]: ts=2026-09-22T14:52:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 93.748211] nix-grpc-daemon[782]: ts=2026-09-22T14:52:05Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=0 worker2 # [ 93.754340] nix-grpc-daemon[782]: ts=2026-09-22T14:52:05Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 93.759625] nix-grpc-daemon[782]: ts=2026-09-22T14:52:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 93.769627] nix-grpc-daemon[782]: ts=2026-09-22T14:52:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 93.785769] nix-grpc-daemon[782]: ts=2026-09-22T14:52:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 93.796977] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 93.811414] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 1/5) worker2 # [ 93.826200] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 2/5) worker2 # [ 93.931803] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 363 ms (attempt 3/5) worker2 # [ 94.296438] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 513 ms (attempt 4/5) worker2 # [ 94.812875] nix-grpc-daemon[782]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 94.816504] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 94.821819] nix-grpc-daemon[782]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 94.931431] nix-daemon[869]: accepted connection from pid 1325, user nix-grpc-daemon (trusted) worker2 # [ 94.947810] nix-daemon[869]: reaped child process 1328, status = succeeded worker2 # [ 95.029190] nix-daemon[869]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker2 # [ 95.046285] nix-daemon[869]: reaped child process 1333, status = succeeded lb # [ 95.041790] niks3-server[1059]: 2026/09/22 14:52:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.055722] nix-grpc-daemon[884]: time=2026-09-22T14:52:07.081Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 95.057143] nix-grpc-daemon[884]: time=2026-09-22T14:52:07.081Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)" lb # [ 95.053294] niks3-server[1059]: 2026/09/22 14:52:05 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst lb # [ 95.058279] niks3-server[1059]: 2026/09/22 14:52:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 95.061063] niks3-server[1059]: 2026/09/22 14:52:05 INFO Signed narinfos id=31 count=1 worker2 # [ 95.070606] nix-grpc-daemon[884]: time=2026-09-22T14:52:07.096Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.067828] niks3-server[1059]: 2026/09/22 14:52:05 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 95.071289] niks3-server[1059]: 2026/09/22 14:52:05 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls lb # [ 95.073689] niks3-server[1059]: 2026/09/22 14:52:05 INFO Completed upload id=31 worker2 # [ 95.083259] nix-grpc-daemon[884]: time=2026-09-22T14:52:07.109Z level=INFO msg="Upload complete. (247ms)" worker2 # [ 95.085261] nix-grpc-daemon[782]: ts=2026-09-22T14:52:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=1 paths=1 nar_bytes_in=560 lb # [ 95.076763] niks3-server[1059]: 2026/09/22 14:52:05 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo worker2 # [ 95.088737] nix-grpc-daemon[782]: ts=2026-09-22T14:52:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 95.094950] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) worker2 # [ 95.099064] nix-daemon[869]: reaped child process 1318, status = succeeded worker2 # [ 95.102109] nix-grpc-daemon[782]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'... worker2 # [ 95.109290] nix-daemon[869]: accepted connection from pid 782, user nix-grpc-daemon (trusted) client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 95.522857] nix-daemon[869]: reaped child process 1338, status = succeeded worker2 # [ 95.600657] nix-daemon[869]: accepted connection from pid 1354, user nix-grpc-daemon (trusted) worker2 # [ 95.615865] nix-daemon[869]: reaped child process 1357, status = succeeded lb # [ 95.610770] niks3-server[1059]: 2026/09/22 14:52:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.630461] nix-grpc-daemon[884]: time=2026-09-22T14:52:07.656Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 95.643176] niks3-server[1059]: 2026/09/22 14:52:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 95.649139] niks3-server[1059]: 2026/09/22 14:52:06 INFO Signed narinfos id=32 count=1 worker2 # [ 95.661864] nix-grpc-daemon[884]: time=2026-09-22T14:52:07.688Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.657125] niks3-server[1059]: 2026/09/22 14:52:06 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv lb # [ 95.671819] niks3-server[1059]: 2026/09/22 14:52:06 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls lb # [ 95.677974] niks3-server[1059]: 2026/09/22 14:52:06 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 95.683422] niks3-server[1059]: 2026/09/22 14:52:06 INFO Completed upload id=32 worker2 # [ 95.693250] nix-grpc-daemon[884]: time=2026-09-22T14:52:07.719Z level=INFO msg="Upload complete. (177ms)" lb # [ 95.688415] niks3-server[1059]: 2026/09/22 14:52:06 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo worker2 # [ 95.698787] nix-grpc-daemon[782]: ts=2026-09-22T14:52:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 client # copying 1 paths... worker2 # [ 95.710333] nix-grpc-daemon[782]: ts=2026-09-22T14:52:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37526 client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 95.719440] nix-daemon[869]: reaped child process 1335, status = succeeded worker2 # [ 95.729377] nix-grpc-daemon[782]: ts=2026-09-22T14:52:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 95.732202] nix-grpc-daemon[782]: ts=2026-09-22T14:52:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_out=120 client # [ 95.851298] nix-daemon[1106]: reaped child process 1214, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.34 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 95.953163] nix-daemon[1106]: accepted connection from pid 1233, user root (trusted) client # this derivation will be built: client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker1 # [ 96.080334] nix-grpc-daemon[781]: ts=2026-09-22T14:52:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:57550 client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'... worker2 # [ 96.064602] nix-grpc-daemon[782]: ts=2026-09-22T14:52:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 96.071628] nix-grpc-daemon[884]: time=2026-09-22T14:52:08.096Z level=INFO msg="All 1 paths already cached" worker2 # [ 96.081203] nix-grpc-daemon[782]: ts=2026-09-22T14:52:08Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=0 worker2 # [ 96.086723] nix-grpc-daemon[782]: ts=2026-09-22T14:52:08Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 96.111100] nix-grpc-daemon[781]: ts=2026-09-22T14:52:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 96.123494] nix-grpc-daemon[781]: ts=2026-09-22T14:52:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 96.137348] nix-grpc-daemon[874]: time=2026-09-22T14:52:07.334Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 96.146144] nix-grpc-daemon[781]: ts=2026-09-22T14:52:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 96.155656] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 96.269931] nix-daemon[849]: accepted connection from pid 1149, user nix-grpc-daemon (trusted) worker1 # [ 96.286706] nix-daemon[849]: reaped child process 1152, status = succeeded worker1 # [ 96.379929] nix-daemon[849]: accepted connection from pid 1154, user nix-grpc-daemon (trusted) worker1 # [ 96.396957] nix-daemon[849]: reaped child process 1157, status = succeeded lb # [ 96.371392] niks3-server[1059]: 2026/09/22 14:52:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 96.406288] nix-grpc-daemon[874]: time=2026-09-22T14:52:07.603Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 96.407989] nix-grpc-daemon[874]: time=2026-09-22T14:52:07.605Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)" lb # [ 96.388344] niks3-server[1059]: 2026/09/22 14:52:06 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst lb # [ 96.392053] niks3-server[1059]: 2026/09/22 14:52:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 96.394783] niks3-server[1059]: 2026/09/22 14:52:06 INFO Signed narinfos id=33 count=1 worker1 # [ 96.426830] nix-grpc-daemon[874]: time=2026-09-22T14:52:07.624Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.397586] niks3-server[1059]: 2026/09/22 14:52:06 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls lb # [ 96.403107] niks3-server[1059]: 2026/09/22 14:52:06 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 96.406509] niks3-server[1059]: 2026/09/22 14:52:06 INFO Completed upload id=33 worker1 # [ 96.437407] nix-grpc-daemon[874]: time=2026-09-22T14:52:07.635Z level=INFO msg="Upload complete. (266ms)" lb # [ 96.409347] niks3-server[1059]: 2026/09/22 14:52:06 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo worker1 # [ 96.440458] nix-grpc-daemon[781]: ts=2026-09-22T14:52:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=0 paths=1 nar_bytes_in=560 worker1 # [ 96.445076] nix-grpc-daemon[781]: ts=2026-09-22T14:52:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 96.454567] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker1 # [ 96.458253] nix-daemon[849]: reaped child process 1147, status = succeeded worker1 # [ 96.462877] nix-daemon[849]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 97.292639] nix-daemon[849]: reaped child process 1161, status = succeeded worker1 # [ 97.378089] nix-daemon[849]: accepted connection from pid 1177, user nix-grpc-daemon (trusted) worker1 # [ 97.393405] nix-daemon[849]: reaped child process 1180, status = succeeded lb # [ 97.367833] niks3-server[1059]: 2026/09/22 14:52:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.405284] nix-grpc-daemon[874]: time=2026-09-22T14:52:08.601Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 97.393748] niks3-server[1059]: 2026/09/22 14:52:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls lb # [ 97.402953] niks3-server[1059]: 2026/09/22 14:52:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker1 # [ 97.438924] nix-grpc-daemon[874]: time=2026-09-22T14:52:08.636Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.408495] niks3-server[1059]: 2026/09/22 14:52:07 INFO Signed narinfos id=34 count=1 lb # [ 97.415722] niks3-server[1059]: 2026/09/22 14:52:07 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv lb # [ 97.428199] niks3-server[1059]: 2026/09/22 14:52:07 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 97.434886] niks3-server[1059]: 2026/09/22 14:52:07 INFO Completed upload id=34 worker1 # [ 97.468195] nix-grpc-daemon[874]: time=2026-09-22T14:52:08.665Z level=INFO msg="Upload complete. (198ms)" lb # [ 97.439363] niks3-server[1059]: 2026/09/22 14:52:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo client # copying 1 paths... worker1 # [ 97.474726] nix-grpc-daemon[781]: ts=2026-09-22T14:52:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57550 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 worker2 # [ 97.460391] nix-grpc-daemon[782]: ts=2026-09-22T14:52:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:37526 worker1 # [ 97.487815] nix-daemon[849]: reaped child process 1159, status = succeeded worker2 # [ 97.468926] nix-grpc-daemon[782]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 97.501740] nix-grpc-daemon[782]: ts=2026-09-22T14:52:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 worker2 # [ 97.506494] nix-grpc-daemon[782]: ts=2026-09-22T14:52:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37526 duration_s=0 paths=1 nar_bytes_out=120 client # [ 97.628895] nix-daemon[1106]: reaped child process 1236, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.78 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 6.94 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache lb # [ 97.648788] envoy[924]: conn peer=[2001:db8:1::1]:33464 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=2163 ms=1268 lb # [ 97.652423] envoy[924]: conn peer=[2001:db8:1::1]:33470 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=378 ms=55 lb # [ 97.655976] envoy[924]: conn peer=[2001:db8:1::1]:33478 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4341 tx=2387 ms=1441 lb # [ 97.659469] envoy[924]: conn peer=[2001:db8:1::1]:33484 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=90 lb # [ 97.662827] envoy[924]: conn peer=[2001:db8:1::1]:33490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3851 tx=2064 ms=2093 lb # [ 97.666882] envoy[924]: conn peer=[2001:db8:1::1]:35328 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=52 lb # [ 97.670325] envoy[924]: conn peer=[2001:db8:1::1]:35336 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3724 tx=2086 ms=2058 lb # [ 97.673952] envoy[924]: conn peer=[2001:db8:1::1]:35338 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=54 lb # [ 97.677408] envoy[924]: conn peer=[2001:db8:1::1]:35354 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3729 tx=2098 ms=1502 lb # [ 97.680891] envoy[924]: conn peer=[2001:db8:1::1]:35370 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=64 client # this derivation will be built: client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.24 seconds) client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.23 seconds) client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds) worker2 # [ 98.362677] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 98.901607] nix-grpc-daemon[782]: ts=2026-09-22T14:52:10Z level=info event=signal_exit lb # [ 99.613963] niks3-server[1059]: 2026/09/22 14:52:10 INFO lead: released remote=192.168.1.4:58196 lb # [ 99.615796] niks3-server[1059]: 2026/09/22 14:52:10 INFO lead: acquired remote=192.168.1.3:36656 worker1 # [ 99.648118] nix-grpc-daemon[781]: ts=2026-09-22T14:52:10Z level=info event=scheduler_take_over worker1 # [ 100.646233] nix-grpc-daemon[781]: ts=2026-09-22T14:52:11Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 100.624792] nix-grpc-daemon[782]: ts=2026-09-22T14:52:12Z level=info event=scheduler_restarting worker2 # [ 100.633478] nix-grpc-daemon[782]: ts=2026-09-22T14:52:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37514 worker2 # [ 100.637260] nix-grpc-daemon[782]: ts=2026-09-22T14:52:12Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 100.640780] nix-grpc-daemon[782]: ts=2026-09-22T14:52:12Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 100.643856] nix-grpc-daemon[782]: ts=2026-09-22T14:52:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37514 worker2 # [ 100.647495] nix-grpc-daemon[782]: ts=2026-09-22T14:52:12Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 100.664728] nix-daemon[869]: reaped child process 872, status = succeeded worker1 # [ 100.851610] nix-grpc-daemon[781]: ts=2026-09-22T14:52:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.855617] nix-grpc-daemon[781]: ts=2026-09-22T14:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 100.845240] nix-grpc-daemon[782]: ts=2026-09-22T14:52:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 101.027386] nix-grpc-daemon[782]: E0000 00:00:1790088733.053468 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker2 # [ 101.032252] nix-grpc-daemon[782]: E0000 00:00:1790088733.053665 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 101.056723] nix-grpc-daemon[781]: ts=2026-09-22T14:52:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.067128] nix-grpc-daemon[781]: ts=2026-09-22T14:52:12Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:55040 worker1 # [ 101.070679] nix-grpc-daemon[781]: ts=2026-09-22T14:52:12Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 101.307746] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 101.311416] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 101.315550] systemd[1]: nix-grpc-daemon.service: Consumed 3.220s CPU time over 1min 23.572s wall clock time, 70.6M memory peak, 117.3K incoming IP traffic, 324.6K outgoing IP traffic. worker2 # [ 101.327199] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 101.331524] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 101.334817] systemd[1]: nix-grpc-daemon.socket: Consumed 319us CPU time over 1min 33.606s wall clock time, 256K memory peak, 121.9K incoming IP traffic, 102.5K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.02 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2 worker1 # [ 101.522115] nix-grpc-daemon[781]: ts=2026-09-22T14:52:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57550 worker1 # [ 101.528684] nix-grpc-daemon[781]: ts=2026-09-22T14:52:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57550 client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds) worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds) worker2 # [ 101.586862] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 101.655286] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 101.824002] nix-grpc-daemon[781]: ts=2026-09-22T14:52:13Z level=info event=signal_exit worker2 # [ 102.300913] systemd[1]: Starting scheduler-token.service... worker2 # [ 102.334755] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 102.336332] systemd[1]: Finished scheduler-token.service. worker2 # [ 102.337537] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 35ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 102.341722] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 102.422171] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 102.424208] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 102.427553] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 102.431882] nix-grpc-daemon[1384]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 102.433251] nix-grpc-daemon[1384]: E0000 00:00:1790088734.458291 1384 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 102.438856] nix-grpc-daemon[1384]: E0000 00:00:1790088734.463924 1384 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 102.443546] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 102.445213] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 102.451256] nix-grpc-daemon[1384]: E0000 00:00:1790088734.477747 1425 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 102.465881] nix-grpc-daemon[1384]: E0000 00:00:1790088734.492316 1425 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 102.470054] nix-grpc-daemon[1384]: E0000 00:00:1790088734.494604 1425 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 102.480323] nix-grpc-daemon[1384]: E0000 00:00:1790088734.506765 1425 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 102.489995] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.491560] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 102.624541] niks3-server[1059]: 2026/09/22 14:52:13 INFO lead: released remote=192.168.1.3:36656 worker2 # [ 102.693087] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.697289] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 102.897742] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 102.899512] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.100440] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.102172] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.302858] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.304682] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 103.506966] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.510255] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.660354] nix-grpc-daemon[781]: ts=2026-09-22T14:52:14Z level=info event=scheduler_restarting worker1 # [ 103.664596] nix-grpc-daemon[781]: ts=2026-09-22T14:52:14Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 103.668526] nix-grpc-daemon[781]: ts=2026-09-22T14:52:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:55040 worker1 # [ 103.671820] nix-grpc-daemon[781]: ts=2026-09-22T14:52:14Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 103.694554] nix-daemon[849]: reaped child process 851, status = succeeded worker2 # [ 103.707994] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.712117] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.866080] nix-grpc-daemon[781]: ts=2026-09-22T14:52:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 103.913103] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.917207] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 103.973634] nix-grpc-daemon[781]: E0000 00:00:1790088735.170250 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 103.979296] nix-grpc-daemon[781]: E0000 00:00:1790088735.170482 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 104.118201] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.122178] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.322755] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.324581] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.525495] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.527268] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.727948] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.729667] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.930856] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.934809] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.135821] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.139859] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.291401] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 105.293801] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 105.296714] systemd[1]: nix-grpc-daemon.service: Consumed 2.369s CPU time over 1min 27.618s wall clock time, 60.7M memory peak, 90.9K incoming IP traffic, 170.8K outgoing IP traffic. worker1 # [ 105.302773] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 105.304601] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 105.305975] systemd[1]: nix-grpc-daemon.socket: Consumed 315us CPU time over 1min 37.709s wall clock time, 256K memory peak, 96.4K incoming IP traffic, 84.5K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2 worker2 # [ 105.340436] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.342489] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.465255] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 105.476744] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 105.492769] nix-grpc-daemon[1384]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5) worker2 # [ 105.545295] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.548409] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.571231] nix-grpc-daemon[1384]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 2/5) worker2 # [ 105.630628] nix-grpc-daemon[1384]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 364 ms (attempt 3/5) worker2 # [ 105.746448] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.750738] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.951634] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.955532] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.996765] nix-grpc-daemon[1384]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 283 ms (attempt 4/5) worker2 # [ 106.156783] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.160654] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.282314] nix-grpc-daemon[1384]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 106.286145] nix-grpc-daemon[1384]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 106.308147] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 106.318581] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 106.343432] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=niks3_push_started pid=1444 worker2 # [ 106.361630] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.365427] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.455830] nix-grpc-daemon[1444]: time=2026-09-22T14:52:18.481Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 106.546340] nix-daemon[869]: accepted connection from pid 1457, user nix-grpc-daemon (trusted) worker2 # [ 106.561119] nix-daemon[869]: reaped child process 1460, status = succeeded worker2 # [ 106.566162] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=scheduler_connected addr=lb:50051 lb # [ 106.555649] niks3-server[1059]: 2026/09/22 14:52:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 106.570250] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 106.568145] niks3-server[1059]: 2026/09/22 14:52:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 106.585075] nix-grpc-daemon[1444]: time=2026-09-22T14:52:18.610Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 106.586459] nix-grpc-daemon[1444]: time=2026-09-22T14:52:18.610Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)" worker2 # [ 106.589780] nix-grpc-daemon[1444]: time=2026-09-22T14:52:18.610Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)" lb # [ 106.617538] niks3-server[1059]: 2026/09/22 14:52:17 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 106.631941] niks3-server[1059]: 2026/09/22 14:52:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 106.640312] niks3-server[1059]: 2026/09/22 14:52:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls lb # [ 106.651252] niks3-server[1059]: 2026/09/22 14:52:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls lb # [ 106.656134] niks3-server[1059]: 2026/09/22 14:52:17 INFO Signed narinfos id=35 count=1 lb # [ 106.657171] niks3-server[1059]: 2026/09/22 14:52:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 106.659143] niks3-server[1059]: 2026/09/22 14:52:17 INFO Signed narinfos id=36 count=2 worker2 # [ 106.670181] nix-grpc-daemon[1444]: time=2026-09-22T14:52:18.695Z level=INFO msg="Uploading 3 narinfos" lb # [ 106.663111] niks3-server[1059]: 2026/09/22 14:52:17 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst lb # [ 106.678801] niks3-server[1059]: 2026/09/22 14:52:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 106.684672] niks3-server[1059]: 2026/09/22 14:52:17 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 106.688993] niks3-server[1059]: 2026/09/22 14:52:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo lb # [ 106.692623] niks3-server[1059]: 2026/09/22 14:52:17 INFO Completed upload id=35 lb # [ 106.694401] niks3-server[1059]: 2026/09/22 14:52:17 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 106.696531] niks3-server[1059]: 2026/09/22 14:52:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo lb # [ 106.699493] niks3-server[1059]: 2026/09/22 14:52:17 INFO Completed upload id=36 worker2 # [ 106.709341] nix-grpc-daemon[1444]: time=2026-09-22T14:52:18.735Z level=INFO msg="Upload complete. (249ms)" worker2 # [ 106.714898] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 106.729475] nix-daemon[869]: reaped child process 1442, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.43 seconds) worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds) worker2 # [ 106.771265] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.774298] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.834118] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 106.846415] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 106.932056] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 106.934099] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 106.937398] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 106.941708] nix-grpc-daemon[1203]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 106.943064] nix-grpc-daemon[1203]: E0000 00:00:1790088738.139230 1203 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 106.949126] nix-grpc-daemon[1203]: E0000 00:00:1790088738.144598 1203 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 106.952122] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 106.953753] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 106.959429] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=scheduler_take_over lb # [ 106.928878] niks3-server[1059]: 2026/09/22 14:52:17 INFO lead: acquired remote=192.168.1.3:55960 worker1 # [ 106.962134] nix-grpc-daemon[1203]: E0000 00:00:1790088738.158461 1244 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 106.973740] nix-grpc-daemon[1203]: E0000 00:00:1790088738.171388 1244 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 106.978055] nix-grpc-daemon[1203]: E0000 00:00:1790088738.173674 1244 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 106.987744] nix-grpc-daemon[1203]: E0000 00:00:1790088738.185406 1244 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 106.975389] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.999840] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.001450] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.979754] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 107.180889] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.202715] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.185179] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.206761] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.386323] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.407524] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.414739] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:50322 worker1 # [ 107.421093] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 107.429319] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 107.432410] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:50322 worker1 # [ 107.436406] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:18Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # [ 107.648921] envoy[924]: conn peer=[2001:db8:1::4]:58772 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=91306 tx=4830 ms=82921 lb # [ 107.652961] envoy[924]: conn peer=[2001:db8:1::1]:35384 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=20 lb # [ 107.656507] envoy[924]: conn peer=[2001:db8:1::3]:55848 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=24041 tx=4525 ms=86013 lb # [ 107.660426] envoy[924]: conn peer=[2001:db8:1::1]:60182 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1005 tx=281 ms=1266 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.42 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb # [ 108.111224] niks3-server[1059]: 2026/09/22 14:52:18 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 108.112822] niks3-server[1059]: 2026/09/22 14:52:18 INFO lead: released remote=192.168.1.3:55960 worker1 # [ 108.142541] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:19Z level=info event=scheduler_lock_lost status=200 worker2 # [ 108.121957] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:20Z level=info event=scheduler_lock_lost status=200 lb # [ 108.118209] systemd[1]: Stopping niks3 server... lb # [ 108.130728] systemd[1]: niks3.service: Deactivated successfully. lb # [ 108.133083] systemd[1]: Stopped niks3 server. lb # [ 108.133741] systemd[1]: niks3.service: Consumed 688ms CPU time over 1min 18.744s wall clock time, 28.7M memory peak, 92.6K incoming IP traffic, 134.6K outgoing IP traffic. lb # [ 108.140768] systemd[1]: Starting niks3 server... lb # [ 108.189640] niks3-server[1194]: 2026/09/22 14:52:18 goose: no migrations to run. current version: 20260920000000 lb # [ 108.195576] niks3-server[1194]: 2026/09/22 14:52:18 OK 1_commit_pending_closure.sql (4.05ms) lb # [ 108.199069] niks3-server[1194]: 2026/09/22 14:52:18 OK 2_object_stats_trigger.sql (1.83ms) lb # [ 108.200157] niks3-server[1194]: 2026/09/22 14:52:18 goose: up to current file version: 2 lb # [ 108.201468] niks3-server[1194]: 2026/09/22 14:52:18 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key lb # [ 108.212618] niks3-server[1194]: 2026/09/22 14:52:18 INFO Read proxy enabled — serving cache objects from S3 lb # [ 108.214559] niks3-server[1194]: 2026/09/22 14:52:18 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 108.216804] systemd[1]: Started niks3 server. lb # [ 108.218337] niks3-server[1194]: 2026/09/22 14:52:18 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 108.220452] niks3-server[1194]: 2026/09/22 14:52:18 INFO systemd watchdog enabled interval=15s lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 108.587148] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 108.598534] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker2 # [ 108.591541] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38758 worker1 # [ 108.626997] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:19Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=0 worker1 # [ 108.631713] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:19Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 108.675313] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 108.686145] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5) worker1 # [ 108.709556] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5) worker1 # [ 108.815603] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 312 ms (attempt 3/5) worker1 # [ 109.129538] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 309 ms (attempt 4/5) lb # [ 109.116255] niks3-server[1194]: 2026/09/22 14:52:19 INFO lead: acquired remote=192.168.1.3:55972 worker1 # [ 109.442382] nix-grpc-daemon[1203]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 109.445564] nix-grpc-daemon[1203]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 109.462693] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50334 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... worker1 # [ 109.477087] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 109.485142] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker1 # [ 109.505604] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:20Z level=info event=niks3_push_started pid=1275 worker1 # [ 109.607668] nix-grpc-daemon[1275]: time=2026-09-22T14:52:20.805Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 109.701957] nix-daemon[849]: accepted connection from pid 1288, user nix-grpc-daemon (trusted) worker1 # [ 109.713530] nix-daemon[849]: reaped child process 1291, status = succeeded worker1 # [ 109.796748] nix-daemon[849]: accepted connection from pid 1293, user nix-grpc-daemon (trusted) worker1 # [ 109.809081] nix-daemon[849]: reaped child process 1296, status = succeeded lb # [ 109.785339] niks3-server[1194]: 2026/09/22 14:52:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 109.822366] nix-grpc-daemon[1275]: time=2026-09-22T14:52:21.020Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 109.823893] nix-grpc-daemon[1275]: time=2026-09-22T14:52:21.021Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" lb # [ 109.809205] niks3-server[1194]: 2026/09/22 14:52:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 109.816093] niks3-server[1194]: 2026/09/22 14:52:20 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst lb # [ 109.825311] niks3-server[1194]: 2026/09/22 14:52:20 INFO Signed narinfos id=37 count=1 worker1 # [ 109.857644] nix-grpc-daemon[1275]: time=2026-09-22T14:52:21.055Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.834112] niks3-server[1194]: 2026/09/22 14:52:20 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls lb # [ 109.837784] niks3-server[1194]: 2026/09/22 14:52:20 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 109.843823] niks3-server[1194]: 2026/09/22 14:52:20 INFO Completed upload id=37 worker1 # [ 109.874655] nix-grpc-daemon[1275]: time=2026-09-22T14:52:21.072Z level=INFO msg="Upload complete. (264ms)" worker1 # [ 109.876756] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50334 duration_s=0 paths=1 nar_bytes_in=536 lb # [ 109.848074] niks3-server[1194]: 2026/09/22 14:52:20 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo worker1 # [ 109.881417] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 109.887978] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker1 # [ 109.889360] nix-daemon[849]: reaped child process 1273, status = succeeded worker1 # [ 109.894568] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051... client # farm-a> node-a: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker1 # [ 111.329890] nix-daemon[849]: reaped child process 1300, status = succeeded worker1 # [ 111.395473] nix-daemon[849]: accepted connection from pid 1316, user nix-grpc-daemon (trusted) worker1 # [ 111.409308] nix-daemon[849]: reaped child process 1319, status = succeeded lb # [ 111.384250] niks3-server[1194]: 2026/09/22 14:52:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.420778] nix-grpc-daemon[1275]: time=2026-09-22T14:52:22.618Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 111.422233] nix-grpc-daemon[1275]: time=2026-09-22T14:52:22.619Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)" lb # [ 111.406167] niks3-server[1194]: 2026/09/22 14:52:21 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv lb # [ 111.411758] niks3-server[1194]: 2026/09/22 14:52:21 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 111.415770] niks3-server[1194]: 2026/09/22 14:52:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 111.417893] niks3-server[1194]: 2026/09/22 14:52:21 INFO Signed narinfos id=38 count=1 worker1 # [ 111.448607] nix-grpc-daemon[1275]: time=2026-09-22T14:52:22.646Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.421398] niks3-server[1194]: 2026/09/22 14:52:21 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls lb # [ 111.426553] niks3-server[1194]: 2026/09/22 14:52:21 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 111.430934] niks3-server[1194]: 2026/09/22 14:52:21 INFO Completed upload id=38 worker1 # [ 111.461692] nix-grpc-daemon[1275]: time=2026-09-22T14:52:22.659Z level=INFO msg="Upload complete. (159ms)" lb # [ 111.433134] niks3-server[1194]: 2026/09/22 14:52:21 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo worker1 # [ 111.464325] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50334 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 worker1 # [ 111.472201] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:22Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=0 worker1 # [ 111.473976] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:22Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 111.478384] nix-daemon[849]: reaped child process 1298, status = succeeded worker1 # [ 111.516501] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 111.527186] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 111.539323] nix-grpc-daemon[1275]: time=2026-09-22T14:52:22.736Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... worker1 # [ 111.546533] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 111.552811] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker1 # [ 111.639868] nix-daemon[849]: accepted connection from pid 1325, user nix-grpc-daemon (trusted) worker1 # [ 111.654179] nix-daemon[849]: reaped child process 1328, status = succeeded worker1 # [ 111.728460] nix-daemon[849]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 111.743675] nix-daemon[849]: reaped child process 1333, status = succeeded lb # [ 111.713915] niks3-server[1194]: 2026/09/22 14:52:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.753726] nix-grpc-daemon[1275]: time=2026-09-22T14:52:22.951Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 111.755082] nix-grpc-daemon[1275]: time=2026-09-22T14:52:22.951Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" lb # [ 111.743868] niks3-server[1194]: 2026/09/22 14:52:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker1 # [ 111.783724] nix-grpc-daemon[1275]: time=2026-09-22T14:52:22.981Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.753737] niks3-server[1194]: 2026/09/22 14:52:22 INFO Signed narinfos id=39 count=1 lb # [ 111.762146] niks3-server[1194]: 2026/09/22 14:52:22 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst lb # [ 111.766554] niks3-server[1194]: 2026/09/22 14:52:22 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls lb # [ 111.776695] niks3-server[1194]: 2026/09/22 14:52:22 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 111.782125] niks3-server[1194]: 2026/09/22 14:52:22 INFO Completed upload id=39 worker1 # [ 111.812928] nix-grpc-daemon[1275]: time=2026-09-22T14:52:23.010Z level=INFO msg="Upload complete. (249ms)" lb # [ 111.784703] niks3-server[1194]: 2026/09/22 14:52:22 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo worker1 # [ 111.816539] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50334 duration_s=0 paths=1 nar_bytes_in=656 worker1 # [ 111.821365] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 111.829264] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker1 # [ 111.834910] nix-daemon[849]: reaped child process 1323, status = succeeded worker1 # [ 111.839201] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051... client # farm-b> node-a: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker1 # [ 112.853817] nix-daemon[849]: reaped child process 1337, status = succeeded worker1 # [ 112.922302] nix-daemon[849]: accepted connection from pid 1353, user nix-grpc-daemon (trusted) worker1 # [ 112.936288] nix-daemon[849]: reaped child process 1356, status = succeeded lb # [ 112.905494] niks3-server[1194]: 2026/09/22 14:52:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.951829] nix-grpc-daemon[1275]: time=2026-09-22T14:52:24.149Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 112.953432] nix-grpc-daemon[1275]: time=2026-09-22T14:52:24.151Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)" lb # [ 112.943125] niks3-server[1194]: 2026/09/22 14:52:23 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv lb # [ 112.954922] niks3-server[1194]: 2026/09/22 14:52:23 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst lb # [ 112.965290] niks3-server[1194]: 2026/09/22 14:52:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 112.968081] niks3-server[1194]: 2026/09/22 14:52:23 INFO Signed narinfos id=40 count=1 worker1 # [ 112.999094] nix-grpc-daemon[1275]: time=2026-09-22T14:52:24.196Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.971240] niks3-server[1194]: 2026/09/22 14:52:23 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls lb # [ 112.975238] niks3-server[1194]: 2026/09/22 14:52:23 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 112.981621] niks3-server[1194]: 2026/09/22 14:52:23 INFO Completed upload id=40 worker1 # [ 113.012417] nix-grpc-daemon[1275]: time=2026-09-22T14:52:24.210Z level=INFO msg="Upload complete. (167ms)" lb # [ 112.983313] niks3-server[1194]: 2026/09/22 14:52:23 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo worker1 # [ 113.015092] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50334 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 worker1 # [ 113.022425] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:24Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=0 worker1 # [ 113.024460] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:24Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 113.028244] nix-daemon[849]: reaped child process 1335, status = succeeded worker1 # [ 113.065990] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 113.072454] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 113.078818] nix-grpc-daemon[1275]: time=2026-09-22T14:52:24.276Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 113.084369] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50334 client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... worker1 # [ 113.090654] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker1 # [ 113.172171] nix-daemon[849]: accepted connection from pid 1362, user nix-grpc-daemon (trusted) worker1 # [ 113.185092] nix-daemon[849]: reaped child process 1365, status = succeeded worker1 # [ 113.264347] nix-daemon[849]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 113.279446] nix-daemon[849]: reaped child process 1370, status = succeeded lb # [ 113.247991] niks3-server[1194]: 2026/09/22 14:52:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 113.287621] nix-grpc-daemon[1275]: time=2026-09-22T14:52:24.485Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 113.289446] nix-grpc-daemon[1275]: time=2026-09-22T14:52:24.486Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" lb # [ 113.281508] niks3-server[1194]: 2026/09/22 14:52:23 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst lb # [ 113.287859] niks3-server[1194]: 2026/09/22 14:52:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 113.291735] niks3-server[1194]: 2026/09/22 14:52:23 INFO Signed narinfos id=41 count=1 worker1 # [ 113.325351] nix-grpc-daemon[1275]: time=2026-09-22T14:52:24.522Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.304369] niks3-server[1194]: 2026/09/22 14:52:23 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls lb # [ 113.309749] niks3-server[1194]: 2026/09/22 14:52:23 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 113.313859] niks3-server[1194]: 2026/09/22 14:52:23 INFO Completed upload id=41 worker1 # [ 113.344626] nix-grpc-daemon[1275]: time=2026-09-22T14:52:24.542Z level=INFO msg="Upload complete. (249ms)" worker1 # [ 113.346578] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50334 duration_s=0 paths=1 nar_bytes_in=784 lb # [ 113.316466] niks3-server[1194]: 2026/09/22 14:52:23 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo worker1 # [ 113.352363] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50334 worker1 # [ 113.356434] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker1 # [ 113.358636] nix-daemon[849]: reaped child process 1360, status = succeeded worker1 # [ 113.363623] nix-daemon[849]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051... client # farm-top> node-a: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker1 # [ 114.604786] nix-daemon[849]: reaped child process 1374, status = succeeded worker1 # [ 114.684513] nix-daemon[849]: accepted connection from pid 1390, user nix-grpc-daemon (trusted) worker1 # [ 114.695762] nix-daemon[849]: reaped child process 1393, status = succeeded lb # [ 114.672959] niks3-server[1194]: 2026/09/22 14:52:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 114.713162] nix-grpc-daemon[1275]: time=2026-09-22T14:52:25.910Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 114.714569] nix-grpc-daemon[1275]: time=2026-09-22T14:52:25.912Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)" lb # [ 114.711313] niks3-server[1194]: 2026/09/22 14:52:25 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst lb # [ 114.724149] niks3-server[1194]: 2026/09/22 14:52:25 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv lb # [ 114.733276] niks3-server[1194]: 2026/09/22 14:52:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker1 # [ 114.770370] nix-grpc-daemon[1275]: time=2026-09-22T14:52:25.967Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.739109] niks3-server[1194]: 2026/09/22 14:52:25 INFO Signed narinfos id=42 count=1 lb # [ 114.744062] niks3-server[1194]: 2026/09/22 14:52:25 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls lb # [ 114.753662] niks3-server[1194]: 2026/09/22 14:52:25 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 114.757297] niks3-server[1194]: 2026/09/22 14:52:25 INFO Completed upload id=42 worker1 # [ 114.788362] nix-grpc-daemon[1275]: time=2026-09-22T14:52:25.985Z level=INFO msg="Upload complete. (217ms)" lb # [ 114.760535] niks3-server[1194]: 2026/09/22 14:52:25 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo worker1 # [ 114.795754] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50334 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 worker1 # [ 114.810107] nix-daemon[849]: reaped child process 1372, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 6.41 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.13 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.91 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1 # [ 115.131748] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 115.952288] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:27Z level=info event=signal_exit lb # [ 116.119972] niks3-server[1194]: 2026/09/22 14:52:26 INFO lead: released remote=192.168.1.3:55972 worker2 # [ 117.132899] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:29Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 117.151976] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:28Z level=info event=scheduler_restarting worker1 # [ 117.161537] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:28Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 117.164748] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50322 worker1 # [ 117.168328] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:28Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 117.171590] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50322 worker1 # [ 117.175183] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:28Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 117.188979] nix-daemon[849]: reaped child process 1263, status = succeeded worker1 # [ 117.318861] nix-grpc-daemon[1203]: E0000 00:00:1790088748.516398 1248 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker1 # [ 117.324348] nix-grpc-daemon[1203]: E0000 00:00:1790088748.521746 1248 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 117.337621] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.341480] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 117.364969] nix-grpc-daemon[1203]: ts=2026-09-22T14:52:28Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 117.542529] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.546373] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 117.648104] envoy[924]: conn peer=[2001:db8:1::1]:60198 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9709 tx=4471 ms=6230 lb # [ 117.650399] envoy[924]: conn peer=[2001:db8:1::3]:47382 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1527 tx=541 ms=10363 worker2 # [ 117.744468] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.748309] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 117.949248] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.953171] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.155584] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.159118] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.363944] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 118.366290] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 118.367211] systemd[1]: nix-grpc-daemon.service: Consumed 929ms CPU time over 11.523s wall clock time, 38.8M memory peak, 35.4K incoming IP traffic, 59K outgoing IP traffic. worker1 # [ 118.371562] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 118.373302] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 118.374490] systemd[1]: nix-grpc-daemon.socket: Consumed 615us CPU time over 11.545s wall clock time, 256K memory peak, 33.7K incoming IP traffic, 24.6K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 118.359593] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.362079] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 118.562130] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.563811] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.765238] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.769324] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.970219] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.974229] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.132554] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=scheduler_take_over lb # [ 119.123434] niks3-server[1194]: 2026/09/22 14:52:29 INFO lead: acquired remote=192.168.1.4:47066 worker2 # [ 119.176455] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.179844] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.380825] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.384774] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker2 # [ 119.585778] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.603138] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 119.607154] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:37050 worker2 # [ 119.611079] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2 client # don't know how to build these paths: client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker2 # [ 120.631163] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 120.634617] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 120.656878] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:32Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=0 worker2 # [ 120.661612] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:32Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 120.701919] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 120.714728] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38758 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'... worker2 # [ 120.727570] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 120.739113] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 120.843151] nix-daemon[869]: accepted connection from pid 1486, user nix-grpc-daemon (trusted) worker2 # [ 120.856401] nix-daemon[869]: reaped child process 1489, status = succeeded worker2 # [ 120.940071] nix-daemon[869]: accepted connection from pid 1491, user nix-grpc-daemon (trusted) worker2 # [ 120.953299] nix-daemon[869]: reaped child process 1494, status = succeeded lb # [ 120.950975] niks3-server[1194]: 2026/09/22 14:52:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 120.969655] nix-grpc-daemon[1444]: time=2026-09-22T14:52:32.995Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 120.971215] nix-grpc-daemon[1444]: time=2026-09-22T14:52:32.995Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)" lb # [ 120.977543] niks3-server[1194]: 2026/09/22 14:52:31 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst lb # [ 120.986354] niks3-server[1194]: 2026/09/22 14:52:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 120.992572] niks3-server[1194]: 2026/09/22 14:52:31 INFO Signed narinfos id=43 count=1 worker2 # [ 121.005311] nix-grpc-daemon[1444]: time=2026-09-22T14:52:33.031Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.008429] niks3-server[1194]: 2026/09/22 14:52:31 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls lb # [ 121.015587] niks3-server[1194]: 2026/09/22 14:52:31 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 121.023756] niks3-server[1194]: 2026/09/22 14:52:31 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo lb # [ 121.026267] niks3-server[1194]: 2026/09/22 14:52:31 INFO Completed upload id=43 worker2 # [ 121.035922] nix-grpc-daemon[1444]: time=2026-09-22T14:52:33.062Z level=INFO msg="Upload complete. (285ms)" worker2 # [ 121.037980] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 121.041858] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 121.053239] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 121.054615] nix-daemon[869]: reaped child process 1484, status = succeeded worker2 # [ 121.059933] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051... client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 122.676480] nix-daemon[869]: reaped child process 1498, status = succeeded worker2 # [ 122.748248] nix-daemon[869]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 122.760852] nix-daemon[869]: reaped child process 1517, status = succeeded lb # [ 122.757602] niks3-server[1194]: 2026/09/22 14:52:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 122.781279] nix-grpc-daemon[1444]: time=2026-09-22T14:52:34.807Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 122.782989] nix-grpc-daemon[1444]: time=2026-09-22T14:52:34.809Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)" lb # [ 122.795570] niks3-server[1194]: 2026/09/22 14:52:33 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv lb # [ 122.809601] niks3-server[1194]: 2026/09/22 14:52:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker2 # [ 122.824494] nix-grpc-daemon[1444]: time=2026-09-22T14:52:34.850Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.815343] niks3-server[1194]: 2026/09/22 14:52:33 INFO Signed narinfos id=44 count=1 lb # [ 122.825103] niks3-server[1194]: 2026/09/22 14:52:33 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 122.833127] niks3-server[1194]: 2026/09/22 14:52:33 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls lb # [ 122.839450] niks3-server[1194]: 2026/09/22 14:52:33 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 122.843698] niks3-server[1194]: 2026/09/22 14:52:33 INFO Completed upload id=44 worker2 # [ 122.853407] nix-grpc-daemon[1444]: time=2026-09-22T14:52:34.879Z level=INFO msg="Upload complete. (185ms)" lb # [ 122.845944] niks3-server[1194]: 2026/09/22 14:52:33 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo worker2 # [ 122.865515] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 worker2 # [ 122.872184] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:34Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=0 worker2 # [ 122.876259] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:34Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 122.885405] nix-daemon[869]: reaped child process 1496, status = succeeded worker2 # [ 122.915550] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 122.928374] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 122.941328] nix-grpc-daemon[1444]: time=2026-09-22T14:52:34.967Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'... worker2 # [ 122.949869] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 122.959330] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 123.054982] nix-daemon[869]: accepted connection from pid 1523, user nix-grpc-daemon (trusted) worker2 # [ 123.067416] nix-daemon[869]: reaped child process 1526, status = succeeded worker2 # [ 123.149928] nix-daemon[869]: accepted connection from pid 1528, user nix-grpc-daemon (trusted) worker2 # [ 123.162346] nix-daemon[869]: reaped child process 1531, status = succeeded lb # [ 123.160371] niks3-server[1194]: 2026/09/22 14:52:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 123.179134] nix-grpc-daemon[1444]: time=2026-09-22T14:52:35.205Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 123.180489] nix-grpc-daemon[1444]: time=2026-09-22T14:52:35.205Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)" lb # [ 123.192242] niks3-server[1194]: 2026/09/22 14:52:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 123.195823] niks3-server[1194]: 2026/09/22 14:52:33 INFO Signed narinfos id=45 count=1 worker2 # [ 123.209177] nix-grpc-daemon[1444]: time=2026-09-22T14:52:35.235Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.203401] niks3-server[1194]: 2026/09/22 14:52:33 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst lb # [ 123.208654] niks3-server[1194]: 2026/09/22 14:52:33 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls lb # [ 123.221112] niks3-server[1194]: 2026/09/22 14:52:33 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 123.227706] niks3-server[1194]: 2026/09/22 14:52:33 INFO Completed upload id=45 worker2 # [ 123.238429] nix-grpc-daemon[1444]: time=2026-09-22T14:52:35.264Z level=INFO msg="Upload complete. (267ms)" lb # [ 123.229519] niks3-server[1194]: 2026/09/22 14:52:33 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo worker2 # [ 123.240677] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 123.243247] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 123.250907] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 123.253312] nix-daemon[869]: reaped child process 1521, status = succeeded client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051... client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker2 # [ 123.258449] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker2 # [ 124.692367] nix-daemon[869]: reaped child process 1535, status = succeeded worker2 # [ 124.774833] nix-daemon[869]: accepted connection from pid 1551, user nix-grpc-daemon (trusted) worker2 # [ 124.787880] nix-daemon[869]: reaped child process 1554, status = succeeded lb # [ 124.784558] niks3-server[1194]: 2026/09/22 14:52:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 124.801740] nix-grpc-daemon[1444]: time=2026-09-22T14:52:36.828Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 124.803989] nix-grpc-daemon[1444]: time=2026-09-22T14:52:36.829Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)" lb # [ 124.806205] niks3-server[1194]: 2026/09/22 14:52:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 124.808404] niks3-server[1194]: 2026/09/22 14:52:35 INFO Signed narinfos id=46 count=1 worker2 # [ 124.817815] nix-grpc-daemon[1444]: time=2026-09-22T14:52:36.844Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.812276] niks3-server[1194]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv lb # [ 124.816557] niks3-server[1194]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst lb # [ 124.820348] niks3-server[1194]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls lb # [ 124.821728] niks3-server[1194]: 2026/09/22 14:52:35 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 124.825053] niks3-server[1194]: 2026/09/22 14:52:35 INFO Completed upload id=46 worker2 # [ 124.834459] nix-grpc-daemon[1444]: time=2026-09-22T14:52:36.860Z level=INFO msg="Upload complete. (166ms)" lb # [ 124.828207] niks3-server[1194]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo worker2 # [ 124.836990] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 worker2 # [ 124.843447] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:36Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=0 worker2 # [ 124.845475] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:36Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 124.850243] nix-daemon[869]: reaped child process 1533, status = succeeded worker2 # [ 124.885926] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 124.894793] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 124.903259] nix-grpc-daemon[1444]: time=2026-09-22T14:52:36.929Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'... worker2 # [ 124.910320] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 124.918192] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 125.003905] nix-daemon[869]: accepted connection from pid 1560, user nix-grpc-daemon (trusted) worker2 # [ 125.017306] nix-daemon[869]: reaped child process 1563, status = succeeded worker2 # [ 125.094786] nix-daemon[869]: accepted connection from pid 1565, user nix-grpc-daemon (trusted) worker2 # [ 125.107448] nix-daemon[869]: reaped child process 1568, status = succeeded lb # [ 125.105536] niks3-server[1194]: 2026/09/22 14:52:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 125.122483] nix-grpc-daemon[1444]: time=2026-09-22T14:52:37.148Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 125.124514] nix-grpc-daemon[1444]: time=2026-09-22T14:52:37.150Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)" lb # [ 125.130117] niks3-server[1194]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst lb # [ 125.142702] niks3-server[1194]: 2026/09/22 14:52:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 125.147696] niks3-server[1194]: 2026/09/22 14:52:35 INFO Signed narinfos id=47 count=1 worker2 # [ 125.160131] nix-grpc-daemon[1444]: time=2026-09-22T14:52:37.186Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.155800] niks3-server[1194]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls lb # [ 125.167325] niks3-server[1194]: 2026/09/22 14:52:35 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 125.174268] niks3-server[1194]: 2026/09/22 14:52:35 INFO Completed upload id=47 worker2 # [ 125.183712] nix-grpc-daemon[1444]: time=2026-09-22T14:52:37.210Z level=INFO msg="Upload complete. (257ms)" lb # [ 125.179122] niks3-server[1194]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo worker2 # [ 125.187450] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 125.192614] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 125.201848] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 125.209881] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051... worker2 # [ 125.212299] nix-daemon[869]: reaped child process 1558, status = succeeded client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 126.227805] nix-daemon[869]: reaped child process 1572, status = succeeded worker2 # [ 126.300489] nix-daemon[869]: accepted connection from pid 1588, user nix-grpc-daemon (trusted) worker2 # [ 126.313532] nix-daemon[869]: reaped child process 1591, status = succeeded lb # [ 126.311736] niks3-server[1194]: 2026/09/22 14:52:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 126.329178] nix-grpc-daemon[1444]: time=2026-09-22T14:52:38.355Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 126.330736] nix-grpc-daemon[1444]: time=2026-09-22T14:52:38.357Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)" lb # [ 126.344206] niks3-server[1194]: 2026/09/22 14:52:36 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst lb # [ 126.358698] niks3-server[1194]: 2026/09/22 14:52:36 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv lb # [ 126.365707] niks3-server[1194]: 2026/09/22 14:52:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 126.372341] niks3-server[1194]: 2026/09/22 14:52:36 INFO Signed narinfos id=48 count=1 worker2 # [ 126.384731] nix-grpc-daemon[1444]: time=2026-09-22T14:52:38.410Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.381099] niks3-server[1194]: 2026/09/22 14:52:36 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls lb # [ 126.391049] niks3-server[1194]: 2026/09/22 14:52:36 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 126.394928] niks3-server[1194]: 2026/09/22 14:52:36 INFO Completed upload id=48 worker2 # [ 126.404482] nix-grpc-daemon[1444]: time=2026-09-22T14:52:38.430Z level=INFO msg="Upload complete. (186ms)" lb # [ 126.396696] niks3-server[1194]: 2026/09/22 14:52:36 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo worker2 # [ 126.410594] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 worker2 # [ 126.426460] nix-daemon[869]: reaped child process 1570, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 6.01 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.11 seconds) worker1 # [ 126.671639] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 126.678604] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 126.760326] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:37Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 126.767138] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 126.769806] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 126.774046] nix-grpc-daemon[1411]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 126.775428] nix-grpc-daemon[1411]: E0000 00:00:1790088757.963315 1411 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 126.777929] nix-grpc-daemon[1411]: E0000 00:00:1790088757.965589 1411 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 126.780059] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 126.783821] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 126.787146] nix-grpc-daemon[1411]: E0000 00:00:1790088757.983217 1450 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 126.798521] nix-grpc-daemon[1411]: E0000 00:00:1790088757.996218 1450 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 126.801167] nix-grpc-daemon[1411]: E0000 00:00:1790088757.998263 1450 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 126.812291] nix-grpc-daemon[1411]: E0000 00:00:1790088758.009939 1450 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 126.821688] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 126.802726] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:38Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37050 worker2 # [ 126.806466] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:38Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.02 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs client # [ 127.028887] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 143d73cacc8d4b7aa313153267f02087 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds) client # [ 127.166852] nix[1359]: don't know how to build these paths: client # [ 127.167774] nix[1359]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 127.154169] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 127.164816] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:39Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=0 worker2 # [ 127.169562] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:39Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 127.209427] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 127.221820] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38758 client # [ 127.242634] nix[1359]: copying 1 paths to 'lb:50051'... client # [ 127.246205] nix[1359]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 127.235421] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 127.243985] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 127.344845] nix-daemon[869]: accepted connection from pid 1604, user nix-grpc-daemon (trusted) worker2 # [ 127.358950] nix-daemon[869]: reaped child process 1607, status = succeeded worker2 # [ 127.440106] nix-daemon[869]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 127.454106] nix-daemon[869]: reaped child process 1612, status = succeeded lb # [ 127.450396] niks3-server[1194]: 2026/09/22 14:52:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 127.467932] nix-grpc-daemon[1444]: time=2026-09-22T14:52:39.493Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 127.469322] nix-grpc-daemon[1444]: time=2026-09-22T14:52:39.493Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" lb # [ 127.476812] niks3-server[1194]: 2026/09/22 14:52:37 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst lb # [ 127.486728] niks3-server[1194]: 2026/09/22 14:52:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 127.491749] niks3-server[1194]: 2026/09/22 14:52:37 INFO Signed narinfos id=49 count=1 worker2 # [ 127.505080] nix-grpc-daemon[1444]: time=2026-09-22T14:52:39.531Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.507344] niks3-server[1194]: 2026/09/22 14:52:37 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls lb # [ 127.511474] niks3-server[1194]: 2026/09/22 14:52:37 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 127.519924] niks3-server[1194]: 2026/09/22 14:52:37 INFO Completed upload id=49 lb # [ 127.522059] niks3-server[1194]: 2026/09/22 14:52:37 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker2 # [ 127.531751] nix-grpc-daemon[1444]: time=2026-09-22T14:52:39.558Z level=INFO msg="Upload complete. (274ms)" worker2 # [ 127.537123] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 127.541574] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 worker2 # [ 127.552191] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 127.554498] nix-daemon[869]: reaped child process 1602, status = succeeded worker2 # [ 127.560355] nix-daemon[869]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) client # [ 127.570780] nix[1359]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051... lb # [ 127.648981] envoy[924]: conn peer=[2001:db8:1::1]:55190 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9573 tx=4381 ms=5837 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 129.589745] systemd-journald[283]: Received client request to rotate journal, rotating. worker1 # [ 129.601466] systemd-journald[283]: Vacuuming done, freed 0B of archived journals from /var/log/journal/198c814fd8ef4e29ae1f5caf28ce282c. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.03 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 129.477203] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds) client: must succeed: sleep 5.0 worker2 # [ 130.450953] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:42Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.03 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 134.806978] nix-daemon[869]: reaped child process 1616, status = succeeded worker2 # [ 134.879167] nix-daemon[869]: accepted connection from pid 1657, user nix-grpc-daemon (trusted) worker2 # [ 134.891610] nix-daemon[869]: reaped child process 1660, status = succeeded lb # [ 134.888708] niks3-server[1194]: 2026/09/22 14:52:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 134.907209] nix-grpc-daemon[1444]: time=2026-09-22T14:52:46.933Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 134.908683] nix-grpc-daemon[1444]: time=2026-09-22T14:52:46.935Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)" lb # [ 134.923994] niks3-server[1194]: 2026/09/22 14:52:45 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv lb # [ 134.940115] niks3-server[1194]: 2026/09/22 14:52:45 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 134.952179] niks3-server[1194]: 2026/09/22 14:52:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker2 # [ 134.968276] nix-grpc-daemon[1444]: time=2026-09-22T14:52:46.994Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.958403] niks3-server[1194]: 2026/09/22 14:52:45 INFO Signed narinfos id=50 count=1 lb # [ 134.965108] niks3-server[1194]: 2026/09/22 14:52:45 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls lb # [ 134.972075] niks3-server[1194]: 2026/09/22 14:52:45 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 134.976525] niks3-server[1194]: 2026/09/22 14:52:45 INFO Completed upload id=50 lb # [ 134.978636] niks3-server[1194]: 2026/09/22 14:52:45 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker2 # [ 134.987581] nix-grpc-daemon[1444]: time=2026-09-22T14:52:47.013Z level=INFO msg="Upload complete. (215ms)" worker2 # [ 134.996469] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38758 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 135.009951] nix-daemon[869]: reaped child process 1614, status = succeeded client # [ 135.037085] systemd[1]: rs.service: Deactivated successfully. client # [ 135.040794] systemd[1]: rs.service: Consumed 130ms CPU time over 8.011s wall clock time, 43.4M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. worker2 # [ 135.454951] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:47Z level=info event=signal_exit lb # [ 136.127507] niks3-server[1194]: 2026/09/22 14:52:46 INFO lead: released remote=192.168.1.4:47066 lb # [ 136.754815] niks3-server[1194]: 2026/09/22 14:52:47 INFO lead: acquired remote=192.168.1.3:41874 worker1 # [ 136.789927] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:47Z level=info event=scheduler_take_over worker1 # [ 137.158251] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:48Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 137.141971] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:49Z level=info event=scheduler_restarting worker2 # [ 137.145462] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:49Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 137.148985] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37050 worker2 # [ 137.152925] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:49Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 137.156571] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37050 worker2 # [ 137.160186] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:49Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 137.175625] nix-daemon[869]: reaped child process 1436, status = succeeded worker1 # [ 137.358819] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 137.360681] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 137.350351] nix-grpc-daemon[1384]: ts=2026-09-22T14:52:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 137.521191] nix-grpc-daemon[1384]: E0000 00:00:1790088769.547108 1429 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker2 # [ 137.526067] nix-grpc-daemon[1384]: E0000 00:00:1790088769.547418 1429 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 137.561248] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 137.564898] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48222 worker1 # [ 137.566499] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb # [ 137.649811] envoy[924]: conn peer=[2001:db8:1::1]:33336 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2973 tx=1517 ms=7852 lb # [ 137.653714] envoy[924]: conn peer=[2001:db8:1::4]:47518 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=31766 tx=1863 ms=34855 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.10 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2 # [ 138.894543] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 138.898235] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 138.901540] systemd[1]: nix-grpc-daemon.service: Consumed 1.424s CPU time over 36.552s wall clock time, 39.6M memory peak, 62.1K incoming IP traffic, 159.5K outgoing IP traffic. worker2 # [ 138.915986] systemd[1]: Starting scheduler-token.service... lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 138.972081] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 138.973677] systemd[1]: Finished scheduler-token.service. worker2 # [ 138.974786] systemd[1]: scheduler-token.service: Consumed 25ms CPU time over 57ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 138.979395] systemd[1]: Starting Nix worker-protocol over gRPC... worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker2 # [ 139.058686] nix-grpc-daemon[1670]: ts=2026-09-22T14:52:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 139.063398] nix-grpc-daemon[1670]: ts=2026-09-22T14:52:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 139.067123] nix-grpc-daemon[1670]: ts=2026-09-22T14:52:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 139.069074] nix-grpc-daemon[1670]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 139.070359] nix-grpc-daemon[1670]: E0000 00:00:1790088771.090842 1670 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 139.077386] nix-grpc-daemon[1670]: E0000 00:00:1790088771.099628 1670 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 139.080687] nix-grpc-daemon[1670]: ts=2026-09-22T14:52:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 139.083102] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 139.083948] nix-grpc-daemon[1670]: E0000 00:00:1790088771.109103 1711 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 139.095887] nix-grpc-daemon[1670]: E0000 00:00:1790088771.122310 1711 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 139.100056] nix-grpc-daemon[1670]: E0000 00:00:1790088771.124584 1711 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 139.110176] nix-grpc-daemon[1670]: E0000 00:00:1790088771.136592 1711 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 139.119492] nix-grpc-daemon[1670]: ts=2026-09-22T14:52:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 139.148777] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:50Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 139.152407] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:50Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48222 worker1 # [ 139.156255] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.13 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid client # [ 140.168645] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 380c25c85019413eba9ad444bf7f43f1 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.07 seconds) worker1 # [ 140.333432] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48236 worker1 # [ 140.344429] nix-daemon[849]: accepted connection from pid 1411, user nix-grpc-daemon (trusted) client # [ 140.347067] nix[1395]: don't know how to build these paths: client # [ 140.347941] nix[1395]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker1 # [ 140.365801] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:51Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 140.371496] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:51Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 140.413893] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48236 worker1 # [ 140.424588] nix-grpc-daemon[1411]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 1/5) worker1 # [ 140.459622] nix-grpc-daemon[1411]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 2/5) worker1 # [ 140.516692] nix-grpc-daemon[1411]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 321 ms (attempt 3/5) worker1 # [ 140.839728] nix-grpc-daemon[1411]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 4/5) worker1 # [ 140.940098] nix-grpc-daemon[1411]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 140.942927] nix-grpc-daemon[1411]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 140.958733] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48236 client # [ 140.958710] nix[1395]: copying 1 paths to 'lb:50051'... client # [ 140.960674] nix[1395]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'... worker1 # [ 140.971383] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48236 worker1 # [ 140.979575] nix-daemon[849]: accepted connection from pid 1411, user nix-grpc-daemon (trusted) worker1 # [ 140.999379] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:52Z level=info event=niks3_push_started pid=1542 worker1 # [ 141.092548] nix-grpc-daemon[1542]: time=2026-09-22T14:52:52.289Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 141.171618] nix-daemon[849]: accepted connection from pid 1554, user nix-grpc-daemon (trusted) worker1 # [ 141.183595] nix-daemon[849]: reaped child process 1557, status = succeeded worker1 # [ 141.257994] nix-daemon[849]: accepted connection from pid 1559, user nix-grpc-daemon (trusted) worker1 # [ 141.270075] nix-daemon[849]: reaped child process 1562, status = succeeded lb # [ 141.245561] niks3-server[1194]: 2026/09/22 14:52:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 141.284410] nix-grpc-daemon[1542]: time=2026-09-22T14:52:52.482Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 141.287706] nix-grpc-daemon[1542]: time=2026-09-22T14:52:52.483Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)" lb # [ 141.281418] niks3-server[1194]: 2026/09/22 14:52:51 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst lb # [ 141.288659] niks3-server[1194]: 2026/09/22 14:52:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 141.298225] niks3-server[1194]: 2026/09/22 14:52:51 INFO Signed narinfos id=51 count=1 worker1 # [ 141.332121] nix-grpc-daemon[1542]: time=2026-09-22T14:52:52.529Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.318485] niks3-server[1194]: 2026/09/22 14:52:51 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 141.326912] niks3-server[1194]: 2026/09/22 14:52:51 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls lb # [ 141.332978] niks3-server[1194]: 2026/09/22 14:52:51 INFO Completed upload id=51 worker1 # [ 141.365044] nix-grpc-daemon[1542]: time=2026-09-22T14:52:52.562Z level=INFO msg="Upload complete. (269ms)" worker1 # [ 141.367512] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48236 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 141.338955] niks3-server[1194]: 2026/09/22 14:52:51 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo worker1 # [ 141.371184] nix-grpc-daemon[1411]: ts=2026-09-22T14:52:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48236 worker1 # [ 141.377645] nix-daemon[849]: accepted connection from pid 1411, user nix-grpc-daemon (trusted) worker1 # [ 141.380876] nix-daemon[849]: reaped child process 1540, status = succeeded client # [ 141.374771] nix[1395]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... worker1 # [ 141.385092] nix-daemon[849]: accepted connection from pid 1411, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 143.723443] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1411 (nix-grpc-daemon) on client request. worker1 # [ 143.728374] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 143.704394] niks3-server[1194]: 2026/09/22 14:52:54 INFO lead: released remote=192.168.1.3:41874 client # [ 143.731150] nix[1395]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 143.741564] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 143.743058] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 143.744311] systemd[1]: nix-grpc-daemon.service: Consumed 410ms CPU time over 17.059s wall clock time, 35.5M memory peak, 15.1K incoming IP traffic, 31.6K outgoing IP traffic. worker2 # [ 143.720095] nix-grpc-daemon[1670]: ts=2026-09-22T14:52:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 143.733753] nix[1395]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 143.758110] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker1 # [ 143.759637] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 143.788563] nix-daemon[849]: reaped child process 1568, status = succeeded worker1 # [ 143.790729] nix-daemon[849]: reaped child process 1532, status = succeeded worker1 # [ 143.796892] nix-daemon[1570]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 143.803456] nix-daemon[849]: reaped child process 1570, status = failed with exit code 1 worker1 # [ 143.849625] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 143.851590] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 143.854691] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 143.859045] nix-grpc-daemon[1606]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 143.860426] nix-grpc-daemon[1606]: E0000 00:00:1790088775.056465 1606 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 143.867630] nix-grpc-daemon[1606]: E0000 00:00:1790088775.061832 1606 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 143.869777] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 143.871341] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 143.876228] nix-grpc-daemon[1606]: E0000 00:00:1790088775.073136 1648 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 143.845785] niks3-server[1194]: 2026/09/22 14:52:54 INFO lead: acquired remote=192.168.1.3:39882 worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.18 seconds) client: must succeed: sleep 5.0 worker1 # [ 143.882067] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=scheduler_take_over worker1 # [ 143.889417] nix-grpc-daemon[1606]: E0000 00:00:1790088775.087071 1648 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 143.894053] nix-grpc-daemon[1606]: E0000 00:00:1790088775.089391 1648 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 143.903678] nix-grpc-daemon[1606]: E0000 00:00:1790088775.101332 1648 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 143.912899] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 143.919159] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:38464 worker1 # [ 143.920665] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 143.920448] nix-grpc-daemon[1670]: ts=2026-09-22T14:52:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 143.946399] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 143.947825] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:38464 worker1 # [ 143.949487] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 144.253907] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=0 worker1 # [ 144.258895] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 144.307144] nix-grpc-daemon[1606]: ts=2026-09-22T14:52:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38480 worker1 # [ 144.317318] nix-daemon[849]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker1 # [ 144.332091] nix-daemon[849]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker1 # [ 144.347394] nix-daemon[849]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # [ 144.336174] nix[1395]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051... lb # [ 147.649385] envoy[924]: conn peer=[2001:db8:1::3]:59464 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=993 tx=376 ms=16923 client: (finished: must succeed: sleep 5.0, in 5.02 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 149.170667] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:00Z level=info event=niks3_push_started pid=1690 worker1 # [ 149.213625] nix-daemon[849]: reaped child process 1665, status = succeeded worker1 # [ 149.296643] nix-grpc-daemon[1690]: time=2026-09-22T14:53:00.492Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 149.388765] nix-daemon[849]: accepted connection from pid 1703, user nix-grpc-daemon (trusted) worker1 # [ 149.403936] nix-daemon[849]: reaped child process 1706, status = succeeded lb # [ 149.382489] niks3-server[1194]: 2026/09/22 14:52:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.423807] nix-grpc-daemon[1690]: time=2026-09-22T14:53:00.621Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.426607] nix-grpc-daemon[1690]: time=2026-09-22T14:53:00.624Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)" lb # [ 149.435590] niks3-server[1194]: 2026/09/22 14:52:59 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv lb # [ 149.443970] niks3-server[1194]: 2026/09/22 14:52:59 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 149.459808] niks3-server[1194]: 2026/09/22 14:52:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 149.462653] niks3-server[1194]: 2026/09/22 14:52:59 INFO Signed narinfos id=52 count=1 worker1 # [ 149.494914] nix-grpc-daemon[1690]: time=2026-09-22T14:53:00.691Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.467839] niks3-server[1194]: 2026/09/22 14:52:59 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls lb # [ 149.471058] niks3-server[1194]: 2026/09/22 14:52:59 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 149.477443] niks3-server[1194]: 2026/09/22 14:52:59 INFO Completed upload id=52 lb # [ 149.479372] niks3-server[1194]: 2026/09/22 14:52:59 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo worker1 # [ 149.509560] nix-grpc-daemon[1690]: time=2026-09-22T14:53:00.707Z level=INFO msg="Upload complete. (213ms)" worker1 # [ 149.515965] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38480 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 149.531109] nix-daemon[849]: reaped child process 1663, status = succeeded client # [ 149.544247] systemd[1]: mid.service: Deactivated successfully. client # [ 149.548887] systemd[1]: mid.service: Consumed 153ms CPU time over 9.379s wall clock time, 39.5M memory peak, 8.6K incoming IP traffic, 10.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.02 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr client # [ 150.162374] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: cb7b6e750d384d66868eff9797b1213c client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds) worker2 # [ 150.289499] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 150.300784] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) client # [ 150.324516] nix[1431]: don't know how to build these paths: client # [ 150.325501] nix[1431]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker1 # [ 150.346508] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:01Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=0 worker1 # [ 150.350682] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:01Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 150.368290] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 150.379478] nix-grpc-daemon[1670]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5) worker2 # [ 150.409938] nix-grpc-daemon[1670]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 2/5) worker2 # [ 150.428665] nix-grpc-daemon[1670]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 249 ms (attempt 3/5) worker2 # [ 150.685408] nix-grpc-daemon[1670]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 163 ms (attempt 4/5) worker2 # [ 150.850833] nix-grpc-daemon[1670]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 150.854321] nix-grpc-daemon[1670]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 150.871178] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49930 client # [ 150.893272] nix[1431]: copying 1 paths to 'lb:50051'... worker2 # [ 150.882607] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 client # [ 150.894845] nix[1431]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'... worker2 # [ 150.894157] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 150.915078] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:02Z level=info event=niks3_push_started pid=1762 worker2 # [ 151.020692] nix-grpc-daemon[1762]: time=2026-09-22T14:53:03.046Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca="" worker2 # [ 151.107391] nix-daemon[869]: accepted connection from pid 1775, user nix-grpc-daemon (trusted) worker2 # [ 151.118733] nix-daemon[869]: reaped child process 1778, status = succeeded worker2 # [ 151.202189] nix-daemon[869]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker2 # [ 151.215046] nix-daemon[869]: reaped child process 1783, status = succeeded lb # [ 151.213072] niks3-server[1194]: 2026/09/22 14:53:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 151.231066] nix-grpc-daemon[1762]: time=2026-09-22T14:53:03.257Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 151.234091] nix-grpc-daemon[1762]: time=2026-09-22T14:53:03.259Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)" lb # [ 151.249562] niks3-server[1194]: 2026/09/22 14:53:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 151.257770] niks3-server[1194]: 2026/09/22 14:53:01 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst lb # [ 151.264217] niks3-server[1194]: 2026/09/22 14:53:01 INFO Signed narinfos id=53 count=1 worker2 # [ 151.277355] nix-grpc-daemon[1762]: time=2026-09-22T14:53:03.303Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.286925] niks3-server[1194]: 2026/09/22 14:53:01 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 151.291185] niks3-server[1194]: 2026/09/22 14:53:01 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls lb # [ 151.294156] niks3-server[1194]: 2026/09/22 14:53:01 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo lb # [ 151.296613] niks3-server[1194]: 2026/09/22 14:53:01 INFO Completed upload id=53 worker2 # [ 151.306170] nix-grpc-daemon[1762]: time=2026-09-22T14:53:03.332Z level=INFO msg="Upload complete. (282ms)" worker2 # [ 151.308588] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 151.312188] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 151.318714] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 151.321552] nix-daemon[869]: reaped child process 1760, status = succeeded worker2 # [ 151.326091] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) client # [ 151.338323] nix[1431]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr client # [ 152.421246] systemd[1]: intr.service: Sent signal SIGINT to main process 1431 (nix) on client request. worker2 # [ 152.412320] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:04Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv client # [ 152.423752] nix[1431]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 152.425819] nix[1431]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.02 seconds) client # [ 152.442945] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 152.444355] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 152.446206] systemd[1]: intr.service: Consumed 117ms CPU time over 2.283s wall clock time, 43.4M memory peak, 6.4K incoming IP traffic, 8.2K outgoing IP traffic. worker2 # [ 152.544103] nix-daemon[869]: reaped child process 1789, status = succeeded worker2 # [ 152.545315] nix-daemon[1791]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 152.549610] nix-daemon[869]: reaped child process 1791, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.46 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw client # [ 153.649562] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 310a985c55c0437b8513a0799ac8cdfb client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.06 seconds) client # [ 153.788352] nix[1452]: don't know how to build these paths: client # [ 153.789223] nix[1452]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 153.797152] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38480 worker1 # [ 153.808107] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:05Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker1 # [ 153.812788] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:05Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 153.852087] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38480 worker1 # [ 153.863800] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker1 # [ 153.956792] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 2/5) worker1 # [ 154.070931] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 3/5) worker1 # [ 154.239831] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 648 ms (attempt 4/5) worker1 # [ 154.889723] nix-grpc-daemon[1606]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 154.891718] nix-grpc-daemon[1606]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 154.903865] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38480 client # [ 154.901651] nix[1452]: copying 1 paths to 'lb:50051'... worker1 # [ 154.915452] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38480 client # [ 154.905453] nix[1452]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 154.923817] nix-daemon[849]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker1 # [ 155.013097] nix-daemon[849]: accepted connection from pid 1746, user nix-grpc-daemon (trusted) worker1 # [ 155.027076] nix-daemon[849]: reaped child process 1749, status = succeeded worker1 # [ 155.109736] nix-daemon[849]: accepted connection from pid 1751, user nix-grpc-daemon (trusted) worker1 # [ 155.123244] nix-daemon[849]: reaped child process 1754, status = succeeded lb # [ 155.098183] niks3-server[1194]: 2026/09/22 14:53:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.136183] nix-grpc-daemon[1690]: time=2026-09-22T14:53:06.333Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 155.137550] nix-grpc-daemon[1690]: time=2026-09-22T14:53:06.333Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" lb # [ 155.113676] niks3-server[1194]: 2026/09/22 14:53:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 155.116236] niks3-server[1194]: 2026/09/22 14:53:05 INFO Signed narinfos id=54 count=1 worker1 # [ 155.148423] nix-grpc-daemon[1690]: time=2026-09-22T14:53:06.345Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.120821] niks3-server[1194]: 2026/09/22 14:53:05 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 155.126059] niks3-server[1194]: 2026/09/22 14:53:05 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls lb # [ 155.129889] niks3-server[1194]: 2026/09/22 14:53:05 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 155.133232] niks3-server[1194]: 2026/09/22 14:53:05 INFO Completed upload id=54 worker1 # [ 155.164108] nix-grpc-daemon[1690]: time=2026-09-22T14:53:06.361Z level=INFO msg="Upload complete. (234ms)" worker1 # [ 155.166220] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38480 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 155.136025] niks3-server[1194]: 2026/09/22 14:53:05 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker1 # [ 155.169176] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38480 worker1 # [ 155.175754] nix-daemon[849]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker1 # [ 155.177995] nix-daemon[849]: reaped child process 1744, status = succeeded worker1 # [ 155.182887] nix-daemon[849]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) client # [ 155.172877] nix[1452]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 157.172264] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 157.198321] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2 worker2 # [ 157.355632] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49930 client # don't know how to build these paths: client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker2 # [ 157.364085] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49930 worker1 # [ 157.407413] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:08Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 157.409111] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:08Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 157.435785] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 157.448605] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49930 client # copying 1 paths to 'lb:50051'... worker2 # [ 157.461519] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'... worker2 # [ 157.483114] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 157.588358] nix-daemon[869]: accepted connection from pid 1842, user nix-grpc-daemon (trusted) worker2 # [ 157.600638] nix-daemon[869]: reaped child process 1845, status = succeeded lb # [ 157.650387] envoy[924]: conn peer=[2001:db8:1::1]:59030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3908 tx=1939 ms=9211 lb # [ 157.654179] envoy[924]: conn peer=[2001:db8:1::1]:44274 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2967 tx=827 ms=2144 worker2 # [ 157.683049] nix-daemon[869]: accepted connection from pid 1847, user nix-grpc-daemon (trusted) worker2 # [ 157.696120] nix-daemon[869]: reaped child process 1850, status = succeeded lb # [ 157.692730] niks3-server[1194]: 2026/09/22 14:53:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 157.711142] nix-grpc-daemon[1762]: time=2026-09-22T14:53:09.737Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 157.712553] nix-grpc-daemon[1762]: time=2026-09-22T14:53:09.737Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" lb # [ 157.724167] niks3-server[1194]: 2026/09/22 14:53:08 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 157.735128] niks3-server[1194]: 2026/09/22 14:53:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker2 # [ 157.751535] nix-grpc-daemon[1762]: time=2026-09-22T14:53:09.777Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.741793] niks3-server[1194]: 2026/09/22 14:53:08 INFO Signed narinfos id=55 count=1 lb # [ 157.753257] niks3-server[1194]: 2026/09/22 14:53:08 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 157.762158] niks3-server[1194]: 2026/09/22 14:53:08 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 157.766063] niks3-server[1194]: 2026/09/22 14:53:08 INFO Completed upload id=55 worker2 # [ 157.775614] nix-grpc-daemon[1762]: time=2026-09-22T14:53:09.802Z level=INFO msg="Upload complete. (280ms)" lb # [ 157.768422] niks3-server[1194]: 2026/09/22 14:53:08 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo worker2 # [ 157.777961] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 157.782668] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 157.792347] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 157.795269] nix-daemon[869]: reaped child process 1840, status = succeeded client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051... worker2 # [ 157.801098] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker1 # [ 157.870908] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:09Z level=info event=draining client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 159.040769] nix-daemon[869]: reaped child process 1854, status = succeeded worker2 # [ 159.122093] nix-daemon[869]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker2 # [ 159.133821] nix-daemon[869]: reaped child process 1873, status = succeeded lb # [ 159.132434] niks3-server[1194]: 2026/09/22 14:53:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 159.150441] nix-grpc-daemon[1762]: time=2026-09-22T14:53:11.176Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 159.151969] nix-grpc-daemon[1762]: time=2026-09-22T14:53:11.178Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 159.164733] niks3-server[1194]: 2026/09/22 14:53:09 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 159.182304] niks3-server[1194]: 2026/09/22 14:53:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker2 # [ 159.200162] nix-grpc-daemon[1762]: time=2026-09-22T14:53:11.226Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.190172] niks3-server[1194]: 2026/09/22 14:53:09 INFO Signed narinfos id=56 count=1 lb # [ 159.195951] niks3-server[1194]: 2026/09/22 14:53:09 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 159.204556] niks3-server[1194]: 2026/09/22 14:53:09 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 159.210660] niks3-server[1194]: 2026/09/22 14:53:09 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 159.215500] niks3-server[1194]: 2026/09/22 14:53:09 INFO Completed upload id=56 worker2 # [ 159.224833] nix-grpc-daemon[1762]: time=2026-09-22T14:53:11.251Z level=INFO msg="Upload complete. (216ms)" lb # [ 159.218450] niks3-server[1194]: 2026/09/22 14:53:09 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo worker2 # [ 159.227404] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 worker2 # [ 159.234866] nix-daemon[869]: reaped child process 1852, status = succeeded worker1 # [ 159.256480] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:10Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker1 # [ 159.258190] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:10Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 159.278103] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 159.288714] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 159.299920] nix-grpc-daemon[1762]: time=2026-09-22T14:53:11.326Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 159.307804] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'... worker2 # [ 159.325518] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 159.427183] nix-daemon[869]: accepted connection from pid 1877, user nix-grpc-daemon (trusted) worker2 # [ 159.439475] nix-daemon[869]: reaped child process 1880, status = succeeded worker2 # [ 159.523668] nix-daemon[869]: accepted connection from pid 1882, user nix-grpc-daemon (trusted) worker2 # [ 159.536184] nix-daemon[869]: reaped child process 1885, status = succeeded lb # [ 159.534037] niks3-server[1194]: 2026/09/22 14:53:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 159.548411] nix-grpc-daemon[1762]: time=2026-09-22T14:53:11.574Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 159.550472] nix-grpc-daemon[1762]: time=2026-09-22T14:53:11.576Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 159.548608] niks3-server[1194]: 2026/09/22 14:53:09 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 159.552697] niks3-server[1194]: 2026/09/22 14:53:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 159.555066] niks3-server[1194]: 2026/09/22 14:53:09 INFO Signed narinfos id=57 count=1 worker2 # [ 159.566055] nix-grpc-daemon[1762]: time=2026-09-22T14:53:11.592Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.558586] niks3-server[1194]: 2026/09/22 14:53:09 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 159.563523] niks3-server[1194]: 2026/09/22 14:53:09 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 159.566599] niks3-server[1194]: 2026/09/22 14:53:09 INFO Completed upload id=57 worker2 # [ 159.576122] nix-grpc-daemon[1762]: time=2026-09-22T14:53:11.602Z level=INFO msg="Upload complete. (236ms)" worker2 # [ 159.578217] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 159.570030] niks3-server[1194]: 2026/09/22 14:53:09 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo worker2 # [ 159.581874] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 159.587980] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 159.590231] nix-daemon[869]: reaped child process 1875, status = succeeded worker2 # [ 159.595445] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051... client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 161.034487] nix-daemon[869]: reaped child process 1889, status = succeeded worker2 # [ 161.116747] nix-daemon[869]: accepted connection from pid 1905, user nix-grpc-daemon (trusted) worker2 # [ 161.128267] nix-daemon[869]: reaped child process 1908, status = succeeded lb # [ 161.126910] niks3-server[1194]: 2026/09/22 14:53:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 161.144549] nix-grpc-daemon[1762]: time=2026-09-22T14:53:13.170Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 161.146142] nix-grpc-daemon[1762]: time=2026-09-22T14:53:13.172Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 161.163078] niks3-server[1194]: 2026/09/22 14:53:11 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 161.171933] niks3-server[1194]: 2026/09/22 14:53:11 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 161.185866] niks3-server[1194]: 2026/09/22 14:53:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 161.191431] niks3-server[1194]: 2026/09/22 14:53:11 INFO Signed narinfos id=58 count=1 worker2 # [ 161.204421] nix-grpc-daemon[1762]: time=2026-09-22T14:53:13.230Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.195805] niks3-server[1194]: 2026/09/22 14:53:11 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 161.206973] niks3-server[1194]: 2026/09/22 14:53:11 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 161.210845] niks3-server[1194]: 2026/09/22 14:53:11 INFO Completed upload id=58 lb # [ 161.213148] niks3-server[1194]: 2026/09/22 14:53:11 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker2 # [ 161.221712] nix-grpc-daemon[1762]: time=2026-09-22T14:53:13.248Z level=INFO msg="Upload complete. (218ms)" worker2 # [ 161.227807] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 worker1 # [ 161.253376] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:12Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 161.256314] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:12Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 161.243947] nix-daemon[869]: reaped child process 1887, status = succeeded worker2 # [ 161.276864] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 161.294855] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 161.307254] nix-grpc-daemon[1762]: time=2026-09-22T14:53:13.333Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 161.316754] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'... worker2 # [ 161.337139] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 161.438331] nix-daemon[869]: accepted connection from pid 1912, user nix-grpc-daemon (trusted) worker2 # [ 161.451367] nix-daemon[869]: reaped child process 1915, status = succeeded worker2 # [ 161.535409] nix-daemon[869]: accepted connection from pid 1917, user nix-grpc-daemon (trusted) worker2 # [ 161.547871] nix-daemon[869]: reaped child process 1920, status = succeeded lb # [ 161.546226] niks3-server[1194]: 2026/09/22 14:53:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 161.563379] nix-grpc-daemon[1762]: time=2026-09-22T14:53:13.589Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 161.565175] nix-grpc-daemon[1762]: time=2026-09-22T14:53:13.591Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 161.572560] niks3-server[1194]: 2026/09/22 14:53:11 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 161.584314] niks3-server[1194]: 2026/09/22 14:53:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker2 # [ 161.599470] nix-grpc-daemon[1762]: time=2026-09-22T14:53:13.625Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.589729] niks3-server[1194]: 2026/09/22 14:53:12 INFO Signed narinfos id=59 count=1 lb # [ 161.600843] niks3-server[1194]: 2026/09/22 14:53:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 161.610383] niks3-server[1194]: 2026/09/22 14:53:12 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 161.616231] niks3-server[1194]: 2026/09/22 14:53:12 INFO Completed upload id=59 worker2 # [ 161.628158] nix-grpc-daemon[1762]: time=2026-09-22T14:53:13.654Z level=INFO msg="Upload complete. (278ms)" lb # [ 161.620772] niks3-server[1194]: 2026/09/22 14:53:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker2 # [ 161.632239] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 161.636880] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 161.648108] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 161.652200] nix-daemon[869]: reaped child process 1910, status = succeeded worker2 # [ 161.657148] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051... client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 162.694945] nix-daemon[869]: reaped child process 1924, status = succeeded worker2 # [ 162.781081] nix-daemon[869]: accepted connection from pid 1940, user nix-grpc-daemon (trusted) worker2 # [ 162.793360] nix-daemon[869]: reaped child process 1943, status = succeeded lb # [ 162.792130] niks3-server[1194]: 2026/09/22 14:53:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 162.809936] nix-grpc-daemon[1762]: time=2026-09-22T14:53:14.836Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 162.812742] nix-grpc-daemon[1762]: time=2026-09-22T14:53:14.837Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 162.831732] niks3-server[1194]: 2026/09/22 14:53:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker2 # [ 162.846669] nix-grpc-daemon[1762]: time=2026-09-22T14:53:14.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.837256] niks3-server[1194]: 2026/09/22 14:53:13 INFO Signed narinfos id=60 count=1 lb # [ 162.850136] niks3-server[1194]: 2026/09/22 14:53:13 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 162.854163] niks3-server[1194]: 2026/09/22 14:53:13 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 162.865589] niks3-server[1194]: 2026/09/22 14:53:13 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 162.870773] niks3-server[1194]: 2026/09/22 14:53:13 INFO Completed upload id=60 worker2 # [ 162.882201] nix-grpc-daemon[1762]: time=2026-09-22T14:53:14.908Z level=INFO msg="Upload complete. (217ms)" lb # [ 162.873812] niks3-server[1194]: 2026/09/22 14:53:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 162.877767] niks3-server[1194]: 2026/09/22 14:53:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker2 # [ 162.887892] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 worker2 # [ 162.899526] nix-daemon[869]: reaped child process 1922, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 5.71 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 163.206562] nix-daemon[849]: reaped child process 1758, status = succeeded worker1 # [ 163.279783] nix-daemon[849]: accepted connection from pid 1805, user nix-grpc-daemon (trusted) worker1 # [ 163.291714] nix-daemon[849]: reaped child process 1808, status = succeeded lb # [ 163.269379] niks3-server[1194]: 2026/09/22 14:53:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.308198] nix-grpc-daemon[1690]: time=2026-09-22T14:53:14.505Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 163.309800] nix-grpc-daemon[1690]: time=2026-09-22T14:53:14.507Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 163.298081] niks3-server[1194]: 2026/09/22 14:53:13 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 163.314759] niks3-server[1194]: 2026/09/22 14:53:13 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 163.330292] niks3-server[1194]: 2026/09/22 14:53:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 163.366155] nix-grpc-daemon[1690]: time=2026-09-22T14:53:14.563Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.334826] niks3-server[1194]: 2026/09/22 14:53:13 INFO Signed narinfos id=61 count=1 lb # [ 163.339538] niks3-server[1194]: 2026/09/22 14:53:13 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 163.348084] niks3-server[1194]: 2026/09/22 14:53:13 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 163.352061] niks3-server[1194]: 2026/09/22 14:53:13 INFO Completed upload id=61 worker1 # [ 163.382748] nix-grpc-daemon[1690]: time=2026-09-22T14:53:14.580Z level=INFO msg="Upload complete. (185ms)" lb # [ 163.353878] niks3-server[1194]: 2026/09/22 14:53:13 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 163.385331] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38480 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 163.393257] nix-daemon[849]: reaped child process 1756, status = succeeded client # [ 163.409605] systemd[1]: sw.service: Deactivated successfully. client # [ 163.413885] systemd[1]: sw.service: Consumed 129ms CPU time over 9.764s wall clock time, 43.4M memory peak, 7.4K incoming IP traffic, 8.5K outgoing IP traffic. worker1 # [ 163.873233] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:15Z level=info event=signal_exit lb # [ 163.847460] niks3-server[1194]: 2026/09/22 14:53:14 INFO lead: released remote=192.168.1.3:39882 lb # [ 164.071478] niks3-server[1194]: 2026/09/22 14:53:14 INFO lead: acquired remote=192.168.1.4:39432 worker2 # [ 164.082382] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:16Z level=info event=scheduler_take_over client: (finished: waiting for success: ! systemctl is-active sw, in 1.04 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.02 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 164.858137] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:16Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 164.884420] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:16Z level=info event=scheduler_restarting worker1 # [ 164.888709] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38464 worker1 # [ 164.892634] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:16Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 164.896258] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:16Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 164.899835] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38464 worker1 # [ 164.903516] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:16Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 164.918114] nix-daemon[849]: reaped child process 1661, status = succeeded worker2 # [ 165.059346] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 165.063399] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 165.093802] nix-grpc-daemon[1606]: ts=2026-09-22T14:53:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 165.265968] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 165.269323] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 165.455292] nix-grpc-daemon[1606]: E0000 00:00:1790088796.652613 1652 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 20, started true, shutdown true worker1 # [ 165.460318] nix-grpc-daemon[1606]: E0000 00:00:1790088796.652906 1652 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 165.467115] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 165.471256] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 165.672448] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 165.676518] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 165.895133] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 165.877712] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 165.898994] systemd[1]: nix-grpc-daemon.service: Consumed 640ms CPU time over 22.156s wall clock time, 36.5M memory peak, 24.4K incoming IP traffic, 31.5K outgoing IP traffic. worker2 # [ 165.881451] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 165.914405] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 166.003736] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 166.005708] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 166.009114] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 166.013559] nix-grpc-daemon[1822]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 166.016158] nix-grpc-daemon[1822]: E0000 00:00:1790088797.210885 1822 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 166.020779] nix-grpc-daemon[1822]: E0000 00:00:1790088797.216305 1822 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 166.024519] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 166.026751] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 166.032058] nix-grpc-daemon[1822]: E0000 00:00:1790088797.227699 1863 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 166.043576] nix-grpc-daemon[1822]: E0000 00:00:1790088797.241176 1863 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 166.047128] nix-grpc-daemon[1822]: E0000 00:00:1790088797.243436 1863 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.90 seconds) lb: waiting until exactly no endpoints of x86_64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 166.058514] nix-grpc-daemon[1822]: E0000 00:00:1790088797.256170 1863 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 166.069196] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 166.056072] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:18Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40620 worker2 # [ 166.057902] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker2 # [ 166.082732] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:18Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 166.091133] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:18Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 166.095309] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:18Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40620 worker2 # [ 166.099193] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:18Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.58 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 167.344401] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 167.349594] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 167.355834] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 167.360647] nix-grpc-daemon[1822]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 1/5) worker1 # [ 167.404996] nix-grpc-daemon[1822]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 2/5) worker1 # [ 167.418643] nix-grpc-daemon[1822]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 303 ms (attempt 3/5) lb # [ 167.650658] envoy[924]: conn peer=[2001:db8:1::1]:41082 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9598 tx=4405 ms=5548 lb # [ 167.654553] envoy[924]: conn peer=[2001:db8:1::1]:41074 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1558 ms=9604 lb # [ 167.658147] envoy[924]: conn peer=[2001:db8:1::3]:55152 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=958 tx=344 ms=21176 worker1 # [ 167.724133] nix-grpc-daemon[1822]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 575 ms (attempt 4/5) worker1 # [ 168.300357] nix-grpc-daemon[1822]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 168.301810] nix-grpc-daemon[1822]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 168.321745] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:20Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=0 worker2 # [ 168.326270] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:20Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 168.330631] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:20Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=0 worker2 # [ 168.334491] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:20Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=0 worker1 # [ 168.387231] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 168.395336] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 168.402710] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 168.406560] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 168.418551] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:19Z level=info event=niks3_push_started pid=1882 worker1 # [ 168.509643] nix-grpc-daemon[1882]: time=2026-09-22T14:53:19.707Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca="" worker1 # [ 168.597755] nix-daemon[849]: accepted connection from pid 1895, user nix-grpc-daemon (trusted) worker1 # [ 168.608505] nix-daemon[849]: reaped child process 1898, status = succeeded worker1 # [ 168.693206] nix-daemon[849]: accepted connection from pid 1900, user nix-grpc-daemon (trusted) worker1 # [ 168.705391] nix-daemon[849]: reaped child process 1903, status = succeeded lb # [ 168.683200] niks3-server[1194]: 2026/09/22 14:53:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.726854] nix-grpc-daemon[1882]: time=2026-09-22T14:53:19.924Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 168.728911] nix-grpc-daemon[1882]: time=2026-09-22T14:53:19.926Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)" lb # [ 168.727283] niks3-server[1194]: 2026/09/22 14:53:19 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst lb # [ 168.734170] niks3-server[1194]: 2026/09/22 14:53:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 168.776138] nix-grpc-daemon[1882]: time=2026-09-22T14:53:19.973Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.744412] niks3-server[1194]: 2026/09/22 14:53:19 INFO Signed narinfos id=62 count=1 lb # [ 168.750824] niks3-server[1194]: 2026/09/22 14:53:19 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls lb # [ 168.764058] niks3-server[1194]: 2026/09/22 14:53:19 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 168.772273] niks3-server[1194]: 2026/09/22 14:53:19 INFO Completed upload id=62 lb # [ 168.773896] niks3-server[1194]: 2026/09/22 14:53:19 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo worker1 # [ 168.803692] nix-grpc-daemon[1882]: time=2026-09-22T14:53:20.001Z level=INFO msg="Upload complete. (290ms)" worker1 # [ 168.808593] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 168.814308] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 168.824671] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 168.832255] nix-daemon[849]: reaped child process 1880, status = succeeded worker1 # [ 168.837174] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 169.852878] nix-daemon[849]: reaped child process 1907, status = succeeded worker1 # [ 169.928755] nix-daemon[849]: accepted connection from pid 1923, user nix-grpc-daemon (trusted) worker1 # [ 169.941960] nix-daemon[849]: reaped child process 1926, status = succeeded lb # [ 169.918665] niks3-server[1194]: 2026/09/22 14:53:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 169.958238] nix-grpc-daemon[1882]: time=2026-09-22T14:53:21.155Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 169.959706] nix-grpc-daemon[1882]: time=2026-09-22T14:53:21.157Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)" lb # [ 169.958171] niks3-server[1194]: 2026/09/22 14:53:20 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv lb # [ 169.964154] niks3-server[1194]: 2026/09/22 14:53:20 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 169.973399] niks3-server[1194]: 2026/09/22 14:53:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 169.978282] niks3-server[1194]: 2026/09/22 14:53:20 INFO Signed narinfos id=63 count=1 worker1 # [ 170.009737] nix-grpc-daemon[1882]: time=2026-09-22T14:53:21.206Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.986345] niks3-server[1194]: 2026/09/22 14:53:20 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls lb # [ 169.989243] niks3-server[1194]: 2026/09/22 14:53:20 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 169.992773] niks3-server[1194]: 2026/09/22 14:53:20 INFO Completed upload id=63 worker1 # [ 170.023571] nix-grpc-daemon[1882]: time=2026-09-22T14:53:21.221Z level=INFO msg="Upload complete. (179ms)" lb # [ 169.994921] niks3-server[1194]: 2026/09/22 14:53:20 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo worker1 # [ 170.026218] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=1 worker1 # [ 170.033338] nix-daemon[849]: reaped child process 1905, status = succeeded worker2 # [ 170.011783] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:22Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 170.019170] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:22Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=0 worker1 # [ 170.081725] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 170.088363] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 170.094600] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 170.098346] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 170.183885] nix-daemon[849]: accepted connection from pid 1930, user nix-grpc-daemon (trusted) worker1 # [ 170.196546] nix-daemon[849]: reaped child process 1933, status = succeeded worker1 # [ 170.279448] nix-daemon[849]: accepted connection from pid 1935, user nix-grpc-daemon (trusted) worker1 # [ 170.293128] nix-daemon[849]: reaped child process 1938, status = succeeded lb # [ 170.267359] niks3-server[1194]: 2026/09/22 14:53:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.306613] nix-grpc-daemon[1882]: time=2026-09-22T14:53:21.504Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 170.307964] nix-grpc-daemon[1882]: time=2026-09-22T14:53:21.504Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)" lb # [ 170.291784] niks3-server[1194]: 2026/09/22 14:53:20 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst lb # [ 170.305561] niks3-server[1194]: 2026/09/22 14:53:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 170.313378] niks3-server[1194]: 2026/09/22 14:53:20 INFO Signed narinfos id=64 count=1 worker1 # [ 170.347155] nix-grpc-daemon[1882]: time=2026-09-22T14:53:21.544Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.318136] niks3-server[1194]: 2026/09/22 14:53:20 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls lb # [ 170.328961] niks3-server[1194]: 2026/09/22 14:53:20 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete worker1 # [ 170.366252] nix-grpc-daemon[1882]: time=2026-09-22T14:53:21.563Z level=INFO msg="Upload complete. (262ms)" lb # [ 170.335738] niks3-server[1194]: 2026/09/22 14:53:20 INFO Completed upload id=64 worker1 # [ 170.368270] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 170.372152] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 lb # [ 170.341479] niks3-server[1194]: 2026/09/22 14:53:20 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo worker1 # [ 170.378487] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 170.380753] nix-daemon[849]: reaped child process 1928, status = succeeded worker1 # [ 170.385708] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 171.423651] nix-daemon[849]: reaped child process 1942, status = succeeded worker1 # [ 171.507646] nix-daemon[849]: accepted connection from pid 1958, user nix-grpc-daemon (trusted) worker1 # [ 171.518870] nix-daemon[849]: reaped child process 1961, status = succeeded lb # [ 171.496261] niks3-server[1194]: 2026/09/22 14:53:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 171.535453] nix-grpc-daemon[1882]: time=2026-09-22T14:53:22.732Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 171.537105] nix-grpc-daemon[1882]: time=2026-09-22T14:53:22.734Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)" lb # [ 171.533603] niks3-server[1194]: 2026/09/22 14:53:21 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv lb # [ 171.542907] niks3-server[1194]: 2026/09/22 14:53:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 171.548559] niks3-server[1194]: 2026/09/22 14:53:21 INFO Signed narinfos id=65 count=1 worker1 # [ 171.582300] nix-grpc-daemon[1882]: time=2026-09-22T14:53:22.779Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.558585] niks3-server[1194]: 2026/09/22 14:53:21 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 171.573522] niks3-server[1194]: 2026/09/22 14:53:21 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls lb # [ 171.577486] niks3-server[1194]: 2026/09/22 14:53:21 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 171.582753] niks3-server[1194]: 2026/09/22 14:53:22 INFO Completed upload id=65 worker1 # [ 171.613743] nix-grpc-daemon[1882]: time=2026-09-22T14:53:22.811Z level=INFO msg="Upload complete. (220ms)" lb # [ 171.584693] niks3-server[1194]: 2026/09/22 14:53:22 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo worker1 # [ 171.619708] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=1 worker2 # [ 171.599628] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:23Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 171.608875] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:23Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=0 worker1 # [ 171.635311] nix-daemon[849]: reaped child process 1940, status = succeeded worker1 # [ 171.669311] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 171.679985] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 171.689934] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 171.697902] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 171.796220] nix-daemon[849]: accepted connection from pid 1965, user nix-grpc-daemon (trusted) worker1 # [ 171.808943] nix-daemon[849]: reaped child process 1968, status = succeeded worker1 # [ 171.891634] nix-daemon[849]: accepted connection from pid 1970, user nix-grpc-daemon (trusted) worker1 # [ 171.905622] nix-daemon[849]: reaped child process 1973, status = succeeded lb # [ 171.881506] niks3-server[1194]: 2026/09/22 14:53:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 171.920517] nix-grpc-daemon[1882]: time=2026-09-22T14:53:23.118Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 171.922382] nix-grpc-daemon[1882]: time=2026-09-22T14:53:23.119Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)" lb # [ 171.917100] niks3-server[1194]: 2026/09/22 14:53:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker1 # [ 171.960680] nix-grpc-daemon[1882]: time=2026-09-22T14:53:23.158Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.930343] niks3-server[1194]: 2026/09/22 14:53:22 INFO Signed narinfos id=66 count=1 lb # [ 171.933820] niks3-server[1194]: 2026/09/22 14:53:22 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst lb # [ 171.953752] niks3-server[1194]: 2026/09/22 14:53:22 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 171.959251] niks3-server[1194]: 2026/09/22 14:53:22 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls lb # [ 171.962073] niks3-server[1194]: 2026/09/22 14:53:22 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo lb # [ 171.964889] niks3-server[1194]: 2026/09/22 14:53:22 INFO Completed upload id=66 worker1 # [ 171.995873] nix-grpc-daemon[1882]: time=2026-09-22T14:53:23.193Z level=INFO msg="Upload complete. (284ms)" worker1 # [ 172.000702] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 172.007301] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 172.016668] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 172.026341] nix-daemon[849]: reaped child process 1963, status = succeeded worker1 # [ 172.034493] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 172.877413] nix-daemon[849]: reaped child process 1977, status = succeeded worker1 # [ 172.958991] nix-daemon[849]: accepted connection from pid 1993, user nix-grpc-daemon (trusted) worker1 # [ 172.972775] nix-daemon[849]: reaped child process 1996, status = succeeded lb # [ 172.947579] niks3-server[1194]: 2026/09/22 14:53:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.986230] nix-grpc-daemon[1882]: time=2026-09-22T14:53:24.183Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 172.988233] nix-grpc-daemon[1882]: time=2026-09-22T14:53:24.185Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)" lb # [ 172.987263] niks3-server[1194]: 2026/09/22 14:53:23 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 172.996724] niks3-server[1194]: 2026/09/22 14:53:23 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv lb # [ 173.004559] niks3-server[1194]: 2026/09/22 14:53:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 173.012421] niks3-server[1194]: 2026/09/22 14:53:23 INFO Signed narinfos id=67 count=1 worker1 # [ 173.043688] nix-grpc-daemon[1882]: time=2026-09-22T14:53:24.241Z level=INFO msg="Uploading 1 narinfos" lb # [ 173.015627] niks3-server[1194]: 2026/09/22 14:53:23 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls lb # [ 173.028390] niks3-server[1194]: 2026/09/22 14:53:23 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 173.032057] niks3-server[1194]: 2026/09/22 14:53:23 INFO Completed upload id=67 worker1 # [ 173.062909] nix-grpc-daemon[1882]: time=2026-09-22T14:53:24.260Z level=INFO msg="Upload complete. (221ms)" lb # [ 173.034267] niks3-server[1194]: 2026/09/22 14:53:23 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo worker1 # [ 173.068840] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=1 worker2 # [ 173.049344] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:25Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 173.077517] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker2 # [ 173.058666] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:25Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=0 worker1 # [ 173.088628] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 173.097466] nix-daemon[849]: reaped child process 1975, status = succeeded worker1 # [ 173.100478] nix-grpc-daemon[1882]: time=2026-09-22T14:53:24.297Z level=INFO msg="All 1 paths already cached" worker1 # [ 173.104526] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 173.109440] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 173.194557] nix-daemon[849]: accepted connection from pid 2000, user nix-grpc-daemon (trusted) worker1 # [ 173.206959] nix-daemon[849]: reaped child process 2003, status = succeeded worker1 # [ 173.290330] nix-daemon[849]: accepted connection from pid 2005, user nix-grpc-daemon (trusted) worker1 # [ 173.302784] nix-daemon[849]: reaped child process 2008, status = succeeded lb # [ 173.279367] niks3-server[1194]: 2026/09/22 14:53:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 173.318317] nix-grpc-daemon[1882]: time=2026-09-22T14:53:24.515Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 173.319695] nix-grpc-daemon[1882]: time=2026-09-22T14:53:24.515Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)" lb # [ 173.304134] niks3-server[1194]: 2026/09/22 14:53:23 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst lb # [ 173.317511] niks3-server[1194]: 2026/09/22 14:53:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 173.323143] niks3-server[1194]: 2026/09/22 14:53:23 INFO Signed narinfos id=68 count=1 worker1 # [ 173.356909] nix-grpc-daemon[1882]: time=2026-09-22T14:53:24.554Z level=INFO msg="Uploading 1 narinfos" lb # [ 173.329377] niks3-server[1194]: 2026/09/22 14:53:23 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls lb # [ 173.341987] niks3-server[1194]: 2026/09/22 14:53:23 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete worker1 # [ 173.378901] nix-grpc-daemon[1882]: time=2026-09-22T14:53:24.576Z level=INFO msg="Upload complete. (264ms)" lb # [ 173.347986] niks3-server[1194]: 2026/09/22 14:53:23 INFO Completed upload id=68 worker1 # [ 173.381983] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 173.354068] niks3-server[1194]: 2026/09/22 14:53:23 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo worker1 # [ 173.388116] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 173.396689] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 173.402124] nix-daemon[849]: reaped child process 1998, status = succeeded worker1 # [ 173.406195] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 174.222404] nix-daemon[849]: reaped child process 2012, status = succeeded worker1 # [ 174.291945] nix-daemon[849]: accepted connection from pid 2028, user nix-grpc-daemon (trusted) worker1 # [ 174.304882] nix-daemon[849]: reaped child process 2031, status = succeeded lb # [ 174.280677] niks3-server[1194]: 2026/09/22 14:53:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.319753] nix-grpc-daemon[1882]: time=2026-09-22T14:53:25.517Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 174.321239] nix-grpc-daemon[1882]: time=2026-09-22T14:53:25.518Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)" lb # [ 174.318462] niks3-server[1194]: 2026/09/22 14:53:24 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst lb # [ 174.335185] niks3-server[1194]: 2026/09/22 14:53:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker1 # [ 174.372689] nix-grpc-daemon[1882]: time=2026-09-22T14:53:25.570Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.341743] niks3-server[1194]: 2026/09/22 14:53:24 INFO Signed narinfos id=69 count=1 lb # [ 174.348170] niks3-server[1194]: 2026/09/22 14:53:24 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv lb # [ 174.353210] niks3-server[1194]: 2026/09/22 14:53:24 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls lb # [ 174.362769] niks3-server[1194]: 2026/09/22 14:53:24 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 174.365377] niks3-server[1194]: 2026/09/22 14:53:24 INFO Completed upload id=69 worker1 # [ 174.397542] nix-grpc-daemon[1882]: time=2026-09-22T14:53:25.595Z level=INFO msg="Upload complete. (185ms)" lb # [ 174.368854] niks3-server[1194]: 2026/09/22 14:53:24 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo worker1 # [ 174.403770] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=1 worker2 # [ 174.383717] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:26Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 174.411716] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker2 # [ 174.391285] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:26Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=0 worker1 # [ 174.422247] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 174.429782] nix-daemon[849]: reaped child process 2010, status = succeeded worker1 # [ 174.435606] nix-grpc-daemon[1882]: time=2026-09-22T14:53:25.633Z level=INFO msg="All 1 paths already cached" worker1 # [ 174.441483] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 174.449375] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 174.528175] nix-daemon[849]: accepted connection from pid 2035, user nix-grpc-daemon (trusted) worker1 # [ 174.540437] nix-daemon[849]: reaped child process 2038, status = succeeded worker1 # [ 174.617398] nix-daemon[849]: accepted connection from pid 2040, user nix-grpc-daemon (trusted) worker1 # [ 174.631088] nix-daemon[849]: reaped child process 2043, status = succeeded lb # [ 174.603966] niks3-server[1194]: 2026/09/22 14:53:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.640762] nix-grpc-daemon[1882]: time=2026-09-22T14:53:25.838Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 174.642120] nix-grpc-daemon[1882]: time=2026-09-22T14:53:25.838Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)" lb # [ 174.630868] niks3-server[1194]: 2026/09/22 14:53:25 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst lb # [ 174.641114] niks3-server[1194]: 2026/09/22 14:53:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker1 # [ 174.677712] nix-grpc-daemon[1882]: time=2026-09-22T14:53:25.875Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.647309] niks3-server[1194]: 2026/09/22 14:53:25 INFO Signed narinfos id=70 count=1 lb # [ 174.652955] niks3-server[1194]: 2026/09/22 14:53:25 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls lb # [ 174.668241] niks3-server[1194]: 2026/09/22 14:53:25 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 174.676084] niks3-server[1194]: 2026/09/22 14:53:25 INFO Completed upload id=70 worker1 # [ 174.706601] nix-grpc-daemon[1882]: time=2026-09-22T14:53:25.904Z level=INFO msg="Upload complete. (252ms)" lb # [ 174.680926] niks3-server[1194]: 2026/09/22 14:53:25 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo worker1 # [ 174.710978] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 174.716245] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 174.724641] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 174.732405] nix-daemon[849]: reaped child process 2033, status = succeeded worker1 # [ 174.737125] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 176.173972] nix-daemon[849]: reaped child process 2047, status = succeeded worker1 # [ 176.249818] nix-daemon[849]: accepted connection from pid 2063, user nix-grpc-daemon (trusted) worker1 # [ 176.262133] nix-daemon[849]: reaped child process 2066, status = succeeded lb # [ 176.238994] niks3-server[1194]: 2026/09/22 14:53:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 176.278480] nix-grpc-daemon[1882]: time=2026-09-22T14:53:27.475Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 176.280056] nix-grpc-daemon[1882]: time=2026-09-22T14:53:27.477Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)" lb # [ 176.282434] niks3-server[1194]: 2026/09/22 14:53:26 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv lb # [ 176.293154] niks3-server[1194]: 2026/09/22 14:53:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign worker1 # [ 176.327594] nix-grpc-daemon[1882]: time=2026-09-22T14:53:27.525Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.296693] niks3-server[1194]: 2026/09/22 14:53:26 INFO Signed narinfos id=71 count=1 lb # [ 176.301869] niks3-server[1194]: 2026/09/22 14:53:26 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls lb # [ 176.309072] niks3-server[1194]: 2026/09/22 14:53:26 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst lb # [ 176.313847] niks3-server[1194]: 2026/09/22 14:53:26 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 176.317061] niks3-server[1194]: 2026/09/22 14:53:26 INFO Completed upload id=71 worker1 # [ 176.348094] nix-grpc-daemon[1882]: time=2026-09-22T14:53:27.545Z level=INFO msg="Upload complete. (203ms)" lb # [ 176.319823] niks3-server[1194]: 2026/09/22 14:53:26 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo worker1 # [ 176.355286] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=1 worker2 # [ 176.334870] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:28Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 176.362789] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker2 # [ 176.344498] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:28Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=0 worker1 # [ 176.374501] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 176.382476] nix-daemon[849]: reaped child process 2045, status = succeeded worker1 # [ 176.385580] nix-grpc-daemon[1882]: time=2026-09-22T14:53:27.582Z level=INFO msg="All 1 paths already cached" worker1 # [ 176.389626] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 176.394186] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 176.475345] nix-daemon[849]: accepted connection from pid 2070, user nix-grpc-daemon (trusted) worker1 # [ 176.487439] nix-daemon[849]: reaped child process 2073, status = succeeded worker1 # [ 176.568941] nix-daemon[849]: accepted connection from pid 2075, user nix-grpc-daemon (trusted) worker1 # [ 176.581529] nix-daemon[849]: reaped child process 2078, status = succeeded lb # [ 176.557209] niks3-server[1194]: 2026/09/22 14:53:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 176.596644] nix-grpc-daemon[1882]: time=2026-09-22T14:53:27.794Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 176.598266] nix-grpc-daemon[1882]: time=2026-09-22T14:53:27.795Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)" lb # [ 176.586939] niks3-server[1194]: 2026/09/22 14:53:27 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst lb # [ 176.598074] niks3-server[1194]: 2026/09/22 14:53:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign worker1 # [ 176.634564] nix-grpc-daemon[1882]: time=2026-09-22T14:53:27.832Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.603677] niks3-server[1194]: 2026/09/22 14:53:27 INFO Signed narinfos id=72 count=1 lb # [ 176.609258] niks3-server[1194]: 2026/09/22 14:53:27 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls lb # [ 176.621523] niks3-server[1194]: 2026/09/22 14:53:27 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 176.624906] niks3-server[1194]: 2026/09/22 14:53:27 INFO Completed upload id=72 worker1 # [ 176.655797] nix-grpc-daemon[1882]: time=2026-09-22T14:53:27.853Z level=INFO msg="Upload complete. (256ms)" lb # [ 176.626405] niks3-server[1194]: 2026/09/22 14:53:27 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo worker1 # [ 176.658762] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 176.663577] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 176.673287] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 176.678053] nix-daemon[849]: reaped child process 2068, status = succeeded worker1 # [ 176.682648] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 177.722614] nix-daemon[849]: reaped child process 2082, status = succeeded worker1 # [ 177.804536] nix-daemon[849]: accepted connection from pid 2098, user nix-grpc-daemon (trusted) worker1 # [ 177.815674] nix-daemon[849]: reaped child process 2101, status = succeeded lb # [ 177.792683] niks3-server[1194]: 2026/09/22 14:53:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 177.831681] nix-grpc-daemon[1882]: time=2026-09-22T14:53:29.029Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 177.833177] nix-grpc-daemon[1882]: time=2026-09-22T14:53:29.030Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)" lb # [ 177.827173] niks3-server[1194]: 2026/09/22 14:53:28 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv lb # [ 177.840214] niks3-server[1194]: 2026/09/22 14:53:28 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst lb # [ 177.852079] niks3-server[1194]: 2026/09/22 14:53:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 177.856606] niks3-server[1194]: 2026/09/22 14:53:28 INFO Signed narinfos id=73 count=1 worker1 # [ 177.890297] nix-grpc-daemon[1882]: time=2026-09-22T14:53:29.087Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.863281] niks3-server[1194]: 2026/09/22 14:53:28 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls lb # [ 177.873130] niks3-server[1194]: 2026/09/22 14:53:28 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 177.876952] niks3-server[1194]: 2026/09/22 14:53:28 INFO Completed upload id=73 lb # [ 177.878269] niks3-server[1194]: 2026/09/22 14:53:28 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo worker1 # [ 177.907584] nix-grpc-daemon[1882]: time=2026-09-22T14:53:29.105Z level=INFO msg="Upload complete. (216ms)" worker1 # [ 177.914387] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=1 worker2 # [ 177.893931] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:29Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 177.903834] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:29Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=0 worker1 # [ 177.930243] nix-daemon[849]: reaped child process 2080, status = succeeded worker1 # [ 177.962956] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 177.968590] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 177.974218] nix-grpc-daemon[1882]: time=2026-09-22T14:53:29.171Z level=INFO msg="All 2 paths already cached" worker1 # [ 177.977527] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 177.982229] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 178.063859] nix-daemon[849]: accepted connection from pid 2105, user nix-grpc-daemon (trusted) worker1 # [ 178.076519] nix-daemon[849]: reaped child process 2108, status = succeeded worker1 # [ 178.156524] nix-daemon[849]: accepted connection from pid 2110, user nix-grpc-daemon (trusted) lb # [ 178.139948] niks3-server[1194]: 2026/09/22 14:53:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 178.171590] nix-daemon[849]: reaped child process 2113, status = succeeded worker1 # [ 178.175535] nix-grpc-daemon[1882]: time=2026-09-22T14:53:29.373Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 178.176939] nix-grpc-daemon[1882]: time=2026-09-22T14:53:29.373Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)" lb # [ 178.154571] niks3-server[1194]: 2026/09/22 14:53:28 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst lb # [ 178.158252] niks3-server[1194]: 2026/09/22 14:53:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign lb # [ 178.160806] niks3-server[1194]: 2026/09/22 14:53:28 INFO Signed narinfos id=74 count=1 worker1 # [ 178.191645] nix-grpc-daemon[1882]: time=2026-09-22T14:53:29.389Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.164151] niks3-server[1194]: 2026/09/22 14:53:28 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls lb # [ 178.169408] niks3-server[1194]: 2026/09/22 14:53:28 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 178.172659] niks3-server[1194]: 2026/09/22 14:53:28 INFO Completed upload id=74 worker1 # [ 178.203388] nix-grpc-daemon[1882]: time=2026-09-22T14:53:29.401Z level=INFO msg="Upload complete. (216ms)" worker1 # [ 178.205360] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 178.176274] niks3-server[1194]: 2026/09/22 14:53:28 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo worker1 # [ 178.209507] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 178.216058] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 178.217161] nix-daemon[849]: reaped child process 2103, status = succeeded worker1 # [ 178.222205] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 179.074631] nix-daemon[849]: reaped child process 2117, status = succeeded worker1 # [ 179.139275] nix-daemon[849]: accepted connection from pid 2133, user nix-grpc-daemon (trusted) worker1 # [ 179.151574] nix-daemon[849]: reaped child process 2136, status = succeeded lb # [ 179.128678] niks3-server[1194]: 2026/09/22 14:53:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 179.167821] nix-grpc-daemon[1882]: time=2026-09-22T14:53:30.365Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 179.169449] nix-grpc-daemon[1882]: time=2026-09-22T14:53:30.367Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)" lb # [ 179.164662] niks3-server[1194]: 2026/09/22 14:53:29 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv lb # [ 179.181652] niks3-server[1194]: 2026/09/22 14:53:29 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst lb # [ 179.190056] niks3-server[1194]: 2026/09/22 14:53:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign lb # [ 179.194145] niks3-server[1194]: 2026/09/22 14:53:29 INFO Signed narinfos id=75 count=1 worker1 # [ 179.225579] nix-grpc-daemon[1882]: time=2026-09-22T14:53:30.422Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.201828] niks3-server[1194]: 2026/09/22 14:53:29 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls lb # [ 179.210313] niks3-server[1194]: 2026/09/22 14:53:29 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 179.213487] niks3-server[1194]: 2026/09/22 14:53:29 INFO Completed upload id=75 worker1 # [ 179.244154] nix-grpc-daemon[1882]: time=2026-09-22T14:53:30.441Z level=INFO msg="Upload complete. (214ms)" worker1 # [ 179.247154] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=1 lb # [ 179.218646] niks3-server[1194]: 2026/09/22 14:53:29 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo worker2 # [ 179.227713] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:31Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 179.255791] nix-daemon[849]: reaped child process 2115, status = succeeded worker1 # [ 179.298136] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 179.306810] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 179.315915] nix-grpc-daemon[1882]: time=2026-09-22T14:53:30.513Z level=INFO msg="All 2 paths already cached" worker1 # [ 179.321079] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 179.325228] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 179.410857] nix-daemon[849]: accepted connection from pid 2140, user nix-grpc-daemon (trusted) worker1 # [ 179.424076] nix-daemon[849]: reaped child process 2143, status = succeeded worker1 # [ 179.502815] nix-daemon[849]: accepted connection from pid 2145, user nix-grpc-daemon (trusted) worker1 # [ 179.514939] nix-daemon[849]: reaped child process 2148, status = succeeded lb # [ 179.491589] niks3-server[1194]: 2026/09/22 14:53:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 179.530380] nix-grpc-daemon[1882]: time=2026-09-22T14:53:30.728Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 179.532249] nix-grpc-daemon[1882]: time=2026-09-22T14:53:30.729Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)" lb # [ 179.524471] niks3-server[1194]: 2026/09/22 14:53:29 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst lb # [ 179.534365] niks3-server[1194]: 2026/09/22 14:53:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign worker1 # [ 179.570825] nix-grpc-daemon[1882]: time=2026-09-22T14:53:30.768Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.540386] niks3-server[1194]: 2026/09/22 14:53:29 INFO Signed narinfos id=76 count=1 lb # [ 179.546351] niks3-server[1194]: 2026/09/22 14:53:29 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls lb # [ 179.558960] niks3-server[1194]: 2026/09/22 14:53:29 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete worker1 # [ 179.598271] nix-grpc-daemon[1882]: time=2026-09-22T14:53:30.795Z level=INFO msg="Upload complete. (265ms)" lb # [ 179.567590] niks3-server[1194]: 2026/09/22 14:53:29 INFO Completed upload id=76 worker1 # [ 179.600545] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 179.571240] niks3-server[1194]: 2026/09/22 14:53:29 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo worker1 # [ 179.604516] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 179.611582] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 179.613090] nix-daemon[849]: reaped child process 2138, status = succeeded worker1 # [ 179.618189] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 180.644626] nix-daemon[849]: reaped child process 2152, status = succeeded worker1 # [ 180.720920] nix-daemon[849]: accepted connection from pid 2168, user nix-grpc-daemon (trusted) worker1 # [ 180.732403] nix-daemon[849]: reaped child process 2171, status = succeeded lb # [ 180.709503] niks3-server[1194]: 2026/09/22 14:53:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 180.749029] nix-grpc-daemon[1882]: time=2026-09-22T14:53:31.946Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 180.751459] nix-grpc-daemon[1882]: time=2026-09-22T14:53:31.948Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)" lb # [ 180.746594] niks3-server[1194]: 2026/09/22 14:53:31 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst lb # [ 180.754587] niks3-server[1194]: 2026/09/22 14:53:31 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv lb # [ 180.766425] niks3-server[1194]: 2026/09/22 14:53:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 180.770693] niks3-server[1194]: 2026/09/22 14:53:31 INFO Signed narinfos id=77 count=1 worker1 # [ 180.804527] nix-grpc-daemon[1882]: time=2026-09-22T14:53:32.002Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.777217] niks3-server[1194]: 2026/09/22 14:53:31 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls lb # [ 180.787505] niks3-server[1194]: 2026/09/22 14:53:31 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 180.790918] niks3-server[1194]: 2026/09/22 14:53:31 INFO Completed upload id=77 worker1 # [ 180.821790] nix-grpc-daemon[1882]: time=2026-09-22T14:53:32.019Z level=INFO msg="Upload complete. (197ms)" lb # [ 180.793252] niks3-server[1194]: 2026/09/22 14:53:31 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo worker1 # [ 180.827832] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=1 worker2 # [ 180.808753] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:32Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 180.843072] nix-daemon[849]: reaped child process 2150, status = succeeded worker1 # [ 180.872909] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 180.883356] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 180.893245] nix-grpc-daemon[1882]: time=2026-09-22T14:53:32.090Z level=INFO msg="All 2 paths already cached" worker1 # [ 180.900594] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 180.910159] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 181.004728] nix-daemon[849]: accepted connection from pid 2175, user nix-grpc-daemon (trusted) worker1 # [ 181.017610] nix-daemon[849]: reaped child process 2178, status = succeeded worker1 # [ 181.098350] nix-daemon[849]: accepted connection from pid 2180, user nix-grpc-daemon (trusted) worker1 # [ 181.111075] nix-daemon[849]: reaped child process 2183, status = succeeded lb # [ 181.086157] niks3-server[1194]: 2026/09/22 14:53:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 181.121140] nix-grpc-daemon[1882]: time=2026-09-22T14:53:32.318Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 181.122491] nix-grpc-daemon[1882]: time=2026-09-22T14:53:32.318Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)" lb # [ 181.098973] niks3-server[1194]: 2026/09/22 14:53:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign lb # [ 181.102539] niks3-server[1194]: 2026/09/22 14:53:31 INFO Signed narinfos id=78 count=1 worker1 # [ 181.133188] nix-grpc-daemon[1882]: time=2026-09-22T14:53:32.330Z level=INFO msg="Uploading 1 narinfos" lb # [ 181.104774] niks3-server[1194]: 2026/09/22 14:53:31 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst lb # [ 181.108556] niks3-server[1194]: 2026/09/22 14:53:31 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls lb # [ 181.117737] niks3-server[1194]: 2026/09/22 14:53:31 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete lb # [ 181.120731] niks3-server[1194]: 2026/09/22 14:53:31 INFO Completed upload id=78 worker1 # [ 181.151605] nix-grpc-daemon[1882]: time=2026-09-22T14:53:32.349Z level=INFO msg="Upload complete. (229ms)" worker1 # [ 181.153823] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 181.123778] niks3-server[1194]: 2026/09/22 14:53:31 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo worker1 # [ 181.156798] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 worker1 # [ 181.163437] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 181.165720] nix-daemon[849]: reaped child process 2173, status = succeeded worker1 # [ 181.170698] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 182.185481] nix-daemon[849]: reaped child process 2187, status = succeeded worker1 # [ 182.258591] nix-daemon[849]: accepted connection from pid 2203, user nix-grpc-daemon (trusted) worker1 # [ 182.270771] nix-daemon[849]: reaped child process 2206, status = succeeded lb # [ 182.248621] niks3-server[1194]: 2026/09/22 14:53:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 182.288131] nix-grpc-daemon[1882]: time=2026-09-22T14:53:33.485Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 182.289819] nix-grpc-daemon[1882]: time=2026-09-22T14:53:33.487Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)" lb # [ 182.287350] niks3-server[1194]: 2026/09/22 14:53:32 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv lb # [ 182.299140] niks3-server[1194]: 2026/09/22 14:53:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign worker1 # [ 182.340826] nix-grpc-daemon[1882]: time=2026-09-22T14:53:33.538Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.310223] niks3-server[1194]: 2026/09/22 14:53:32 INFO Signed narinfos id=79 count=1 lb # [ 182.314989] niks3-server[1194]: 2026/09/22 14:53:32 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst lb # [ 182.320388] niks3-server[1194]: 2026/09/22 14:53:32 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls lb # [ 182.331593] niks3-server[1194]: 2026/09/22 14:53:32 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 182.338326] niks3-server[1194]: 2026/09/22 14:53:32 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo lb # [ 182.342359] niks3-server[1194]: 2026/09/22 14:53:32 INFO Completed upload id=79 worker1 # [ 182.373409] nix-grpc-daemon[1882]: time=2026-09-22T14:53:33.571Z level=INFO msg="Upload complete. (195ms)" worker1 # [ 182.379537] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44050 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=1 worker1 # [ 182.396253] nix-daemon[849]: reaped child process 2185, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.23 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 182.508988] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 75890cb453ff4d61a8b9022c90804875 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) worker1 # [ 182.650245] nix-grpc-daemon[1822]: ts=2026-09-22T14:53:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44050 client # [ 182.646067] nix[1531]: don't know how to build these paths: client # [ 182.646914] nix[1531]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv worker2 # [ 182.636689] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49930 client # [ 182.667094] nix[1531]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker worker2 # [ 182.655137] nix-grpc-daemon[1670]: ts=2026-09-22T14:53:34Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 187.651542] envoy[924]: conn peer=[2001:db8:1::1]:33958 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27098 tx=12337 ms=15049 client # [ 212.668226] nix[1531]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip} client # [ 212.677783] nix[1531]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed client # [ 212.703976] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 212.707651] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 212.711681] systemd[1]: gpu.service: Consumed 141ms CPU time over 30.196s wall clock time, 35.6M memory peak, 5.2K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.21 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.89 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1 # [ 214.033958] nix-grpc-daemon[1822]: ts=2026-09-22T14:54:05Z level=info event=unhealthy reason=min_free worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.96 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.02 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2 worker2 # [ 214.190403] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49930 client # don't know how to build these paths: client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker1 # [ 214.220700] nix-grpc-daemon[1822]: ts=2026-09-22T14:54:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44050 worker2 # [ 214.221149] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:06Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=0 worker2 # [ 214.225066] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:06Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 214.273833] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 214.284365] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49930 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'... worker2 # [ 214.294976] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 214.303836] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 214.410387] nix-daemon[869]: accepted connection from pid 1977, user nix-grpc-daemon (trusted) worker2 # [ 214.423989] nix-daemon[869]: reaped child process 1980, status = succeeded worker2 # [ 214.508678] nix-daemon[869]: accepted connection from pid 1982, user nix-grpc-daemon (trusted) worker2 # [ 214.519770] nix-daemon[869]: reaped child process 1985, status = succeeded lb # [ 214.518596] niks3-server[1194]: 2026/09/22 14:54:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 214.534143] nix-grpc-daemon[1762]: time=2026-09-22T14:54:06.560Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 214.536105] nix-grpc-daemon[1762]: time=2026-09-22T14:54:06.562Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)" lb # [ 214.542650] niks3-server[1194]: 2026/09/22 14:54:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign worker2 # [ 214.556651] nix-grpc-daemon[1762]: time=2026-09-22T14:54:06.583Z level=INFO msg="Uploading 1 narinfos" lb # [ 214.547548] niks3-server[1194]: 2026/09/22 14:54:04 INFO Signed narinfos id=80 count=1 lb # [ 214.558497] niks3-server[1194]: 2026/09/22 14:54:04 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls lb # [ 214.563258] niks3-server[1194]: 2026/09/22 14:54:04 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst lb # [ 214.570386] niks3-server[1194]: 2026/09/22 14:54:04 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete lb # [ 214.576928] niks3-server[1194]: 2026/09/22 14:54:04 INFO Completed upload id=80 worker2 # [ 214.586564] nix-grpc-daemon[1762]: time=2026-09-22T14:54:06.613Z level=INFO msg="Upload complete. (269ms)" worker2 # [ 214.588781] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 214.581262] niks3-server[1194]: 2026/09/22 14:54:04 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo worker2 # [ 214.593036] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 214.599257] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 214.602283] nix-daemon[869]: reaped child process 1975, status = succeeded client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051... client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker2 # [ 214.607263] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 215.427380] nix-daemon[869]: reaped child process 1989, status = succeeded worker2 # [ 215.496515] nix-daemon[869]: accepted connection from pid 2005, user nix-grpc-daemon (trusted) worker2 # [ 215.508236] nix-daemon[869]: reaped child process 2008, status = succeeded lb # [ 215.505066] niks3-server[1194]: 2026/09/22 14:54:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 215.519447] nix-grpc-daemon[1762]: time=2026-09-22T14:54:07.545Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 215.521095] nix-grpc-daemon[1762]: time=2026-09-22T14:54:07.547Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)" lb # [ 215.527254] niks3-server[1194]: 2026/09/22 14:54:05 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv lb # [ 215.532193] niks3-server[1194]: 2026/09/22 14:54:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign lb # [ 215.534615] niks3-server[1194]: 2026/09/22 14:54:05 INFO Signed narinfos id=81 count=1 worker2 # [ 215.543905] nix-grpc-daemon[1762]: time=2026-09-22T14:54:07.570Z level=INFO msg="Uploading 1 narinfos" lb # [ 215.537131] niks3-server[1194]: 2026/09/22 14:54:05 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 215.542074] niks3-server[1194]: 2026/09/22 14:54:05 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 215.545359] niks3-server[1194]: 2026/09/22 14:54:05 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls lb # [ 215.548936] niks3-server[1194]: 2026/09/22 14:54:05 INFO Completed upload id=81 worker2 # [ 215.558450] nix-grpc-daemon[1762]: time=2026-09-22T14:54:07.584Z level=INFO msg="Upload complete. (144ms)" lb # [ 215.551089] niks3-server[1194]: 2026/09/22 14:54:05 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo worker2 # [ 215.561207] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=0 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=1 worker2 # [ 215.568351] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:07Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=0 worker2 # [ 215.570963] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:07Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 215.574631] nix-daemon[869]: reaped child process 1987, status = succeeded worker2 # [ 215.611826] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 215.620091] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 215.630475] nix-grpc-daemon[1762]: time=2026-09-22T14:54:07.656Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'... worker2 # [ 215.636517] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 215.644126] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 215.729788] nix-daemon[869]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker2 # [ 215.742393] nix-daemon[869]: reaped child process 2017, status = succeeded worker2 # [ 215.824616] nix-daemon[869]: accepted connection from pid 2019, user nix-grpc-daemon (trusted) worker2 # [ 215.837591] nix-daemon[869]: reaped child process 2022, status = succeeded lb # [ 215.834379] niks3-server[1194]: 2026/09/22 14:54:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 215.854059] nix-grpc-daemon[1762]: time=2026-09-22T14:54:07.880Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 215.855434] nix-grpc-daemon[1762]: time=2026-09-22T14:54:07.880Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)" lb # [ 215.864496] niks3-server[1194]: 2026/09/22 14:54:06 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst lb # [ 215.874313] niks3-server[1194]: 2026/09/22 14:54:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign lb # [ 215.879252] niks3-server[1194]: 2026/09/22 14:54:06 INFO Signed narinfos id=82 count=1 worker2 # [ 215.891170] nix-grpc-daemon[1762]: time=2026-09-22T14:54:07.917Z level=INFO msg="Uploading 1 narinfos" lb # [ 215.887853] niks3-server[1194]: 2026/09/22 14:54:06 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls lb # [ 215.896728] niks3-server[1194]: 2026/09/22 14:54:06 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 215.900144] niks3-server[1194]: 2026/09/22 14:54:06 INFO Completed upload id=82 worker2 # [ 215.909882] nix-grpc-daemon[1762]: time=2026-09-22T14:54:07.936Z level=INFO msg="Upload complete. (258ms)" lb # [ 215.901986] niks3-server[1194]: 2026/09/22 14:54:06 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo worker2 # [ 215.913966] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 215.918741] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 215.927978] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 215.934924] nix-daemon[869]: reaped child process 2012, status = succeeded worker2 # [ 215.937841] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051... client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 217.374746] nix-daemon[869]: reaped child process 2026, status = succeeded worker2 # [ 217.457583] nix-daemon[869]: accepted connection from pid 2042, user nix-grpc-daemon (trusted) worker2 # [ 217.469177] nix-daemon[869]: reaped child process 2045, status = succeeded lb # [ 217.467580] niks3-server[1194]: 2026/09/22 14:54:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 217.485440] nix-grpc-daemon[1762]: time=2026-09-22T14:54:09.511Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 217.486990] nix-grpc-daemon[1762]: time=2026-09-22T14:54:09.513Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)" lb # [ 217.508258] niks3-server[1194]: 2026/09/22 14:54:07 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv lb # [ 217.513917] niks3-server[1194]: 2026/09/22 14:54:07 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst lb # [ 217.528550] niks3-server[1194]: 2026/09/22 14:54:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign lb # [ 217.534806] niks3-server[1194]: 2026/09/22 14:54:07 INFO Signed narinfos id=83 count=1 worker2 # [ 217.547561] nix-grpc-daemon[1762]: time=2026-09-22T14:54:09.573Z level=INFO msg="Uploading 1 narinfos" lb # [ 217.541745] niks3-server[1194]: 2026/09/22 14:54:07 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls lb # [ 217.550967] niks3-server[1194]: 2026/09/22 14:54:07 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 217.554693] niks3-server[1194]: 2026/09/22 14:54:07 INFO Completed upload id=83 worker2 # [ 217.564394] nix-grpc-daemon[1762]: time=2026-09-22T14:54:09.590Z level=INFO msg="Upload complete. (218ms)" lb # [ 217.557224] niks3-server[1194]: 2026/09/22 14:54:07 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo worker2 # [ 217.572670] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=1 worker2 # [ 217.582192] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:09Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=0 worker2 # [ 217.588306] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:09Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 217.597874] nix-daemon[869]: reaped child process 2024, status = succeeded worker2 # [ 217.626412] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 217.639103] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 217.652097] nix-grpc-daemon[1762]: time=2026-09-22T14:54:09.678Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'... worker2 # [ 217.657301] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 217.662543] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) lb # [ 217.652749] envoy[924]: conn peer=[2001:db8:1::1]:40340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=562 ms=30045 worker2 # [ 217.748792] nix-daemon[869]: accepted connection from pid 2051, user nix-grpc-daemon (trusted) worker2 # [ 217.762416] nix-daemon[869]: reaped child process 2054, status = succeeded worker2 # [ 217.846501] nix-daemon[869]: accepted connection from pid 2056, user nix-grpc-daemon (trusted) worker2 # [ 217.860201] nix-daemon[869]: reaped child process 2059, status = succeeded lb # [ 217.857610] niks3-server[1194]: 2026/09/22 14:54:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 217.874851] nix-grpc-daemon[1762]: time=2026-09-22T14:54:09.901Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 217.876238] nix-grpc-daemon[1762]: time=2026-09-22T14:54:09.901Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)" lb # [ 217.881746] niks3-server[1194]: 2026/09/22 14:54:08 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst lb # [ 217.895245] niks3-server[1194]: 2026/09/22 14:54:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign worker2 # [ 217.909242] nix-grpc-daemon[1762]: time=2026-09-22T14:54:09.935Z level=INFO msg="Uploading 1 narinfos" lb # [ 217.899676] niks3-server[1194]: 2026/09/22 14:54:08 INFO Signed narinfos id=84 count=1 lb # [ 217.906871] niks3-server[1194]: 2026/09/22 14:54:08 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls lb # [ 217.917238] niks3-server[1194]: 2026/09/22 14:54:08 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete lb # [ 217.923799] niks3-server[1194]: 2026/09/22 14:54:08 INFO Completed upload id=84 worker2 # [ 217.935450] nix-grpc-daemon[1762]: time=2026-09-22T14:54:09.961Z level=INFO msg="Upload complete. (267ms)" lb # [ 217.928742] niks3-server[1194]: 2026/09/22 14:54:08 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo worker2 # [ 217.939069] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 217.943821] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 worker2 # [ 217.954377] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) worker2 # [ 217.960767] nix-daemon[869]: reaped child process 2049, status = succeeded worker2 # [ 217.963681] nix-daemon[869]: accepted connection from pid 1670, user nix-grpc-daemon (trusted) client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051... client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 218.979323] nix-daemon[869]: reaped child process 2063, status = succeeded worker2 # [ 219.052535] nix-daemon[869]: accepted connection from pid 2079, user nix-grpc-daemon (trusted) worker2 # [ 219.065975] nix-daemon[869]: reaped child process 2082, status = succeeded lb # [ 219.060938] niks3-server[1194]: 2026/09/22 14:54:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 219.079979] nix-grpc-daemon[1762]: time=2026-09-22T14:54:11.106Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 219.082362] nix-grpc-daemon[1762]: time=2026-09-22T14:54:11.108Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)" lb # [ 219.094592] niks3-server[1194]: 2026/09/22 14:54:09 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv lb # [ 219.107707] niks3-server[1194]: 2026/09/22 14:54:09 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst lb # [ 219.120201] niks3-server[1194]: 2026/09/22 14:54:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign worker2 # [ 219.135209] nix-grpc-daemon[1762]: time=2026-09-22T14:54:11.161Z level=INFO msg="Uploading 1 narinfos" lb # [ 219.125594] niks3-server[1194]: 2026/09/22 14:54:09 INFO Signed narinfos id=85 count=1 lb # [ 219.132147] niks3-server[1194]: 2026/09/22 14:54:09 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls lb # [ 219.140143] niks3-server[1194]: 2026/09/22 14:54:09 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 219.144420] niks3-server[1194]: 2026/09/22 14:54:09 INFO Completed upload id=85 worker2 # [ 219.153989] nix-grpc-daemon[1762]: time=2026-09-22T14:54:11.180Z level=INFO msg="Upload complete. (183ms)" lb # [ 219.146239] niks3-server[1194]: 2026/09/22 14:54:09 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo worker2 # [ 219.156779] nix-grpc-daemon[1670]: ts=2026-09-22T14:54:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49930 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=1 worker2 # [ 219.169611] nix-daemon[869]: reaped child process 2061, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.15 seconds) client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.10 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.11 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 220.035603] nix-grpc-daemon[1822]: ts=2026-09-22T14:54:11Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.07 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 7.45 seconds) (finished: run the VM test script, in 221.45 seconds) test script finished in 221.63s cleanup kill QemuMachine (pid 49) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) client # [2026-09-22T14:54:12Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T14:54:12Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T14:54:12Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) lb # [2026-09-22T14:54:12Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T14:54:12Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T14:54:12Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T14:54:12Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T14:54:12Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T14:54:12Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T14:54:13Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T14:54:13Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T14:54:13Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.08 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh