vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #508
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client: QEMU running (pid 49)14lb # Disk image does not exist, creating the virtualisation disk image...15lb: QEMU running (pid 50)16lb # Formatting '/build/vm-state-lb/tmp.YU0TGN12un', fmt=raw size=107374182417client # Formatting '/build/vm-state-client/tmp.a3IIkCCYTp', fmt=raw size=107374182418client # mke2fs 1.47.4 (6-Mar-2025)19client # Discarding device blocks: 0/262144 done20client # Creating filesystem with 262144 4k blocks and 65536 inodes21worker1 # Disk image does not exist, creating the virtualisation disk image...22worker1: QEMU running (pid 51)23lb # mke2fs 1.47.4 (6-Mar-2025)24lb # Discarding device blocks: 0/262144 done25worker1 # Formatting '/build/vm-state-worker1/tmp.lu775QR304', fmt=raw size=107374182426lb # Creating filesystem with 262144 4k blocks and 65536 inodes27worker1 # mke2fs 1.47.4 (6-Mar-2025)28lb # Filesystem UUID: 584ecce4-ad2e-4d2e-9f8c-48f804df99f929worker1 # Discarding device blocks: 0/262144 done30lb # Superblock backups stored on blocks:31worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes32lb # 32768, 98304, 163840, 22937633worker1 # Filesystem UUID: d062716e-6d66-4e79-a03e-5a9d2dc53b5334lb # 35worker1 # Superblock backups stored on blocks:36lb # Allocating group tables: 0/8 done37worker1 # 32768, 98304, 163840, 22937638client # Filesystem UUID: b9f13cff-0ead-459d-99cb-c38c5adb499c39lb # Writing inode tables: 0/8 done40worker1 # 41client # Superblock backups stored on blocks:42lb # Creating journal (8192 blocks): done43worker1 # Allocating group tables: 0/8 done44client # 32768, 98304, 163840, 22937645lb # Writing superblocks and filesystem accounting information: 0/8 done46worker1 # Writing inode tables: 0/8 done47client # 48lb # 49worker1 # Creating journal (8192 blocks): done50client # Allocating group tables: 0/8 done51client # Writing inode tables: 0/8 done52lb # Virtualisation disk image created.53worker2: QEMU running (pid 52)54worker2 # Disk image does not exist, creating the virtualisation disk image...55lb # Starting virtiofs daemons...56worker1 # Writing superblocks and filesystem accounting information: 0/8 done57(finished: start all VMs, in 0.24 seconds)58lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)59worker1 # 60client: waiting for unit network-addresses-eth1.service61lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether62worker1 # Virtualisation disk image created.63client: waiting for the VM to finish booting64lb # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...65worker1 # Starting virtiofs daemons...66worker2 # Formatting '/build/vm-state-worker2/tmp.4SvOpmkl2X', fmt=raw size=107374182467worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)68worker2 # mke2fs 1.47.4 (6-Mar-2025)69lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)70client # Creating journal (8192 blocks): done71worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether72worker2 # Discarding device blocks: 0/262144 done73lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether74client # Writing superblocks and filesystem accounting information: 0/8 done75worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)76worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes77lb # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...78client # 79worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether80worker2 # Filesystem UUID: 27aedd73-c7f5-47bc-89d2-75f46435235d81lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)82client # Virtualisation disk image created.83worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...84worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...85lb # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether86client # Starting virtiofs daemons...87worker2 # Superblock backups stored on blocks:88worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)89lb # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...90client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)91worker2 # 32768, 98304, 163840, 22937692worker1 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether93lb # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests94client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether95worker2 # 96worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...97lb # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests98client # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...99worker2 # Allocating group tables: 0/8 done100worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests101lb # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests102client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)103worker2 # Writing inode tables: 0/8 done104client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether105worker2 # Creating journal (8192 blocks): done106client # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...107worker2 # Writing superblocks and filesystem accounting information: 0/8 done108client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)109worker2 # 110client # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether111worker2 # Virtualisation disk image created.112client # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...113worker2 # Starting virtiofs daemons...114client # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests115worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)116client # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests117worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether118client # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests119worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...120worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests121worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)122worker1 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests123worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether124worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...125worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)126worker2 # [2026-09-22T16:58:00Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether127worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Waiting for vhost-user socket connection...128worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests129worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests130worker2 # [2026-09-22T16:58:00Z INFO virtiofsd] Client connected, servicing requests131client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)132worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)133worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)134lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)135client # 136client # 137client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00138worker1 # 139worker1 # 140worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00141client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...142client # 143client # 144client # 145client # 146worker2 # 147worker2 # 148client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00149worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00150worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...151worker1 # 152worker1 # 153worker1 # 154worker1 # 155worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00156worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...157worker2 # 158worker2 # 159worker2 # 160worker2 # 161client # Press Ctrl-B to configure iPXE (PCI 00:05.0)...162client # 163client # 164worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00165worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)...166worker1 # 167worker1 # 168worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)...169worker2 # 170worker2 # 171lb # 172lb # 173lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00174lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...175lb # 176lb # 177lb # 178lb # 179lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00180lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)...181lb # 182lb # 183worker1 # Booting from ROM...184client # Booting from ROM...185worker2 # Booting from ROM...186lb # Booting from ROM...187worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026188client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026189worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4idnay9kf4i79rgksq2a0cx0x5kksln8-nixos-system-worker1-test/init regInfo=/nix/store/hnxmbc46xwssrsa5c66xddlq152f9x0y-closure-info/registration console=ttyS0,115200n8 console=tty0190worker1 # [ 0.000000] BIOS-provided physical RAM map:191client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test/init regInfo=/nix/store/9lyia4mvv2i1s4lyj2244g6qjddq61k6-closure-info/registration console=ttyS0,115200n8 console=tty0192worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026193client # [ 0.000000] BIOS-provided physical RAM map:194worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable195client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable196worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved197client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved198worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved199client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved200worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable201worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xnscg6z9qxa84gbw1h8qb1f0c0aarhsv-nixos-system-worker2-test/init regInfo=/nix/store/l9mgb5s68rv42f8xbdmqfv6fgq35z9b7-closure-info/registration console=ttyS0,115200n8 console=tty0202client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable203worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved204worker2 # [ 0.000000] BIOS-provided physical RAM map:205client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved206worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved207worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable208client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved209worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved210worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved211client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved212worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved213worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved214client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved215worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved216worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable217client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved218worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved219worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved220worker1 # [ 0.000000] NX (Execute Disable) protection: active221client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved222worker1 # [ 0.000000] APIC: Static calls initialized223worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved224client # [ 0.000000] NX (Execute Disable) protection: active225worker1 # [ 0.000000] SMBIOS 2.8 present.226client # [ 0.000000] APIC: Static calls initialized227worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved228client # [ 0.000000] SMBIOS 2.8 present.229worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014230worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved231worker1 # [ 0.000000] DMI: Memory slots populated: 1/1232client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014233worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved234worker1 # [ 0.000000] Hypervisor detected: KVM235client # [ 0.000000] DMI: Memory slots populated: 1/1236client # [ 0.000000] Hypervisor detected: KVM237worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000238worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved239client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000240worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00241worker2 # [ 0.000000] NX (Execute Disable) protection: active242lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026243worker2 # [ 0.000000] APIC: Static calls initialized244worker1 # [ 0.000001] kvm-clock: using sched offset of 479607283 cycles245client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00246worker2 # [ 0.000000] SMBIOS 2.8 present.247client # [ 0.000001] kvm-clock: using sched offset of 498262300 cycles248worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns249worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014250worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor251client # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns252worker2 # [ 0.000000] DMI: Memory slots populated: 1/1253client # [ 0.000005] tsc: Detected 2400.012 MHz processor254worker2 # [ 0.000000] Hypervisor detected: KVM255worker1 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000256client # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000257worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000258lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test/init regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration console=ttyS0,115200n8 console=tty0259worker1 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs260worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00261lb # [ 0.000000] BIOS-provided physical RAM map:262client # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs263worker1 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT264worker2 # [ 0.000000] kvm-clock: using sched offset of 471071575 cycles265lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable266client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT267worker1 # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f]268lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved269worker1 # [ 0.002742] Using GB pages for direct mapping270client # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f]271worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns272worker1 # [ 0.002831] RAMDISK: [mem 0x5e370000-0x5ffcffff]273client # [ 0.002735] Using GB pages for direct mapping274worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor275lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved276client # [ 0.002861] RAMDISK: [mem 0x5e370000-0x5ffcffff]277worker1 # [ 0.002840] ACPI: Early table checksum verification disabled278worker2 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000279lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable280client # [ 0.002869] ACPI: Early table checksum verification disabled281worker1 # [ 0.002843] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )282lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved283worker2 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs284client # [ 0.002872] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )285worker1 # [ 0.002846] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)286lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved287worker2 # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT288client # [ 0.002876] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)289worker2 # [ 0.002731] found SMP MP-table at [mem 0x000f5450-0x000f545f]290worker1 # [ 0.002851] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)291lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved292worker2 # [ 0.002742] Using GB pages for direct mapping293client # [ 0.002881] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)294lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved295worker1 # [ 0.002858] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)296worker2 # [ 0.002884] RAMDISK: [mem 0x5e36f000-0x5ffcffff]297worker1 # [ 0.002860] ACPI: FACS 0x000000005FFE0000 000040298client # [ 0.002887] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)299worker2 # [ 0.002893] ACPI: Early table checksum verification disabled300lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved301client # [ 0.002889] ACPI: FACS 0x000000005FFE0000 000040302worker2 # [ 0.002896] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )303lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved304worker1 # [ 0.002862] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)305lb # [ 0.000000] NX (Execute Disable) protection: active306client # [ 0.002891] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)307worker2 # [ 0.002900] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)308lb # [ 0.000000] APIC: Static calls initialized309worker1 # [ 0.002863] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)310lb # [ 0.000000] SMBIOS 2.8 present.311client # [ 0.002893] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)312worker2 # [ 0.002904] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)313worker1 # [ 0.002865] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)314client # [ 0.002894] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)315lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014316worker2 # [ 0.002911] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)317worker1 # [ 0.002866] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)318lb # [ 0.000000] DMI: Memory slots populated: 1/1319worker2 # [ 0.002913] ACPI: FACS 0x000000005FFE0000 000040320lb # [ 0.000000] Hypervisor detected: KVM321client # [ 0.002896] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)322worker1 # [ 0.002868] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]323lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000324worker2 # [ 0.002915] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)325client # [ 0.002897] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]326worker1 # [ 0.002869] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]327lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00328client # [ 0.002898] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]329worker2 # [ 0.002916] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)330lb # [ 0.000000] kvm-clock: using sched offset of 495544413 cycles331worker1 # [ 0.002869] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]332client # [ 0.002898] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]333worker1 # [ 0.002870] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]334worker2 # [ 0.002918] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)335lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns336client # [ 0.002899] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]337worker1 # [ 0.002870] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]338lb # [ 0.000004] tsc: Detected 2400.012 MHz processor339worker2 # [ 0.002919] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)340client # [ 0.002899] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]341lb # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000342worker1 # [ 0.002871] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]343worker2 # [ 0.002920] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]344client # [ 0.002900] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]345worker1 # [ 0.002871] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]346lb # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs347worker2 # [ 0.002921] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]348worker1 # [ 0.003103] No NUMA configuration found349client # [ 0.002900] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]350lb # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT351client # [ 0.003121] No NUMA configuration found352worker2 # [ 0.002922] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]353worker1 # [ 0.003103] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]354lb # [ 0.002726] found SMP MP-table at [mem 0x000f5450-0x000f545f]355client # [ 0.003122] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]356worker2 # [ 0.002922] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]357worker1 # [ 0.003106] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]358lb # [ 0.002736] Using GB pages for direct mapping359worker1 # [ 0.005307] Zone ranges:360client # [ 0.003124] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]361lb # [ 0.002889] RAMDISK: [mem 0x5e36e000-0x5ffcffff]362worker2 # [ 0.002923] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]363client # [ 0.005339] Zone ranges:364worker1 # [ 0.005308] DMA [mem 0x0000000000001000-0x0000000000ffffff]365lb # [ 0.002897] ACPI: Early table checksum verification disabled366client # [ 0.005340] DMA [mem 0x0000000000001000-0x0000000000ffffff]367worker2 # [ 0.002923] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]368worker1 # [ 0.005310] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]369lb # [ 0.002899] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )370worker1 # [ 0.005311] Normal empty371client # [ 0.005342] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]372worker2 # [ 0.002924] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]373worker1 # [ 0.005312] Device empty374client # [ 0.005343] Normal empty375worker2 # [ 0.003152] No NUMA configuration found376worker1 # [ 0.005312] Movable zone start for each node377client # [ 0.005343] Device empty378lb # [ 0.002903] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)379worker1 # [ 0.005313] Early memory node ranges380client # [ 0.005344] Movable zone start for each node381worker2 # [ 0.003153] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]382lb # [ 0.002907] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)383client # [ 0.005345] Early memory node ranges384worker1 # [ 0.005313] node 0: [mem 0x0000000000001000-0x000000000009efff]385worker2 # [ 0.003155] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]386worker2 # [ 0.005383] Zone ranges:387client # [ 0.005345] node 0: [mem 0x0000000000001000-0x000000000009efff]388worker1 # [ 0.005314] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]389lb # [ 0.002913] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)390worker2 # [ 0.005384] DMA [mem 0x0000000000001000-0x0000000000ffffff]391client # [ 0.005346] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]392lb # [ 0.002915] ACPI: FACS 0x000000005FFE0000 000040393worker1 # [ 0.005315] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]394worker2 # [ 0.005386] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]395client # [ 0.005347] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]396worker1 # [ 0.005334] On node 0, zone DMA: 1 pages in unavailable ranges397worker2 # [ 0.005387] Normal empty398lb # [ 0.002917] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)399worker2 # [ 0.005388] Device empty400client # [ 0.005366] On node 0, zone DMA: 1 pages in unavailable ranges401worker1 # [ 0.005592] On node 0, zone DMA: 97 pages in unavailable ranges402worker2 # [ 0.005388] Movable zone start for each node403lb # [ 0.002918] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)404client # [ 0.005624] On node 0, zone DMA: 97 pages in unavailable ranges405worker2 # [ 0.005389] Early memory node ranges406worker1 # [ 0.031346] On node 0, zone DMA32: 40 pages in unavailable ranges407worker1 # [ 0.031798] ACPI: PM-Timer IO Port: 0x608408client # [ 0.031571] On node 0, zone DMA32: 40 pages in unavailable ranges409worker2 # [ 0.005389] node 0: [mem 0x0000000000001000-0x000000000009efff]410lb # [ 0.002920] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)411client # [ 0.032029] ACPI: PM-Timer IO Port: 0x608412worker1 # [ 0.031809] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])413worker2 # [ 0.005390] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]414client # [ 0.032039] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])415lb # [ 0.002921] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)416worker1 # [ 0.031834] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23417worker2 # [ 0.005391] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]418client # [ 0.032065] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23419lb # [ 0.002922] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]420worker1 # [ 0.031837] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)421worker2 # [ 0.005411] On node 0, zone DMA: 1 pages in unavailable ranges422client # [ 0.032067] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)423lb # [ 0.002923] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]424worker1 # [ 0.031839] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)425worker2 # [ 0.005668] On node 0, zone DMA: 97 pages in unavailable ranges426client # [ 0.032069] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)427lb # [ 0.002924] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]428worker1 # [ 0.031840] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)429worker2 # [ 0.031527] On node 0, zone DMA32: 40 pages in unavailable ranges430client # [ 0.032069] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)431worker2 # [ 0.031981] ACPI: PM-Timer IO Port: 0x608432worker1 # [ 0.031841] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)433lb # [ 0.002924] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]434worker2 # [ 0.031991] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])435client # [ 0.032070] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)436worker1 # [ 0.031842] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)437lb # [ 0.002925] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]438worker2 # [ 0.032017] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23439client # [ 0.032071] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)440worker1 # [ 0.031844] ACPI: Using ACPI (MADT) for SMP configuration information441lb # [ 0.002925] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]442worker2 # [ 0.032020] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)443worker1 # [ 0.031845] ACPI: HPET id: 0x8086a201 base: 0xfed00000444client # [ 0.032074] ACPI: Using ACPI (MADT) for SMP configuration information445lb # [ 0.002926] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]446worker1 # [ 0.031848] TSC deadline timer available447client # [ 0.032075] ACPI: HPET id: 0x8086a201 base: 0xfed00000448worker2 # [ 0.032022] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)449lb # [ 0.003145] No NUMA configuration found450worker1 # [ 0.031852] CPU topo: Max. logical packages: 1451client # [ 0.032078] TSC deadline timer available452worker2 # [ 0.032023] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)453worker1 # [ 0.031853] CPU topo: Max. logical dies: 1454lb # [ 0.003146] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]455client # [ 0.032082] CPU topo: Max. logical packages: 1456worker1 # [ 0.031853] CPU topo: Max. dies per package: 1457client # [ 0.032083] CPU topo: Max. logical dies: 1458worker2 # [ 0.032024] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)459lb # [ 0.003148] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]460lb # [ 0.005347] Zone ranges:461worker1 # [ 0.031857] CPU topo: Max. threads per core: 1462client # [ 0.032083] CPU topo: Max. dies per package: 1463worker2 # [ 0.032025] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)464worker1 # [ 0.031857] CPU topo: Num. cores per package: 1465client # [ 0.032086] CPU topo: Max. threads per core: 1466lb # [ 0.005348] DMA [mem 0x0000000000001000-0x0000000000ffffff]467worker1 # [ 0.031857] CPU topo: Num. threads per package: 1468client # [ 0.032087] CPU topo: Num. cores per package: 1469worker2 # [ 0.032027] ACPI: Using ACPI (MADT) for SMP configuration information470lb # [ 0.005349] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]471lb # [ 0.005350] Normal empty472worker2 # [ 0.032028] ACPI: HPET id: 0x8086a201 base: 0xfed00000473client # [ 0.032087] CPU topo: Num. threads per package: 1474worker1 # [ 0.031858] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs475lb # [ 0.005351] Device empty476worker2 # [ 0.032031] TSC deadline timer available477client # [ 0.032087] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs478lb # [ 0.005352] Movable zone start for each node479worker1 # [ 0.031874] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()480worker2 # [ 0.032035] CPU topo: Max. logical packages: 1481lb # [ 0.005353] Early memory node ranges482client # [ 0.032105] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()483worker2 # [ 0.032035] CPU topo: Max. logical dies: 1484worker1 # [ 0.031902] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]485lb # [ 0.005353] node 0: [mem 0x0000000000001000-0x000000000009efff]486worker2 # [ 0.032036] CPU topo: Max. dies per package: 1487client # [ 0.032134] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]488worker2 # [ 0.032039] CPU topo: Max. threads per core: 1489lb # [ 0.005354] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]490worker1 # [ 0.031903] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]491worker2 # [ 0.032040] CPU topo: Num. cores per package: 1492client # [ 0.032136] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]493worker1 # [ 0.031905] [mem 0x60000000-0xafffffff] available for PCI devices494lb # [ 0.005355] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]495worker2 # [ 0.032040] CPU topo: Num. threads per package: 1496worker1 # [ 0.031906] Booting paravirtualized kernel on KVM497client # [ 0.032137] [mem 0x60000000-0xafffffff] available for PCI devices498lb # [ 0.005374] On node 0, zone DMA: 1 pages in unavailable ranges499worker2 # [ 0.032041] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs500client # [ 0.032138] Booting paravirtualized kernel on KVM501lb # [ 0.005635] On node 0, zone DMA: 97 pages in unavailable ranges502worker1 # [ 0.031909] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns503worker2 # [ 0.032058] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()504lb # [ 0.031567] On node 0, zone DMA32: 40 pages in unavailable ranges505client # [ 0.032141] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns506lb # [ 0.032016] ACPI: PM-Timer IO Port: 0x608507worker1 # [ 0.036388] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1508worker2 # [ 0.032087] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]509client # [ 0.036605] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1510lb # [ 0.032027] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])511worker1 # [ 0.038695] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152512worker2 # [ 0.032089] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]513worker1 # [ 0.038737] kvm-guest: PV spinlocks disabled, single CPU514client # [ 0.038719] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152515lb # [ 0.032053] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23516worker2 # [ 0.032090] [mem 0x60000000-0xafffffff] available for PCI devices517client # [ 0.038769] kvm-guest: PV spinlocks disabled, single CPU518lb # [ 0.032055] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)519worker2 # [ 0.032092] Booting paravirtualized kernel on KVM520lb # [ 0.032057] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)521worker2 # [ 0.032094] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns522lb # [ 0.032058] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)523worker2 # [ 0.036564] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1524lb # [ 0.032059] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)525worker1 # [ 0.038739] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4idnay9kf4i79rgksq2a0cx0x5kksln8-nixos-system-worker1-test/init regInfo=/nix/store/hnxmbc46xwssrsa5c66xddlq152f9x0y-closure-info/registration console=ttyS0,115200n8 console=tty0526worker2 # [ 0.038863] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152527lb # [ 0.032059] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)528client # [ 0.038770] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zpiq30cb38yj5xq9czkzgv1bvg949hyw-nixos-system-client-test/init regInfo=/nix/store/9lyia4mvv2i1s4lyj2244g6qjddq61k6-closure-info/registration console=ttyS0,115200n8 console=tty0529worker2 # [ 0.038906] kvm-guest: PV spinlocks disabled, single CPU530lb # [ 0.032062] ACPI: Using ACPI (MADT) for SMP configuration information531lb # [ 0.032063] ACPI: HPET id: 0x8086a201 base: 0xfed00000532worker1 # [ 0.038831] Unknown kernel command line parameters "regInfo=/nix/store/hnxmbc46xwssrsa5c66xddlq152f9x0y-closure-info/registration", will be passed to user space.533worker1 # [ 0.038843] random: crng init done534lb # [ 0.032066] TSC deadline timer available535client # [ 0.038862] Unknown kernel command line parameters "regInfo=/nix/store/9lyia4mvv2i1s4lyj2244g6qjddq61k6-closure-info/registration", will be passed to user space.536client # [ 0.038875] random: crng init done537lb # [ 0.032071] CPU topo: Max. logical packages: 1538worker1 # [ 0.038844] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes539lb # [ 0.032071] CPU topo: Max. logical dies: 1540client # [ 0.038875] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes541lb # [ 0.032072] CPU topo: Max. dies per package: 1542worker1 # [ 0.040921] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)543lb # [ 0.032075] CPU topo: Max. threads per core: 1544client # [ 0.041142] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)545worker2 # [ 0.038908] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xnscg6z9qxa84gbw1h8qb1f0c0aarhsv-nixos-system-worker2-test/init regInfo=/nix/store/l9mgb5s68rv42f8xbdmqfv6fgq35z9b7-closure-info/registration console=ttyS0,115200n8 console=tty0546worker1 # [ 0.041962] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)547lb # [ 0.032075] CPU topo: Num. cores per package: 1548worker1 # [ 0.041993] Fallback order for Node 0: 0549client # [ 0.042181] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)550lb # [ 0.032076] CPU topo: Num. threads per package: 1551client # [ 0.042216] Fallback order for Node 0: 0552worker1 # [ 0.041996] Built 1 zonelists, mobility grouping on. Total pages: 393078553worker2 # [ 0.038998] Unknown kernel command line parameters "regInfo=/nix/store/l9mgb5s68rv42f8xbdmqfv6fgq35z9b7-closure-info/registration", will be passed to user space.554lb # [ 0.032076] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs555worker1 # [ 0.041997] Policy zone: DMA32556worker2 # [ 0.039010] random: crng init done557client # [ 0.042219] Built 1 zonelists, mobility grouping on. Total pages: 393078558client # [ 0.042220] Policy zone: DMA32559lb # [ 0.032094] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()560worker1 # [ 0.044435] mem auto-init: stack:all(zero), heap alloc:on, heap free:off561worker2 # [ 0.039011] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes562client # [ 0.044649] mem auto-init: stack:all(zero), heap alloc:on, heap free:off563lb # [ 0.032124] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]564worker1 # [ 0.047430] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1565worker2 # [ 0.041084] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)566client # [ 0.047608] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1567worker1 # [ 0.050857] allocated 3145728 bytes of page_ext568lb # [ 0.032125] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]569client # [ 0.050874] allocated 3145728 bytes of page_ext570worker1 # [ 0.060816] ftrace: allocating 48787 entries in 192 pages571worker2 # [ 0.042130] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)572lb # [ 0.032127] [mem 0x60000000-0xafffffff] available for PCI devices573client # [ 0.061001] ftrace: allocating 48787 entries in 192 pages574worker2 # [ 0.042161] Fallback order for Node 0: 0575worker1 # [ 0.060818] ftrace: allocated 192 pages with 2 groups576lb # [ 0.032128] Booting paravirtualized kernel on KVM577worker1 # [ 0.061637] Dynamic Preempt: lazy578client # [ 0.061003] ftrace: allocated 192 pages with 2 groups579worker2 # [ 0.042164] Built 1 zonelists, mobility grouping on. Total pages: 393078580client # [ 0.061831] Dynamic Preempt: lazy581worker2 # [ 0.042165] Policy zone: DMA32582worker1 # [ 0.061811] rcu: Preemptible hierarchical RCU implementation.583lb # [ 0.032131] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns584worker1 # [ 0.061811] rcu: RCU event tracing is enabled.585client # [ 0.061987] rcu: Preemptible hierarchical RCU implementation.586worker2 # [ 0.044584] mem auto-init: stack:all(zero), heap alloc:on, heap free:off587client # [ 0.061988] rcu: RCU event tracing is enabled.588lb # [ 0.036619] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1589worker1 # [ 0.061812] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.590worker2 # [ 0.047553] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1591client # [ 0.061988] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.592worker1 # [ 0.061813] Trampoline variant of Tasks RCU enabled.593lb # [ 0.038714] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152594worker2 # [ 0.050968] allocated 3145728 bytes of page_ext595client # [ 0.061989] Trampoline variant of Tasks RCU enabled.596worker1 # [ 0.061814] Rude variant of Tasks RCU enabled.597lb # [ 0.038755] kvm-guest: PV spinlocks disabled, single CPU598worker2 # [ 0.060873] ftrace: allocating 48787 entries in 192 pages599client # [ 0.061990] Rude variant of Tasks RCU enabled.600worker1 # [ 0.061814] Tracing variant of Tasks RCU enabled.601worker2 # [ 0.060874] ftrace: allocated 192 pages with 2 groups602client # [ 0.061990] Tracing variant of Tasks RCU enabled.603worker2 # [ 0.061698] Dynamic Preempt: lazy604worker1 # [ 0.061815] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.605worker2 # [ 0.061881] rcu: Preemptible hierarchical RCU implementation.606client # [ 0.061991] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.607worker1 # [ 0.061816] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1608worker2 # [ 0.061882] rcu: RCU event tracing is enabled.609client # [ 0.061991] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1610worker2 # [ 0.061882] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.611worker1 # [ 0.061831] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.612client # [ 0.062013] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.613worker2 # [ 0.061884] Trampoline variant of Tasks RCU enabled.614lb # [ 0.038757] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test/init regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration console=ttyS0,115200n8 console=tty0615worker1 # [ 0.061833] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.616worker2 # [ 0.061884] Rude variant of Tasks RCU enabled.617client # [ 0.062014] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.618worker2 # [ 0.061885] Tracing variant of Tasks RCU enabled.619worker1 # [ 0.061833] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.620lb # [ 0.038848] Unknown kernel command line parameters "regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration", will be passed to user space.621client # [ 0.062015] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.622worker2 # [ 0.061885] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.623lb # [ 0.038860] random: crng init done624worker1 # [ 0.066237] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16625client # [ 0.066365] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16626worker2 # [ 0.061886] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1627lb # [ 0.038861] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes628worker1 # [ 0.066532] rcu: srcu_init: Setting srcu_struct sizes based on contention.629client # [ 0.066638] rcu: srcu_init: Setting srcu_struct sizes based on contention.630worker2 # [ 0.061907] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.631lb # [ 0.040910] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)632worker1 # [ 0.066538] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns633client # [ 0.066644] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns634lb # [ 0.041941] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)635worker2 # [ 0.061908] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.636lb # [ 0.041970] Fallback order for Node 0: 0637worker1 # [ 0.066639] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)638worker1 # [ 0.070178] Console: colour VGA+ 80x25639client # [ 0.066753] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)640worker2 # [ 0.061909] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.641lb # [ 0.041973] Built 1 zonelists, mobility grouping on. Total pages: 393078642worker1 # [ 0.070181] printk: legacy console [tty0] enabled643client # [ 0.070270] Console: colour VGA+ 80x25644lb # [ 0.041974] Policy zone: DMA32645worker2 # [ 0.066258] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16646client # [ 0.070273] printk: legacy console [tty0] enabled647worker1 # [ 0.099789] printk: legacy console [ttyS0] enabled648lb # [ 0.044382] mem auto-init: stack:all(zero), heap alloc:on, heap free:off649client # [ 0.099703] printk: legacy console [ttyS0] enabled650worker2 # [ 0.066549] rcu: srcu_init: Setting srcu_struct sizes based on contention.651worker1 # [ 0.196391] ACPI: Core revision 20250807652lb # [ 0.047343] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1653client # [ 0.195611] ACPI: Core revision 20250807654lb # [ 0.050736] allocated 3145728 bytes of page_ext655worker2 # [ 0.066556] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns656lb # [ 0.060477] ftrace: allocating 48787 entries in 192 pages657worker1 # [ 0.197261] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns658lb # [ 0.060478] ftrace: allocated 192 pages with 2 groups659worker2 # [ 0.066655] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)660client # [ 0.196508] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns661lb # [ 0.061280] Dynamic Preempt: lazy662worker2 # [ 0.070234] Console: colour VGA+ 80x25663worker1 # [ 0.198753] APIC: Switch to symmetric I/O mode setup664worker2 # [ 0.070237] printk: legacy console [tty0] enabled665client # [ 0.197993] APIC: Switch to symmetric I/O mode setup666worker1 # [ 0.199687] x2apic enabled667lb # [ 0.061411] rcu: Preemptible hierarchical RCU implementation.668lb # [ 0.061411] rcu: RCU event tracing is enabled.669worker2 # [ 0.099701] printk: legacy console [ttyS0] enabled670client # [ 0.198972] x2apic enabled671worker1 # [ 0.200418] APIC: Switched APIC routing to: physical x2apic672worker2 # [ 0.195805] ACPI: Core revision 20250807673lb # [ 0.061412] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.674client # [ 0.199740] APIC: Switched APIC routing to: physical x2apic675lb # [ 0.061414] Trampoline variant of Tasks RCU enabled.676lb # [ 0.061414] Rude variant of Tasks RCU enabled.677worker2 # [ 0.196732] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns678worker1 # [ 0.202196] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1679lb # [ 0.061414] Tracing variant of Tasks RCU enabled.680client # [ 0.201554] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1681worker2 # [ 0.198286] APIC: Switch to symmetric I/O mode setup682lb # [ 0.061415] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.683worker2 # [ 0.199226] x2apic enabled684worker1 # [ 0.203152] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns685lb # [ 0.061416] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1686client # [ 0.202524] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns687worker2 # [ 0.199979] APIC: Switched APIC routing to: physical x2apic688lb # [ 0.061430] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.689worker1 # [ 0.204756] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)690client # [ 0.204183] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)691lb # [ 0.061431] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.692worker1 # [ 0.205839] x86/cpu: User Mode Instruction Prevention (UMIP) activated693worker2 # [ 0.201748] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1694client # [ 0.205267] x86/cpu: User Mode Instruction Prevention (UMIP) activated695lb # [ 0.061432] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.696worker1 # [ 0.206914] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127697lb # [ 0.065780] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16698client # [ 0.206321] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127699worker1 # [ 0.207753] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0700worker2 # [ 0.202759] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns701lb # [ 0.066083] rcu: srcu_init: Setting srcu_struct sizes based on contention.702client # [ 0.207181] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0703worker2 # [ 0.204371] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)704lb # [ 0.066089] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns705worker1 # [ 0.208757] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto706worker2 # [ 0.205456] x86/cpu: User Mode Instruction Prevention (UMIP) activated707client # [ 0.208184] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto708lb # [ 0.066186] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)709worker1 # [ 0.209753] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl710lb # [ 0.069728] Console: colour VGA+ 80x25711worker2 # [ 0.206491] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127712lb # [ 0.069730] printk: legacy console [tty0] enabled713client # [ 0.210181] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl714worker1 # [ 0.210754] Transient Scheduler Attacks: Vulnerable: No microcode715lb # [ 0.099219] printk: legacy console [ttyS0] enabled716worker2 # [ 0.207369] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0717client # [ 0.211181] Transient Scheduler Attacks: Vulnerable: No microcode718worker1 # [ 0.211753] Spectre V2 : Mitigation: Enhanced / Automatic IBRS719lb # [ 0.194900] ACPI: Core revision 20250807720client # [ 0.212181] Spectre V2 : Mitigation: Enhanced / Automatic IBRS721worker1 # [ 0.212753] Speculative Return Stack Overflow: Mitigation: Safe RET722worker2 # [ 0.208373] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto723client # [ 0.213181] Speculative Return Stack Overflow: Mitigation: Safe RET724lb # [ 0.195791] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns725worker2 # [ 0.209369] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl726lb # [ 0.197320] APIC: Switch to symmetric I/O mode setup727lb # [ 0.198310] x2apic enabled728worker2 # [ 0.210368] Transient Scheduler Attacks: Vulnerable: No microcode729lb # [ 0.199087] APIC: Switched APIC routing to: physical x2apic730worker2 # [ 0.211368] Spectre V2 : Mitigation: Enhanced / Automatic IBRS731worker1 # [ 0.213753] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization732worker1 # [ 0.215760] Spectre V2 : Enabling IBPB for BPF733worker2 # [ 0.212368] Speculative Return Stack Overflow: Mitigation: Safe RET734client # [ 0.214181] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization735lb # [ 0.200840] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1736client # [ 0.216188] Spectre V2 : Enabling IBPB for BPF737worker1 # [ 0.216480] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier738worker1 # [ 0.217754] active return thunk: srso_alias_return_thunk739client # [ 0.217182] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier740lb # [ 0.201815] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns741client # [ 0.218182] active return thunk: srso_alias_return_thunk742worker1 # [ 0.218774] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'743lb # [ 0.203474] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)744worker2 # [ 0.213368] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization745worker1 # [ 0.219753] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'746client # [ 0.219203] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747worker2 # [ 0.215374] Spectre V2 : Enabling IBPB for BPF748lb # [ 0.204557] x86/cpu: User Mode Instruction Prevention (UMIP) activated749worker1 # [ 0.220753] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'750client # [ 0.220181] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'751lb # [ 0.205596] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127752worker2 # [ 0.216078] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier753worker1 # [ 0.221753] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'754client # [ 0.221901] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'755worker2 # [ 0.217369] active return thunk: srso_alias_return_thunk756lb # [ 0.206471] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0757worker1 # [ 0.222753] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'758client # [ 0.222181] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'759worker2 # [ 0.218389] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'760worker1 # [ 0.223753] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'761client # [ 0.223181] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'762lb # [ 0.207474] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto763worker2 # [ 0.219368] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'764client # [ 0.224181] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'765worker1 # [ 0.224753] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'766lb # [ 0.208471] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl767worker2 # [ 0.220368] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'768worker1 # [ 0.225754] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256769client # [ 0.225181] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'770lb # [ 0.209471] Transient Scheduler Attacks: Vulnerable: No microcode771worker2 # [ 0.221368] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'772worker1 # [ 0.226753] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64773client # [ 0.227068] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256774lb # [ 0.210470] Spectre V2 : Mitigation: Enhanced / Automatic IBRS775worker2 # [ 0.222368] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'776worker1 # [ 0.227753] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512777client # [ 0.227877] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64778lb # [ 0.211471] Speculative Return Stack Overflow: Mitigation: Safe RET779worker2 # [ 0.223368] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'780worker1 # [ 0.228753] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024781client # [ 0.228881] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512782worker2 # [ 0.224368] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'783worker1 # [ 0.229753] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8784client # [ 0.229888] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024785worker2 # [ 0.225369] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256786client # [ 0.230181] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8787worker1 # [ 0.230753] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.788worker2 # [ 0.226368] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64789lb # [ 0.212470] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization790client # [ 0.231181] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.791worker2 # [ 0.227368] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512792lb # [ 0.214477] Spectre V2 : Enabling IBPB for BPF793worker2 # [ 0.228368] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024794lb # [ 0.215207] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier795worker2 # [ 0.229368] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8796lb # [ 0.216471] active return thunk: srso_alias_return_thunk797worker2 # [ 0.230368] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.798lb # [ 0.217492] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'799lb # [ 0.218471] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'800lb # [ 0.219470] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'801lb # [ 0.220470] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'802lb # [ 0.221470] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'803lb # [ 0.222471] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'804lb # [ 0.223471] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'805lb # [ 0.225471] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256806lb # [ 0.226470] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64807lb # [ 0.227471] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512808lb # [ 0.228471] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024809lb # [ 0.229470] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8810lb # [ 0.230471] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.811worker1 # [ 0.265040] Freeing SMP alternatives memory: 44K812worker1 # [ 0.265760] pid_max: default: 32768 minimum: 301813client # [ 0.266054] Freeing SMP alternatives memory: 44K814worker1 # [ 0.266596] LSM: initializing lsm=capability,landlock,yama,bpf,ima815client # [ 0.266737] pid_max: default: 32768 minimum: 301816worker1 # [ 0.267824] landlock: Up and running.817client # [ 0.267263] LSM: initializing lsm=capability,landlock,yama,bpf,ima818worker1 # [ 0.268467] Yama: becoming mindful.819client # [ 0.268280] landlock: Up and running.820worker1 # [ 0.268967] LSM support for eBPF active821client # [ 0.269182] Yama: becoming mindful.822worker2 # [ 0.265310] Freeing SMP alternatives memory: 44K823client # [ 0.270268] LSM support for eBPF active824worker1 # [ 0.269893] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)825worker2 # [ 0.265918] pid_max: default: 32768 minimum: 301826client # [ 0.270994] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)827worker1 # [ 0.270791] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)828worker2 # [ 0.266458] LSM: initializing lsm=capability,landlock,yama,bpf,ima829worker2 # [ 0.267477] landlock: Up and running.830client # [ 0.272216] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)831worker2 # [ 0.268369] Yama: becoming mindful.832worker2 # [ 0.269539] LSM support for eBPF active833worker1 # [ 0.273627] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)834client # [ 0.274493] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)835worker2 # [ 0.270311] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)836worker1 # [ 0.274284] Performance Events: Fam17h+ core perfctr, AMD PMU driver.837worker1 # [ 0.274758] ... version: 2838client # [ 0.275736] Performance Events: Fam17h+ core perfctr, AMD PMU driver.839worker2 # [ 0.271406] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)840worker1 # [ 0.275442] ... bit width: 48841client # [ 0.276189] ... version: 2842worker1 # [ 0.275756] ... generic counters: 6843client # [ 0.276909] ... bit width: 48844client # [ 0.277183] ... generic counters: 6845worker1 # [ 0.276502] ... generic bitmap: 000000000000003f846worker2 # [ 0.273783] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)847worker1 # [ 0.276803] ... fixed-purpose counters: 0848client # [ 0.277889] ... generic bitmap: 000000000000003f849client # [ 0.278183] ... fixed-purpose counters: 0850worker1 # [ 0.277510] ... fixed-purpose bitmap: 0000000000000000851worker2 # [ 0.274877] Performance Events: Fam17h+ core perfctr, AMD PMU driver.852client # [ 0.278912] ... fixed-purpose bitmap: 0000000000000000853worker2 # [ 0.275373] ... version: 2854worker1 # [ 0.277756] ... value mask: 0000ffffffffffff855worker2 # [ 0.276099] ... bit width: 48856client # [ 0.279183] ... value mask: 0000ffffffffffff857worker1 # [ 0.278755] ... max period: 00007fffffffffff858worker2 # [ 0.276371] ... generic counters: 6859client # [ 0.280048] ... max period: 00007fffffffffff860lb # [ 0.264816] Freeing SMP alternatives memory: 44K861worker1 # [ 0.279663] ... global_ctrl mask: 000000000000003f862worker2 # [ 0.277133] ... generic bitmap: 000000000000003f863lb # [ 0.265474] pid_max: default: 32768 minimum: 301864client # [ 0.280820] ... global_ctrl mask: 000000000000003f865worker1 # [ 0.280516] signal: max sigframe size: 3376866worker2 # [ 0.277437] ... fixed-purpose counters: 0867client # [ 0.281289] signal: max sigframe size: 3376868worker1 # [ 0.280845] rcu: Hierarchical SRCU implementation.869lb # [ 0.266258] LSM: initializing lsm=capability,landlock,yama,bpf,ima870worker2 # [ 0.278175] ... fixed-purpose bitmap: 0000000000000000871client # [ 0.282064] rcu: Hierarchical SRCU implementation.872lb # [ 0.267537] landlock: Up and running.873worker1 # [ 0.281596] rcu: Max phase no-delay instances is 400.874lb # [ 0.268126] Yama: becoming mindful.875worker2 # [ 0.279062] ... value mask: 0000ffffffffffff876client # [ 0.282755] rcu: Max phase no-delay instances is 400.877lb # [ 0.268684] LSM support for eBPF active878worker2 # [ 0.279371] ... max period: 00007fffffffffff879worker2 # [ 0.280313] ... global_ctrl mask: 000000000000003f880lb # [ 0.269571] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)881worker2 # [ 0.281198] signal: max sigframe size: 3376882lb # [ 0.270514] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)883worker2 # [ 0.281979] rcu: Hierarchical SRCU implementation.884worker2 # [ 0.282373] rcu: Max phase no-delay instances is 400.885worker1 # [ 0.286926] smp: Bringing up secondary CPUs ...886client # [ 0.287677] smp: Bringing up secondary CPUs ...887worker1 # [ 0.287713] smp: Brought up 1 node, 1 CPU888lb # [ 0.273246] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)889client # [ 0.288198] smp: Brought up 1 node, 1 CPU890worker1 # [ 0.288249] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)891client # [ 0.288877] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)892lb # [ 0.273970] Performance Events: Fam17h+ core perfctr, AMD PMU driver.893lb # [ 0.274476] ... version: 2894worker1 # [ 0.288904] Memory: 1454584K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved)895lb # [ 0.275193] ... bit width: 48896client # [ 0.289320] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved)897worker1 # [ 0.289965] devtmpfs: initialized898lb # [ 0.275473] ... generic counters: 6899worker2 # [ 0.287775] smp: Bringing up secondary CPUs ...900client # [ 0.290413] devtmpfs: initialized901worker2 # [ 0.288384] smp: Brought up 1 node, 1 CPU902lb # [ 0.276138] ... generic bitmap: 000000000000003f903worker1 # [ 0.290836] x86/mm: Memory block size: 128MB904client # [ 0.291199] x86/mm: Memory block size: 128MB905lb # [ 0.276519] ... fixed-purpose counters: 0906worker2 # [ 0.289035] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)907lb # [ 0.277231] ... fixed-purpose bitmap: 0000000000000000908worker1 # [ 0.292539] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)909lb # [ 0.277474] ... value mask: 0000ffffffffffff910client # [ 0.292975] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)911worker2 # [ 0.289531] Memory: 1454548K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved)912lb # [ 0.278347] ... max period: 00007fffffffffff913worker1 # [ 0.293649] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).914worker2 # [ 0.290600] devtmpfs: initialized915client # [ 0.294039] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).916lb # [ 0.279145] ... global_ctrl mask: 000000000000003f917worker1 # [ 0.294852] pinctrl core: initialized pinctrl subsystem918lb # [ 0.279583] signal: max sigframe size: 3376919client # [ 0.295252] pinctrl core: initialized pinctrl subsystem920worker2 # [ 0.291470] x86/mm: Memory block size: 128MB921worker1 # [ 0.295936] PM: RTC time: 16:58:00, date: 2026-09-22922lb # [ 0.280322] rcu: Hierarchical SRCU implementation.923client # [ 0.296399] PM: RTC time: 16:58:00, date: 2026-09-22924lb # [ 0.281048] rcu: Max phase no-delay instances is 400.925worker2 # [ 0.293210] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)926worker2 # [ 0.294321] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).927worker1 # [ 0.299688] NET: Registered PF_NETLINK/PF_ROUTE protocol family928client # [ 0.299892] NET: Registered PF_NETLINK/PF_ROUTE protocol family929worker2 # [ 0.295445] pinctrl core: initialized pinctrl subsystem930worker2 # [ 0.296591] PM: RTC time: 16:58:00, date: 2026-09-22931worker1 # [ 0.300948] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations932client # [ 0.300681] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations933lb # [ 0.286031] smp: Bringing up secondary CPUs ...934worker1 # [ 0.301777] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations935client # [ 0.301210] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations936lb # [ 0.286487] smp: Brought up 1 node, 1 CPU937lb # [ 0.287153] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)938worker1 # [ 0.303022] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations939client # [ 0.302451] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations940worker2 # [ 0.300110] NET: Registered PF_NETLINK/PF_ROUTE protocol family941worker1 # [ 0.303765] audit: initializing netlink subsys (disabled)942client # [ 0.303192] audit: initializing netlink subsys (disabled)943lb # [ 0.287660] Memory: 1454576K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved)944client # [ 0.304343] thermal_sys: Registered thermal governor 'fair_share'945worker2 # [ 0.300862] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations946worker1 # [ 0.304757] audit: type=2000 audit(1790096281.559:1): state=initialized audit_enabled=0 res=1947lb # [ 0.288714] devtmpfs: initialized948client # [ 0.304346] thermal_sys: Registered thermal governor 'bang_bang'949worker1 # [ 0.305900] thermal_sys: Registered thermal governor 'fair_share'950worker2 # [ 0.301394] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations951lb # [ 0.289442] x86/mm: Memory block size: 128MB952client # [ 0.305185] thermal_sys: Registered thermal governor 'step_wise'953worker1 # [ 0.305902] thermal_sys: Registered thermal governor 'bang_bang'954client # [ 0.306100] thermal_sys: Registered thermal governor 'user_space'955worker2 # [ 0.302635] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations956worker1 # [ 0.306757] thermal_sys: Registered thermal governor 'step_wise'957worker2 # [ 0.303381] audit: initializing netlink subsys (disabled)958lb # [ 0.291035] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)959worker1 # [ 0.307711] thermal_sys: Registered thermal governor 'user_space'960client # [ 0.306907] audit: type=2000 audit(1790096281.560:1): state=initialized audit_enabled=0 res=1961worker1 # [ 0.308506] thermal_sys: Registered thermal governor 'power_allocator'962client # [ 0.308186] thermal_sys: Registered thermal governor 'power_allocator'963worker2 # [ 0.304373] audit: type=2000 audit(1790096281.563:1): state=initialized audit_enabled=0 res=1964lb # [ 0.291502] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).965worker1 # [ 0.308779] cpuidle: using governor menu966client # [ 0.308200] cpuidle: using governor menu967lb # [ 0.292545] pinctrl core: initialized pinctrl subsystem968worker2 # [ 0.305473] thermal_sys: Registered thermal governor 'fair_share'969lb # [ 0.293667] PM: RTC time: 16:58:00, date: 2026-09-22970worker2 # [ 0.305475] thermal_sys: Registered thermal governor 'bang_bang'971worker1 # [ 0.310973] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5972client # [ 0.310188] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5973worker2 # [ 0.306372] thermal_sys: Registered thermal governor 'step_wise'974worker1 # [ 0.311977] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]975client # [ 0.311389] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]976worker2 # [ 0.307295] thermal_sys: Registered thermal governor 'user_space'977client # [ 0.312186] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry978worker1 # [ 0.312759] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry979worker2 # [ 0.308150] thermal_sys: Registered thermal governor 'power_allocator'980worker1 # [ 0.313767] PCI: Using configuration type 1 for base access981client # [ 0.313195] PCI: Using configuration type 1 for base access982worker2 # [ 0.308383] cpuidle: using governor menu983lb # [ 0.297197] NET: Registered PF_NETLINK/PF_ROUTE protocol family984worker1 # [ 0.314842] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.985client # [ 0.314262] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.986worker2 # [ 0.310578] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5987lb # [ 0.297956] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations988lb # [ 0.298494] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations989worker2 # [ 0.311594] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]990worker2 # [ 0.312374] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry991lb # [ 0.299744] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations992worker2 # [ 0.313382] PCI: Using configuration type 1 for base access993lb # [ 0.300483] audit: initializing netlink subsys (disabled)994client # [ 0.319418] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages995worker2 # [ 0.314517] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.996lb # [ 0.301475] audit: type=2000 audit(1790096281.575:1): state=initialized audit_enabled=0 res=1997client # [ 0.320184] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page998lb # [ 0.302618] thermal_sys: Registered thermal governor 'fair_share'999worker1 # [ 0.321781] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1000lb # [ 0.302619] thermal_sys: Registered thermal governor 'bang_bang'1001worker1 # [ 0.322756] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1002lb # [ 0.303474] thermal_sys: Registered thermal governor 'step_wise'1003lb # [ 0.304443] thermal_sys: Registered thermal governor 'user_space'1004lb # [ 0.305192] thermal_sys: Registered thermal governor 'power_allocator'1005lb # [ 0.305485] cpuidle: using governor menu1006client # [ 0.325185] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1007client # [ 0.326183] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1008worker2 # [ 0.321394] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1009lb # [ 0.307736] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.51010worker1 # [ 0.327757] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1011worker2 # [ 0.322371] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1012worker1 # [ 0.328757] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1013lb # [ 0.308694] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]1014lb # [ 0.309476] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry1015lb # [ 0.310484] PCI: Using configuration type 1 for base access1016lb # [ 0.311609] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.1017worker2 # [ 0.327372] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1018worker2 # [ 0.328372] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1019client # [ 0.336545] ACPI: Added _OSI(Module Device)1020client # [ 0.337185] ACPI: Added _OSI(Processor Device)1021client # [ 0.337932] ACPI: Added _OSI(Processor Aggregator Device)1022lb # [ 0.318487] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1023worker1 # [ 0.340062] ACPI: Added _OSI(Module Device)1024worker1 # [ 0.340747] ACPI: Added _OSI(Processor Device)1025lb # [ 0.319474] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1026worker1 # [ 0.341257] ACPI: Added _OSI(Processor Aggregator Device)1027worker2 # [ 0.339624] ACPI: Added _OSI(Module Device)1028client # [ 0.344094] ACPI: 1 ACPI AML tables successfully acquired and loaded1029worker2 # [ 0.340348] ACPI: Added _OSI(Processor Device)1030lb # [ 0.324474] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1031worker2 # [ 0.340900] ACPI: Added _OSI(Processor Aggregator Device)1032lb # [ 0.325474] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1033worker1 # [ 0.347039] ACPI: 1 ACPI AML tables successfully acquired and loaded1034worker1 # [ 0.351169] ACPI: Interpreter enabled1035client # [ 0.350592] ACPI: Interpreter enabled1036worker1 # [ 0.351771] ACPI: PM: (supports S0 S3 S4 S5)1037client # [ 0.351200] ACPI: PM: (supports S0 S3 S4 S5)1038worker2 # [ 0.346684] ACPI: 1 ACPI AML tables successfully acquired and loaded1039worker1 # [ 0.352461] ACPI: Using IOAPIC for interrupt routing1040client # [ 0.351913] ACPI: Using IOAPIC for interrupt routing1041worker1 # [ 0.354802] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1042client # [ 0.354234] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1043worker2 # [ 0.350771] ACPI: Interpreter enabled1044worker1 # [ 0.355757] PCI: Using E820 reservations for host bridge windows1045client # [ 0.355185] PCI: Using E820 reservations for host bridge windows1046worker2 # [ 0.351386] ACPI: PM: (supports S0 S3 S4 S5)1047lb # [ 0.336763] ACPI: Added _OSI(Module Device)1048lb # [ 0.337443] ACPI: Added _OSI(Processor Device)1049worker2 # [ 0.352084] ACPI: Using IOAPIC for interrupt routing1050lb # [ 0.337996] ACPI: Added _OSI(Processor Aggregator Device)1051worker1 # [ 0.358854] ACPI: Enabled 2 GPEs in block 00 to 3F1052client # [ 0.358262] ACPI: Enabled 2 GPEs in block 00 to 3F1053worker2 # [ 0.354408] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1054worker2 # [ 0.355372] PCI: Using E820 reservations for host bridge windows1055lb # [ 0.343776] ACPI: 1 ACPI AML tables successfully acquired and loaded1056worker2 # [ 0.358525] ACPI: Enabled 2 GPEs in block 00 to 3F1057worker1 # [ 0.366101] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1058client # [ 0.365541] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1059worker1 # [ 0.366762] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1060client # [ 0.366189] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1061lb # [ 0.347898] ACPI: Interpreter enabled1062worker1 # [ 0.367832] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1063lb # [ 0.348489] ACPI: PM: (supports S0 S3 S4 S5)1064client # [ 0.367263] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1065lb # [ 0.349221] ACPI: Using IOAPIC for interrupt routing1066worker1 # [ 0.368878] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1067client # [ 0.368314] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1068worker1 # [ 0.370117] PCI host bridge to bus 0000:001069client # [ 0.369538] PCI host bridge to bus 0000:001070worker1 # [ 0.370760] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1071worker2 # [ 0.366053] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1072client # [ 0.370187] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1073worker1 # [ 0.371756] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1074lb # [ 0.351519] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1075client # [ 0.371184] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1076worker2 # [ 0.366377] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1077lb # [ 0.352474] PCI: Using E820 reservations for host bridge windows1078worker1 # [ 0.372756] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1079client # [ 0.372183] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1080worker2 # [ 0.367462] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1081worker1 # [ 0.373756] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1082client # [ 0.373184] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1083worker2 # [ 0.368495] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1084worker1 # [ 0.374756] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1085client # [ 0.374183] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1086lb # [ 0.355586] ACPI: Enabled 2 GPEs in block 00 to 3F1087worker2 # [ 0.369738] PCI host bridge to bus 0000:001088worker1 # [ 0.375756] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1089client # [ 0.375183] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1090worker2 # [ 0.370375] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1091worker1 # [ 0.376756] pci_bus 0000:00: root bus resource [bus 00-ff]1092client # [ 0.376189] pci_bus 0000:00: root bus resource [bus 00-ff]1093worker2 # [ 0.371372] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1094worker1 # [ 0.377704] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1095client # [ 0.377131] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1096worker2 # [ 0.372371] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1097worker1 # [ 0.379138] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1098worker2 # [ 0.373371] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1099client # [ 0.378630] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1100worker2 # [ 0.374372] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1101worker2 # [ 0.375371] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1102lb # [ 0.362944] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1103worker2 # [ 0.376372] pci_bus 0000:00: root bus resource [bus 00-ff]1104lb # [ 0.363479] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1105worker2 # [ 0.377383] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1106lb # [ 0.364550] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1107lb # [ 0.365595] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1108worker2 # [ 0.378821] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1109lb # [ 0.366841] PCI host bridge to bus 0000:001110worker1 # [ 0.381820] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1111client # [ 0.381223] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1112lb # [ 0.367478] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1113worker1 # [ 0.382769] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1114client # [ 0.382196] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1115lb # [ 0.368473] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1116client # [ 0.383156] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1117worker1 # [ 0.383700] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1118lb # [ 0.369473] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1119client # [ 0.384160] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1120worker1 # [ 0.385053] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1121lb # [ 0.370474] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1122lb # [ 0.371473] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1123client # [ 0.385891] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1124worker1 # [ 0.386673] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1125lb # [ 0.372473] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1126lb # [ 0.373473] pci_bus 0000:00: root bus resource [bus 00-ff]1127worker2 # [ 0.381460] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1128worker2 # [ 0.382384] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1129lb # [ 0.374462] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1130client # [ 0.388201] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1131worker1 # [ 0.389772] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1132client # [ 0.389039] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1133worker2 # [ 0.383386] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1134worker1 # [ 0.390586] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1135lb # [ 0.375900] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1136client # [ 0.389896] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1137worker1 # [ 0.391453] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1138worker2 # [ 0.384609] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1139client # [ 0.390189] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1140worker1 # [ 0.391762] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1141worker2 # [ 0.386268] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1142client # [ 0.391703] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1143worker1 # [ 0.393740] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1144client # [ 0.393200] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1145worker2 # [ 0.389411] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1146worker1 # [ 0.396712] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1147client # [ 0.394018] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1148worker2 # [ 0.390227] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1149worker1 # [ 0.397384] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1150client # [ 0.394894] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1151worker2 # [ 0.391098] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1152lb # [ 0.378522] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1153worker1 # [ 0.397777] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1154lb # [ 0.379486] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1155worker2 # [ 0.391377] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1156client # [ 0.395741] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1157worker1 # [ 0.399330] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1158lb # [ 0.380431] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1159worker2 # [ 0.392932] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1160lb # [ 0.381699] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1161client # [ 0.398205] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1162worker2 # [ 0.395411] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1163lb # [ 0.383193] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1164client # [ 0.399191] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1165worker1 # [ 0.401763] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1166worker2 # [ 0.396263] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1167worker1 # [ 0.403378] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1168client # [ 0.400109] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1169worker2 # [ 0.397146] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1170worker1 # [ 0.403777] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1171lb # [ 0.386490] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1172client # [ 0.401540] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1173lb # [ 0.387340] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1174worker2 # [ 0.398788] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1175worker1 # [ 0.405304] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1176lb # [ 0.388202] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1177client # [ 0.403200] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1178lb # [ 0.388479] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1179client # [ 0.404027] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1180worker1 # [ 0.407503] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1181client # [ 0.404888] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1182worker1 # [ 0.407763] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1183worker2 # [ 0.401410] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1184lb # [ 0.390574] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1185client # [ 0.405190] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1186worker1 # [ 0.408685] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1187worker2 # [ 0.402262] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1188worker2 # [ 0.403145] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1189worker1 # [ 0.409561] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1190lb # [ 0.392492] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1191client # [ 0.407295] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1192lb # [ 0.393325] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1193worker2 # [ 0.404811] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1194worker1 # [ 0.411291] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1195lb # [ 0.394195] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1196client # [ 0.409196] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1197client # [ 0.410127] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1198worker1 # [ 0.412778] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1199lb # [ 0.395064] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1200worker2 # [ 0.407348] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1201worker1 # [ 0.413719] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1202worker2 # [ 0.408028] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1203client # [ 0.411587] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1204worker1 # [ 0.415134] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1205worker2 # [ 0.408393] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1206client # [ 0.413196] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1207worker2 # [ 0.410271] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1208lb # [ 0.397712] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1209client # [ 0.414137] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1210worker1 # [ 0.416768] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1211lb # [ 0.399090] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1212worker2 # [ 0.411722] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1213lb # [ 0.399495] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1214worker1 # [ 0.417716] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1215client # [ 0.415575] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1216lb # [ 0.401053] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1217worker2 # [ 0.413384] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1218worker1 # [ 0.419337] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1219client # [ 0.418206] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1220worker2 # [ 0.414394] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1221client # [ 0.419143] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1222lb # [ 0.402505] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1223worker1 # [ 0.420768] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1224worker2 # [ 0.415970] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1225lb # [ 0.403369] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1226client # [ 0.420524] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1227worker1 # [ 0.421710] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1228lb # [ 0.404197] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1229lb # [ 0.404479] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1230worker1 # [ 0.423096] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1231client # [ 0.422197] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1232worker2 # [ 0.418055] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1233client # [ 0.423111] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1234worker2 # [ 0.418394] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1235worker1 # [ 0.424768] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1236lb # [ 0.406339] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1237client # [ 0.424526] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1238worker2 # [ 0.419996] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1239worker1 # [ 0.425715] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1240lb # [ 0.408486] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1241lb # [ 0.409433] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1242worker2 # [ 0.421383] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1243worker1 # [ 0.427301] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1244client # [ 0.426203] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1245worker2 # [ 0.422296] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1246client # [ 0.427016] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1247lb # [ 0.410904] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1248client # [ 0.427885] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1249worker1 # [ 0.429564] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1250worker2 # [ 0.423778] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1251worker1 # [ 0.430381] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1252lb # [ 0.412486] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1253client # [ 0.428740] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1254worker1 # [ 0.430777] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1255lb # [ 0.413442] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1256worker2 # [ 0.426119] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1257worker1 # [ 0.432356] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1258client # [ 0.430201] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1259worker2 # [ 0.427138] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1260lb # [ 0.415010] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1261client # [ 0.431029] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1262worker2 # [ 0.427935] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1263lb # [ 0.416486] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1264client # [ 0.432205] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1265lb # [ 0.417457] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1266worker1 # [ 0.435139] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1267client # [ 0.433740] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1268worker2 # [ 0.430246] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1269worker1 # [ 0.436384] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1270lb # [ 0.418844] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1271worker2 # [ 0.431013] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1272worker1 # [ 0.436777] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1273client # [ 0.434853] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1274worker2 # [ 0.431393] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1275lb # [ 0.420486] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1276client # [ 0.435383] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1277worker1 # [ 0.438330] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1278lb # [ 0.421445] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1279client # [ 0.436832] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1280worker1 # [ 0.439575] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1281worker2 # [ 0.433472] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1282client # [ 0.437382] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1283worker1 # [ 0.440560] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1284lb # [ 0.423368] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1285worker2 # [ 0.436050] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1286worker1 # [ 0.442419] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1287client # [ 0.438825] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1288worker2 # [ 0.436378] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1289lb # [ 0.425493] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1290worker2 # [ 0.437356] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1291lb # [ 0.426342] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1292worker1 # [ 0.442954] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1293lb # [ 0.427210] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1294worker2 # [ 0.438792] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1295worker1 # [ 0.444784] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1296lb # [ 0.428059] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1297worker2 # [ 0.440153] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1298worker2 # [ 0.440569] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1299lb # [ 0.429801] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1300worker2 # [ 0.443235] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1301lb # [ 0.431146] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1302lb # [ 0.431495] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1303worker2 # [ 0.444309] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1304worker2 # [ 0.446098] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1305client # [ 0.440045] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1306lb # [ 0.433074] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1307lb # [ 0.434193] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1308client # [ 0.442660] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1309lb # [ 0.434706] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1310worker1 # [ 0.445833] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1311client # [ 0.443464] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1312lb # [ 0.436136] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1313worker1 # [ 0.448503] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1314client # [ 0.444470] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1315lb # [ 0.436669] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1316worker1 # [ 0.449043] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1317client # [ 0.445435] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1318lb # [ 0.439113] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1319worker1 # [ 0.450072] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1320client # [ 0.447213] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1321worker1 # [ 0.451000] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1322client # [ 0.448078] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1323worker1 # [ 0.452814] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1324worker2 # [ 0.446639] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1325client # [ 0.449512] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1326worker1 # [ 0.453664] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1327client # [ 0.450902] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1328worker2 # [ 0.449127] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1329worker1 # [ 0.454793] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1330worker2 # [ 0.450648] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1331worker1 # [ 0.456470] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1332worker2 # [ 0.451697] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1333client # [ 0.454172] ACPI: PCI: Interrupt link LNKA configured for IRQ 101334client # [ 0.455030] ACPI: PCI: Interrupt link LNKB configured for IRQ 101335worker2 # [ 0.452622] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1336client # [ 0.455990] ACPI: PCI: Interrupt link LNKC configured for IRQ 111337lb # [ 0.439728] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1338worker1 # [ 0.459835] ACPI: PCI: Interrupt link LNKA configured for IRQ 101339worker2 # [ 0.454432] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1340client # [ 0.457031] ACPI: PCI: Interrupt link LNKD configured for IRQ 111341worker1 # [ 0.460865] ACPI: PCI: Interrupt link LNKB configured for IRQ 101342lb # [ 0.442135] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1343worker2 # [ 0.455325] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1344client # [ 0.458211] ACPI: PCI: Interrupt link LNKE configured for IRQ 101345worker1 # [ 0.461863] ACPI: PCI: Interrupt link LNKC configured for IRQ 111346client # [ 0.459229] ACPI: PCI: Interrupt link LNKF configured for IRQ 101347lb # [ 0.442702] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1348worker2 # [ 0.456417] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1349worker1 # [ 0.462861] ACPI: PCI: Interrupt link LNKD configured for IRQ 111350client # [ 0.460257] ACPI: PCI: Interrupt link LNKG configured for IRQ 111351worker1 # [ 0.463852] ACPI: PCI: Interrupt link LNKE configured for IRQ 101352lb # [ 0.443796] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1353client # [ 0.461284] ACPI: PCI: Interrupt link LNKH configured for IRQ 111354worker1 # [ 0.464852] ACPI: PCI: Interrupt link LNKF configured for IRQ 101355worker2 # [ 0.458792] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1356client # [ 0.462217] ACPI: PCI: Interrupt link GSIA configured for IRQ 161357worker1 # [ 0.465855] ACPI: PCI: Interrupt link LNKG configured for IRQ 111358lb # [ 0.444900] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1359client # [ 0.463193] ACPI: PCI: Interrupt link GSIB configured for IRQ 171360worker1 # [ 0.466852] ACPI: PCI: Interrupt link LNKH configured for IRQ 111361client # [ 0.464177] ACPI: PCI: Interrupt link GSIC configured for IRQ 181362lb # [ 0.446490] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1363worker1 # [ 0.467793] ACPI: PCI: Interrupt link GSIA configured for IRQ 161364client # [ 0.464950] ACPI: PCI: Interrupt link GSID configured for IRQ 191365lb # [ 0.447361] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1366worker1 # [ 0.468744] ACPI: PCI: Interrupt link GSIB configured for IRQ 171367worker2 # [ 0.462449] ACPI: PCI: Interrupt link LNKA configured for IRQ 101368client # [ 0.465196] ACPI: PCI: Interrupt link GSIE configured for IRQ 201369worker2 # [ 0.463478] ACPI: PCI: Interrupt link LNKB configured for IRQ 101370worker1 # [ 0.469529] ACPI: PCI: Interrupt link GSIC configured for IRQ 181371client # [ 0.466155] ACPI: PCI: Interrupt link GSIF configured for IRQ 211372lb # [ 0.448514] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1373worker2 # [ 0.464467] ACPI: PCI: Interrupt link LNKC configured for IRQ 111374worker1 # [ 0.470586] ACPI: PCI: Interrupt link GSID configured for IRQ 191375client # [ 0.467057] ACPI: PCI: Interrupt link GSIG configured for IRQ 221376lb # [ 0.450120] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1377worker2 # [ 0.465469] ACPI: PCI: Interrupt link LNKD configured for IRQ 111378worker1 # [ 0.471516] ACPI: PCI: Interrupt link GSIE configured for IRQ 201379client # [ 0.467937] ACPI: PCI: Interrupt link GSIH configured for IRQ 231380worker1 # [ 0.471768] ACPI: PCI: Interrupt link GSIF configured for IRQ 211381worker2 # [ 0.466468] ACPI: PCI: Interrupt link LNKE configured for IRQ 101382worker1 # [ 0.472744] ACPI: PCI: Interrupt link GSIG configured for IRQ 221383client # [ 0.469256] iommu: Default domain type: Translated1384worker2 # [ 0.467671] ACPI: PCI: Interrupt link LNKF configured for IRQ 101385worker1 # [ 0.473509] ACPI: PCI: Interrupt link GSIH configured for IRQ 231386client # [ 0.470058] iommu: DMA domain TLB invalidation policy: lazy mode1387worker2 # [ 0.468478] ACPI: PCI: Interrupt link LNKG configured for IRQ 111388client # [ 0.471227] ACPI: bus type USB registered1389lb # [ 0.453594] ACPI: PCI: Interrupt link LNKA configured for IRQ 101390worker2 # [ 0.469468] ACPI: PCI: Interrupt link LNKH configured for IRQ 111391worker1 # [ 0.474821] iommu: Default domain type: Translated1392client # [ 0.472006] usbcore: registered new interface driver usbfs1393lb # [ 0.454591] ACPI: PCI: Interrupt link LNKB configured for IRQ 101394worker2 # [ 0.470407] ACPI: PCI: Interrupt link GSIA configured for IRQ 161395client # [ 0.472859] usbcore: registered new interface driver hub1396worker1 # [ 0.475615] iommu: DMA domain TLB invalidation policy: lazy mode1397lb # [ 0.455574] ACPI: PCI: Interrupt link LNKC configured for IRQ 111398client # [ 0.473192] usbcore: registered new device driver usb1399worker2 # [ 0.471356] ACPI: PCI: Interrupt link GSIB configured for IRQ 171400worker1 # [ 0.476771] ACPI: bus type USB registered1401lb # [ 0.456569] ACPI: PCI: Interrupt link LNKD configured for IRQ 111402worker2 # [ 0.472096] ACPI: PCI: Interrupt link GSIC configured for IRQ 181403worker1 # [ 0.477525] usbcore: registered new interface driver usbfs1404client # [ 0.474858] NetLabel: Initializing1405lb # [ 0.457571] ACPI: PCI: Interrupt link LNKE configured for IRQ 101406worker2 # [ 0.472385] ACPI: PCI: Interrupt link GSID configured for IRQ 191407worker1 # [ 0.477773] usbcore: registered new interface driver hub1408client # [ 0.475185] NetLabel: domain hash size = 1281409worker1 # [ 0.478616] usbcore: registered new device driver usb1410lb # [ 0.458572] ACPI: PCI: Interrupt link LNKF configured for IRQ 101411worker2 # [ 0.473327] ACPI: PCI: Interrupt link GSIE configured for IRQ 201412client # [ 0.475976] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker2 # [ 0.474099] ACPI: PCI: Interrupt link GSIF configured for IRQ 211414lb # [ 0.459573] ACPI: PCI: Interrupt link LNKG configured for IRQ 111415client # [ 0.476963] NetLabel: unlabeled traffic allowed by default1416worker1 # [ 0.480292] NetLabel: Initializing1417worker2 # [ 0.474386] ACPI: PCI: Interrupt link GSIG configured for IRQ 221418client # [ 0.477196] PCI: Using ACPI for IRQ routing1419lb # [ 0.460608] ACPI: PCI: Interrupt link LNKH configured for IRQ 111420worker1 # [ 0.480757] NetLabel: domain hash size = 1281421lb # [ 0.461533] ACPI: PCI: Interrupt link GSIA configured for IRQ 161422worker2 # [ 0.475359] ACPI: PCI: Interrupt link GSIH configured for IRQ 231423worker1 # [ 0.481481] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1424worker1 # [ 0.481842] NetLabel: unlabeled traffic allowed by default1425lb # [ 0.462486] ACPI: PCI: Interrupt link GSIB configured for IRQ 171426worker1 # [ 0.482776] PCI: Using ACPI for IRQ routing1427worker2 # [ 0.477107] iommu: Default domain type: Translated1428lb # [ 0.463489] ACPI: PCI: Interrupt link GSIC configured for IRQ 181429worker2 # [ 0.477379] iommu: DMA domain TLB invalidation policy: lazy mode1430lb # [ 0.464485] ACPI: PCI: Interrupt link GSID configured for IRQ 191431worker2 # [ 0.478645] ACPI: bus type USB registered1432lb # [ 0.465486] ACPI: PCI: Interrupt link GSIE configured for IRQ 201433worker2 # [ 0.479444] usbcore: registered new interface driver usbfs1434lb # [ 0.466490] ACPI: PCI: Interrupt link GSIF configured for IRQ 211435worker2 # [ 0.480380] usbcore: registered new interface driver hub1436lb # [ 0.467479] ACPI: PCI: Interrupt link GSIG configured for IRQ 221437worker2 # [ 0.481272] usbcore: registered new device driver usb1438lb # [ 0.468486] ACPI: PCI: Interrupt link GSIH configured for IRQ 231439worker2 # [ 0.482937] NetLabel: Initializing1440worker2 # [ 0.483372] NetLabel: domain hash size = 1281441lb # [ 0.470457] iommu: Default domain type: Translated1442worker2 # [ 0.484084] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1443lb # [ 0.471107] iommu: DMA domain TLB invalidation policy: lazy mode1444worker2 # [ 0.484410] NetLabel: unlabeled traffic allowed by default1445lb # [ 0.471732] ACPI: bus type USB registered1446worker2 # [ 0.485383] PCI: Using ACPI for IRQ routing1447lb # [ 0.472533] usbcore: registered new interface driver usbfs1448lb # [ 0.473484] usbcore: registered new interface driver hub1449lb # [ 0.474489] usbcore: registered new device driver usb1450lb # [ 0.476311] NetLabel: Initializing1451lb # [ 0.476920] NetLabel: domain hash size = 1281452lb # [ 0.477473] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1453lb # [ 0.478455] NetLabel: unlabeled traffic allowed by default1454lb # [ 0.479233] PCI: Using ACPI for IRQ routing1455client # [ 0.520520] pci 0000:00:01.0: vgaarb: setting as boot VGA device1456client # [ 0.521180] pci 0000:00:01.0: vgaarb: bridge control possible1457client # [ 0.521180] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1458client # [ 0.521188] vgaarb: loaded1459client # [ 0.521946] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01460worker1 # [ 0.526954] pci 0000:00:01.0: vgaarb: setting as boot VGA device1461client # [ 0.522185] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1462worker1 # [ 0.527752] pci 0000:00:01.0: vgaarb: bridge control possible1463worker1 # [ 0.527752] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1464worker1 # [ 0.527761] vgaarb: loaded1465worker1 # [ 0.528550] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01466client # [ 0.525264] clocksource: Switched to clocksource kvm-clock1467worker1 # [ 0.529408] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1468client # [ 0.528780] VFS: Disk quotas dquot_6.6.01469client # [ 0.529509] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1470worker1 # [ 0.532837] clocksource: Switched to clocksource kvm-clock1471worker2 # [ 0.529565] pci 0000:00:01.0: vgaarb: setting as boot VGA device1472client # [ 0.530914] pnp: PnP ACPI init1473worker2 # [ 0.530367] pci 0000:00:01.0: vgaarb: bridge control possible1474client # [ 0.531702] ACPI: IRQ 4 override to edge(!), high(!)1475worker2 # [ 0.530367] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1476client # [ 0.532661] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1477worker1 # [ 0.536292] VFS: Disk quotas dquot_6.6.01478worker2 # [ 0.530376] vgaarb: loaded1479client # [ 0.534184] pnp: PnP ACPI: found 5 devices1480worker1 # [ 0.536970] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1481worker2 # [ 0.531119] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01482worker1 # [ 0.538306] pnp: PnP ACPI init1483worker2 # [ 0.531371] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1484worker1 # [ 0.539078] ACPI: IRQ 4 override to edge(!), high(!)1485lb # [ 0.522487] pci 0000:00:01.0: vgaarb: setting as boot VGA device1486worker1 # [ 0.540058] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1487lb # [ 0.523469] pci 0000:00:01.0: vgaarb: bridge control possible1488worker1 # [ 0.541681] pnp: PnP ACPI: found 5 devices1489lb # [ 0.523469] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1490lb # [ 0.523517] vgaarb: loaded1491worker2 # [ 0.536468] clocksource: Switched to clocksource kvm-clock1492lb # [ 0.524436] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01493client # [ 0.541743] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1494lb # [ 0.525084] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1495client # [ 0.543155] clocksource: Switched to clocksource acpi_pm1496client # [ 0.544185] NET: Registered PF_INET protocol family1497worker2 # [ 0.539997] VFS: Disk quotas dquot_6.6.01498client # [ 0.545395] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1499worker2 # [ 0.540722] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1500worker2 # [ 0.542072] pnp: PnP ACPI init1501worker1 # [ 0.549307] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1502lb # [ 0.529625] clocksource: Switched to clocksource kvm-clock1503worker1 # [ 0.550795] clocksource: Switched to clocksource acpi_pm1504worker2 # [ 0.542872] ACPI: IRQ 4 override to edge(!), high(!)1505worker1 # [ 0.551762] NET: Registered PF_INET protocol family1506worker2 # [ 0.543783] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1507worker2 # [ 0.545325] pnp: PnP ACPI: found 5 devices1508worker1 # [ 0.552961] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1509lb # [ 0.533725] VFS: Disk quotas dquot_6.6.01510lb # [ 0.534490] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1511lb # [ 0.536011] pnp: PnP ACPI init1512lb # [ 0.536950] ACPI: IRQ 4 override to edge(!), high(!)1513lb # [ 0.538107] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1514lb # [ 0.539843] pnp: PnP ACPI: found 5 devices1515worker2 # [ 0.552934] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1516worker2 # [ 0.554374] clocksource: Switched to clocksource acpi_pm1517worker2 # [ 0.555389] NET: Registered PF_INET protocol family1518worker2 # [ 0.556556] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1519client # [ 0.561855] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1520client # [ 0.563427] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1521client # [ 0.564809] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1522lb # [ 0.547700] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1523client # [ 0.566184] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1524worker1 # [ 0.569181] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1525lb # [ 0.549156] clocksource: Switched to clocksource acpi_pm1526client # [ 0.567384] TCP: Hash tables configured (established 16384 bind 16384)1527worker1 # [ 0.570696] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1528lb # [ 0.550134] NET: Registered PF_INET protocol family1529client # [ 0.568486] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1530worker1 # [ 0.571974] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1531lb # [ 0.551309] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1532client # [ 0.569752] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1533worker1 # [ 0.573307] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1534client # [ 0.570798] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1535worker1 # [ 0.574577] TCP: Hash tables configured (established 16384 bind 16384)1536client # [ 0.572005] NET: Registered PF_UNIX/PF_LOCAL protocol family1537client # [ 0.572966] NET: Registered PF_XDP protocol family1538worker1 # [ 0.575774] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1539client # [ 0.573816] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1540worker1 # [ 0.577130] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1541client # [ 0.574835] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1542worker1 # [ 0.578339] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1543client # [ 0.575866] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1544worker1 # [ 0.579587] NET: Registered PF_UNIX/PF_LOCAL protocol family1545client # [ 0.576978] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1546worker1 # [ 0.580572] NET: Registered PF_XDP protocol family1547client # [ 0.578100] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1548worker1 # [ 0.581435] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1549worker2 # [ 0.572964] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1550client # [ 0.579215] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1551worker1 # [ 0.582419] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1552worker2 # [ 0.574573] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1553worker1 # [ 0.583428] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1554client # [ 0.580925] ACPI: \_SB_.GSIA: Enabled at IRQ 161555worker2 # [ 0.575871] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1556worker1 # [ 0.584544] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1557worker2 # [ 0.577206] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1558worker1 # [ 0.585681] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1559client # [ 0.583075] ACPI: \_SB_.GSIB: Enabled at IRQ 171560worker2 # [ 0.578451] TCP: Hash tables configured (established 16384 bind 16384)1561worker1 # [ 0.586767] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1562worker2 # [ 0.579549] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1563client # [ 0.585143] ACPI: \_SB_.GSIC: Enabled at IRQ 181564worker1 # [ 0.588493] ACPI: \_SB_.GSIA: Enabled at IRQ 161565worker2 # [ 0.580836] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1566client # [ 0.587096] ACPI: \_SB_.GSID: Enabled at IRQ 191567worker2 # [ 0.581954] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1568lb # [ 0.568912] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1569worker1 # [ 0.590968] ACPI: \_SB_.GSIB: Enabled at IRQ 171570worker2 # [ 0.583137] NET: Registered PF_UNIX/PF_LOCAL protocol family1571client # [ 0.588756] PCI: CLS 0 bytes, default 641572lb # [ 0.570468] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1573worker2 # [ 0.584088] NET: Registered PF_XDP protocol family1574client # [ 0.589664] Trying to unpack rootfs image as initramfs...1575worker1 # [ 0.592849] ACPI: \_SB_.GSIC: Enabled at IRQ 181576worker2 # [ 0.584915] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1577lb # [ 0.571762] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1578worker2 # [ 0.585900] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1579lb # [ 0.573069] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1580worker1 # [ 0.594805] ACPI: \_SB_.GSID: Enabled at IRQ 191581worker2 # [ 0.586922] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1582lb # [ 0.574310] TCP: Hash tables configured (established 16384 bind 16384)1583worker1 # [ 0.596477] PCI: CLS 0 bytes, default 641584worker2 # [ 0.588014] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1585lb # [ 0.575476] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1586worker2 # [ 0.589106] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1587client # [ 0.594052] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1588lb # [ 0.576682] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1589worker1 # [ 0.597360] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1590worker2 # [ 0.590147] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1591worker1 # [ 0.599018] Trying to unpack rootfs image as initramfs...1592lb # [ 0.577710] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1593worker2 # [ 0.591796] ACPI: \_SB_.GSIA: Enabled at IRQ 161594lb # [ 0.578913] NET: Registered PF_UNIX/PF_LOCAL protocol family1595lb # [ 0.579947] NET: Registered PF_XDP protocol family1596lb # [ 0.580850] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1597worker2 # [ 0.594430] ACPI: \_SB_.GSIB: Enabled at IRQ 171598lb # [ 0.581875] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1599worker2 # [ 0.596315] ACPI: \_SB_.GSIC: Enabled at IRQ 181600lb # [ 0.582941] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1601lb # [ 0.584077] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1602worker2 # [ 0.598220] ACPI: \_SB_.GSID: Enabled at IRQ 191603lb # [ 0.585200] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1604lb # [ 0.586296] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1605worker2 # [ 0.599920] PCI: CLS 0 bytes, default 641606lb # [ 0.588145] ACPI: \_SB_.GSIA: Enabled at IRQ 161607worker2 # [ 0.600798] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1608worker2 # [ 0.602598] Trying to unpack rootfs image as initramfs...1609lb # [ 0.591304] ACPI: \_SB_.GSIB: Enabled at IRQ 171610lb # [ 0.593431] ACPI: \_SB_.GSIC: Enabled at IRQ 181611lb # [ 0.595441] ACPI: \_SB_.GSID: Enabled at IRQ 191612lb # [ 0.597184] PCI: CLS 0 bytes, default 641613lb # [ 0.598108] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1614lb # [ 0.599910] Trying to unpack rootfs image as initramfs...1615client # [ 0.632437] Initialise system trusted keyrings1616client # [ 0.635612] workingset: timestamp_bits=40 max_order=19 bucket_order=01617worker1 # [ 0.642620] Initialise system trusted keyrings1618worker1 # [ 0.646295] workingset: timestamp_bits=40 max_order=19 bucket_order=01619worker2 # [ 0.644252] Initialise system trusted keyrings1620worker2 # [ 0.646889] workingset: timestamp_bits=40 max_order=19 bucket_order=01621client # [ 0.655455] Key type asymmetric registered1622client # [ 0.658571] Asymmetric key parser 'x509' registered1623client # [ 0.659417] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1624worker1 # [ 0.665530] Key type asymmetric registered1625client # [ 0.662667] io scheduler mq-deadline registered1626client # [ 0.663444] io scheduler kyber registered1627lb # [ 0.645877] Initialise system trusted keyrings1628worker1 # [ 0.670248] Asymmetric key parser 'x509' registered1629client # [ 0.667143] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1630lb # [ 0.649457] workingset: timestamp_bits=40 max_order=19 bucket_order=01631worker1 # [ 0.671067] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1632client # [ 0.668426] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1633worker1 # [ 0.672410] io scheduler mq-deadline registered1634worker1 # [ 0.673184] io scheduler kyber registered1635client # [ 0.672340] Linux agpgart interface v0.1031636client # [ 0.673149] ACPI: bus type drm_connector registered1637worker2 # [ 0.668855] Key type asymmetric registered1638worker1 # [ 0.676806] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1639worker2 # [ 0.669599] Asymmetric key parser 'x509' registered1640worker1 # [ 0.678099] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1641worker2 # [ 0.670477] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1642client # [ 0.677976] usbcore: registered new interface driver usbserial_generic1643client # [ 0.679101] usbserial: USB Serial support registered for generic1644worker1 # [ 0.683859] Linux agpgart interface v0.1031645worker2 # [ 0.675942] io scheduler mq-deadline registered1646worker1 # [ 0.684667] ACPI: bus type drm_connector registered1647worker2 # [ 0.676726] io scheduler kyber registered1648client # [ 0.681578] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1649client # [ 0.681578] Please enable it if your BIOS has the CPPC option.1650client # [ 0.683812] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1651worker2 # [ 0.679379] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1652worker1 # [ 0.687738] usbcore: registered new interface driver usbserial_generic1653worker1 # [ 0.688872] usbserial: USB Serial support registered for generic1654worker2 # [ 0.680607] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1655client # [ 0.687716] drop_monitor: Initializing network drop monitor service1656lb # [ 0.670759] Key type asymmetric registered1657client # [ 0.688912] NET: Registered PF_INET6 protocol family1658lb # [ 0.671520] Asymmetric key parser 'x509' registered1659worker1 # [ 0.692254] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1660worker1 # [ 0.692254] Please enable it if your BIOS has the CPPC option.1661lb # [ 0.672373] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1662worker2 # [ 0.686104] Linux agpgart interface v0.1031663client # [ 0.692002] Segment Routing with IPv61664worker1 # [ 0.694518] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1665worker2 # [ 0.686882] ACPI: bus type drm_connector registered1666client # [ 0.694584] In-situ OAM (IOAM) with IPv61667worker1 # [ 0.697405] drop_monitor: Initializing network drop monitor service1668client # [ 0.695650] IPI shorthand broadcast: enabled1669worker2 # [ 0.690173] usbcore: registered new interface driver usbserial_generic1670worker1 # [ 0.698603] NET: Registered PF_INET6 protocol family1671lb # [ 0.677575] io scheduler mq-deadline registered1672lb # [ 0.678318] io scheduler kyber registered1673worker2 # [ 0.691236] usbserial: USB Serial support registered for generic1674worker1 # [ 0.701731] Segment Routing with IPv61675worker2 # [ 0.693853] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1676worker2 # [ 0.693853] Please enable it if your BIOS has the CPPC option.1677lb # [ 0.682111] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1678worker2 # [ 0.696173] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1679lb # [ 0.683366] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1680worker1 # [ 0.705259] In-situ OAM (IOAM) with IPv61681worker1 # [ 0.706551] IPI shorthand broadcast: enabled1682client # [ 0.703955] sched_clock: Marking stable (570013622, 133535962)->(774839825, -71290241)1683worker2 # [ 0.699989] drop_monitor: Initializing network drop monitor service1684lb # [ 0.687224] Linux agpgart interface v0.1031685lb # [ 0.687984] ACPI: bus type drm_connector registered1686worker2 # [ 0.701179] NET: Registered PF_INET6 protocol family1687worker2 # [ 0.704273] Segment Routing with IPv61688client # [ 0.709633] registered taskstats version 11689client # [ 0.710601] Loading compiled-in X.509 certificates1690lb # [ 0.692954] usbcore: registered new interface driver usbserial_generic1691worker2 # [ 0.706860] In-situ OAM (IOAM) with IPv61692worker1 # [ 0.714881] sched_clock: Marking stable (580014565, 134214089)->(783820450, -69591796)1693lb # [ 0.694088] usbserial: USB Serial support registered for generic1694worker2 # [ 0.707967] IPI shorthand broadcast: enabled1695lb # [ 0.697417] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1696lb # [ 0.697417] Please enable it if your BIOS has the CPPC option.1697worker1 # [ 0.720339] registered taskstats version 11698worker1 # [ 0.721291] Loading compiled-in X.509 certificates1699lb # [ 0.699688] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1700lb # [ 0.703598] drop_monitor: Initializing network drop monitor service1701worker2 # [ 0.716414] sched_clock: Marking stable (582014972, 133812331)->(788582917, -72755614)1702lb # [ 0.704747] NET: Registered PF_INET6 protocol family1703lb # [ 0.707961] Segment Routing with IPv61704client # [ 0.727033] Demotion targets for Node 0: null1705worker2 # [ 0.722019] registered taskstats version 11706worker2 # [ 0.723007] Loading compiled-in X.509 certificates1707lb # [ 0.710426] In-situ OAM (IOAM) with IPv61708lb # [ 0.711533] IPI shorthand broadcast: enabled1709client # [ 0.730596] Key type .fscrypt registered1710client # [ 0.731283] Key type fscrypt-provisioning registered1711client # [ 0.732232] ima: No TPM chip found, activating TPM-bypass!1712client # [ 0.734562] ima: Allocated hash algorithm: sha11713worker1 # [ 0.737785] Demotion targets for Node 0: null1714client # [ 0.735339] ima: No architecture policies found1715client # [ 0.737561] PM: Magic number: 10:811:9951716worker1 # [ 0.741274] Key type .fscrypt registered1717lb # [ 0.719958] sched_clock: Marking stable (586015107, 133380733)->(791504012, -72108172)1718worker1 # [ 0.741961] Key type fscrypt-provisioning registered1719client # [ 0.739190] RAS: Correctable Errors collector initialized.1720worker1 # [ 0.742926] ima: No TPM chip found, activating TPM-bypass!1721worker1 # [ 0.745240] ima: Allocated hash algorithm: sha11722lb # [ 0.724625] registered taskstats version 11723worker1 # [ 0.746031] ima: No architecture policies found1724lb # [ 0.725621] Loading compiled-in X.509 certificates1725worker1 # [ 0.748241] PM: Magic number: 10:811:9951726worker2 # [ 0.741834] Demotion targets for Node 0: null1727worker1 # [ 0.749849] RAS: Correctable Errors collector initialized.1728worker2 # [ 0.742714] Key type .fscrypt registered1729client # [ 0.748230] clk: Disabling unused clocks1730worker2 # [ 0.743380] Key type fscrypt-provisioning registered1731worker2 # [ 0.744273] ima: No TPM chip found, activating TPM-bypass!1732client # [ 0.752581] PM: genpd: Disabling unused power domains1733worker2 # [ 0.748836] ima: Allocated hash algorithm: sha11734worker2 # [ 0.749624] ima: No architecture policies found1735worker2 # [ 0.750544] PM: Magic number: 10:811:9951736worker1 # [ 0.758913] clk: Disabling unused clocks1737worker1 # [ 0.762263] PM: genpd: Disabling unused power domains1738worker2 # [ 0.754180] RAS: Correctable Errors collector initialized.1739lb # [ 0.744410] Demotion targets for Node 0: null1740lb # [ 0.747458] Key type .fscrypt registered1741lb # [ 0.748103] Key type fscrypt-provisioning registered1742lb # [ 0.749029] ima: No TPM chip found, activating TPM-bypass!1743worker2 # [ 0.762871] clk: Disabling unused clocks1744worker2 # [ 0.763556] PM: genpd: Disabling unused power domains1745lb # [ 0.751412] ima: Allocated hash algorithm: sha11746lb # [ 0.752160] ima: No architecture policies found1747lb # [ 0.754415] PM: Magic number: 10:811:9951748lb # [ 0.756167] RAS: Correctable Errors collector initialized.1749lb # [ 0.765090] clk: Disabling unused clocks1750lb # [ 0.768438] PM: genpd: Disabling unused power domains1751client # [ 0.916399] Freeing initrd memory: 29056K1752client # [ 0.919525] Freeing unused decrypted memory: 2028K1753worker1 # [ 0.924281] Freeing initrd memory: 29056K1754client # [ 0.922201] Freeing unused kernel image (initmem) memory: 3652K1755client # [ 0.923244] Write protecting the kernel read-only data: 32768k1756worker1 # [ 0.927471] Freeing unused decrypted memory: 2028K1757client # [ 0.925076] Freeing unused kernel image (text/rodata gap) memory: 1184K1758client # [ 0.926529] Freeing unused kernel image (rodata/data gap) memory: 720K1759worker1 # [ 0.930138] Freeing unused kernel image (initmem) memory: 3652K1760worker1 # [ 0.931315] Write protecting the kernel read-only data: 32768k1761worker1 # [ 0.933191] Freeing unused kernel image (text/rodata gap) memory: 1184K1762worker1 # [ 0.934767] Freeing unused kernel image (rodata/data gap) memory: 720K1763worker2 # [ 0.928008] Freeing initrd memory: 29060K1764worker2 # [ 0.931207] Freeing unused decrypted memory: 2028K1765worker2 # [ 0.933892] Freeing unused kernel image (initmem) memory: 3652K1766worker2 # [ 0.934988] Write protecting the kernel read-only data: 32768k1767worker2 # [ 0.936887] Freeing unused kernel image (text/rodata gap) memory: 1184K1768worker2 # [ 0.938410] Freeing unused kernel image (rodata/data gap) memory: 720K1769lb # [ 0.943789] Freeing initrd memory: 29064K1770lb # [ 0.947238] Freeing unused decrypted memory: 2028K1771lb # [ 0.950278] Freeing unused kernel image (initmem) memory: 3652K1772lb # [ 0.951347] Write protecting the kernel read-only data: 32768k1773lb # [ 0.953358] Freeing unused kernel image (text/rodata gap) memory: 1184K1774lb # [ 0.954934] Freeing unused kernel image (rodata/data gap) memory: 720K1775client # [ 0.977371] x86/mm: Checked W+X mappings: passed, no W+X pages found.1776client # [ 0.978415] Run /init as init process1777worker1 # [ 0.985782] x86/mm: Checked W+X mappings: passed, no W+X pages found.1778worker1 # [ 0.986902] Run /init as init process1779client # [ 0.989285] systemd[1]: Inserted module 'autofs4'1780worker2 # [ 0.989009] x86/mm: Checked W+X mappings: passed, no W+X pages found.1781worker1 # [ 0.997612] systemd[1]: Inserted module 'autofs4'1782worker2 # [ 0.990071] Run /init as init process1783worker2 # [ 1.000671] systemd[1]: Inserted module 'autofs4'1784client # [ 1.009071] fuse: init (API version 7.45)1785worker1 # [ 1.017472] fuse: init (API version 7.45)1786client # [ 1.016459] ACPI: \_SB_.GSIG: Enabled at IRQ 221787client # [ 1.018821] ACPI: \_SB_.GSIH: Enabled at IRQ 231788client # [ 1.021802] ACPI: \_SB_.GSIE: Enabled at IRQ 201789worker1 # [ 1.024840] ACPI: \_SB_.GSIG: Enabled at IRQ 221790client # [ 1.023770] ACPI: \_SB_.GSIF: Enabled at IRQ 211791worker1 # [ 1.027368] ACPI: \_SB_.GSIH: Enabled at IRQ 231792lb # [ 1.006076] x86/mm: Checked W+X mappings: passed, no W+X pages found.1793lb # [ 1.007127] Run /init as init process1794worker2 # [ 1.020454] fuse: init (API version 7.45)1795worker1 # [ 1.030397] ACPI: \_SB_.GSIE: Enabled at IRQ 201796client # [ 1.028892] virtiofs virtio5: discovered new tag: nix-store1797worker1 # [ 1.032493] ACPI: \_SB_.GSIF: Enabled at IRQ 211798client # [ 1.030420] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1799worker2 # [ 1.027872] ACPI: \_SB_.GSIG: Enabled at IRQ 221800worker1 # [ 1.037649] virtiofs virtio5: discovered new tag: nix-store1801worker2 # [ 1.030224] ACPI: \_SB_.GSIH: Enabled at IRQ 231802worker1 # [ 1.039344] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1803lb # [ 1.019143] systemd[1]: Inserted module 'autofs4'1804worker2 # [ 1.033376] ACPI: \_SB_.GSIE: Enabled at IRQ 201805client # [ 1.039825] virtiofs virtio6: discovered new tag: shared1806worker2 # [ 1.035433] ACPI: \_SB_.GSIF: Enabled at IRQ 211807client # [ 1.041427] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1808worker1 # [ 1.046603] virtiofs virtio6: discovered new tag: shared1809client # [ 1.045282] virtiofs virtio7: discovered new tag: xchg1810worker1 # [ 1.048348] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1811worker2 # [ 1.040874] virtiofs virtio5: discovered new tag: nix-store1812client # [ 1.046873] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1813worker2 # [ 1.042571] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1814worker1 # [ 1.052714] virtiofs virtio7: discovered new tag: xchg1815worker1 # [ 1.054406] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1816worker2 # [ 1.049276] virtiofs virtio6: discovered new tag: shared1817worker2 # [ 1.050949] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1818lb # [ 1.039302] fuse: init (API version 7.45)1819worker2 # [ 1.054294] virtiofs virtio7: discovered new tag: xchg1820worker2 # [ 1.055875] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1821lb # [ 1.046874] ACPI: \_SB_.GSIG: Enabled at IRQ 221822lb # [ 1.049720] ACPI: \_SB_.GSIH: Enabled at IRQ 231823client # [ 1.068687] systemd[1]: Successfully made /usr/ read-only.1824lb # [ 1.053106] ACPI: \_SB_.GSIE: Enabled at IRQ 201825worker1 # [ 1.074998] systemd[1]: Successfully made /usr/ read-only.1826lb # [ 1.055440] ACPI: \_SB_.GSIF: Enabled at IRQ 211827lb # [ 1.061041] virtiofs virtio5: discovered new tag: nix-store1828lb # [ 1.062627] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1829worker2 # [ 1.078016] systemd[1]: Successfully made /usr/ read-only.1830lb # [ 1.070058] virtiofs virtio6: discovered new tag: shared1831lb # [ 1.071560] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1832lb # [ 1.075632] virtiofs virtio7: discovered new tag: xchg1833lb # [ 1.077249] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1834lb # [ 1.100371] systemd[1]: Successfully made /usr/ read-only.1835client # [ 1.404444] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1836client # [ 1.409666] systemd[1]: Detected virtualization kvm.1837client # [ 1.410530] systemd[1]: Detected architecture x86-64.1838client # [ 1.411392] systemd[1]: Running in initrd.1839worker1 # [ 1.410556] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1840worker1 # [ 1.415422] systemd[1]: Detected virtualization kvm.1841client # [ 1.412617] systemd[1]: Initializing machine ID from random generator.1842worker1 # [ 1.416286] systemd[1]: Detected architecture x86-64.1843client # [ 1.413778] systemd[1]: Hostname set to <client>.1844worker1 # [ 1.417090] systemd[1]: Running in initrd.1845worker1 # [ 1.418092] systemd[1]: Initializing machine ID from random generator.1846worker1 # [ 1.419243] systemd[1]: Hostname set to <worker1>.1847worker2 # [ 1.414783] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1848worker2 # [ 1.427054] systemd[1]: Detected virtualization kvm.1849worker2 # [ 1.429242] systemd[1]: Detected architecture x86-64.1850worker2 # [ 1.431378] systemd[1]: Running in initrd.1851worker2 # [ 1.433975] systemd[1]: Initializing machine ID from random generator.1852worker2 # [ 1.436933] systemd[1]: Hostname set to <worker2>.1853lb # [ 1.437023] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1854lb # [ 1.448980] systemd[1]: Detected virtualization kvm.1855lb # [ 1.451124] systemd[1]: Detected architecture x86-64.1856lb # [ 1.453300] systemd[1]: Running in initrd.1857lb # [ 1.455843] systemd[1]: Initializing machine ID from random generator.1858lb # [ 1.458728] systemd[1]: Hostname set to <lb>.1859client # [ 1.603349] systemd[1]: bpf-restrict-fs: LSM BPF program attached1860worker1 # [ 1.611444] systemd[1]: bpf-restrict-fs: LSM BPF program attached1861client # [ 1.643369] systemd[1]: Queued start job for default target Initrd Default Target.1862worker1 # [ 1.648773] systemd[1]: Queued start job for default target Initrd Default Target.1863client # [ 1.647937] systemd[1]: Created slice Slice /system/modprobe.1864worker1 # [ 1.652561] systemd[1]: Created slice Slice /system/modprobe.1865client # [ 1.649166] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1866client # [ 1.650650] systemd[1]: Expecting device /dev/disk/by-label/nixos...1867worker1 # [ 1.653697] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1868client # [ 1.651756] systemd[1]: Reached target Path Units.1869worker1 # [ 1.655031] systemd[1]: Expecting device /dev/disk/by-label/nixos...1870client # [ 1.652658] systemd[1]: Reached target Slice Units.1871worker1 # [ 1.656070] systemd[1]: Reached target Path Units.1872client # [ 1.653577] systemd[1]: Reached target Swaps.1873worker1 # [ 1.656898] systemd[1]: Reached target Slice Units.1874client # [ 1.654350] systemd[1]: Reached target Timer Units.1875worker1 # [ 1.657744] systemd[1]: Reached target Swaps.1876worker1 # [ 1.658517] systemd[1]: Reached target Timer Units.1877client # [ 1.655377] systemd[1]: Listening on D-Bus System Message Bus Socket.1878worker1 # [ 1.659446] systemd[1]: Listening on D-Bus System Message Bus Socket.1879client # [ 1.656677] systemd[1]: Listening on Journal Socket (/dev/log).1880worker2 # [ 1.651679] systemd[1]: bpf-restrict-fs: LSM BPF program attached1881worker1 # [ 1.660592] systemd[1]: Listening on Journal Socket (/dev/log).1882client # [ 1.657847] systemd[1]: Listening on Journal Sockets.1883worker1 # [ 1.661706] systemd[1]: Listening on Journal Sockets.1884client # [ 1.658871] systemd[1]: Listening on udev Control Socket.1885worker1 # [ 1.662674] systemd[1]: Listening on udev Control Socket.1886client # [ 1.659934] systemd[1]: Listening on udev Kernel Socket.1887worker1 # [ 1.663704] systemd[1]: Listening on udev Kernel Socket.1888client # [ 1.660941] systemd[1]: Reached target Socket Units.1889worker1 # [ 1.664622] systemd[1]: Reached target Socket Units.1890client # [ 1.662898] systemd[1]: Starting Create List of Static Device Nodes...1891worker1 # [ 1.666292] systemd[1]: Starting Create List of Static Device Nodes...1892worker1 # [ 1.670011] systemd[1]: Starting Load Kernel Module configfs...1893client # [ 1.667622] systemd[1]: Starting Load Kernel Module configfs...1894worker1 # [ 1.678295] systemd[1]: Starting Journal Service...1895client # [ 1.675744] systemd[1]: Starting Journal Service...1896worker2 # [ 1.691374] systemd[1]: Queued start job for default target Initrd Default Target.1897worker1 # [ 1.702788] systemd[1]: Starting Load Kernel Modules...1898worker2 # [ 1.695180] systemd[1]: Created slice Slice /system/modprobe.1899lb # [ 1.680957] systemd[1]: bpf-restrict-fs: LSM BPF program attached1900worker2 # [ 1.696335] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1901client # [ 1.702738] systemd[1]: Starting Load Kernel Modules...1902worker2 # [ 1.697724] systemd[1]: Expecting device /dev/disk/by-label/nixos...1903worker2 # [ 1.698876] systemd[1]: Reached target Path Units.1904worker2 # [ 1.699790] systemd[1]: Reached target Slice Units.1905worker1 # [ 1.707369] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1906worker2 # [ 1.700666] systemd[1]: Reached target Swaps.1907worker2 # [ 1.701432] systemd[1]: Reached target Timer Units.1908client # [ 1.706657] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1909worker2 # [ 1.702359] systemd[1]: Listening on D-Bus System Message Bus Socket.1910worker2 # [ 1.703541] systemd[1]: Listening on Journal Socket (/dev/log).1911worker2 # [ 1.704647] systemd[1]: Listening on Journal Sockets.1912worker2 # [ 1.705601] systemd[1]: Listening on udev Control Socket.1913worker2 # [ 1.706567] systemd[1]: Listening on udev Kernel Socket.1914worker1 # [ 1.715305] systemd[1]: Starting Coldplug All udev Devices...1915worker2 # [ 1.707471] systemd[1]: Reached target Socket Units.1916client # [ 1.713741] systemd[1]: Starting Coldplug All udev Devices...1917worker2 # [ 1.709283] systemd[1]: Starting Create List of Static Device Nodes...1918worker2 # [ 1.713894] systemd[1]: Starting Load Kernel Module configfs...1919worker1 # [ 1.726746] systemd-journald[66]: Collecting audit messages is disabled.1920worker1 # [ 1.728196] systemd[1]: Finished Create List of Static Device Nodes.1921client # [ 1.726968] systemd-journald[66]: Collecting audit messages is disabled.1922client # [ 1.728849] systemd[1]: Finished Create List of Static Device Nodes.1923worker1 # [ 1.733841] systemd[1]: modprobe@configfs.service: Deactivated successfully.1924client # [ 1.735209] systemd[1]: modprobe@configfs.service: Deactivated successfully.1925worker1 # [ 1.739295] systemd[1]: Finished Load Kernel Module configfs.1926worker2 # [ 1.720501] systemd[1]: Starting Journal Service...1927client # [ 1.741968] systemd[1]: Finished Load Kernel Module configfs.1928worker1 # [ 1.744635] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1929client # [ 1.747996] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1930worker1 # [ 1.754303] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1931lb # [ 1.735058] systemd[1]: Queued start job for default target Initrd Default Target.1932worker2 # [ 1.749039] systemd[1]: Starting Load Kernel Modules...1933lb # [ 1.739756] systemd[1]: Created slice Slice /system/modprobe.1934worker2 # [ 1.752932] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1935client # [ 1.758639] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1936lb # [ 1.741040] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1937lb # [ 1.742503] systemd[1]: Expecting device /dev/disk/by-label/nixos...1938lb # [ 1.743676] systemd[1]: Reached target Path Units.1939worker1 # [ 1.764354] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1940lb # [ 1.744646] systemd[1]: Reached target Slice Units.1941lb # [ 1.745564] systemd[1]: Reached target Swaps.1942lb # [ 1.746420] systemd[1]: Reached target Timer Units.1943worker2 # [ 1.760081] systemd[1]: Starting Coldplug All udev Devices...1944lb # [ 1.747455] systemd[1]: Listening on D-Bus System Message Bus Socket.1945lb # [ 1.748695] systemd[1]: Listening on Journal Socket (/dev/log).1946lb # [ 1.749916] systemd[1]: Listening on Journal Sockets.1947lb # [ 1.750969] systemd[1]: Listening on udev Control Socket.1948lb # [ 1.752033] systemd[1]: Listening on udev Kernel Socket.1949client # [ 1.769342] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1950lb # [ 1.752989] systemd[1]: Reached target Socket Units.1951worker1 # [ 1.775553] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1952lb # [ 1.754879] systemd[1]: Starting Create List of Static Device Nodes...1953worker2 # [ 1.771512] systemd-journald[66]: Collecting audit messages is disabled.1954lb # [ 1.759463] systemd[1]: Starting Load Kernel Module configfs...1955client # [ 1.779764] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1956worker2 # [ 1.780133] systemd[1]: Finished Create List of Static Device Nodes.1957worker2 # [ 1.786536] systemd[1]: modprobe@configfs.service: Deactivated successfully.1958worker1 # [ 1.796327] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1959lb # [ 1.769075] systemd[1]: Starting Journal Service...1960worker2 # [ 1.794203] systemd[1]: Finished Load Kernel Module configfs.1961worker1 # [ 1.804421] systemd[1]: Starting Create Static Device Nodes in /dev...1962client # [ 1.802171] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1963worker2 # [ 1.798271] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1964lb # [ 1.794638] systemd[1]: Starting Load Kernel Modules...1965worker1 # [ 1.817297] systemd[1]: Finished Load Kernel Modules.1966worker2 # [ 1.809893] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1967client # [ 1.815658] systemd[1]: Starting Create Static Device Nodes in /dev...1968lb # [ 1.798505] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1969worker2 # [ 1.814535] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1970worker1 # [ 1.825452] systemd[1]: Starting Apply Kernel Variables...1971client # [ 1.823109] systemd[1]: Finished Load Kernel Modules.1972lb # [ 1.806584] systemd[1]: Starting Coldplug All udev Devices...1973worker2 # [ 1.823877] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1974client # [ 1.835836] systemd[1]: Starting Apply Kernel Variables...1975lb # [ 1.817922] systemd-journald[66]: Collecting audit messages is disabled.1976lb # [ 1.819906] systemd[1]: Finished Create List of Static Device Nodes.1977worker1 # [ 1.844371] systemd[1]: Started Journal Service.1978worker1 # [ 1.711105] systemd-modules-load[67]: Inserted module 'dm_mod'1979worker1 # [ 1.714313] systemd-modules-load[67]: Inserted module 'virtio_balloon'1980lb # [ 1.827531] systemd[1]: modprobe@configfs.service: Deactivated successfully.1981worker1 # [ 1.715375] systemd-modules-load[67]: Inserted module 'virtio_gpu'1982worker1 # [ 1.717322] systemd[1]: Finished Create Static Device Nodes in /dev.1983client # [ 1.716276] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.850964] systemd[1]: Started Journal Service.1984client # 1985lb # [ 1.833474] systemd[1]: Finished Load Kernel Module configfs.1986client # [ 1.719584] systemd-modules-load[68]: Inserted module 'virtio_balloon'1987client # [ 1.721547] systemd-modules-load[68]: Inserted module 'virtio_gpu'1988worker1 # [ 1.724065] systemd[1]: Reached target Preparation for Local File Systems.1989worker1 # [ 1.725308] systemd[1]: Reached target Local File Systems.1990lb # [ 1.839821] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1991worker1 # [ 1.728741] systemd[1]: Starting Create System Files and Directories...1992worker2 # [ 1.855940] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1993worker1 # [ 1.735812] systemd[1]: Starting Rule-based Manager for Device Events and Files...1994client # [ 1.736102] systemd[1]: Finished Create Static Device Nodes in /dev.1995worker2 # [ 1.865093] systemd[1]: Starting Create Static Device Nodes in /dev...1996client # [ 1.737154] systemd[1]: Reached target Preparation for Local File Systems.1997client # [ 1.738103] systemd[1]: Reached target Local File Systems.1998worker1 # [ 1.740911] systemd[1]: Finished Apply Kernel Variables.1999lb # [ 1.853472] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...2000client # [ 1.742097] systemd[1]: Starting Create System Files and Directories...
loading 2,615 hidden lines…
4616worker1 # [ 33.538487] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486784617worker1 # [ 33.566262] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04618worker1 # [ 33.568325] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14619worker1 # [ 33.615928] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486784620worker1 # [ 33.628822] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486784621client # copying 1 paths to 'lb:50051'...4622client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4623worker1 # [ 33.640767] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486784624worker1 # [ 33.653359] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4625worker1 # [ 33.680484] nix-grpc-daemon[724]: ts=2026-09-22T16:58:33Z level=info event=niks3_push_started pid=8764626worker1 # [ 33.823300] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.075Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""4627worker1 # [ 33.912688] nix-daemon[861]: accepted connection from pid 889, user nix-grpc-daemon (trusted)4628worker1 # [ 33.926223] nix-daemon[861]: reaped child process 892, status = succeeded4629lb # [ 33.914861] niks3-server[980]: 2026/09/22 16:58:34 INFO Received uploads request method=POST path=/api/pending_closures4630worker1 # [ 33.949643] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.202Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4631worker1 # [ 33.951441] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.204Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4632lb # [ 33.962190] niks3-server[980]: 2026/09/22 16:58:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4633lb # [ 33.977995] niks3-server[980]: 2026/09/22 16:58:34 INFO Signed narinfos id=1 count=14634worker1 # [ 34.003221] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.255Z level=INFO msg="Uploading 1 narinfos"4635lb # [ 33.996484] niks3-server[980]: 2026/09/22 16:58:34 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4636lb # [ 34.000899] niks3-server[980]: 2026/09/22 16:58:34 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4637lb # [ 34.012211] niks3-server[980]: 2026/09/22 16:58:34 INFO Completed upload id=14638worker1 # [ 34.033059] nix-grpc-daemon[876]: time=2026-09-22T16:58:34.285Z level=INFO msg="Upload complete. (204ms)"4639lb # [ 34.018827] niks3-server[980]: 2026/09/22 16:58:34 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4640worker1 # [ 34.038942] nix-grpc-daemon[724]: ts=2026-09-22T16:58:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=5044641worker1 # [ 34.046122] nix-grpc-daemon[724]: ts=2026-09-22T16:58:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486784642worker1 # [ 34.058975] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4643worker1 # [ 34.070228] nix-daemon[861]: reaped child process 874, status = succeeded4644worker1 # [ 34.074060] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4645client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4646client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4647client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4648lb # [ 35.156617] envoy[907]: conn peer=[2001:db8:1::1]:51788 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=16334649client # farm-a> LOG-farm-a-t14650lb # [ 35.161338] envoy[907]: conn peer=[2001:db8:1::1]:59404 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=362 ms=394651lb # [ 35.164731] envoy[907]: conn peer=[2001:db8:1::1]:59418 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=94652lb # [ 35.168587] envoy[907]: conn peer=[2001:db8:1::1]:59426 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84653worker1 # [ 35.307965] nix-daemon[861]: reaped child process 896, status = succeeded4654worker1 # [ 35.386731] nix-daemon[861]: accepted connection from pid 913, user nix-grpc-daemon (trusted)4655worker1 # [ 35.397618] nix-daemon[861]: reaped child process 916, status = succeeded4656lb # [ 35.384683] niks3-server[980]: 2026/09/22 16:58:35 INFO Received uploads request method=POST path=/api/pending_closures4657worker1 # [ 35.412269] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.664Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4658worker1 # [ 35.415953] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.666Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4659lb # [ 35.408632] niks3-server[980]: 2026/09/22 16:58:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4660worker1 # [ 35.434781] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.687Z level=INFO msg="Uploading 1 narinfos"4661lb # [ 35.414933] niks3-server[980]: 2026/09/22 16:58:35 INFO Signed narinfos id=2 count=14662lb # [ 35.418268] niks3-server[980]: 2026/09/22 16:58:35 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4663lb # [ 35.420763] niks3-server[980]: 2026/09/22 16:58:35 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4664lb # [ 35.426395] niks3-server[980]: 2026/09/22 16:58:35 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4665lb # [ 35.428460] niks3-server[980]: 2026/09/22 16:58:35 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4666lb # [ 35.433978] niks3-server[980]: 2026/09/22 16:58:35 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4667lb # [ 35.437853] niks3-server[980]: 2026/09/22 16:58:35 INFO Completed upload id=24668worker1 # [ 35.458385] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.710Z level=INFO msg="Upload complete. (175ms)"4669worker1 # [ 35.462553] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14670worker1 # [ 35.469392] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04671worker1 # [ 35.471316] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14672worker1 # [ 35.475211] nix-daemon[861]: reaped child process 894, status = succeeded4673worker1 # [ 35.512944] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486784674worker1 # [ 35.529519] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486784675worker1 # [ 35.543292] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.795Z level=INFO msg="All 1 paths already cached"4676client # copying 1 paths to 'lb:50051'...4677worker1 # [ 35.551662] nix-grpc-daemon[724]: ts=2026-09-22T16:58:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486784678client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4679worker1 # [ 35.570430] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4680worker1 # [ 35.666500] nix-daemon[861]: accepted connection from pid 922, user nix-grpc-daemon (trusted)4681worker1 # [ 35.678990] nix-daemon[861]: reaped child process 925, status = succeeded4682lb # [ 35.665503] niks3-server[980]: 2026/09/22 16:58:36 INFO Received uploads request method=POST path=/api/pending_closures4683worker1 # [ 35.695147] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.947Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4684worker1 # [ 35.696646] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.949Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4685lb # [ 35.699848] niks3-server[980]: 2026/09/22 16:58:36 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4686lb # [ 35.706864] niks3-server[980]: 2026/09/22 16:58:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4687lb # [ 35.712282] niks3-server[980]: 2026/09/22 16:58:36 INFO Signed narinfos id=3 count=14688worker1 # [ 35.736385] nix-grpc-daemon[876]: time=2026-09-22T16:58:35.988Z level=INFO msg="Uploading 1 narinfos"4689lb # [ 35.728501] niks3-server[980]: 2026/09/22 16:58:36 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4690lb # [ 35.735796] niks3-server[980]: 2026/09/22 16:58:36 INFO Completed upload id=34691worker1 # [ 35.759341] nix-grpc-daemon[876]: time=2026-09-22T16:58:36.011Z level=INFO msg="Upload complete. (176ms)"4692lb # [ 35.739740] niks3-server[980]: 2026/09/22 16:58:36 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4693lb # [ 35.744391] niks3-server[980]: 2026/09/22 16:58:36 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4694worker1 # [ 35.763960] nix-grpc-daemon[724]: ts=2026-09-22T16:58:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=6244695worker1 # [ 35.771315] nix-grpc-daemon[724]: ts=2026-09-22T16:58:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486784696worker1 # [ 35.779135] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4697worker1 # [ 35.790254] nix-daemon[861]: reaped child process 920, status = succeeded4698worker1 # [ 35.794268] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4699client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4700client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4701client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4702client # farm-b> LOG-farm-b-t14703worker1 # [ 37.224447] nix-daemon[861]: reaped child process 929, status = succeeded4704worker1 # [ 37.310260] nix-daemon[861]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4705worker1 # [ 37.322317] nix-daemon[861]: reaped child process 948, status = succeeded4706lb # [ 37.311628] niks3-server[980]: 2026/09/22 16:58:37 INFO Received uploads request method=POST path=/api/pending_closures4707worker1 # [ 37.342952] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.595Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4708worker1 # [ 37.344691] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.597Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4709lb # [ 37.359127] niks3-server[980]: 2026/09/22 16:58:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4710lb # [ 37.363155] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4711lb # [ 37.368261] niks3-server[980]: 2026/09/22 16:58:37 INFO Signed narinfos id=4 count=14712worker1 # [ 37.391641] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.643Z level=INFO msg="Uploading 1 narinfos"4713lb # [ 37.375456] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4714lb # [ 37.380816] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4715lb # [ 37.388412] niks3-server[980]: 2026/09/22 16:58:37 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4716lb # [ 37.394076] niks3-server[980]: 2026/09/22 16:58:37 INFO Completed upload id=44717lb # [ 37.395471] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4718worker1 # [ 37.416125] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.668Z level=INFO msg="Upload complete. (214ms)"4719worker1 # [ 37.424601] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14720worker1 # [ 37.435416] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04721worker1 # [ 37.439198] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14722worker1 # [ 37.448072] nix-daemon[861]: reaped child process 927, status = succeeded4723worker1 # [ 37.478524] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486784724worker1 # [ 37.490604] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486784725worker1 # [ 37.506119] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.758Z level=INFO msg="All 2 paths already cached"4726client # copying 1 paths to 'lb:50051'...4727client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4728worker1 # [ 37.514835] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486784729worker1 # [ 37.524348] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4730worker1 # [ 37.618111] nix-daemon[861]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4731worker1 # [ 37.630303] nix-daemon[861]: reaped child process 957, status = succeeded4732lb # [ 37.617332] niks3-server[980]: 2026/09/22 16:58:37 INFO Received uploads request method=POST path=/api/pending_closures4733worker1 # [ 37.647033] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.899Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4734worker1 # [ 37.648517] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.901Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4735lb # [ 37.651659] niks3-server[980]: 2026/09/22 16:58:37 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4736lb # [ 37.659275] niks3-server[980]: 2026/09/22 16:58:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4737lb # [ 37.664232] niks3-server[980]: 2026/09/22 16:58:38 INFO Signed narinfos id=5 count=14738worker1 # [ 37.687688] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.940Z level=INFO msg="Uploading 1 narinfos"4739lb # [ 37.676612] niks3-server[980]: 2026/09/22 16:58:38 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4740lb # [ 37.693185] niks3-server[980]: 2026/09/22 16:58:38 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4741lb # [ 37.698690] niks3-server[980]: 2026/09/22 16:58:38 INFO Completed upload id=54742worker1 # [ 37.719291] nix-grpc-daemon[876]: time=2026-09-22T16:58:37.971Z level=INFO msg="Upload complete. (183ms)"4743lb # [ 37.700788] niks3-server[980]: 2026/09/22 16:58:38 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4744worker1 # [ 37.724146] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=7524745worker1 # [ 37.731108] nix-grpc-daemon[724]: ts=2026-09-22T16:58:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486784746worker1 # [ 37.740661] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4747worker1 # [ 37.751266] nix-daemon[861]: reaped child process 952, status = succeeded4748client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4749worker1 # [ 37.758671] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4750client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4751client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4752client # farm-top> LOG-farm-top-t14753worker1 # [ 39.006758] nix-daemon[861]: reaped child process 961, status = succeeded4754worker1 # [ 39.080430] nix-daemon[861]: accepted connection from pid 978, user nix-grpc-daemon (trusted)4755worker1 # [ 39.093076] nix-daemon[861]: reaped child process 981, status = succeeded4756lb # [ 39.078443] niks3-server[980]: 2026/09/22 16:58:39 INFO Received uploads request method=POST path=/api/pending_closures4757worker1 # [ 39.111559] nix-grpc-daemon[876]: time=2026-09-22T16:58:39.363Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4758worker1 # [ 39.114566] nix-grpc-daemon[876]: time=2026-09-22T16:58:39.365Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4759lb # [ 39.121172] niks3-server[980]: 2026/09/22 16:58:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4760lb # [ 39.125138] niks3-server[980]: 2026/09/22 16:58:39 INFO Signed narinfos id=6 count=14761worker1 # [ 39.148925] nix-grpc-daemon[876]: time=2026-09-22T16:58:39.401Z level=INFO msg="Uploading 1 narinfos"4762lb # [ 39.137301] niks3-server[980]: 2026/09/22 16:58:39 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4763lb # [ 39.142857] niks3-server[980]: 2026/09/22 16:58:39 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4764lb # [ 39.151313] niks3-server[980]: 2026/09/22 16:58:39 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4765lb # [ 39.155438] niks3-server[980]: 2026/09/22 16:58:39 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4766lb # [ 39.158358] niks3-server[980]: 2026/09/22 16:58:39 INFO Completed upload id=64767worker1 # [ 39.180586] nix-grpc-daemon[876]: time=2026-09-22T16:58:39.433Z level=INFO msg="Upload complete. (213ms)"4768lb # [ 39.162077] niks3-server[980]: 2026/09/22 16:58:39 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4769worker1 # [ 39.188492] nix-grpc-daemon[724]: ts=2026-09-22T16:58:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14770worker1 # [ 39.202717] nix-daemon[861]: reaped child process 959, status = succeeded4771client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 5.81 seconds)4772client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath4773client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.10 seconds)4774client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4775client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds)4776client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4777client # copying 3 paths...4778client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4779client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4780client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4781client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.16 seconds)4782(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.14 seconds)4783subtest: repeat is answered Cached by the scheduler without building4784worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4785worker1 # finding garbage collector roots...4786worker1 # deleting specified paths...4787worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4788worker1 # deleting unused links...4789worker1 # note: hard linking is currently saving 0.0 KiB4790worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.15 seconds)4791worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4792worker2 # finding garbage collector roots...4793worker2 # deleting specified paths...4794worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4795worker2 # deleting unused links...4796worker2 # note: hard linking is currently saving 0.0 KiB4797worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.17 seconds)4798client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&24799client # don't know how to build these paths:4800client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4801worker2 # [ 39.974948] nix-grpc-daemon[783]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:467864802worker1 # [ 39.986712] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486784803worker1 # [ 39.992495] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.245Z level=INFO msg="All 2 paths already cached"4804worker1 # [ 40.002038] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14805client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.15 seconds)4806client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath4807client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.09 seconds)4808lb: must succeed: curl -sf localhost:9901/clusters4809lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4810lb: must succeed: curl -sf localhost:9901/clusters4811lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4812worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4813worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4814(finished: subtest: repeat is answered Cached by the scheduler without building, in 0.74 seconds)4815subtest: inputs already in the cache are not sent to the scheduler4816lb: must succeed: curl -sf localhost:9901/clusters4817lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4818lb: must succeed: curl -sf localhost:9901/clusters4819lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)4820worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4821worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds)4822client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&24823client # don't know how to build these paths:4824client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4825worker1 # [ 40.502261] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:486784826worker2 # [ 40.497411] nix-grpc-daemon[783]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467864827worker1 # [ 40.526474] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04828worker1 # [ 40.533328] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14829worker1 # [ 40.537865] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486784830worker1 # [ 40.545716] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486784831worker1 # [ 40.558756] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.810Z level=INFO msg="All 2 paths already cached"4832client # copying 1 paths to 'lb:50051'...4833client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4834worker1 # [ 40.566386] nix-grpc-daemon[724]: ts=2026-09-22T16:58:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486784835worker1 # [ 40.577292] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4836worker1 # [ 40.668424] nix-daemon[861]: accepted connection from pid 1010, user nix-grpc-daemon (trusted)4837worker1 # [ 40.680609] nix-daemon[861]: reaped child process 1013, status = succeeded4838lb # [ 40.667785] niks3-server[980]: 2026/09/22 16:58:41 INFO Received uploads request method=POST path=/api/pending_closures4839worker1 # [ 40.696809] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.949Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4840worker1 # [ 40.698483] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.950Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4841lb # [ 40.700728] niks3-server[980]: 2026/09/22 16:58:41 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4842lb # [ 40.710378] niks3-server[980]: 2026/09/22 16:58:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4843lb # [ 40.715736] niks3-server[980]: 2026/09/22 16:58:41 INFO Signed narinfos id=7 count=14844worker1 # [ 40.739292] nix-grpc-daemon[876]: time=2026-09-22T16:58:40.991Z level=INFO msg="Uploading 1 narinfos"4845lb # [ 40.724194] niks3-server[980]: 2026/09/22 16:58:41 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4846lb # [ 40.734067] niks3-server[980]: 2026/09/22 16:58:41 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4847lb # [ 40.741224] niks3-server[980]: 2026/09/22 16:58:41 INFO Completed upload id=74848worker1 # [ 40.761878] nix-grpc-daemon[876]: time=2026-09-22T16:58:41.014Z level=INFO msg="Upload complete. (173ms)"4849lb # [ 40.744354] niks3-server[980]: 2026/09/22 16:58:41 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4850worker1 # [ 40.766595] nix-grpc-daemon[724]: ts=2026-09-22T16:58:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=7524851worker1 # [ 40.772168] nix-grpc-daemon[724]: ts=2026-09-22T16:58:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486784852worker1 # [ 40.782142] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4853worker1 # [ 40.791911] nix-daemon[861]: reaped child process 1008, status = succeeded4854client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4855worker1 # [ 40.794827] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)4856client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4857client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4858client # farm-top> LOG-farm-top-t1b4859worker1 # [ 41.609413] nix-daemon[861]: reaped child process 1017, status = succeeded4860worker1 # [ 41.684133] nix-daemon[861]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4861worker1 # [ 41.697047] nix-daemon[861]: reaped child process 1037, status = succeeded4862lb # [ 41.684996] niks3-server[980]: 2026/09/22 16:58:42 INFO Received uploads request method=POST path=/api/pending_closures4863worker1 # [ 41.715323] nix-grpc-daemon[876]: time=2026-09-22T16:58:41.967Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4864worker1 # [ 41.717437] nix-grpc-daemon[876]: time=2026-09-22T16:58:41.969Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4865lb # [ 41.730238] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4866lb # [ 41.738060] niks3-server[980]: 2026/09/22 16:58:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4867worker1 # [ 41.768307] nix-grpc-daemon[876]: time=2026-09-22T16:58:42.020Z level=INFO msg="Uploading 1 narinfos"4868lb # [ 41.747707] niks3-server[980]: 2026/09/22 16:58:42 INFO Signed narinfos id=8 count=14869lb # [ 41.751605] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4870lb # [ 41.756127] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4871lb # [ 41.766517] niks3-server[980]: 2026/09/22 16:58:42 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4872lb # [ 41.769451] niks3-server[980]: 2026/09/22 16:58:42 INFO Completed upload id=84873worker1 # [ 41.791218] nix-grpc-daemon[876]: time=2026-09-22T16:58:42.043Z level=INFO msg="Upload complete. (190ms)"4874lb # [ 41.774069] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4875worker1 # [ 41.799301] nix-grpc-daemon[724]: ts=2026-09-22T16:58:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14876worker1 # [ 41.812424] nix-daemon[861]: reaped child process 1015, status = succeeded4877client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.47 seconds)4878client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath4879client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.10 seconds)4880lb: must succeed: curl -sf localhost:9901/clusters4881lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4882lb: must succeed: curl -sf localhost:9901/clusters4883lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)4884worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4885worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.02 seconds)4886(finished: subtest: inputs already in the cache are not sent to the scheduler, in 1.72 seconds)4887subtest: outputs read back through any worker carry the cache signature4888client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&24889worker2 # [ 42.107187] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:467864890client # don't know how to build these paths:4891client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv4892worker2 # [ 42.115575] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467864893worker1 # [ 42.144260] nix-grpc-daemon[724]: ts=2026-09-22T16:58:42Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=04894worker1 # [ 42.148337] nix-grpc-daemon[724]: ts=2026-09-22T16:58:42Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.4:50051 clients=14895worker2 # [ 42.148248] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467864896worker2 # [ 42.159732] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467864897client # copying 1 paths to 'lb:50051'...4898client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'...4899worker2 # [ 42.170965] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:467864900worker2 # [ 42.182190] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4901worker2 # [ 42.201798] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=info event=niks3_push_started pid=8774902worker2 # [ 42.323501] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.616Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""4903worker2 # [ 42.412828] nix-daemon[851]: accepted connection from pid 890, user nix-grpc-daemon (trusted)4904worker2 # [ 42.426177] nix-daemon[851]: reaped child process 893, status = succeeded4905lb # [ 42.418868] niks3-server[980]: 2026/09/22 16:58:42 INFO Received uploads request method=POST path=/api/pending_closures4906worker2 # [ 42.440372] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.733Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4907worker2 # [ 42.441838] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.735Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)"4908lb # [ 42.460371] niks3-server[980]: 2026/09/22 16:58:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4909lb # [ 42.465558] niks3-server[980]: 2026/09/22 16:58:42 INFO Signed narinfos id=9 count=14910worker2 # [ 42.482716] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.775Z level=INFO msg="Uploading 1 narinfos"4911lb # [ 42.471793] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls4912lb # [ 42.484503] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst4913lb # [ 42.492700] niks3-server[980]: 2026/09/22 16:58:42 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4914lb # [ 42.499608] niks3-server[980]: 2026/09/22 16:58:42 INFO Completed upload id=94915worker2 # [ 42.514455] nix-grpc-daemon[877]: time=2026-09-22T16:58:42.807Z level=INFO msg="Upload complete. (186ms)"4916lb # [ 42.504109] niks3-server[980]: 2026/09/22 16:58:42 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo4917worker2 # [ 42.517759] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=5044918worker2 # [ 42.525297] nix-grpc-daemon[783]: ts=2026-09-22T16:58:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467864919worker2 # [ 42.535321] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4920worker2 # [ 42.539132] nix-daemon[851]: reaped child process 875, status = succeeded4921worker2 # [ 42.542684] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4922client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051...4923client # farm-a> worker2: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv4924client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4925client # farm-a> LOG-farm-a-sig4926worker2 # [ 43.576091] nix-daemon[851]: reaped child process 897, status = succeeded4927worker2 # [ 43.645419] nix-daemon[851]: accepted connection from pid 913, user nix-grpc-daemon (trusted)4928worker2 # [ 43.656790] nix-daemon[851]: reaped child process 916, status = succeeded4929lb # [ 43.652837] niks3-server[980]: 2026/09/22 16:58:43 INFO Received uploads request method=POST path=/api/pending_closures4930worker2 # [ 43.678148] nix-grpc-daemon[877]: time=2026-09-22T16:58:43.971Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4931worker2 # [ 43.679875] nix-grpc-daemon[877]: time=2026-09-22T16:58:43.972Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)"4932lb # [ 43.698633] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv4933lb # [ 43.704609] niks3-server[980]: 2026/09/22 16:58:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4934lb # [ 43.713224] niks3-server[980]: 2026/09/22 16:58:44 INFO Signed narinfos id=10 count=14935worker2 # [ 43.726346] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.019Z level=INFO msg="Uploading 1 narinfos"4936lb # [ 43.717822] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4937lb # [ 43.729149] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls4938lb # [ 43.736518] niks3-server[980]: 2026/09/22 16:58:44 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4939lb # [ 43.741198] niks3-server[980]: 2026/09/22 16:58:44 INFO Completed upload id=104940lb # [ 43.743414] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo4941worker2 # [ 43.755396] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.048Z level=INFO msg="Upload complete. (205ms)"4942worker2 # [ 43.761920] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=14943worker1 # [ 43.775458] nix-grpc-daemon[724]: ts=2026-09-22T16:58:44Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=04944worker1 # [ 43.779589] nix-grpc-daemon[724]: ts=2026-09-22T16:58:44Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=14945worker2 # [ 43.777338] nix-daemon[851]: reaped child process 895, status = succeeded4946worker2 # [ 43.811636] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467864947worker2 # [ 43.824430] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467864948worker2 # [ 43.838476] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.131Z level=INFO msg="All 1 paths already cached"4949client # copying 1 paths to 'lb:50051'...4950client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'...4951worker2 # [ 43.847194] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:467864952worker2 # [ 43.857131] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4953worker2 # [ 43.954796] nix-daemon[851]: accepted connection from pid 920, user nix-grpc-daemon (trusted)4954worker2 # [ 43.967598] nix-daemon[851]: reaped child process 923, status = succeeded4955lb # [ 43.963602] niks3-server[980]: 2026/09/22 16:58:44 INFO Received uploads request method=POST path=/api/pending_closures4956worker2 # [ 43.985547] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.278Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4957worker2 # [ 43.987225] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.280Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)"4958lb # [ 43.996587] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst4959lb # [ 44.006100] niks3-server[980]: 2026/09/22 16:58:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4960worker2 # [ 44.024918] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.318Z level=INFO msg="Uploading 1 narinfos"4961lb # [ 44.012529] niks3-server[980]: 2026/09/22 16:58:44 INFO Signed narinfos id=11 count=14962lb # [ 44.016812] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls4963lb # [ 44.032750] niks3-server[980]: 2026/09/22 16:58:44 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4964lb # [ 44.041322] niks3-server[980]: 2026/09/22 16:58:44 INFO Completed upload id=114965worker2 # [ 44.054094] nix-grpc-daemon[877]: time=2026-09-22T16:58:44.347Z level=INFO msg="Upload complete. (185ms)"4966lb # [ 44.044670] niks3-server[980]: 2026/09/22 16:58:44 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo4967worker2 # [ 44.058520] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=6244968worker2 # [ 44.064351] nix-grpc-daemon[783]: ts=2026-09-22T16:58:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467864969worker2 # [ 44.077820] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4970worker2 # [ 44.085215] nix-daemon[851]: reaped child process 918, status = succeeded4971client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051...4972client # farm-b> worker2: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv4973worker2 # [ 44.089252] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4974client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4975lb # [ 45.157357] envoy[907]: conn peer=[2001:db8:1::1]:59440 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=4416 ms=56774976lb # [ 45.161450] envoy[907]: conn peer=[2001:db8:1::1]:59448 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=479 ms=324977lb # [ 45.165072] envoy[907]: conn peer=[2001:db8:1::1]:59456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4178 tx=1902 ms=13064978client # farm-b> LOG-farm-b-sig4979worker2 # [ 45.303453] nix-daemon[851]: reaped child process 927, status = succeeded4980worker2 # [ 45.380258] nix-daemon[851]: accepted connection from pid 943, user nix-grpc-daemon (trusted)4981worker2 # [ 45.392756] nix-daemon[851]: reaped child process 946, status = succeeded4982lb # [ 45.388411] niks3-server[980]: 2026/09/22 16:58:45 INFO Received uploads request method=POST path=/api/pending_closures4983worker2 # [ 45.410676] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.703Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4984worker2 # [ 45.412228] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.705Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)"4985lb # [ 45.431483] niks3-server[980]: 2026/09/22 16:58:45 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv4986lb # [ 45.441573] niks3-server[980]: 2026/09/22 16:58:45 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst4987lb # [ 45.451450] niks3-server[980]: 2026/09/22 16:58:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4988lb # [ 45.456839] niks3-server[980]: 2026/09/22 16:58:45 INFO Signed narinfos id=12 count=14989worker2 # [ 45.470263] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.763Z level=INFO msg="Uploading 1 narinfos"4990lb # [ 45.463379] niks3-server[980]: 2026/09/22 16:58:45 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls4991lb # [ 45.473059] niks3-server[980]: 2026/09/22 16:58:45 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4992lb # [ 45.475749] niks3-server[980]: 2026/09/22 16:58:45 INFO Completed upload id=124993worker2 # [ 45.490073] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.783Z level=INFO msg="Upload complete. (193ms)"4994lb # [ 45.478714] niks3-server[980]: 2026/09/22 16:58:45 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo4995worker2 # [ 45.497146] nix-grpc-daemon[783]: ts=2026-09-22T16:58:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=14996worker1 # [ 45.510733] nix-grpc-daemon[724]: ts=2026-09-22T16:58:45Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=04997worker1 # [ 45.514896] nix-grpc-daemon[724]: ts=2026-09-22T16:58:45Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=14998worker2 # [ 45.511734] nix-daemon[851]: reaped child process 925, status = succeeded4999worker2 # [ 45.546727] nix-grpc-daemon[783]: ts=2026-09-22T16:58:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865000worker2 # [ 45.560311] nix-grpc-daemon[783]: ts=2026-09-22T16:58:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865001worker2 # [ 45.573266] nix-grpc-daemon[877]: time=2026-09-22T16:58:45.866Z level=INFO msg="All 2 paths already cached"5002client # copying 1 paths to 'lb:50051'...5003client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'...5004worker2 # [ 45.583300] nix-grpc-daemon[783]: ts=2026-09-22T16:58:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:467865005worker2 # [ 45.595529] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5006worker2 # [ 45.694708] nix-daemon[851]: accepted connection from pid 950, user nix-grpc-daemon (trusted)5007worker2 # [ 45.707458] nix-daemon[851]: reaped child process 953, status = succeeded5008lb # [ 45.702432] niks3-server[980]: 2026/09/22 16:58:46 INFO Received uploads request method=POST path=/api/pending_closures5009worker2 # [ 45.723225] nix-grpc-daemon[877]: time=2026-09-22T16:58:46.016Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5010worker2 # [ 45.724642] nix-grpc-daemon[877]: time=2026-09-22T16:58:46.017Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)"5011lb # [ 45.736380] niks3-server[980]: 2026/09/22 16:58:46 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls5012lb # [ 45.743928] niks3-server[980]: 2026/09/22 16:58:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign5013worker2 # [ 45.762228] nix-grpc-daemon[877]: time=2026-09-22T16:58:46.055Z level=INFO msg="Uploading 1 narinfos"5014lb # [ 45.750805] niks3-server[980]: 2026/09/22 16:58:46 INFO Signed narinfos id=13 count=15015lb # [ 45.759265] niks3-server[980]: 2026/09/22 16:58:46 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst5016lb # [ 45.772816] niks3-server[980]: 2026/09/22 16:58:46 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete5017lb # [ 45.778148] niks3-server[980]: 2026/09/22 16:58:46 INFO Completed upload id=135018worker2 # [ 45.790836] nix-grpc-daemon[877]: time=2026-09-22T16:58:46.083Z level=INFO msg="Upload complete. (181ms)"5019lb # [ 45.783453] niks3-server[980]: 2026/09/22 16:58:46 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo5020worker2 # [ 45.794762] nix-grpc-daemon[783]: ts=2026-09-22T16:58:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=7525021worker2 # [ 45.799926] nix-grpc-daemon[783]: ts=2026-09-22T16:58:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865022worker2 # [ 45.812246] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5023worker2 # [ 45.820148] nix-daemon[851]: reaped child process 948, status = succeeded5024worker2 # [ 45.824463] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5025client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051...5026client # farm-top> worker2: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv5027client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5028client # farm-top> LOG-farm-top-sig5029worker2 # [ 46.841323] nix-daemon[851]: reaped child process 957, status = succeeded5030worker2 # [ 46.918272] nix-daemon[851]: accepted connection from pid 973, user nix-grpc-daemon (trusted)5031worker2 # [ 46.931197] nix-daemon[851]: reaped child process 976, status = succeeded5032lb # [ 46.926438] niks3-server[980]: 2026/09/22 16:58:47 INFO Received uploads request method=POST path=/api/pending_closures5033worker2 # [ 46.943792] nix-grpc-daemon[877]: time=2026-09-22T16:58:47.236Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5034worker2 # [ 46.945304] nix-grpc-daemon[877]: time=2026-09-22T16:58:47.238Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)"5035lb # [ 46.958697] niks3-server[980]: 2026/09/22 16:58:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign5036lb # [ 46.966915] niks3-server[980]: 2026/09/22 16:58:47 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls5037worker2 # [ 46.985571] nix-grpc-daemon[877]: time=2026-09-22T16:58:47.278Z level=INFO msg="Uploading 1 narinfos"5038lb # [ 46.973111] niks3-server[980]: 2026/09/22 16:58:47 INFO Signed narinfos id=14 count=15039lb # [ 46.975176] niks3-server[980]: 2026/09/22 16:58:47 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst5040lb # [ 46.985148] niks3-server[980]: 2026/09/22 16:58:47 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv5041lb # [ 46.989517] niks3-server[980]: 2026/09/22 16:58:47 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete5042lb # [ 46.993534] niks3-server[980]: 2026/09/22 16:58:47 INFO Completed upload id=145043worker2 # [ 47.006304] nix-grpc-daemon[877]: time=2026-09-22T16:58:47.299Z level=INFO msg="Upload complete. (175ms)"5044lb # [ 46.995695] niks3-server[980]: 2026/09/22 16:58:47 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo5045worker2 # [ 47.009251] nix-grpc-daemon[783]: ts=2026-09-22T16:58:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=15046worker2 # [ 47.017391] nix-daemon[851]: reaped child process 955, status = succeeded5047client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.05 seconds)5048client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath5049client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.11 seconds)5050client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top5051worker1 # [ 47.265731] nix-grpc-daemon[724]: ts=2026-09-22T16:58:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:437105052client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):5053client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a5054client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b5055client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top5056worker1 # [ 47.309525] nix-grpc-daemon[724]: ts=2026-09-22T16:58:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:437105057worker1 # [ 47.316131] nix-grpc-daemon[724]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'...5058worker1 # [ 47.330630] nix-grpc-daemon[724]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'...5059worker1 # [ 47.342794] nix-grpc-daemon[724]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'...5060client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.22 seconds)5061client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top5062worker2 # [ 47.486917] nix-grpc-daemon[783]: ts=2026-09-22T16:58:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:518025063worker2 # [ 47.528290] nix-grpc-daemon[783]: ts=2026-09-22T16:58:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:518025064client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.22 seconds)5065client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top5066client # finding garbage collector roots...5067client # removing stale temporary roots file "/nix/var/nix/temproots/841"5068client # removing stale temporary roots file "/nix/var/nix/temproots/862"5069client # removing stale temporary roots file "/nix/var/nix/temproots/898"5070client # removing stale temporary roots file "/nix/var/nix/temproots/883"5071client # removing stale temporary roots file "/nix/var/nix/temproots/854"5072client # removing stale temporary roots file "/nix/var/nix/temproots/875"5073client # removing stale temporary roots file "/nix/var/nix/temproots/803"5074client # removing stale temporary roots file "/nix/var/nix/temproots/820"5075client # deleting specified paths...5076client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top'5077client # deleting unused links...5078client # note: hard linking is currently saving 0.0 KiB5079worker1 # [ 47.834553] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:486785080worker2 # [ 47.835074] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865081worker2 # [ 47.844094] nix-grpc-daemon[877]: time=2026-09-22T16:58:48.137Z level=INFO msg="All 1 paths already cached"5082worker2 # [ 47.850275] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:467865083worker1 # [ 47.864333] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486785084client # copying 3 paths...5085worker1 # [ 47.873706] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486785086client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'...5087worker1 # [ 47.887329] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:486785088worker2 # [ 47.884210] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:467865089worker1 # [ 47.892849] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_out=2325090worker2 # [ 47.889900] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=1765091worker2 # [ 47.896191] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:467865092worker2 # [ 47.899798] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=1285093client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'...5094client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'...5095client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.38 seconds)5096(finished: subtest: outputs read back through any worker carry the cache signature, in 5.97 seconds)5097subtest: two clients wanting the same drv build it once5098client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup5099client # [ 47.999863] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup.5100client # Running as unit: dedup1.service; invocation ID: 3f937a7ac9d240c4a4321e35b55365745101client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds)5102client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup5103client # [ 48.125140] nix[951]: don't know how to build these paths:5104client # [ 48.126684] nix[951]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv5105worker2 # [ 48.119439] nix-grpc-daemon[783]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:467865106worker1 # [ 48.136319] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=05107worker1 # [ 48.141631] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=15108worker1 # [ 48.184156] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785109worker1 # [ 48.196438] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486785110client # [ 48.204278] nix[951]: copying 1 paths to 'lb:50051'...5111worker1 # [ 48.207601] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486785112client # [ 48.206483] nix[951]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...5113worker1 # [ 48.220102] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5114worker1 # [ 48.325098] nix-daemon[861]: accepted connection from pid 1057, user nix-grpc-daemon (trusted)5115worker1 # [ 48.339392] nix-daemon[861]: reaped child process 1060, status = succeeded5116lb # [ 48.325243] niks3-server[980]: 2026/09/22 16:58:48 INFO Received uploads request method=POST path=/api/pending_closures5117worker1 # [ 48.353827] nix-grpc-daemon[876]: time=2026-09-22T16:58:48.606Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5118worker1 # [ 48.355752] nix-grpc-daemon[876]: time=2026-09-22T16:58:48.607Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"5119lb # [ 48.355370] niks3-server[980]: 2026/09/22 16:58:48 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls5120lb # [ 48.364098] niks3-server[980]: 2026/09/22 16:58:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign5121lb # [ 48.369448] niks3-server[980]: 2026/09/22 16:58:48 INFO Signed narinfos id=15 count=15122worker1 # [ 48.393091] nix-grpc-daemon[876]: time=2026-09-22T16:58:48.645Z level=INFO msg="Uploading 1 narinfos"5123lb # [ 48.375285] niks3-server[980]: 2026/09/22 16:58:48 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst5124lb # [ 48.390326] niks3-server[980]: 2026/09/22 16:58:48 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete5125lb # [ 48.397199] niks3-server[980]: 2026/09/22 16:58:48 INFO Completed upload id=155126worker1 # [ 48.417641] nix-grpc-daemon[876]: time=2026-09-22T16:58:48.670Z level=INFO msg="Upload complete. (186ms)"5127lb # [ 48.399831] niks3-server[980]: 2026/09/22 16:58:48 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo5128worker1 # [ 48.422073] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=4325129worker1 # [ 48.427966] nix-grpc-daemon[724]: ts=2026-09-22T16:58:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785130worker1 # [ 48.437195] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5131worker1 # [ 48.447143] nix-daemon[861]: reaped child process 1055, status = succeeded5132worker1 # [ 48.450434] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5133client # [ 48.447685] nix[951]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...5134client # [ 49.050733] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup.5135client # Running as unit: dedup2.service; invocation ID: 1bcb4381bd244da7981d0b262066bbe35136client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.06 seconds)5137client # [ 49.212413] nix[967]: don't know how to build these paths:5138client # [ 49.213240] nix[967]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv5139worker2 # [ 49.205071] nix-grpc-daemon[783]: ts=2026-09-22T16:58:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:467865140worker1 # [ 49.220698] nix-grpc-daemon[724]: ts=2026-09-22T16:58:49Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=05141worker1 # [ 49.224477] nix-grpc-daemon[724]: ts=2026-09-22T16:58:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785142client # [ 49.224463] nix[967]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...5143client: must succeed: sleep 25144client: (finished: must succeed: sleep 2, in 2.03 seconds)5145client: waiting for success: ! systemctl is-active dedup1 dedup25146worker1 # [ 52.480547] nix-daemon[861]: reaped child process 1064, status = succeeded5147worker1 # [ 52.564794] nix-daemon[861]: accepted connection from pid 1096, user nix-grpc-daemon (trusted)5148worker1 # [ 52.576521] nix-daemon[861]: reaped child process 1099, status = succeeded5149lb # [ 52.564841] niks3-server[980]: 2026/09/22 16:58:52 INFO Received uploads request method=POST path=/api/pending_closures5150worker1 # [ 52.594961] nix-grpc-daemon[876]: time=2026-09-22T16:58:52.847Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5151worker1 # [ 52.596409] nix-grpc-daemon[876]: time=2026-09-22T16:58:52.849Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"5152lb # [ 52.610155] niks3-server[980]: 2026/09/22 16:58:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign5153lb # [ 52.617876] niks3-server[980]: 2026/09/22 16:58:52 INFO Signed narinfos id=16 count=15154worker1 # [ 52.641786] nix-grpc-daemon[876]: time=2026-09-22T16:58:52.894Z level=INFO msg="Uploading 1 narinfos"5155lb # [ 52.629531] niks3-server[980]: 2026/09/22 16:58:52 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst5156lb # [ 52.639783] niks3-server[980]: 2026/09/22 16:58:52 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls5157lb # [ 52.647113] niks3-server[980]: 2026/09/22 16:58:52 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv5158lb # [ 52.652934] niks3-server[980]: 2026/09/22 16:58:52 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete5159lb # [ 52.656670] niks3-server[980]: 2026/09/22 16:58:52 INFO Completed upload id=165160worker1 # [ 52.677354] nix-grpc-daemon[876]: time=2026-09-22T16:58:52.929Z level=INFO msg="Upload complete. (218ms)"5161lb # [ 52.661178] niks3-server[980]: 2026/09/22 16:58:52 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo5162worker1 # [ 52.683801] nix-grpc-daemon[724]: ts=2026-09-22T16:58:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=15163worker1 # [ 52.692660] nix-grpc-daemon[724]: ts=2026-09-22T16:58:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=15164worker1 # [ 52.706072] nix-daemon[861]: reaped child process 1062, status = succeeded5165client # [ 52.729969] systemd[1]: dedup2.service: Deactivated successfully.5166client # [ 52.733617] systemd[1]: dedup2.service: Consumed 136ms CPU time over 3.682s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.6K outgoing IP traffic.5167client # [ 52.740742] systemd[1]: dedup1.service: Deactivated successfully.5168client # [ 52.744243] systemd[1]: dedup1.service: Consumed 113ms CPU time over 4.743s wall clock time, 41.5M memory peak, 7K incoming IP traffic, 8.3K outgoing IP traffic.5169client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds)5170client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }5171client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)5172worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true5173worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)5174worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true5175worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)5176worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5177worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5178worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5179worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5180(finished: subtest: two clients wanting the same drv build it once, in 5.74 seconds)5181subtest: --timeout and --max-silent-time reach the builder5182worker2 # [ 53.862955] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:467865183worker1 # [ 53.884669] nix-grpc-daemon[724]: ts=2026-09-22T16:58:54Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=05184worker2 # [ 53.878901] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865185worker1 # [ 53.888726] nix-grpc-daemon[724]: ts=2026-09-22T16:58:54Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=15186worker2 # [ 53.891346] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865187worker2 # [ 53.902240] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:467865188worker2 # [ 53.913128] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5189worker2 # [ 54.015663] nix-daemon[851]: accepted connection from pid 1001, user nix-grpc-daemon (trusted)5190worker2 # [ 54.029305] nix-daemon[851]: reaped child process 1004, status = succeeded5191lb # [ 54.023512] niks3-server[980]: 2026/09/22 16:58:54 INFO Received uploads request method=POST path=/api/pending_closures5192worker2 # [ 54.043523] nix-grpc-daemon[877]: time=2026-09-22T16:58:54.336Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5193worker2 # [ 54.045404] nix-grpc-daemon[877]: time=2026-09-22T16:58:54.338Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)"5194lb # [ 54.041609] niks3-server[980]: 2026/09/22 16:58:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign5195lb # [ 54.045544] niks3-server[980]: 2026/09/22 16:58:54 INFO Signed narinfos id=17 count=15196worker2 # [ 54.058703] nix-grpc-daemon[877]: time=2026-09-22T16:58:54.351Z level=INFO msg="Uploading 1 narinfos"5197lb # [ 54.051192] niks3-server[980]: 2026/09/22 16:58:54 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5198lb # [ 54.053806] niks3-server[980]: 2026/09/22 16:58:54 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst5199lb # [ 54.058734] niks3-server[980]: 2026/09/22 16:58:54 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls5200lb # [ 54.066191] niks3-server[980]: 2026/09/22 16:58:54 INFO Completed upload id=175201worker2 # [ 54.078848] nix-grpc-daemon[877]: time=2026-09-22T16:58:54.372Z level=INFO msg="Upload complete. (153ms)"5202lb # [ 54.068949] niks3-server[980]: 2026/09/22 16:58:54 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo5203worker2 # [ 54.081068] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=4245204worker2 # [ 54.084432] nix-grpc-daemon[783]: ts=2026-09-22T16:58:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865205worker2 # [ 54.092159] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5206worker2 # [ 54.093471] nix-daemon[851]: reaped child process 999, status = succeeded5207worker2 # [ 54.098815] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5208lb # [ 55.158183] envoy[907]: conn peer=[2001:db8:1::1]:59458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9468 tx=4356 ms=49205209lb # [ 55.161919] envoy[907]: conn peer=[2001:db8:1::1]:36676 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=755210lb # [ 55.165599] envoy[907]: conn peer=[2001:db8:1::1]:36686 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=715211lb # [ 55.169112] envoy[907]: conn peer=[2001:db8:1::1]:36698 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=655212lb # [ 55.173159] envoy[907]: conn peer=[2001:db8:1::1]:36674 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2887 ms=1315213lb # [ 55.176665] envoy[907]: conn peer=[2001:db8:1::1]:36724 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1194 ms=34885214lb # [ 55.180362] envoy[907]: conn peer=[2001:db8:1::1]:36710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2994 tx=1519 ms=45765215worker2 # [ 60.112870] nix-grpc-daemon[783]: ts=2026-09-22T16:59:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=05216worker2 # [ 60.137849] nix-daemon[851]: reaped child process 1006, status = succeeded5217worker2 # [ 60.140635] nix-daemon[851]: reaped child process 1008, status = succeeded5218worker2 # [ 60.310965] nix-grpc-daemon[783]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:467865219worker1 # [ 60.334303] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=05220worker1 # [ 60.338835] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=15221worker1 # [ 60.343663] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785222worker1 # [ 60.355987] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486785223worker1 # [ 60.368100] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486785224worker1 # [ 60.378645] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5225worker1 # [ 60.483063] nix-daemon[861]: accepted connection from pid 1116, user nix-grpc-daemon (trusted)5226worker1 # [ 60.497479] nix-daemon[861]: reaped child process 1119, status = succeeded5227lb # [ 60.482516] niks3-server[980]: 2026/09/22 16:59:00 INFO Received uploads request method=POST path=/api/pending_closures5228worker1 # [ 60.513386] nix-grpc-daemon[876]: time=2026-09-22T16:59:00.765Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5229worker1 # [ 60.514782] nix-grpc-daemon[876]: time=2026-09-22T16:59:00.765Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)"5230lb # [ 60.510194] niks3-server[980]: 2026/09/22 16:59:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5231lb # [ 60.517932] niks3-server[980]: 2026/09/22 16:59:00 INFO Signed narinfos id=18 count=15232worker1 # [ 60.541362] nix-grpc-daemon[876]: time=2026-09-22T16:59:00.793Z level=INFO msg="Uploading 1 narinfos"5233lb # [ 60.526908] niks3-server[980]: 2026/09/22 16:59:00 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls5234lb # [ 60.536642] niks3-server[980]: 2026/09/22 16:59:00 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst5235lb # [ 60.547362] niks3-server[980]: 2026/09/22 16:59:00 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5236lb # [ 60.557909] niks3-server[980]: 2026/09/22 16:59:00 INFO Completed upload id=185237worker1 # [ 60.578837] nix-grpc-daemon[876]: time=2026-09-22T16:59:00.831Z level=INFO msg="Upload complete. (189ms)"5238lb # [ 60.560514] niks3-server[980]: 2026/09/22 16:59:00 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo5239worker1 # [ 60.582967] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=4245240worker1 # [ 60.589600] nix-grpc-daemon[724]: ts=2026-09-22T16:59:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785241worker1 # [ 60.600133] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5242worker1 # [ 60.611269] nix-daemon[861]: reaped child process 1114, status = succeeded5243worker1 # [ 60.614424] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5244lb # [ 65.158574] envoy[907]: conn peer=[2001:db8:1::1]:52398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=936 ms=63035245worker1 # [ 66.425944] nix-grpc-daemon[724]: ts=2026-09-22T16:59:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=05246worker1 # [ 66.438112] nix-daemon[861]: reaped child process 1123, status = succeeded5247worker1 # [ 66.439141] nix-daemon[861]: reaped child process 1121, status = succeeded5248(finished: subtest: --timeout and --max-silent-time reach the builder, in 12.78 seconds)5249subtest: the first client leaving does not fail the second5250client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share5251client # [ 66.518657] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share.5252client # Running as unit: share1.service; invocation ID: f6bc588787e7468fba88b0719a779f8c5253client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.03 seconds)5254client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share5255worker1 # [ 66.648314] nix-grpc-daemon[724]: ts=2026-09-22T16:59:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:486785256client # [ 66.652569] nix[1040]: don't know how to build these paths:5257client # [ 66.653577] nix[1040]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5258worker1 # [ 66.661843] nix-grpc-daemon[724]: ts=2026-09-22T16:59:06Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=05259worker2 # [ 66.657742] nix-grpc-daemon[783]: ts=2026-09-22T16:59:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865260worker1 # [ 66.666426] nix-grpc-daemon[724]: ts=2026-09-22T16:59:06Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=15261worker2 # [ 66.665606] nix-grpc-daemon[783]: ts=2026-09-22T16:59:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865262client # [ 66.678067] nix[1040]: copying 1 paths to 'lb:50051'...5263client # [ 66.678874] nix[1040]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'...5264worker2 # [ 66.673444] nix-grpc-daemon[783]: ts=2026-09-22T16:59:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:467865265worker2 # [ 66.677658] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5266worker2 # [ 66.764687] nix-daemon[851]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)5267worker2 # [ 66.778097] nix-daemon[851]: reaped child process 1034, status = succeeded5268lb # [ 66.771992] niks3-server[980]: 2026/09/22 16:59:07 INFO Received uploads request method=POST path=/api/pending_closures5269worker2 # [ 66.793410] nix-grpc-daemon[877]: time=2026-09-22T16:59:07.086Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5270worker2 # [ 66.795290] nix-grpc-daemon[877]: time=2026-09-22T16:59:07.088Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)"5271lb # [ 66.808745] niks3-server[980]: 2026/09/22 16:59:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5272lb # [ 66.815138] niks3-server[980]: 2026/09/22 16:59:07 INFO Signed narinfos id=19 count=15273worker2 # [ 66.831070] nix-grpc-daemon[877]: time=2026-09-22T16:59:07.124Z level=INFO msg="Uploading 1 narinfos"5274lb # [ 66.825485] niks3-server[980]: 2026/09/22 16:59:07 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst5275lb # [ 66.833622] niks3-server[980]: 2026/09/22 16:59:07 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls5276lb # [ 66.842594] niks3-server[980]: 2026/09/22 16:59:07 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5277lb # [ 66.850907] niks3-server[980]: 2026/09/22 16:59:07 INFO Completed upload id=195278worker2 # [ 66.863835] nix-grpc-daemon[877]: time=2026-09-22T16:59:07.156Z level=INFO msg="Upload complete. (180ms)"5279lb # [ 66.852660] niks3-server[980]: 2026/09/22 16:59:07 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo5280worker2 # [ 66.868442] nix-grpc-daemon[783]: ts=2026-09-22T16:59:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=4325281worker2 # [ 66.874313] nix-grpc-daemon[783]: ts=2026-09-22T16:59:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865282worker2 # [ 66.885669] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5283worker2 # [ 66.893740] nix-daemon[851]: reaped child process 1029, status = succeeded5284worker2 # [ 66.902937] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5285client # [ 66.907310] nix[1040]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051...5286client # [ 67.570561] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share.5287client # Running as unit: share2.service; invocation ID: 72c7e36e245e48448a9bb7000c15a6695288client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds)5289client # [ 67.712740] nix[1056]: don't know how to build these paths:5290worker1 # [ 67.714137] nix-grpc-daemon[724]: ts=2026-09-22T16:59:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:486785291client # [ 67.713643] nix[1056]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5292worker1 # [ 67.719973] nix-grpc-daemon[724]: ts=2026-09-22T16:59:07Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=05293worker2 # [ 67.716390] nix-grpc-daemon[783]: ts=2026-09-22T16:59:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865294client # [ 67.726650] nix[1056]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051...5295client: must succeed: sleep 2; systemctl kill -s INT share15296client # [ 70.795748] systemd[1]: share1.service: Sent signal SIGINT to main process 1040 (nix) on client request.5297client # [ 70.798923] nix[1040]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5298client # [ 70.801676] nix[1040]: error: interrupted by the user5299client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.05 seconds)5300client: waiting for success: ! systemctl is-active share15301client # [ 70.833187] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE5302client # [ 70.834742] systemd[1]: share1.service: Failed with result 'exit-code'.5303client # [ 70.836895] systemd[1]: share1.service: Consumed 104ms CPU time over 4.317s wall clock time, 43.4M memory peak, 6K incoming IP traffic, 8.1K outgoing IP traffic.5304client: (finished: waiting for success: ! systemctl is-active share1, in 1.07 seconds)5305client: waiting for success: ! systemctl is-active share25306worker2 # [ 72.122267] nix-daemon[851]: reaped child process 1038, status = succeeded5307worker2 # [ 72.195662] nix-daemon[851]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)5308worker2 # [ 72.207511] nix-daemon[851]: reaped child process 1075, status = succeeded5309lb # [ 72.203629] niks3-server[980]: 2026/09/22 16:59:12 INFO Received uploads request method=POST path=/api/pending_closures5310worker2 # [ 72.225321] nix-grpc-daemon[877]: time=2026-09-22T16:59:12.518Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5311worker2 # [ 72.227524] nix-grpc-daemon[877]: time=2026-09-22T16:59:12.519Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)"5312lb # [ 72.250430] niks3-server[980]: 2026/09/22 16:59:12 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst5313lb # [ 72.257344] niks3-server[980]: 2026/09/22 16:59:12 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls5314lb # [ 72.265584] niks3-server[980]: 2026/09/22 16:59:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5315lb # [ 72.272405] niks3-server[980]: 2026/09/22 16:59:12 INFO Signed narinfos id=20 count=15316worker2 # [ 72.288270] nix-grpc-daemon[877]: time=2026-09-22T16:59:12.581Z level=INFO msg="Uploading 1 narinfos"5317lb # [ 72.278112] niks3-server[980]: 2026/09/22 16:59:12 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5318lb # [ 72.288920] niks3-server[980]: 2026/09/22 16:59:12 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5319lb # [ 72.294373] niks3-server[980]: 2026/09/22 16:59:12 INFO Completed upload id=205320worker2 # [ 72.307530] nix-grpc-daemon[877]: time=2026-09-22T16:59:12.600Z level=INFO msg="Upload complete. (194ms)"5321lb # [ 72.297152] niks3-server[980]: 2026/09/22 16:59:12 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo5322worker2 # [ 72.313619] nix-grpc-daemon[783]: ts=2026-09-22T16:59:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=15323worker2 # [ 72.321456] nix-grpc-daemon[783]: ts=2026-09-22T16:59:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=15324worker2 # [ 72.333409] nix-daemon[851]: reaped child process 1036, status = succeeded5325client # [ 72.390438] systemd[1]: share2.service: Deactivated successfully.5326client # [ 72.394216] systemd[1]: share2.service: Consumed 119ms CPU time over 4.822s wall clock time, 35.4M memory peak, 6.1K incoming IP traffic, 5.7K outgoing IP traffic.5327client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds)5328client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }5329client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds)5330(finished: subtest: the first client leaving does not fail the second, in 6.66 seconds)5331subtest: build hook: nix-daemon with builders = grpc://lb5332client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log5333client # [ 73.237814] systemd[1]: Started Nix Daemon.5334client # [ 73.325857] nix-daemon[1108]: accepted connection from pid 1105, user root (trusted)5335worker2 # [ 73.434601] nix-grpc-daemon[783]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:467865336worker2 # [ 73.439889] nix-grpc-daemon[783]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865337worker1 # [ 73.455952] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=05338worker1 # [ 73.458289] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=15339worker1 # [ 73.461453] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785340worker1 # [ 73.466851] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486785341worker1 # [ 73.475384] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486785342worker1 # [ 73.483843] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5343worker1 # [ 73.582913] nix-daemon[861]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5344worker1 # [ 73.595590] nix-daemon[861]: reaped child process 1171, status = succeeded5345lb # [ 73.583557] niks3-server[980]: 2026/09/22 16:59:13 INFO Received uploads request method=POST path=/api/pending_closures5346worker1 # [ 73.612388] nix-grpc-daemon[876]: time=2026-09-22T16:59:13.864Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5347worker1 # [ 73.614285] nix-grpc-daemon[876]: time=2026-09-22T16:59:13.866Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"5348lb # [ 73.616162] niks3-server[980]: 2026/09/22 16:59:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5349worker1 # [ 73.644975] nix-grpc-daemon[876]: time=2026-09-22T16:59:13.897Z level=INFO msg="Uploading 1 narinfos"5350lb # [ 73.624706] niks3-server[980]: 2026/09/22 16:59:13 INFO Signed narinfos id=21 count=15351lb # [ 73.635128] niks3-server[980]: 2026/09/22 16:59:13 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst5352lb # [ 73.641817] niks3-server[980]: 2026/09/22 16:59:13 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls5353lb # [ 73.651867] niks3-server[980]: 2026/09/22 16:59:13 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5354lb # [ 73.657781] niks3-server[980]: 2026/09/22 16:59:13 INFO Completed upload id=215355lb # [ 73.660063] niks3-server[980]: 2026/09/22 16:59:13 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo5356worker1 # [ 73.681138] nix-grpc-daemon[876]: time=2026-09-22T16:59:13.932Z level=INFO msg="Upload complete. (183ms)"5357worker1 # [ 73.685762] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=5125358worker1 # [ 73.692379] nix-grpc-daemon[724]: ts=2026-09-22T16:59:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785359worker1 # [ 73.704110] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5360worker1 # [ 73.712764] nix-daemon[861]: reaped child process 1166, status = succeeded5361worker1 # [ 73.717480] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5362lb # [ 75.159531] envoy[907]: conn peer=[2001:db8:1::1]:52410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=933 ms=61205363lb # [ 75.163411] envoy[907]: conn peer=[2001:db8:1::1]:56896 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=794 ms=41645364lb # [ 75.166919] envoy[907]: conn peer=[2001:db8:1::1]:56904 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1453 tx=1220 ms=46575365worker1 # [ 75.356801] nix-daemon[861]: reaped child process 1175, status = succeeded5366worker1 # [ 75.439375] nix-daemon[861]: accepted connection from pid 1191, user nix-grpc-daemon (trusted)5367worker1 # [ 75.452123] nix-daemon[861]: reaped child process 1194, status = succeeded5368lb # [ 75.439363] niks3-server[980]: 2026/09/22 16:59:15 INFO Received uploads request method=POST path=/api/pending_closures5369worker1 # [ 75.469413] nix-grpc-daemon[876]: time=2026-09-22T16:59:15.721Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5370worker1 # [ 75.470886] nix-grpc-daemon[876]: time=2026-09-22T16:59:15.723Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"5371lb # [ 75.485324] niks3-server[980]: 2026/09/22 16:59:15 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst5372lb # [ 75.492091] niks3-server[980]: 2026/09/22 16:59:15 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls5373lb # [ 75.500533] niks3-server[980]: 2026/09/22 16:59:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5374lb # [ 75.507127] niks3-server[980]: 2026/09/22 16:59:15 INFO Signed narinfos id=22 count=15375worker1 # [ 75.527743] nix-grpc-daemon[876]: time=2026-09-22T16:59:15.780Z level=INFO msg="Uploading 1 narinfos"5376lb # [ 75.513567] niks3-server[980]: 2026/09/22 16:59:15 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv5377lb # [ 75.522108] niks3-server[980]: 2026/09/22 16:59:15 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5378lb # [ 75.525633] niks3-server[980]: 2026/09/22 16:59:15 INFO Completed upload id=225379worker1 # [ 75.546460] nix-grpc-daemon[876]: time=2026-09-22T16:59:15.798Z level=INFO msg="Upload complete. (220ms)"5380lb # [ 75.528747] niks3-server[980]: 2026/09/22 16:59:15 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo5381worker1 # [ 75.553213] nix-grpc-daemon[724]: ts=2026-09-22T16:59:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=15382worker1 # [ 75.562567] nix-grpc-daemon[724]: ts=2026-09-22T16:59:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486785383worker1 # [ 75.572108] nix-daemon[861]: reaped child process 1173, status = succeeded5384worker2 # [ 75.571172] nix-grpc-daemon[783]: ts=2026-09-22T16:59:15Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:467865385worker2 # [ 75.580674] nix-grpc-daemon[783]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...5386worker2 # [ 75.593848] nix-grpc-daemon[783]: ts=2026-09-22T16:59:15Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=1285387worker1 # [ 75.801891] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:486785388worker2 # [ 75.797325] nix-grpc-daemon[783]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865389worker2 # [ 75.806292] nix-grpc-daemon[877]: time=2026-09-22T16:59:16.098Z level=INFO msg="All 1 paths already cached"5390worker1 # [ 75.827429] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=05391worker1 # [ 75.832409] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=15392worker1 # [ 75.837148] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785393worker1 # [ 75.846766] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486785394worker1 # [ 75.856795] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.109Z level=INFO msg="All 1 paths already cached"5395worker1 # [ 75.863321] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486785396worker1 # [ 75.873168] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5397worker1 # [ 75.968405] nix-daemon[861]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)5398worker1 # [ 75.982655] nix-daemon[861]: reaped child process 1203, status = succeeded5399lb # [ 75.967671] niks3-server[980]: 2026/09/22 16:59:16 INFO Received uploads request method=POST path=/api/pending_closures5400worker1 # [ 75.992452] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.245Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5401worker1 # [ 75.993893] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.246Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"5402lb # [ 75.982787] niks3-server[980]: 2026/09/22 16:59:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5403lb # [ 75.984913] niks3-server[980]: 2026/09/22 16:59:16 INFO Signed narinfos id=23 count=15404worker1 # [ 76.005496] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.258Z level=INFO msg="Uploading 1 narinfos"5405lb # [ 75.991914] niks3-server[980]: 2026/09/22 16:59:16 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5406lb # [ 75.995122] niks3-server[980]: 2026/09/22 16:59:16 INFO Completed upload id=235407worker1 # [ 76.016776] nix-grpc-daemon[876]: time=2026-09-22T16:59:16.269Z level=INFO msg="Upload complete. (133ms)"5408lb # [ 75.998112] niks3-server[980]: 2026/09/22 16:59:16 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst5409worker1 # [ 76.019091] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=6245410lb # [ 76.001716] niks3-server[980]: 2026/09/22 16:59:16 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo5411lb # [ 76.003479] niks3-server[980]: 2026/09/22 16:59:16 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls5412worker1 # [ 76.025410] nix-daemon[861]: reaped child process 1198, status = succeeded5413worker1 # [ 76.026872] nix-grpc-daemon[724]: ts=2026-09-22T16:59:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785414worker1 # [ 76.030338] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5415worker1 # [ 76.036818] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5416worker1 # [ 77.454481] nix-daemon[861]: reaped child process 1207, status = succeeded5417worker1 # [ 77.529381] nix-daemon[861]: accepted connection from pid 1223, user nix-grpc-daemon (trusted)5418worker1 # [ 77.542168] nix-daemon[861]: reaped child process 1226, status = succeeded5419lb # [ 77.529195] niks3-server[980]: 2026/09/22 16:59:17 INFO Received uploads request method=POST path=/api/pending_closures5420worker1 # [ 77.558785] nix-grpc-daemon[876]: time=2026-09-22T16:59:17.811Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5421worker1 # [ 77.561057] nix-grpc-daemon[876]: time=2026-09-22T16:59:17.812Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"5422lb # [ 77.574508] niks3-server[980]: 2026/09/22 16:59:17 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst5423lb # [ 77.581418] niks3-server[980]: 2026/09/22 16:59:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5424lb # [ 77.586439] niks3-server[980]: 2026/09/22 16:59:17 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls5425lb # [ 77.591304] niks3-server[980]: 2026/09/22 16:59:17 INFO Signed narinfos id=24 count=15426worker1 # [ 77.611519] nix-grpc-daemon[876]: time=2026-09-22T16:59:17.863Z level=INFO msg="Uploading 1 narinfos"5427lb # [ 77.599484] niks3-server[980]: 2026/09/22 16:59:17 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv5428lb # [ 77.604484] niks3-server[980]: 2026/09/22 16:59:17 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5429lb # [ 77.607494] niks3-server[980]: 2026/09/22 16:59:17 INFO Completed upload id=245430worker1 # [ 77.628209] nix-grpc-daemon[876]: time=2026-09-22T16:59:17.880Z level=INFO msg="Upload complete. (182ms)"5431lb # [ 77.610374] niks3-server[980]: 2026/09/22 16:59:17 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo5432worker1 # [ 77.634580] nix-grpc-daemon[724]: ts=2026-09-22T16:59:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=15433worker1 # [ 77.642518] nix-grpc-daemon[724]: ts=2026-09-22T16:59:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486785434worker1 # [ 77.651122] nix-daemon[861]: reaped child process 1205, status = succeeded5435worker2 # [ 77.650141] nix-grpc-daemon[783]: ts=2026-09-22T16:59:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:467865436worker2 # [ 77.659662] nix-grpc-daemon[783]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...5437worker2 # [ 77.669588] nix-grpc-daemon[783]: ts=2026-09-22T16:59:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=1765438worker1 # [ 77.883369] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:486785439worker1 # [ 77.885973] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486785440worker1 # [ 77.891735] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.144Z level=INFO msg="All 2 paths already cached"5441worker1 # [ 77.901324] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=05442worker1 # [ 77.903534] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=15443worker1 # [ 77.906125] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785444worker1 # [ 77.914154] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486785445worker1 # [ 77.922548] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.175Z level=INFO msg="All 2 paths already cached"5446worker1 # [ 77.926815] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486785447worker1 # [ 77.931592] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5448worker1 # [ 78.013203] nix-daemon[861]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)5449worker1 # [ 78.028138] nix-daemon[861]: reaped child process 1235, status = succeeded5450lb # [ 78.012189] niks3-server[980]: 2026/09/22 16:59:18 INFO Received uploads request method=POST path=/api/pending_closures5451worker1 # [ 78.040658] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.293Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5452worker1 # [ 78.042269] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.294Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"5453lb # [ 78.043355] niks3-server[980]: 2026/09/22 16:59:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5454worker1 # [ 78.071065] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.323Z level=INFO msg="Uploading 1 narinfos"5455lb # [ 78.050873] niks3-server[980]: 2026/09/22 16:59:18 INFO Signed narinfos id=25 count=15456lb # [ 78.055711] niks3-server[980]: 2026/09/22 16:59:18 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst5457lb # [ 78.068415] niks3-server[980]: 2026/09/22 16:59:18 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5458lb # [ 78.073629] niks3-server[980]: 2026/09/22 16:59:18 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls5459worker1 # [ 78.100421] nix-grpc-daemon[876]: time=2026-09-22T16:59:18.352Z level=INFO msg="Upload complete. (164ms)"5460lb # [ 78.079652] niks3-server[980]: 2026/09/22 16:59:18 INFO Completed upload id=255461worker1 # [ 78.102903] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=7525462lb # [ 78.084210] niks3-server[980]: 2026/09/22 16:59:18 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo5463worker1 # [ 78.109970] nix-grpc-daemon[724]: ts=2026-09-22T16:59:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785464worker1 # [ 78.111665] nix-daemon[861]: reaped child process 1230, status = succeeded5465worker1 # [ 78.114429] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5466worker1 # [ 78.120767] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5467worker1 # [ 79.356710] nix-daemon[861]: reaped child process 1239, status = succeeded5468worker1 # [ 79.441738] nix-daemon[861]: accepted connection from pid 1255, user nix-grpc-daemon (trusted)5469worker1 # [ 79.453097] nix-daemon[861]: reaped child process 1258, status = succeeded5470lb # [ 79.441334] niks3-server[980]: 2026/09/22 16:59:19 INFO Received uploads request method=POST path=/api/pending_closures5471worker1 # [ 79.471154] nix-grpc-daemon[876]: time=2026-09-22T16:59:19.723Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5472worker1 # [ 79.472821] nix-grpc-daemon[876]: time=2026-09-22T16:59:19.725Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"5473lb # [ 79.481671] niks3-server[980]: 2026/09/22 16:59:19 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv5474lb # [ 79.490105] niks3-server[980]: 2026/09/22 16:59:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5475lb # [ 79.496632] niks3-server[980]: 2026/09/22 16:59:19 INFO Signed narinfos id=26 count=15476worker1 # [ 79.519915] nix-grpc-daemon[876]: time=2026-09-22T16:59:19.772Z level=INFO msg="Uploading 1 narinfos"5477lb # [ 79.503484] niks3-server[980]: 2026/09/22 16:59:19 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls5478lb # [ 79.506311] niks3-server[980]: 2026/09/22 16:59:19 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst5479lb # [ 79.511704] niks3-server[980]: 2026/09/22 16:59:19 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5480lb # [ 79.515467] niks3-server[980]: 2026/09/22 16:59:19 INFO Completed upload id=265481lb # [ 79.519223] niks3-server[980]: 2026/09/22 16:59:19 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo5482worker1 # [ 79.537509] nix-grpc-daemon[876]: time=2026-09-22T16:59:19.789Z level=INFO msg="Upload complete. (209ms)"5483worker1 # [ 79.545333] nix-grpc-daemon[724]: ts=2026-09-22T16:59:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=15484worker1 # [ 79.551290] nix-grpc-daemon[724]: ts=2026-09-22T16:59:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486785485worker1 # [ 79.561151] nix-daemon[861]: reaped child process 1237, status = succeeded5486worker1 # [ 79.566931] nix-grpc-daemon[724]: ts=2026-09-22T16:59:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:486785487worker1 # [ 79.570972] nix-grpc-daemon[724]: ts=2026-09-22T16:59:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_out=2325488client # [ 79.676800] nix-daemon[1108]: reaped child process 1110, status = succeeded5489client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.54 seconds)5490client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top5491client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)5492client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5493client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds)5494client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5495client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds)5496(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.60 seconds)5497subtest: an input only one worker has still reaches the builder5498client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only5499client # this derivation will be built:5500client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv5501client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...5502client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.23 seconds)5503client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure5504client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds)5505worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5506worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.12 seconds)5507worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only5508worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)5509client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&25510client # [ 80.331897] nix-daemon[1108]: accepted connection from pid 1191, user root (trusted)5511client # this derivation will be built:5512client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5513worker2 # [ 80.445545] nix-grpc-daemon[783]: ts=2026-09-22T16:59:20Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:467865514client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5515worker2 # [ 80.450698] nix-grpc-daemon[783]: ts=2026-09-22T16:59:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865516client # copying 1 paths...5517client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...5518worker2 # [ 80.463237] nix-grpc-daemon[783]: ts=2026-09-22T16:59:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:467865519worker2 # [ 80.471935] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5520worker2 # [ 80.584133] nix-daemon[851]: accepted connection from pid 1084, user nix-grpc-daemon (trusted)5521worker2 # [ 80.597460] nix-daemon[851]: reaped child process 1087, status = succeeded5522lb # [ 80.592715] niks3-server[980]: 2026/09/22 16:59:20 INFO Received uploads request method=POST path=/api/pending_closures5523worker2 # [ 80.614243] nix-grpc-daemon[877]: time=2026-09-22T16:59:20.907Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5524worker2 # [ 80.616084] nix-grpc-daemon[877]: time=2026-09-22T16:59:20.908Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5525lb # [ 80.621115] niks3-server[980]: 2026/09/22 16:59:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5526worker2 # [ 80.643846] nix-grpc-daemon[877]: time=2026-09-22T16:59:20.936Z level=INFO msg="Uploading 1 narinfos"5527lb # [ 80.630701] niks3-server[980]: 2026/09/22 16:59:20 INFO Signed narinfos id=27 count=15528lb # [ 80.639519] niks3-server[980]: 2026/09/22 16:59:20 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5529lb # [ 80.643681] niks3-server[980]: 2026/09/22 16:59:20 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5530lb # [ 80.654830] niks3-server[980]: 2026/09/22 16:59:20 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5531lb # [ 80.657925] niks3-server[980]: 2026/09/22 16:59:20 INFO Completed upload id=275532worker2 # [ 80.670820] nix-grpc-daemon[877]: time=2026-09-22T16:59:20.964Z level=INFO msg="Upload complete. (186ms)"5533lb # [ 80.660440] niks3-server[980]: 2026/09/22 16:59:20 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5534worker2 # [ 80.673691] nix-grpc-daemon[783]: ts=2026-09-22T16:59:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=1205535worker2 # [ 80.684569] nix-daemon[851]: reaped child process 1082, status = succeeded5536worker1 # [ 80.696768] nix-grpc-daemon[724]: ts=2026-09-22T16:59:20Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05537worker1 # [ 80.701433] nix-grpc-daemon[724]: ts=2026-09-22T16:59:20Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=15538worker2 # [ 80.732605] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865539worker2 # [ 80.744863] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865540client # copying 2 paths to 'lb:50051'...5541client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5542worker2 # [ 80.760519] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:467865543client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5544worker2 # [ 80.770158] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5545worker2 # [ 80.869746] nix-daemon[851]: accepted connection from pid 1091, user nix-grpc-daemon (trusted)5546worker2 # [ 80.883392] nix-daemon[851]: reaped child process 1094, status = succeeded5547lb # [ 80.876923] niks3-server[980]: 2026/09/22 16:59:21 INFO Received uploads request method=POST path=/api/pending_closures5548lb # [ 80.885950] niks3-server[980]: 2026/09/22 16:59:21 INFO Received uploads request method=POST path=/api/pending_closures5549worker2 # [ 80.908036] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.201Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5550worker2 # [ 80.909542] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.202Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5551worker2 # [ 80.911264] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.204Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5552lb # [ 80.933234] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5553lb # [ 80.945944] niks3-server[980]: 2026/09/22 16:59:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5554lb # [ 80.950787] niks3-server[980]: 2026/09/22 16:59:21 INFO Signed narinfos id=28 count=15555lb # [ 80.956167] niks3-server[980]: 2026/09/22 16:59:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5556lb # [ 80.959183] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5557lb # [ 80.962291] niks3-server[980]: 2026/09/22 16:59:21 INFO Signed narinfos id=29 count=25558lb # [ 80.963987] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5559worker2 # [ 80.976190] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.268Z level=INFO msg="Uploading 3 narinfos"5560lb # [ 80.965467] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5561lb # [ 80.979843] niks3-server[980]: 2026/09/22 16:59:21 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5562lb # [ 80.983327] niks3-server[980]: 2026/09/22 16:59:21 INFO Completed upload id=285563lb # [ 80.986282] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5564lb # [ 80.988197] niks3-server[980]: 2026/09/22 16:59:21 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5565lb # [ 80.990476] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5566lb # [ 80.993786] niks3-server[980]: 2026/09/22 16:59:21 INFO Completed upload id=295567worker2 # [ 81.006886] nix-grpc-daemon[877]: time=2026-09-22T16:59:21.299Z level=INFO msg="Upload complete. (223ms)"5568lb # [ 80.997595] niks3-server[980]: 2026/09/22 16:59:21 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5569worker2 # [ 81.012405] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=2 nar_bytes_in=9765570worker2 # [ 81.017930] nix-grpc-daemon[783]: ts=2026-09-22T16:59:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865571worker2 # [ 81.028401] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5572worker2 # [ 81.041263] nix-daemon[851]: reaped child process 1089, status = succeeded5573client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5574client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5575worker2 # [ 81.048802] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5576client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds5577worker2 # [ 82.479314] nix-daemon[851]: reaped child process 1098, status = succeeded5578worker2 # [ 82.557642] nix-daemon[851]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)5579worker2 # [ 82.570113] nix-daemon[851]: reaped child process 1117, status = succeeded5580lb # [ 82.564626] niks3-server[980]: 2026/09/22 16:59:22 INFO Received uploads request method=POST path=/api/pending_closures5581worker2 # [ 82.584230] nix-grpc-daemon[877]: time=2026-09-22T16:59:22.877Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5582lb # [ 82.595611] niks3-server[980]: 2026/09/22 16:59:22 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5583lb # [ 82.602435] niks3-server[980]: 2026/09/22 16:59:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5584lb # [ 82.610251] niks3-server[980]: 2026/09/22 16:59:22 INFO Signed narinfos id=30 count=15585worker2 # [ 82.626034] nix-grpc-daemon[877]: time=2026-09-22T16:59:22.919Z level=INFO msg="Uploading 1 narinfos"5586lb # [ 82.616711] niks3-server[980]: 2026/09/22 16:59:22 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5587lb # [ 82.631973] niks3-server[980]: 2026/09/22 16:59:22 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5588lb # [ 82.637595] niks3-server[980]: 2026/09/22 16:59:22 INFO Completed upload id=305589worker2 # [ 82.649987] nix-grpc-daemon[877]: time=2026-09-22T16:59:22.943Z level=INFO msg="Upload complete. (190ms)"5590lb # [ 82.639669] niks3-server[980]: 2026/09/22 16:59:22 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5591client # copying 1 paths...5592worker2 # [ 82.654900] nix-grpc-daemon[783]: ts=2026-09-22T16:59:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=15593worker1 # [ 82.668906] nix-grpc-daemon[724]: ts=2026-09-22T16:59:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486785594worker2 # [ 82.669203] nix-daemon[851]: reaped child process 1096, status = succeeded5595worker1 # [ 82.677687] nix-grpc-daemon[724]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5596client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5597worker2 # [ 82.689627] nix-grpc-daemon[783]: ts=2026-09-22T16:59:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:467865598worker2 # [ 82.694320] nix-grpc-daemon[783]: ts=2026-09-22T16:59:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_out=1205599client # [ 82.810368] nix-daemon[1108]: reaped child process 1194, status = succeeded5600client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.60 seconds)5601client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&25602client # [ 82.911092] nix-daemon[1108]: accepted connection from pid 1213, user root (trusted)5603client # this derivation will be built:5604client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5605worker2 # [ 83.017425] nix-grpc-daemon[783]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:467865606client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5607worker2 # [ 83.023259] nix-grpc-daemon[783]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865608worker2 # [ 83.028605] nix-grpc-daemon[877]: time=2026-09-22T16:59:23.320Z level=INFO msg="All 1 paths already cached"5609worker1 # [ 83.044691] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05610worker1 # [ 83.050801] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15611worker1 # [ 83.056794] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785612worker1 # [ 83.066951] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:486785613client # copying 1 paths to 'lb:50051'...5614client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5615worker1 # [ 83.079971] nix-grpc-daemon[724]: ts=2026-09-22T16:59:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:486785616worker1 # [ 83.090862] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5617worker1 # [ 83.105159] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5)5618worker1 # [ 83.174089] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 2/5)5619worker1 # [ 83.208714] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 325 ms (attempt 3/5)5620worker1 # [ 83.535706] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 4/5)5621worker1 # [ 83.729863] nix-grpc-daemon[724]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5622worker1 # [ 83.733723] nix-grpc-daemon[724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5623worker1 # [ 83.739215] nix-grpc-daemon[724]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5624worker1 # [ 83.853969] nix-daemon[861]: accepted connection from pid 1277, user nix-grpc-daemon (trusted)5625worker1 # [ 83.868916] nix-daemon[861]: reaped child process 1280, status = succeeded5626lb # [ 83.854559] niks3-server[980]: 2026/09/22 16:59:24 INFO Received uploads request method=POST path=/api/pending_closures5627worker1 # [ 83.883201] nix-grpc-daemon[876]: time=2026-09-22T16:59:24.135Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5628worker1 # [ 83.884652] nix-grpc-daemon[876]: time=2026-09-22T16:59:24.137Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5629lb # [ 83.886264] niks3-server[980]: 2026/09/22 16:59:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5630worker1 # [ 83.915929] nix-grpc-daemon[876]: time=2026-09-22T16:59:24.168Z level=INFO msg="Uploading 1 narinfos"5631lb # [ 83.896737] niks3-server[980]: 2026/09/22 16:59:24 INFO Signed narinfos id=31 count=15632lb # [ 83.900975] niks3-server[980]: 2026/09/22 16:59:24 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5633lb # [ 83.906670] niks3-server[980]: 2026/09/22 16:59:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5634lb # [ 83.917613] niks3-server[980]: 2026/09/22 16:59:24 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5635lb # [ 83.925102] niks3-server[980]: 2026/09/22 16:59:24 INFO Completed upload id=315636worker1 # [ 83.945419] nix-grpc-daemon[876]: time=2026-09-22T16:59:24.197Z level=INFO msg="Upload complete. (187ms)"5637worker1 # [ 83.949307] nix-grpc-daemon[724]: ts=2026-09-22T16:59:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_in=5605638lb # [ 83.932061] niks3-server[980]: 2026/09/22 16:59:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5639worker1 # [ 83.954783] nix-grpc-daemon[724]: ts=2026-09-22T16:59:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:486785640worker1 # [ 83.966126] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5641worker1 # [ 83.970822] nix-daemon[861]: reaped child process 1270, status = succeeded5642worker1 # [ 83.975980] nix-daemon[861]: accepted connection from pid 724, user nix-grpc-daemon (trusted)5643client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5644client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5645client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5646worker1 # [ 84.791120] nix-daemon[861]: reaped child process 1284, status = succeeded5647worker1 # [ 84.862172] nix-daemon[861]: accepted connection from pid 1301, user nix-grpc-daemon (trusted)5648worker1 # [ 84.874618] nix-daemon[861]: reaped child process 1304, status = succeeded5649lb # [ 84.861724] niks3-server[980]: 2026/09/22 16:59:25 INFO Received uploads request method=POST path=/api/pending_closures5650worker1 # [ 84.890311] nix-grpc-daemon[876]: time=2026-09-22T16:59:25.142Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5651lb # [ 84.893151] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5652lb # [ 84.899204] niks3-server[980]: 2026/09/22 16:59:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5653lb # [ 84.907291] niks3-server[980]: 2026/09/22 16:59:25 INFO Signed narinfos id=32 count=15654worker1 # [ 84.931091] nix-grpc-daemon[876]: time=2026-09-22T16:59:25.183Z level=INFO msg="Uploading 1 narinfos"5655lb # [ 84.915560] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5656lb # [ 84.926690] niks3-server[980]: 2026/09/22 16:59:25 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5657lb # [ 84.933481] niks3-server[980]: 2026/09/22 16:59:25 INFO Completed upload id=325658worker1 # [ 84.954084] nix-grpc-daemon[876]: time=2026-09-22T16:59:25.206Z level=INFO msg="Upload complete. (171ms)"5659worker1 # [ 84.959476] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=15660client # copying 1 paths...5661worker2 # [ 84.959996] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:467865662worker1 # [ 84.971747] nix-daemon[861]: reaped child process 1282, status = succeeded5663worker2 # [ 84.965118] nix-grpc-daemon[783]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5664client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5665worker1 # [ 84.987659] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:486785666worker1 # [ 84.991966] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_out=1205667client # [ 85.098351] nix-daemon[1108]: reaped child process 1216, status = succeeded5668client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.29 seconds)5669client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&25670lb # [ 85.160310] envoy[907]: conn peer=[2001:db8:1::1]:46852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3410 tx=1920 ms=22125671lb # [ 85.162366] envoy[907]: conn peer=[2001:db8:1::1]:46862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=755672lb # [ 85.164293] envoy[907]: conn peer=[2001:db8:1::1]:46872 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3863 tx=2140 ms=19255673lb # [ 85.166258] envoy[907]: conn peer=[2001:db8:1::1]:46884 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=705674lb # [ 85.168168] envoy[907]: conn peer=[2001:db8:1::1]:46894 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4324 tx=2366 ms=17385675lb # [ 85.170114] envoy[907]: conn peer=[2001:db8:1::1]:46898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=555676lb # [ 85.172214] envoy[907]: conn peer=[2001:db8:1::1]:46912 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4235 tx=2057 ms=23025677lb # [ 85.174179] envoy[907]: conn peer=[2001:db8:1::1]:46916 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=555678lb # [ 85.176138] envoy[907]: conn peer=[2001:db8:1::1]:48840 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=545679lb # [ 85.178092] envoy[907]: conn peer=[2001:db8:1::1]:48828 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3732 tx=2124 ms=20185680client # [ 85.203072] nix-daemon[1108]: accepted connection from pid 1235, user root (trusted)5681client # this derivation will be built:5682client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5683worker2 # [ 85.308480] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:467865684worker2 # [ 85.312714] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865685client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5686worker2 # [ 85.317940] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.610Z level=INFO msg="All 1 paths already cached"5687worker1 # [ 85.336270] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05688worker1 # [ 85.340628] nix-grpc-daemon[724]: ts=2026-09-22T16:59:25Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15689worker2 # [ 85.371379] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865690worker2 # [ 85.377663] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467865691worker2 # [ 85.383841] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.677Z level=INFO msg="All 1 paths already cached"5692client # copying 1 paths to 'lb:50051'...5693worker2 # [ 85.387719] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:467865694client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5695worker2 # [ 85.393936] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5696worker2 # [ 85.479416] nix-daemon[851]: accepted connection from pid 1122, user nix-grpc-daemon (trusted)5697worker2 # [ 85.491546] nix-daemon[851]: reaped child process 1125, status = succeeded5698lb # [ 85.487108] niks3-server[980]: 2026/09/22 16:59:25 INFO Received uploads request method=POST path=/api/pending_closures5699worker2 # [ 85.508251] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.801Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5700worker2 # [ 85.509838] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.802Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5701lb # [ 85.514102] niks3-server[980]: 2026/09/22 16:59:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5702lb # [ 85.516894] niks3-server[980]: 2026/09/22 16:59:25 INFO Signed narinfos id=33 count=15703worker2 # [ 85.532417] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.825Z level=INFO msg="Uploading 1 narinfos"5704lb # [ 85.523233] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5705lb # [ 85.532256] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5706lb # [ 85.535507] niks3-server[980]: 2026/09/22 16:59:25 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5707lb # [ 85.538466] niks3-server[980]: 2026/09/22 16:59:25 INFO Completed upload id=335708worker2 # [ 85.551296] nix-grpc-daemon[877]: time=2026-09-22T16:59:25.844Z level=INFO msg="Upload complete. (151ms)"5709worker2 # [ 85.553189] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=0 paths=1 nar_bytes_in=5605710lb # [ 85.543326] niks3-server[980]: 2026/09/22 16:59:25 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5711worker2 # [ 85.556230] nix-grpc-daemon[783]: ts=2026-09-22T16:59:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467865712worker2 # [ 85.563221] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5713worker2 # [ 85.565526] nix-daemon[851]: reaped child process 1120, status = succeeded5714worker2 # [ 85.570661] nix-daemon[851]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5715client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5716client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5717client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5718worker2 # [ 86.797437] nix-daemon[851]: reaped child process 1129, status = succeeded5719worker2 # [ 86.874398] nix-daemon[851]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)5720worker2 # [ 86.886624] nix-daemon[851]: reaped child process 1148, status = succeeded5721lb # [ 86.883731] niks3-server[980]: 2026/09/22 16:59:27 INFO Received uploads request method=POST path=/api/pending_closures5722worker2 # [ 86.902733] nix-grpc-daemon[877]: time=2026-09-22T16:59:27.195Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5723lb # [ 86.912738] niks3-server[980]: 2026/09/22 16:59:27 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5724lb # [ 86.921100] niks3-server[980]: 2026/09/22 16:59:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5725lb # [ 86.926617] niks3-server[980]: 2026/09/22 16:59:27 INFO Signed narinfos id=34 count=15726worker2 # [ 86.942630] nix-grpc-daemon[877]: time=2026-09-22T16:59:27.235Z level=INFO msg="Uploading 1 narinfos"5727lb # [ 86.933821] niks3-server[980]: 2026/09/22 16:59:27 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5728lb # [ 86.946926] niks3-server[980]: 2026/09/22 16:59:27 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5729lb # [ 86.953508] niks3-server[980]: 2026/09/22 16:59:27 INFO Completed upload id=345730worker2 # [ 86.966383] nix-grpc-daemon[877]: time=2026-09-22T16:59:27.259Z level=INFO msg="Upload complete. (187ms)"5731lb # [ 86.955989] niks3-server[980]: 2026/09/22 16:59:27 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5732client # copying 1 paths...5733worker2 # [ 86.971338] nix-grpc-daemon[783]: ts=2026-09-22T16:59:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46786 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=15734worker2 # [ 86.977908] nix-grpc-daemon[783]: ts=2026-09-22T16:59:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:467865735client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5736worker2 # [ 86.987807] nix-daemon[851]: reaped child process 1127, status = succeeded5737worker1 # [ 87.000920] nix-grpc-daemon[724]: ts=2026-09-22T16:59:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:486785738worker1 # [ 87.009198] nix-grpc-daemon[724]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5739worker1 # [ 87.019722] nix-grpc-daemon[724]: ts=2026-09-22T16:59:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48678 duration_s=0 paths=1 nar_bytes_out=1205740client # [ 87.125411] nix-daemon[1108]: reaped child process 1238, status = succeeded5741client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.03 seconds)5742(finished: subtest: an input only one worker has still reaches the builder, in 7.38 seconds)5743subtest: upload whose reference the worker lacks is completed from the cache5744client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache5745client # this derivation will be built:5746client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5747client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5748client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.23 seconds)5749client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache5750client # this derivation will be built:5751client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5752client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5753client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.23 seconds)5754client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5755client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds)5756worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5757worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.12 seconds)5758worker2 # [ 87.843930] systemd[1]: Stopping Nix worker-protocol over gRPC...5759worker2 # [ 88.413164] nix-grpc-daemon[783]: ts=2026-09-22T16:59:28Z level=info event=signal_exit5760worker1 # [ 89.596487] nix-grpc-daemon[724]: ts=2026-09-22T16:59:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:486665761worker1 # [ 89.600607] nix-grpc-daemon[724]: ts=2026-09-22T16:59:29Z level=info event=worker_gone addr=192.168.1.4:500515762worker2 # [ 89.590913] nix-grpc-daemon[783]: ts=2026-09-22T16:59:29Z level=info event=scheduler_restarting5763worker2 # [ 89.604845] nix-grpc-daemon[783]: ts=2026-09-22T16:59:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5764worker2 # [ 89.625262] nix-daemon[851]: reaped child process 853, status = succeeded5765worker2 # [ 89.772181] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5766worker2 # [ 89.775161] systemd[1]: Stopped Nix worker-protocol over gRPC.5767worker2 # [ 89.778610] systemd[1]: nix-grpc-daemon.service: Consumed 1.815s CPU time over 1min 14.521s wall clock time, 60.5M memory peak, 84.3K incoming IP traffic, 201.9K outgoing IP traffic.5768worker2 # [ 89.790498] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5769worker2 # [ 89.794791] systemd[1]: Closed Nix worker-protocol over gRPC.5770worker2 # [ 89.798455] systemd[1]: nix-grpc-daemon.socket: Consumed 292us CPU time over 1min 22.292s wall clock time, 256K memory peak, 87.2K incoming IP traffic, 77.1K outgoing IP traffic.5771lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5772lb: must succeed: curl -sf localhost:9901/clusters5773lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5774lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.03 seconds)5775client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25776worker1 # [ 89.956677] nix-grpc-daemon[724]: ts=2026-09-22T16:59:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:486785777worker1 # [ 89.963639] nix-grpc-daemon[724]: ts=2026-09-22T16:59:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:486785778client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5779client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.14 seconds)5780worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5781worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5782worker2 # [ 90.035745] systemd[1]: Listening on Nix worker-protocol over gRPC.5783worker1 # [ 90.088082] systemd[1]: Stopping Nix worker-protocol over gRPC...5784worker1 # [ 90.363057] nix-grpc-daemon[724]: ts=2026-09-22T16:59:30Z level=info event=signal_exit5785worker2 # [ 90.548661] systemd[1]: Starting scheduler-token.service...5786lb # [ 90.570838] niks3-server[980]: 2026/09/22 16:59:30 INFO lead: released remote=192.168.1.3:401645787worker2 # [ 90.608598] systemd[1]: scheduler-token.service: Deactivated successfully.5788worker2 # [ 90.613345] systemd[1]: Finished scheduler-token.service.5789worker2 # [ 90.615342] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 62ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5790worker2 # [ 90.623153] systemd[1]: Starting Nix worker-protocol over gRPC...5791worker2 # [ 90.701332] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5792worker2 # [ 90.703375] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5793worker2 # [ 90.706518] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15794worker2 # [ 90.710822] nix-grpc-daemon[1172]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5795worker2 # [ 90.712150] nix-grpc-daemon[1172]: E0000 00:00:1790096371.003560 1172 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5796worker2 # [ 90.716478] nix-grpc-daemon[1172]: E0000 00:00:1790096371.008871 1172 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5797worker2 # [ 90.720609] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5798worker2 # [ 90.724925] systemd[1]: Started Nix worker-protocol over gRPC.5799worker2 # [ 90.728063] nix-grpc-daemon[1172]: E0000 00:00:1790096371.020900 1211 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5800worker2 # [ 90.732696] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_take_over5801lb # [ 90.719948] niks3-server[980]: 2026/09/22 16:59:31 INFO lead: acquired remote=192.168.1.4:386105802worker2 # [ 90.743616] nix-grpc-daemon[1172]: E0000 00:00:1790096371.036767 1211 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5803worker2 # [ 90.747132] nix-grpc-daemon[1172]: E0000 00:00:1790096371.038971 1211 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5804worker2 # [ 90.757574] nix-grpc-daemon[1172]: E0000 00:00:1790096371.050721 1211 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5805worker2 # [ 90.768550] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:500515806worker2 # [ 90.770605] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5807worker2 # [ 90.971949] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:500515808worker2 # [ 90.975890] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5809worker2 # [ 91.176941] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:500515810worker2 # [ 91.181409] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5811worker2 # [ 91.382328] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:500515812worker2 # [ 91.386752] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5813worker1 # [ 91.593696] nix-grpc-daemon[724]: ts=2026-09-22T16:59:31Z level=info event=scheduler_restarting5814worker2 # [ 91.587845] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_connected addr=lb:500515815worker1 # [ 91.599681] nix-grpc-daemon[724]: ts=2026-09-22T16:59:31Z level=info event=scheduler_restarting addr=lb:500515816worker2 # [ 91.592268] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5817worker1 # [ 91.602894] nix-grpc-daemon[724]: ts=2026-09-22T16:59:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:486665818worker1 # [ 91.606336] nix-grpc-daemon[724]: ts=2026-09-22T16:59:31Z level=info event=worker_gone addr=192.168.1.3:500515819worker1 # [ 91.625218] nix-daemon[861]: reaped child process 863, status = succeeded5820worker2 # [ 91.793938] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:32Z level=info event=scheduler_connected addr=lb:500515821worker1 # [ 91.806665] nix-grpc-daemon[724]: ts=2026-09-22T16:59:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5822worker2 # [ 91.807149] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:32Z level=info event=oidc_jwks provider=mock keys=15823worker2 # [ 91.810740] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:32Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:366305824worker2 # [ 91.814594] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05825worker1 # [ 92.505362] nix-grpc-daemon[724]: E0000 00:00:1790096372.757577 769 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true5826worker1 # [ 92.510445] nix-grpc-daemon[724]: E0000 00:00:1790096372.758149 769 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5827worker1 # [ 93.741243] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5828worker1 # [ 93.744909] systemd[1]: Stopped Nix worker-protocol over gRPC.5829worker1 # [ 93.749360] systemd[1]: nix-grpc-daemon.service: Consumed 2.388s CPU time over 1min 18.565s wall clock time, 69.8M memory peak, 111.7K incoming IP traffic, 244.8K outgoing IP traffic.5830worker1 # [ 93.761154] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5831worker1 # [ 93.765436] systemd[1]: Closed Nix worker-protocol over gRPC.5832worker1 # [ 93.768620] systemd[1]: nix-grpc-daemon.socket: Consumed 306us CPU time over 1min 25.322s wall clock time, 256K memory peak, 121.3K incoming IP traffic, 106K outgoing IP traffic.5833lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5834lb: must succeed: curl -sf localhost:9901/clusters5835lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5836lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds)5837client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25838worker2 # [ 93.962469] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348785839worker2 # [ 93.973708] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)5840worker2 # [ 93.989808] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5)5841worker2 # [ 94.066137] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 118 ms (attempt 2/5)5842worker2 # [ 94.186091] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 335 ms (attempt 3/5)5843worker2 # [ 94.522252] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 378 ms (attempt 4/5)5844worker2 # [ 94.902609] nix-grpc-daemon[1172]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5845worker2 # [ 94.906271] nix-grpc-daemon[1172]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5846client # copying 2 paths...5847client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5848client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5849worker2 # [ 94.925969] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348785850worker2 # [ 94.935908] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)5851worker2 # [ 94.946722] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=info event=niks3_push_started pid=12325852worker2 # [ 95.035505] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.328Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""5853worker2 # [ 95.120383] nix-daemon[851]: accepted connection from pid 1245, user nix-grpc-daemon (trusted)5854worker2 # [ 95.132354] nix-daemon[851]: reaped child process 1248, status = succeeded5855lb # [ 95.130565] niks3-server[980]: 2026/09/22 16:59:35 INFO Received uploads request method=POST path=/api/pending_closures5856lb # [ 95.141692] niks3-server[980]: 2026/09/22 16:59:35 INFO Received uploads request method=POST path=/api/pending_closures5857worker2 # [ 95.161645] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.454Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5858worker2 # [ 95.163447] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.456Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5859worker2 # [ 95.166046] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.458Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5860lb # [ 95.161802] envoy[907]: conn peer=[2001:db8:1::1]:48846 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3729 tx=2081 ms=17535861lb # [ 95.166516] envoy[907]: conn peer=[2001:db8:1::1]:48852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=725862lb # [ 95.169985] envoy[907]: conn peer=[2001:db8:1::4]:53266 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=63563 tx=3260 ms=741545863lb # [ 95.173650] envoy[907]: conn peer=[2001:db8:1::1]:48862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=195864lb # [ 95.178190] envoy[907]: conn peer=[2001:db8:1::3]:39780 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=17299 tx=3700 ms=763985865lb # [ 95.211849] niks3-server[980]: 2026/09/22 16:59:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5866lb # [ 95.215605] niks3-server[980]: 2026/09/22 16:59:35 INFO Signed narinfos id=35 count=15867lb # [ 95.216669] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5868lb # [ 95.221524] niks3-server[980]: 2026/09/22 16:59:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5869lb # [ 95.223713] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5870lb # [ 95.226222] niks3-server[980]: 2026/09/22 16:59:35 INFO Signed narinfos id=36 count=25871worker2 # [ 95.240129] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.532Z level=INFO msg="Uploading 3 narinfos"5872lb # [ 95.231310] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5873lb # [ 95.234666] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5874lb # [ 95.248483] niks3-server[980]: 2026/09/22 16:59:35 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5875lb # [ 95.251446] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5876lb # [ 95.254363] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5877lb # [ 95.258241] niks3-server[980]: 2026/09/22 16:59:35 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5878lb # [ 95.264991] niks3-server[980]: 2026/09/22 16:59:35 INFO Completed upload id=355879lb # [ 95.266641] niks3-server[980]: 2026/09/22 16:59:35 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5880lb # [ 95.271543] niks3-server[980]: 2026/09/22 16:59:35 INFO Completed upload id=365881worker2 # [ 95.284696] nix-grpc-daemon[1232]: time=2026-09-22T16:59:35.577Z level=INFO msg="Upload complete. (245ms)"5882worker2 # [ 95.290940] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 paths=2 nar_bytes_in=3125883worker2 # [ 95.305443] nix-daemon[851]: reaped child process 1230, status = succeeded5884client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.50 seconds)5885worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5886worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5887worker1 # [ 95.395980] systemd[1]: Listening on Nix worker-protocol over gRPC.5888worker1 # [ 95.402941] systemd[1]: Starting Nix worker-protocol over gRPC...5889worker1 # [ 95.490348] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5890worker1 # [ 95.494609] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5891worker1 # [ 95.498128] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15892worker1 # [ 95.502271] nix-grpc-daemon[1330]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5893worker1 # [ 95.507498] nix-grpc-daemon[1330]: E0000 00:00:1790096375.750156 1330 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5894worker1 # [ 95.510631] nix-grpc-daemon[1330]: E0000 00:00:1790096375.753891 1330 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5895worker1 # [ 95.515067] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5896worker1 # [ 95.518115] systemd[1]: Started Nix worker-protocol over gRPC.5897worker1 # [ 95.518941] nix-grpc-daemon[1330]: E0000 00:00:1790096375.766546 1369 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5898worker1 # [ 95.530060] nix-grpc-daemon[1330]: E0000 00:00:1790096375.782398 1369 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5899worker1 # [ 95.534103] nix-grpc-daemon[1330]: E0000 00:00:1790096375.782529 1369 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5900lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5901lb: must succeed: curl -sf localhost:9901/clusters5902worker1 # [ 95.544499] nix-grpc-daemon[1330]: E0000 00:00:1790096375.797085 1369 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5903worker1 # [ 95.552255] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:35Z level=info event=scheduler_connected addr=lb:500515904worker2 # [ 95.546233] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:366305905worker2 # [ 95.550514] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05906lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5907lb: must succeed: curl -sf localhost:9901/clusters5908lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5909lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.08 seconds)5910(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.48 seconds)5911subtest: a niks3 restart does not cost the leader its role5912lb: must succeed: curl -sf localhost:9901/clusters5913lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5914lb: must succeed: curl -sf localhost:9901/clusters5915lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5916lb # [ 96.669453] systemd[1]: Stopping niks3 server...5917lb # [ 96.672780] niks3-server[980]: 2026/09/22 16:59:37 INFO Shutdown signal received, draining in-flight requests timeout=10s5918worker2 # [ 96.688056] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:36Z level=info event=scheduler_lock_lost status=2005919lb # [ 96.675184] niks3-server[980]: 2026/09/22 16:59:37 INFO lead: released remote=192.168.1.4:386105920worker1 # [ 96.696360] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:36Z level=info event=scheduler_lock_lost status=2005921lb # [ 96.691651] systemd[1]: niks3.service: Deactivated successfully.5922lb # [ 96.693359] systemd[1]: Stopped niks3 server.5923lb # [ 96.694609] systemd[1]: niks3.service: Consumed 736ms CPU time over 1min 17.355s wall clock time, 28.9M memory peak, 94K incoming IP traffic, 136.5K outgoing IP traffic.5924lb # [ 96.702033] systemd[1]: Starting niks3 server...5925lb # [ 96.756304] niks3-server[1120]: 2026/09/22 16:59:37 goose: no migrations to run. current version: 202609200000005926lb # [ 96.762551] niks3-server[1120]: 2026/09/22 16:59:37 OK 1_commit_pending_closure.sql (4.28ms)5927lb # [ 96.766276] niks3-server[1120]: 2026/09/22 16:59:37 OK 2_object_stats_trigger.sql (1.9ms)5928lb # [ 96.767396] niks3-server[1120]: 2026/09/22 16:59:37 goose: up to current file version: 25929lb # [ 96.768650] niks3-server[1120]: 2026/09/22 16:59:37 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key5930lb # [ 96.780397] niks3-server[1120]: 2026/09/22 16:59:37 INFO Read proxy enabled — serving cache objects from S35931lb # [ 96.781756] niks3-server[1120]: 2026/09/22 16:59:37 INFO Using socket-activated listener address=0.0.0.0:57515932lb # [ 96.784323] systemd[1]: Started niks3 server.5933lb # [ 96.786209] niks3-server[1120]: 2026/09/22 16:59:37 INFO Starting HTTP server address=0.0.0.0:57515934lb # [ 96.787687] niks3-server[1120]: 2026/09/22 16:59:37 INFO systemd watchdog enabled interval=15s5935lb: waiting for unit niks3.service5936lb: (finished: waiting for unit niks3.service, in 0.02 seconds)5937lb: must succeed: curl -sf localhost:9901/clusters5938lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5939worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5940worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds)5941lb: must succeed: curl -sf localhost:9901/clusters5942lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5943lb: must succeed: curl -sf localhost:9901/clusters5944lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5945worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5946worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.02 seconds)5947client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&25948worker1 # [ 97.054983] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:470745949worker1 # [ 97.065988] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)5950client # don't know how to build these paths:5951client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv5952worker2 # [ 97.072813] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348785953worker2 # [ 97.092914] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=05954worker2 # [ 97.098438] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=15955worker2 # [ 97.137121] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348785956worker2 # [ 97.147880] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348785957client # copying 1 paths to 'lb:50051'...5958client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'...5959worker2 # [ 97.158456] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348785960worker2 # [ 97.169153] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)5961worker2 # [ 97.267411] nix-daemon[851]: accepted connection from pid 1265, user nix-grpc-daemon (trusted)5962worker2 # [ 97.281168] nix-daemon[851]: reaped child process 1268, status = succeeded5963lb # [ 97.273124] niks3-server[1120]: 2026/09/22 16:59:37 INFO Received uploads request method=POST path=/api/pending_closures5964worker2 # [ 97.291715] nix-grpc-daemon[1232]: time=2026-09-22T16:59:37.584Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5965worker2 # [ 97.294170] nix-grpc-daemon[1232]: time=2026-09-22T16:59:37.586Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)"5966lb # [ 97.292713] niks3-server[1120]: 2026/09/22 16:59:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5967lb # [ 97.296505] niks3-server[1120]: 2026/09/22 16:59:37 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst5968lb # [ 97.307847] niks3-server[1120]: 2026/09/22 16:59:37 INFO Signed narinfos id=37 count=15969worker2 # [ 97.322867] nix-grpc-daemon[1232]: time=2026-09-22T16:59:37.615Z level=INFO msg="Uploading 1 narinfos"5970lb # [ 97.315446] niks3-server[1120]: 2026/09/22 16:59:37 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls5971lb # [ 97.318622] niks3-server[1120]: 2026/09/22 16:59:37 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5972lb # [ 97.326545] niks3-server[1120]: 2026/09/22 16:59:37 INFO Completed upload id=375973worker2 # [ 97.339333] nix-grpc-daemon[1232]: time=2026-09-22T16:59:37.632Z level=INFO msg="Upload complete. (158ms)"5974worker2 # [ 97.341323] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 paths=1 nar_bytes_in=5365975lb # [ 97.330763] niks3-server[1120]: 2026/09/22 16:59:37 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo5976worker2 # [ 97.345685] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348785977worker2 # [ 97.352449] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)5978worker2 # [ 97.353770] nix-daemon[851]: reaped child process 1263, status = succeeded5979client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051...5980client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv5981worker2 # [ 97.358825] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)5982lb # [ 97.679950] niks3-server[1120]: 2026/09/22 16:59:38 INFO lead: acquired remote=192.168.1.4:446145983client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5984client # farm-a> LOG-farm-a-after-niks3-restart5985worker2 # [ 98.191880] nix-daemon[851]: reaped child process 1272, status = succeeded5986worker2 # [ 98.278912] nix-daemon[851]: accepted connection from pid 1290, user nix-grpc-daemon (trusted)5987worker2 # [ 98.291571] nix-daemon[851]: reaped child process 1293, status = succeeded5988lb # [ 98.286480] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received uploads request method=POST path=/api/pending_closures5989worker2 # [ 98.305158] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.598Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5990worker2 # [ 98.306623] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.599Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)"5991lb # [ 98.308383] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5992worker2 # [ 98.325553] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.618Z level=INFO msg="Uploading 1 narinfos"5993lb # [ 98.313704] niks3-server[1120]: 2026/09/22 16:59:38 INFO Signed narinfos id=38 count=15994lb # [ 98.315937] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv5995lb # [ 98.319766] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5996lb # [ 98.323797] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5997lb # [ 98.328309] niks3-server[1120]: 2026/09/22 16:59:38 INFO Completed upload id=385998worker2 # [ 98.341140] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.634Z level=INFO msg="Upload complete. (175ms)"5999lb # [ 98.330779] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls6000worker2 # [ 98.343986] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=16001lb # [ 98.333648] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo6002worker2 # [ 98.353568] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=06003worker2 # [ 98.355523] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=16004worker2 # [ 98.358731] nix-daemon[851]: reaped child process 1270, status = succeeded6005worker2 # [ 98.395883] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348786006worker2 # [ 98.404587] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348786007worker2 # [ 98.413670] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.706Z level=INFO msg="All 1 paths already cached"6008client # copying 1 paths to 'lb:50051'...6009client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'...6010worker2 # [ 98.419262] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348786011worker2 # [ 98.425857] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)6012worker2 # [ 98.512653] nix-daemon[851]: accepted connection from pid 1299, user nix-grpc-daemon (trusted)6013worker2 # [ 98.525367] nix-daemon[851]: reaped child process 1302, status = succeeded6014lb # [ 98.520093] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received uploads request method=POST path=/api/pending_closures6015worker2 # [ 98.537249] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.830Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6016worker2 # [ 98.538742] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.831Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)"6017lb # [ 98.535275] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6018lb # [ 98.539428] niks3-server[1120]: 2026/09/22 16:59:38 INFO Signed narinfos id=39 count=16019worker2 # [ 98.551969] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.845Z level=INFO msg="Uploading 1 narinfos"6020lb # [ 98.546094] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls6021lb # [ 98.551113] niks3-server[1120]: 2026/09/22 16:59:38 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6022lb # [ 98.556497] niks3-server[1120]: 2026/09/22 16:59:38 INFO Completed upload id=396023worker2 # [ 98.569230] nix-grpc-daemon[1232]: time=2026-09-22T16:59:38.862Z level=INFO msg="Upload complete. (136ms)"6024worker2 # [ 98.571246] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 paths=1 nar_bytes_in=6566025lb # [ 98.559752] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo6026worker2 # [ 98.575360] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348786027lb # [ 98.563628] niks3-server[1120]: 2026/09/22 16:59:38 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst6028worker2 # [ 98.581591] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)6029worker2 # [ 98.583969] nix-daemon[851]: reaped child process 1297, status = succeeded6030worker2 # [ 98.589170] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)6031client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051...6032client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv6033client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6034client # farm-b> LOG-farm-b-after-niks3-restart6035worker2 # [ 99.603323] nix-daemon[851]: reaped child process 1306, status = succeeded6036worker2 # [ 99.679384] nix-daemon[851]: accepted connection from pid 1322, user nix-grpc-daemon (trusted)6037worker2 # [ 99.691384] nix-daemon[851]: reaped child process 1325, status = succeeded6038lb # [ 99.685660] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received uploads request method=POST path=/api/pending_closures6039worker2 # [ 99.709568] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.002Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6040worker2 # [ 99.711045] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.004Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)"6041lb # [ 99.727377] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv6042lb # [ 99.736747] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6043worker2 # [ 99.757805] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.050Z level=INFO msg="Uploading 1 narinfos"6044lb # [ 99.745090] niks3-server[1120]: 2026/09/22 16:59:40 INFO Signed narinfos id=40 count=16045lb # [ 99.751992] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls6046lb # [ 99.760783] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst6047lb # [ 99.766426] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6048lb # [ 99.770160] niks3-server[1120]: 2026/09/22 16:59:40 INFO Completed upload id=406049worker2 # [ 99.782937] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.076Z level=INFO msg="Upload complete. (187ms)"6050lb # [ 99.773417] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo6051worker2 # [ 99.786357] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=16052worker2 # [ 99.791649] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=06053worker2 # [ 99.794095] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=16054worker2 # [ 99.798825] nix-daemon[851]: reaped child process 1304, status = succeeded6055worker2 # [ 99.836254] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348786056worker2 # [ 99.848510] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348786057worker2 # [ 99.860937] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.153Z level=INFO msg="All 2 paths already cached"6058client # copying 1 paths to 'lb:50051'...6059client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'...6060worker2 # [ 99.870154] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348786061worker2 # [ 99.881166] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)6062worker2 # [ 99.974199] nix-daemon[851]: accepted connection from pid 1331, user nix-grpc-daemon (trusted)6063worker2 # [ 99.988976] nix-daemon[851]: reaped child process 1334, status = succeeded6064lb # [ 99.982143] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received uploads request method=POST path=/api/pending_closures6065worker2 # [ 100.002924] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.296Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6066worker2 # [ 100.004400] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.297Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)"6067lb # [ 100.015232] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6068lb # [ 100.020351] niks3-server[1120]: 2026/09/22 16:59:40 INFO Signed narinfos id=41 count=16069worker2 # [ 100.036025] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.329Z level=INFO msg="Uploading 1 narinfos"6070lb # [ 100.029520] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst6071lb # [ 100.039709] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls6072lb # [ 100.050304] niks3-server[1120]: 2026/09/22 16:59:40 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6073lb # [ 100.057124] niks3-server[1120]: 2026/09/22 16:59:40 INFO Completed upload id=416074worker2 # [ 100.069802] nix-grpc-daemon[1232]: time=2026-09-22T16:59:40.362Z level=INFO msg="Upload complete. (178ms)"6075lb # [ 100.060480] niks3-server[1120]: 2026/09/22 16:59:40 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo6076worker2 # [ 100.074940] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=0 paths=1 nar_bytes_in=7846077worker2 # [ 100.081360] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348786078worker2 # [ 100.095112] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)6079worker2 # [ 100.104150] nix-daemon[851]: reaped child process 1329, status = succeeded6080client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051...6081worker2 # [ 100.107928] nix-daemon[851]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)6082client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv6083client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6084client # farm-top> LOG-farm-top-after-niks3-restart6085worker2 # [ 101.524303] nix-daemon[851]: reaped child process 1338, status = succeeded6086worker2 # [ 101.596886] nix-daemon[851]: accepted connection from pid 1354, user nix-grpc-daemon (trusted)6087worker2 # [ 101.609975] nix-daemon[851]: reaped child process 1357, status = succeeded6088lb # [ 101.604638] niks3-server[1120]: 2026/09/22 16:59:41 INFO Received uploads request method=POST path=/api/pending_closures6089worker2 # [ 101.626753] nix-grpc-daemon[1232]: time=2026-09-22T16:59:41.919Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6090worker2 # [ 101.628429] nix-grpc-daemon[1232]: time=2026-09-22T16:59:41.921Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)"6091lb # [ 101.632089] niks3-server[1120]: 2026/09/22 16:59:41 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv6092lb # [ 101.636149] niks3-server[1120]: 2026/09/22 16:59:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6093lb # [ 101.638563] niks3-server[1120]: 2026/09/22 16:59:41 INFO Signed narinfos id=42 count=16094worker2 # [ 101.651465] nix-grpc-daemon[1232]: time=2026-09-22T16:59:41.944Z level=INFO msg="Uploading 1 narinfos"6095lb # [ 101.643713] niks3-server[1120]: 2026/09/22 16:59:41 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst6096lb # [ 101.646914] niks3-server[1120]: 2026/09/22 16:59:41 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls6097lb # [ 101.650464] niks3-server[1120]: 2026/09/22 16:59:41 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6098lb # [ 101.654246] niks3-server[1120]: 2026/09/22 16:59:41 INFO Completed upload id=426099worker2 # [ 101.668313] nix-grpc-daemon[1232]: time=2026-09-22T16:59:41.961Z level=INFO msg="Upload complete. (152ms)"6100lb # [ 101.657629] niks3-server[1120]: 2026/09/22 16:59:41 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo6101worker2 # [ 101.670948] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34878 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=16102worker2 # [ 101.678908] nix-daemon[851]: reaped child process 1336, status = succeeded6103client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 4.76 seconds)6104client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath6105client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.10 seconds)6106(finished: subtest: a niks3 restart does not cost the leader its role, in 5.18 seconds)6107subtest: scheduler down: the other node takes the lock and keeps it6108lb: must succeed: curl -sf localhost:9901/clusters6109lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6110lb: must succeed: curl -sf localhost:9901/clusters6111lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6112lb: must succeed: curl -sf localhost:9901/clusters6113lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6114lb: must succeed: curl -sf localhost:9901/clusters6115lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6116worker2 # [ 101.954771] systemd[1]: Stopping Nix worker-protocol over gRPC...6117worker2 # [ 102.724138] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:43Z level=info event=signal_exit6118lb # [ 103.684772] niks3-server[1120]: 2026/09/22 16:59:44 INFO lead: released remote=192.168.1.4:446146119worker2 # [ 104.695407] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=scheduler_restarting6120worker2 # [ 104.698329] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=scheduler_restarting addr=lb:500516121worker1 # [ 104.706768] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:44Z level=info event=scheduler_restarting addr=lb:500516122worker2 # [ 104.701830] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:366306123worker2 # [ 104.705927] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=worker_gone addr=192.168.1.3:500516124worker2 # [ 104.709884] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:366306125worker2 # [ 104.713361] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:44Z level=info event=worker_gone addr=192.168.1.4:500516126worker2 # [ 104.735443] nix-daemon[851]: reaped child process 1224, status = succeeded6127worker2 # [ 104.773658] nix-grpc-daemon[1172]: E0000 00:00:1790096385.066616 1217 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true6128worker2 # [ 104.779008] nix-grpc-daemon[1172]: E0000 00:00:1790096385.071957 1217 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6129worker1 # [ 104.906465] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:500516130worker1 # [ 104.911151] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6131worker2 # [ 104.911454] nix-grpc-daemon[1172]: ts=2026-09-22T16:59:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6132worker1 # [ 105.112398] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:500516133worker1 # [ 105.116417] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6134lb # [ 105.162238] envoy[907]: conn peer=[2001:db8:1::1]:35296 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1008 tx=282 ms=13416135lb # [ 105.167746] envoy[907]: conn peer=[2001:db8:1::1]:35304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9718 tx=4376 ms=46416136lb # [ 105.171395] envoy[907]: conn peer=[2001:db8:1::4]:38140 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5880 tx=625 ms=141386137worker1 # [ 105.317277] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:500516138worker1 # [ 105.321321] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6139worker1 # [ 105.521882] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:500516140worker1 # [ 105.525811] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6141worker1 # [ 105.727465] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_connected addr=lb:500516142worker1 # [ 105.731389] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6143worker1 # [ 105.932267] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_connected addr=lb:500516144worker1 # [ 105.936357] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6145worker1 # [ 106.137134] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_connected addr=lb:500516146worker1 # [ 106.141156] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6147worker1 # [ 106.341983] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_connected addr=lb:500516148worker1 # [ 106.345952] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6149worker1 # [ 106.546757] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_connected addr=lb:500516150worker1 # [ 106.550761] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6151worker1 # [ 106.752841] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:500516152worker1 # [ 106.757091] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6153worker2 # [ 106.904674] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6154worker2 # [ 106.908812] systemd[1]: Stopped Nix worker-protocol over gRPC.6155worker2 # [ 106.913154] systemd[1]: nix-grpc-daemon.service: Consumed 840ms CPU time over 16.284s wall clock time, 37.8M memory peak, 46.5K incoming IP traffic, 85.3K outgoing IP traffic.6156worker2 # [ 106.925556] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.6157worker2 # [ 106.929970] systemd[1]: Closed Nix worker-protocol over gRPC.6158worker2 # [ 106.933607] systemd[1]: nix-grpc-daemon.socket: Consumed 314us CPU time over 16.896s wall clock time, 256K memory peak, 37.7K incoming IP traffic, 28K outgoing IP traffic.6159worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over6160worker1 # [ 106.957991] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:500516161worker1 # [ 106.963216] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6162worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds)6163worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6164worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds)6165worker1 # [ 107.163939] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:500516166worker1 # [ 107.168154] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6167worker1 # [ 107.368856] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:500516168worker1 # [ 107.373105] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6169worker1 # [ 107.573795] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_connected addr=lb:500516170worker1 # [ 107.577672] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6171worker1 # [ 107.702208] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:47Z level=info event=scheduler_take_over6172lb # [ 107.682731] niks3-server[1120]: 2026/09/22 16:59:48 INFO lead: acquired remote=192.168.1.3:359926173worker1 # [ 107.779088] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=info event=scheduler_connected addr=lb:500516174worker1 # [ 107.786130] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:486586175worker1 # [ 107.790687] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06176worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6177worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6178client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&26179worker1 # [ 108.224562] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:470746180client # don't know how to build these paths:6181client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6182worker1 # [ 108.233900] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:470746183worker1 # [ 108.244384] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5)6184worker1 # [ 108.262891] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 2/5)6185worker1 # [ 108.290269] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 3/5)6186worker1 # [ 108.423249] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 282 ms (attempt 4/5)6187worker1 # [ 108.706457] nix-grpc-daemon[1330]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6188worker1 # [ 108.708269] nix-grpc-daemon[1330]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6189worker1 # [ 108.724076] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=06190worker1 # [ 108.726727] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:48Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=16191worker1 # [ 108.768428] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:470746192worker1 # [ 108.778165] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:470746193client # copying 1 paths to 'lb:50051'...6194client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...6195worker1 # [ 108.787449] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:470746196worker1 # [ 108.792382] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6197worker1 # [ 108.804503] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=info event=niks3_push_started pid=14066198worker1 # [ 108.893592] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.145Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""6199worker1 # [ 108.976624] nix-daemon[861]: accepted connection from pid 1419, user nix-grpc-daemon (trusted)6200worker1 # [ 108.990380] nix-daemon[861]: reaped child process 1422, status = succeeded6201lb # [ 108.977262] niks3-server[1120]: 2026/09/22 16:59:49 INFO Received uploads request method=POST path=/api/pending_closures6202worker1 # [ 109.004994] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.257Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6203worker1 # [ 109.006561] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.259Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"6204lb # [ 109.019160] niks3-server[1120]: 2026/09/22 16:59:49 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls6205lb # [ 109.025983] niks3-server[1120]: 2026/09/22 16:59:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6206worker1 # [ 109.053198] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.305Z level=INFO msg="Uploading 1 narinfos"6207lb # [ 109.033080] niks3-server[1120]: 2026/09/22 16:59:49 INFO Signed narinfos id=43 count=16208lb # [ 109.047142] niks3-server[1120]: 2026/09/22 16:59:49 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst6209lb # [ 109.056879] niks3-server[1120]: 2026/09/22 16:59:49 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6210lb # [ 109.062590] niks3-server[1120]: 2026/09/22 16:59:49 INFO Completed upload id=436211worker1 # [ 109.085181] nix-grpc-daemon[1406]: time=2026-09-22T16:59:49.337Z level=INFO msg="Upload complete. (188ms)"6212lb # [ 109.066933] niks3-server[1120]: 2026/09/22 16:59:49 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo6213worker1 # [ 109.090274] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=0 paths=1 nar_bytes_in=5206214worker1 # [ 109.096669] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:470746215worker1 # [ 109.107112] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6216worker1 # [ 109.114608] nix-daemon[861]: reaped child process 1404, status = succeeded6217worker1 # [ 109.119336] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6218client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...6219client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv6220client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6221client # farm-a> LOG-farm-a-on-standby6222worker1 # [ 110.352084] nix-daemon[861]: reaped child process 1426, status = succeeded6223worker1 # [ 110.438469] nix-daemon[861]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)6224worker1 # [ 110.451903] nix-daemon[861]: reaped child process 1445, status = succeeded6225lb # [ 110.436867] niks3-server[1120]: 2026/09/22 16:59:50 INFO Received uploads request method=POST path=/api/pending_closures6226worker1 # [ 110.466483] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.718Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6227worker1 # [ 110.468159] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.720Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"6228lb # [ 110.480989] niks3-server[1120]: 2026/09/22 16:59:50 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst6229lb # [ 110.487952] niks3-server[1120]: 2026/09/22 16:59:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6230worker1 # [ 110.513334] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.765Z level=INFO msg="Uploading 1 narinfos"6231lb # [ 110.493357] niks3-server[1120]: 2026/09/22 16:59:50 INFO Signed narinfos id=44 count=16232lb # [ 110.502538] niks3-server[1120]: 2026/09/22 16:59:50 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls6233lb # [ 110.511335] niks3-server[1120]: 2026/09/22 16:59:50 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6234lb # [ 110.521337] niks3-server[1120]: 2026/09/22 16:59:50 INFO Completed upload id=446235worker1 # [ 110.542100] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.794Z level=INFO msg="Upload complete. (214ms)"6236lb # [ 110.523880] niks3-server[1120]: 2026/09/22 16:59:50 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv6237worker1 # [ 110.549158] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=16238lb # [ 110.535318] niks3-server[1120]: 2026/09/22 16:59:50 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo6239worker1 # [ 110.561835] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=06240worker1 # [ 110.565357] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=16241worker1 # [ 110.572821] nix-daemon[861]: reaped child process 1424, status = succeeded6242worker1 # [ 110.605645] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:470746243worker1 # [ 110.619327] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:470746244worker1 # [ 110.633564] nix-grpc-daemon[1406]: time=2026-09-22T16:59:50.886Z level=INFO msg="All 1 paths already cached"6245client # copying 1 paths to 'lb:50051'...6246client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...6247worker1 # [ 110.642878] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:470746248worker1 # [ 110.652351] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6249worker1 # [ 110.746721] nix-daemon[861]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)6250worker1 # [ 110.759358] nix-daemon[861]: reaped child process 1454, status = succeeded6251lb # [ 110.746950] niks3-server[1120]: 2026/09/22 16:59:51 INFO Received uploads request method=POST path=/api/pending_closures6252worker1 # [ 110.783490] nix-grpc-daemon[1406]: time=2026-09-22T16:59:51.036Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6253worker1 # [ 110.784979] nix-grpc-daemon[1406]: time=2026-09-22T16:59:51.037Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"6254lb # [ 110.789269] niks3-server[1120]: 2026/09/22 16:59:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6255lb # [ 110.791642] niks3-server[1120]: 2026/09/22 16:59:51 INFO Signed narinfos id=45 count=16256worker1 # [ 110.812146] nix-grpc-daemon[1406]: time=2026-09-22T16:59:51.064Z level=INFO msg="Uploading 1 narinfos"6257lb # [ 110.795114] niks3-server[1120]: 2026/09/22 16:59:51 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst6258lb # [ 110.798365] niks3-server[1120]: 2026/09/22 16:59:51 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls6259lb # [ 110.805896] niks3-server[1120]: 2026/09/22 16:59:51 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6260lb # [ 110.810243] niks3-server[1120]: 2026/09/22 16:59:51 INFO Completed upload id=456261worker1 # [ 110.830092] nix-grpc-daemon[1406]: time=2026-09-22T16:59:51.082Z level=INFO msg="Upload complete. (166ms)"6262lb # [ 110.813054] niks3-server[1120]: 2026/09/22 16:59:51 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo6263worker1 # [ 110.834061] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=0 paths=1 nar_bytes_in=6406264worker1 # [ 110.839445] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:470746265worker1 # [ 110.847568] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6266worker1 # [ 110.852210] nix-daemon[861]: reaped child process 1449, status = succeeded6267worker1 # [ 110.856407] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6268client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...6269client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv6270client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6271client # farm-b> LOG-farm-b-on-standby6272worker1 # [ 112.073605] nix-daemon[861]: reaped child process 1458, status = succeeded6273worker1 # [ 112.148377] nix-daemon[861]: accepted connection from pid 1474, user nix-grpc-daemon (trusted)6274worker1 # [ 112.159920] nix-daemon[861]: reaped child process 1477, status = succeeded6275lb # [ 112.146255] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received uploads request method=POST path=/api/pending_closures6276worker1 # [ 112.172375] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.424Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6277worker1 # [ 112.173937] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.426Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"6278lb # [ 112.169381] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv6279lb # [ 112.172327] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls6280lb # [ 112.174618] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6281lb # [ 112.178053] niks3-server[1120]: 2026/09/22 16:59:52 INFO Signed narinfos id=46 count=16282worker1 # [ 112.199907] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.452Z level=INFO msg="Uploading 1 narinfos"6283lb # [ 112.181254] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst6284lb # [ 112.187178] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6285lb # [ 112.191128] niks3-server[1120]: 2026/09/22 16:59:52 INFO Completed upload id=466286worker1 # [ 112.211257] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.463Z level=INFO msg="Upload complete. (146ms)"6287lb # [ 112.192637] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo6288worker1 # [ 112.213872] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=16289worker1 # [ 112.222374] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=06290worker1 # [ 112.224108] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=16291worker1 # [ 112.227175] nix-daemon[861]: reaped child process 1456, status = succeeded6292worker1 # [ 112.265147] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:470746293worker1 # [ 112.273956] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:470746294worker1 # [ 112.282651] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.535Z level=INFO msg="All 2 paths already cached"6295client # copying 1 paths to 'lb:50051'...6296client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...6297worker1 # [ 112.288596] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:470746298worker1 # [ 112.296886] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6299worker1 # [ 112.380775] nix-daemon[861]: accepted connection from pid 1483, user nix-grpc-daemon (trusted)6300worker1 # [ 112.394059] nix-daemon[861]: reaped child process 1486, status = succeeded6301lb # [ 112.378612] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received uploads request method=POST path=/api/pending_closures6302worker1 # [ 112.403406] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.656Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6303worker1 # [ 112.404925] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.657Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"6304lb # [ 112.395504] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6305worker1 # [ 112.419673] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.672Z level=INFO msg="Uploading 1 narinfos"6306lb # [ 112.400050] niks3-server[1120]: 2026/09/22 16:59:52 INFO Signed narinfos id=47 count=16307lb # [ 112.402905] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls6308lb # [ 112.405050] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst6309lb # [ 112.409439] niks3-server[1120]: 2026/09/22 16:59:52 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6310lb # [ 112.413168] niks3-server[1120]: 2026/09/22 16:59:52 INFO Completed upload id=476311worker1 # [ 112.433557] nix-grpc-daemon[1406]: time=2026-09-22T16:59:52.686Z level=INFO msg="Upload complete. (129ms)"6312worker1 # [ 112.435743] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=0 paths=1 nar_bytes_in=7686313lb # [ 112.416310] niks3-server[1120]: 2026/09/22 16:59:52 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo6314worker1 # [ 112.439295] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:470746315worker1 # [ 112.446797] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6316worker1 # [ 112.448228] nix-daemon[861]: reaped child process 1481, status = succeeded6317client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...6318worker1 # [ 112.453284] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6319client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6320client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6321client # farm-top> LOG-farm-top-on-standby6322worker1 # [ 113.490818] nix-daemon[861]: reaped child process 1490, status = succeeded6323worker1 # [ 113.573743] nix-daemon[861]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)6324worker1 # [ 113.585641] nix-daemon[861]: reaped child process 1509, status = succeeded6325lb # [ 113.571393] niks3-server[1120]: 2026/09/22 16:59:53 INFO Received uploads request method=POST path=/api/pending_closures6326worker1 # [ 113.597117] nix-grpc-daemon[1406]: time=2026-09-22T16:59:53.849Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6327worker1 # [ 113.600288] nix-grpc-daemon[1406]: time=2026-09-22T16:59:53.851Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"6328lb # [ 113.593811] niks3-server[1120]: 2026/09/22 16:59:53 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst6329lb # [ 113.596608] niks3-server[1120]: 2026/09/22 16:59:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6330lb # [ 113.598581] niks3-server[1120]: 2026/09/22 16:59:53 INFO Signed narinfos id=48 count=16331worker1 # [ 113.620623] nix-grpc-daemon[1406]: time=2026-09-22T16:59:53.872Z level=INFO msg="Uploading 1 narinfos"6332lb # [ 113.600183] niks3-server[1120]: 2026/09/22 16:59:53 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6333lb # [ 113.606781] niks3-server[1120]: 2026/09/22 16:59:53 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls6334lb # [ 113.609317] niks3-server[1120]: 2026/09/22 16:59:53 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6335lb # [ 113.612630] niks3-server[1120]: 2026/09/22 16:59:53 INFO Completed upload id=486336worker1 # [ 113.633204] nix-grpc-daemon[1406]: time=2026-09-22T16:59:53.885Z level=INFO msg="Upload complete. (173ms)"6337lb # [ 113.616922] niks3-server[1120]: 2026/09/22 16:59:53 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo6338worker1 # [ 113.636289] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=16339worker1 # [ 113.645360] nix-daemon[861]: reaped child process 1488, status = succeeded6340client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.60 seconds)6341client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath6342client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.12 seconds)6343worker2 # [ 113.811887] systemd[1]: Listening on Nix worker-protocol over gRPC.6344worker2 # [ 113.815161] systemd[1]: Starting scheduler-token.service...6345worker2 # [ 113.851779] systemd[1]: scheduler-token.service: Deactivated successfully.6346worker2 # [ 113.853426] systemd[1]: Finished scheduler-token.service.6347worker2 # [ 113.855258] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 38ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6348worker2 # [ 113.859064] systemd[1]: Starting Nix worker-protocol over gRPC...6349worker2 # [ 113.937116] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6350worker2 # [ 113.939126] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6351worker2 # [ 113.942354] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16352worker2 # [ 113.946721] nix-grpc-daemon[1378]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6353worker2 # [ 113.948092] nix-grpc-daemon[1378]: E0000 00:00:1790096394.239533 1378 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6354worker2 # [ 113.954234] nix-grpc-daemon[1378]: E0000 00:00:1790096394.244939 1378 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6355worker2 # [ 113.957970] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6356worker2 # [ 113.960837] systemd[1]: Started Nix worker-protocol over gRPC.6357worker2 # [ 113.962923] nix-grpc-daemon[1378]: E0000 00:00:1790096394.256124 1419 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6358lb: must succeed: curl -sf localhost:9901/clusters6359worker2 # [ 113.977066] nix-grpc-daemon[1378]: E0000 00:00:1790096394.270007 1419 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6360worker2 # [ 113.980222] nix-grpc-daemon[1378]: E0000 00:00:1790096394.270122 1419 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6361worker2 # [ 113.991112] nix-grpc-daemon[1378]: E0000 00:00:1790096394.284244 1419 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6362worker2 # [ 114.002832] nix-grpc-daemon[1378]: ts=2026-09-22T16:59:54Z level=info event=scheduler_connected addr=lb:500516363worker1 # [ 114.019191] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=info event=oidc_jwks provider=mock keys=16364worker1 # [ 114.024712] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:486586365worker1 # [ 114.029404] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06366lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6367worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6368worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)6369lb: must succeed: curl -sf localhost:9901/clusters6370lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6371lb: must succeed: curl -sf localhost:9901/clusters6372lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6373worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6374worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6375(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.35 seconds)6376subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise6377client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs6378client # [ 114.171652] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs.6379client # Running as unit: rs.service; invocation ID: e389dd8a68954c73afdf71171879ebc06380client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.03 seconds)6381worker1 # [ 114.298765] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:470746382client # [ 114.302910] nix[1361]: don't know how to build these paths:6383client # [ 114.303839] nix[1361]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv6384worker1 # [ 114.312292] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=06385worker1 # [ 114.316300] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=16386worker1 # [ 114.364660] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:470746387worker1 # [ 114.376161] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:470746388client # [ 114.383263] nix[1361]: copying 1 paths to 'lb:50051'...6389worker1 # [ 114.386531] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:470746390client # [ 114.385529] nix[1361]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...6391worker1 # [ 114.395902] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6392worker1 # [ 114.495514] nix-daemon[861]: accepted connection from pid 1522, user nix-grpc-daemon (trusted)6393worker1 # [ 114.508267] nix-daemon[861]: reaped child process 1525, status = succeeded6394lb # [ 114.494129] niks3-server[1120]: 2026/09/22 16:59:54 INFO Received uploads request method=POST path=/api/pending_closures6395worker1 # [ 114.519125] nix-grpc-daemon[1406]: time=2026-09-22T16:59:54.771Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6396worker1 # [ 114.520688] nix-grpc-daemon[1406]: time=2026-09-22T16:59:54.773Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"6397lb # [ 114.510540] niks3-server[1120]: 2026/09/22 16:59:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6398lb # [ 114.514231] niks3-server[1120]: 2026/09/22 16:59:54 INFO Signed narinfos id=49 count=16399worker1 # [ 114.534839] nix-grpc-daemon[1406]: time=2026-09-22T16:59:54.787Z level=INFO msg="Uploading 1 narinfos"6400lb # [ 114.516787] niks3-server[1120]: 2026/09/22 16:59:54 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst6401lb # [ 114.521600] niks3-server[1120]: 2026/09/22 16:59:54 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6402lb # [ 114.524773] niks3-server[1120]: 2026/09/22 16:59:54 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls6403lb # [ 114.527712] niks3-server[1120]: 2026/09/22 16:59:54 INFO Completed upload id=496404worker1 # [ 114.549492] nix-grpc-daemon[1406]: time=2026-09-22T16:59:54.802Z level=INFO msg="Upload complete. (140ms)"6405lb # [ 114.529765] niks3-server[1120]: 2026/09/22 16:59:54 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo6406worker1 # [ 114.551597] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=0 paths=1 nar_bytes_in=4166407worker1 # [ 114.554446] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:470746408worker1 # [ 114.560537] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6409worker1 # [ 114.564375] nix-daemon[861]: reaped child process 1520, status = succeeded6410worker1 # [ 114.568777] nix-daemon[861]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)6411client # [ 114.566332] nix[1361]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...6412lb # [ 115.163183] envoy[907]: conn peer=[2001:db8:1::1]:51594 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9586 tx=4395 ms=54276413lb: must succeed: curl -sf localhost:9901/clusters6414lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6415lb: must succeed: curl -sf localhost:9901/clusters6416lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6417lb: must succeed: curl -sf localhost:9901/clusters6418lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6419lb: must succeed: curl -sf localhost:9901/clusters6420lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6421worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true6422worker2 # [ 116.807927] systemd-journald[283]: Received client request to rotate journal, rotating.6423worker2 # [ 116.826079] systemd-journald[283]: Vacuuming done, freed 0B of archived journals from /var/log/journal/1d0a62af5b194d4dbe4a770d60074cbf.6424worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds)6425worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service6426worker1 # [ 116.744404] systemd[1]: Stopping Nix worker-protocol over gRPC...6427worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds)6428client: must succeed: sleep 5.06429worker1 # [ 117.509625] nix-grpc-daemon[1330]: ts=2026-09-22T16:59:57Z level=info event=draining6430client: (finished: must succeed: sleep 5.0, in 5.03 seconds)6431worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='6432worker1 # [ 121.989363] nix-daemon[861]: reaped child process 1529, status = succeeded6433worker1 # [ 122.062870] nix-daemon[861]: accepted connection from pid 1570, user nix-grpc-daemon (trusted)6434worker1 # [ 122.075460] nix-daemon[861]: reaped child process 1573, status = succeeded6435lb # [ 122.063610] niks3-server[1120]: 2026/09/22 17:00:02 INFO Received uploads request method=POST path=/api/pending_closures6436worker1 # [ 122.091912] nix-grpc-daemon[1406]: time=2026-09-22T17:00:02.344Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6437worker1 # [ 122.093785] nix-grpc-daemon[1406]: time=2026-09-22T17:00:02.346Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"6438lb # [ 122.107621] niks3-server[1120]: 2026/09/22 17:00:02 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls6439lb # [ 122.122417] niks3-server[1120]: 2026/09/22 17:00:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6440lb # [ 122.128231] niks3-server[1120]: 2026/09/22 17:00:02 INFO Signed narinfos id=50 count=16441worker1 # [ 122.148756] nix-grpc-daemon[1406]: time=2026-09-22T17:00:02.401Z level=INFO msg="Uploading 1 narinfos"6442lb # [ 122.133693] niks3-server[1120]: 2026/09/22 17:00:02 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst6443lb # [ 122.145238] niks3-server[1120]: 2026/09/22 17:00:02 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv6444lb # [ 122.149669] niks3-server[1120]: 2026/09/22 17:00:02 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6445lb # [ 122.154375] niks3-server[1120]: 2026/09/22 17:00:02 INFO Completed upload id=506446lb # [ 122.156554] niks3-server[1120]: 2026/09/22 17:00:02 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo6447worker1 # [ 122.176320] nix-grpc-daemon[1406]: time=2026-09-22T17:00:02.428Z level=INFO msg="Upload complete. (193ms)"6448worker1 # [ 122.184976] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47074 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=16449worker1 # [ 122.199533] nix-daemon[861]: reaped child process 1527, status = succeeded6450client # [ 122.210353] systemd[1]: rs.service: Deactivated successfully.6451client # [ 122.213878] systemd[1]: rs.service: Consumed 126ms CPU time over 8.041s wall clock time, 41.4M memory peak, 7.2K incoming IP traffic, 8.3K outgoing IP traffic.6452worker1 # [ 122.510225] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:02Z level=info event=signal_exit6453lb # [ 122.681907] niks3-server[1120]: 2026/09/22 17:00:03 INFO lead: released remote=192.168.1.3:359926454worker2 # [ 123.697410] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:03Z level=info event=scheduler_restarting addr=lb:500516455worker1 # [ 123.707895] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=scheduler_restarting6456worker1 # [ 123.712186] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=scheduler_restarting addr=lb:500516457worker1 # [ 123.716166] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:486586458worker1 # [ 123.719782] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=worker_gone addr=192.168.1.4:500516459worker1 # [ 123.723107] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:486586460worker1 # [ 123.726735] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:03Z level=info event=worker_gone addr=192.168.1.3:500516461worker1 # [ 123.741759] nix-daemon[861]: reaped child process 1382, status = succeeded6462worker1 # [ 123.795152] nix-grpc-daemon[1330]: E0000 00:00:1790096404.047465 1375 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true6463worker1 # [ 123.800502] nix-grpc-daemon[1330]: E0000 00:00:1790096404.047948 1375 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6464worker2 # [ 123.897647] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:500516465worker2 # [ 123.901873] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6466worker1 # [ 123.917800] nix-grpc-daemon[1330]: ts=2026-09-22T17:00:04Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6467lb # [ 123.952397] niks3-server[1120]: 2026/09/22 17:00:04 INFO lead: acquired remote=192.168.1.4:420906468worker2 # [ 123.968070] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_take_over6469worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.11 seconds)6470client: waiting for success: ! systemctl is-active rs6471client: (finished: waiting for success: ! systemctl is-active rs, in 0.03 seconds)6472client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }6473worker1 # [ 124.106255] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6474worker1 # [ 124.108871] systemd[1]: Stopped Nix worker-protocol over gRPC.6475worker2 # [ 124.102834] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:500516476worker1 # [ 124.111469] systemd[1]: nix-grpc-daemon.service: Consumed 1.001s CPU time over 28.703s wall clock time, 37.3M memory peak, 48.2K incoming IP traffic, 95.5K outgoing IP traffic.6477worker2 # [ 124.106694] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6478client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)6479client: must fail: journalctl -u rs | grep -q 'reconnecting'6480worker1 # [ 124.127368] systemd[1]: Starting Nix worker-protocol over gRPC...6481client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds)6482lb: must succeed: curl -sf localhost:9901/clusters6483lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6484worker1 # [ 124.221078] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6485worker1 # [ 124.226050] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6486worker1 # [ 124.230207] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16487worker1 # [ 124.232309] nix-grpc-daemon[1580]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6488worker1 # [ 124.233604] nix-grpc-daemon[1580]: E0000 00:00:1790096404.481375 1580 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6489worker1 # [ 124.241065] nix-grpc-daemon[1580]: E0000 00:00:1790096404.489144 1580 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6490worker1 # [ 124.244101] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6491worker1 # [ 124.247185] systemd[1]: Started Nix worker-protocol over gRPC.6492worker1 # [ 124.247945] nix-grpc-daemon[1580]: E0000 00:00:1790096404.496228 1621 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6493worker1 # [ 124.257813] nix-grpc-daemon[1580]: E0000 00:00:1790096404.510352 1621 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6494worker1 # [ 124.262052] nix-grpc-daemon[1580]: E0000 00:00:1790096404.512625 1621 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6495worker1 # [ 124.271731] nix-grpc-daemon[1580]: E0000 00:00:1790096404.524282 1621 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6496worker1 # [ 124.279281] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:500516497worker1 # [ 124.280789] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6498worker2 # [ 124.307868] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:500516499worker2 # [ 124.311814] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6500worker1 # [ 124.481358] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:500516501worker1 # [ 124.483214] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6502worker2 # [ 124.512573] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:500516503worker2 # [ 124.514386] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6504worker1 # [ 124.683696] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_connected addr=lb:500516505worker1 # [ 124.685516] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6506worker2 # [ 124.716482] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=scheduler_connected addr=lb:500516507worker2 # [ 124.720156] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6508worker1 # [ 124.886633] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:05Z level=info event=scheduler_connected addr=lb:500516509worker2 # [ 124.883774] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:538166510worker2 # [ 124.888476] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06511worker2 # [ 124.920898] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=scheduler_connected addr=lb:500516512worker2 # [ 124.930139] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=oidc_jwks provider=mock keys=16513worker2 # [ 124.933849] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:538166514worker2 # [ 124.937747] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06515lb: must succeed: curl -sf localhost:9901/clusters6516lb # [ 125.163642] envoy[907]: conn peer=[2001:db8:1::1]:33334 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2956 tx=1498 ms=78956517lb # [ 125.168499] envoy[907]: conn peer=[2001:db8:1::3]:43162 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4382 tx=1078 ms=283586518lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6519worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6520worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6521(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 11.12 seconds)6522subtest: scheduler restart mid-build: build finishes, no double build6523client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid6524client # [ 125.317162] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid.6525client # Running as unit: mid.service; invocation ID: 844a42eb682c46bfaf562152b2e68c486526client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds)6527worker2 # [ 125.452800] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:538266528worker2 # [ 125.463596] nix-daemon[851]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6529client # [ 125.481349] nix[1397]: don't know how to build these paths:6530client # [ 125.482231] nix[1397]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6531worker2 # [ 125.481950] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=06532worker2 # [ 125.486392] nix-grpc-daemon[1378]: ts=2026-09-22T17:00:05Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=16533worker1 # [ 125.546383] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476726534worker1 # [ 125.557496] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6535worker1 # [ 125.574159] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 1/5)6536worker1 # [ 125.654946] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 2/5)6537worker1 # [ 125.680347] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 3/5)6538worker1 # [ 125.760470] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 527 ms (attempt 4/5)6539worker1 # [ 126.290255] nix-grpc-daemon[1580]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6540worker1 # [ 126.293176] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6541worker1 # [ 126.309827] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476726542client # [ 126.318116] nix[1397]: copying 1 paths to 'lb:50051'...6543client # [ 126.321997] nix[1397]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...6544worker1 # [ 126.324504] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476726545worker1 # [ 126.333310] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6546worker1 # [ 126.354936] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=info event=niks3_push_started pid=16446547worker1 # [ 126.459226] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.711Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""6548worker1 # [ 126.551546] nix-daemon[861]: accepted connection from pid 1660, user nix-grpc-daemon (trusted)6549worker1 # [ 126.563814] nix-daemon[861]: reaped child process 1663, status = succeeded6550lb # [ 126.550433] niks3-server[1120]: 2026/09/22 17:00:06 INFO Received uploads request method=POST path=/api/pending_closures6551worker1 # [ 126.579098] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.831Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6552worker1 # [ 126.580560] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.833Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"6553lb # [ 126.589377] niks3-server[1120]: 2026/09/22 17:00:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6554lb # [ 126.595711] niks3-server[1120]: 2026/09/22 17:00:06 INFO Signed narinfos id=51 count=16555worker1 # [ 126.620877] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.872Z level=INFO msg="Uploading 1 narinfos"6556lb # [ 126.603292] niks3-server[1120]: 2026/09/22 17:00:06 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls6557lb # [ 126.622435] niks3-server[1120]: 2026/09/22 17:00:06 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6558lb # [ 126.635505] niks3-server[1120]: 2026/09/22 17:00:06 INFO Completed upload id=516559worker1 # [ 126.656264] nix-grpc-daemon[1644]: time=2026-09-22T17:00:06.908Z level=INFO msg="Upload complete. (193ms)"6560lb # [ 126.638336] niks3-server[1120]: 2026/09/22 17:00:06 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo6561lb # [ 126.641950] niks3-server[1120]: 2026/09/22 17:00:06 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst6562worker1 # [ 126.662168] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47672 duration_s=0 paths=1 nar_bytes_in=4246563worker1 # [ 126.667984] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476726564worker1 # [ 126.678936] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6565worker1 # [ 126.684691] nix-daemon[861]: reaped child process 1642, status = succeeded6566worker1 # [ 126.692453] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6567client # [ 126.690469] nix[1397]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...6568lb: must succeed: curl -sf localhost:9901/clusters6569lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6570lb: must succeed: curl -sf localhost:9901/clusters6571lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6572worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6573worker2 # [ 127.809798] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1378 (nix-grpc-daemon) on client request.6574lb # [ 127.812488] niks3-server[1120]: 2026/09/22 17:00:08 INFO lead: released remote=192.168.1.4:420906575worker2 # [ 127.829123] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6576worker1 # [ 127.841509] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:08Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"6577client # [ 127.839880] nix[1397]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6578worker2 # [ 127.838766] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6579worker2 # [ 127.844298] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6580worker2 # [ 127.847863] systemd[1]: nix-grpc-daemon.service: Consumed 199ms CPU time over 13.983s wall clock time, 13.4M memory peak, 10.5K incoming IP traffic, 21K outgoing IP traffic.6581worker2 # [ 127.864708] systemd[1]: Starting scheduler-token.service...6582worker2 # [ 127.867459] nix-daemon[851]: reaped child process 1487, status = succeeded6583worker2 # [ 127.901084] systemd[1]: scheduler-token.service: Deactivated successfully.6584worker2 # [ 127.903116] systemd[1]: Finished scheduler-token.service.6585worker2 # [ 127.903959] systemd[1]: scheduler-token.service: Consumed 15ms CPU time over 35ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6586worker2 # [ 127.905759] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6587worker2 # [ 127.908586] systemd[1]: Starting scheduler-token.service...6588worker2 # [ 127.941512] systemd[1]: scheduler-token.service: Deactivated successfully.6589worker2 # [ 127.943097] systemd[1]: Finished scheduler-token.service.6590worker2 # [ 127.945103] systemd[1]: scheduler-token.service: Consumed 15ms CPU time over 34ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6591worker2 # [ 127.948568] systemd[1]: Starting Nix worker-protocol over gRPC...6592worker2 # [ 128.023802] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6593worker2 # [ 128.025736] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6594worker2 # [ 128.028842] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16595worker2 # [ 128.033051] nix-grpc-daemon[1517]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6596worker1 # [ 128.041703] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:08Z level=info event=scheduler_connected addr=lb:500516597worker2 # [ 128.034807] nix-grpc-daemon[1517]: E0000 00:00:1790096408.326204 1517 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6598worker2 # [ 128.040543] nix-grpc-daemon[1517]: E0000 00:00:1790096408.331962 1517 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6599worker2 # [ 128.047109] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6600worker2 # [ 128.050121] systemd[1]: Started Nix worker-protocol over gRPC.6601worker2 # [ 128.054899] nix-grpc-daemon[1517]: E0000 00:00:1790096408.348097 1556 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6602lb # [ 128.043910] niks3-server[1120]: 2026/09/22 17:00:08 INFO lead: acquired remote=192.168.1.4:492846603worker2 # [ 128.058813] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=scheduler_take_over6604worker2 # [ 128.062096] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:538526605worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.29 seconds)6606client: must succeed: sleep 5.06607worker2 # [ 128.065105] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=16608worker2 # [ 128.075817] nix-grpc-daemon[1517]: E0000 00:00:1790096408.368931 1556 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6609worker2 # [ 128.081053] nix-grpc-daemon[1517]: E0000 00:00:1790096408.371278 1556 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6610worker2 # [ 128.089903] nix-grpc-daemon[1517]: E0000 00:00:1790096408.383062 1556 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6611worker2 # [ 128.099259] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=scheduler_connected addr=lb:500516612worker2 # [ 128.104569] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=oidc_jwks provider=mock keys=16613worker2 # [ 128.106265] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:538526614worker2 # [ 128.107940] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06615client: (finished: must succeed: sleep 5.0, in 5.03 seconds)6616client: waiting for success: ! systemctl is-active mid6617worker1 # [ 133.315364] nix-daemon[861]: reaped child process 1667, status = succeeded6618worker1 # [ 133.381084] nix-daemon[861]: accepted connection from pid 1700, user nix-grpc-daemon (trusted)6619worker1 # [ 133.394695] nix-daemon[861]: reaped child process 1703, status = succeeded6620lb # [ 133.376338] niks3-server[1120]: 2026/09/22 17:00:13 INFO Received uploads request method=POST path=/api/pending_closures6621worker1 # [ 133.406066] nix-grpc-daemon[1644]: time=2026-09-22T17:00:13.658Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6622worker1 # [ 133.407548] nix-grpc-daemon[1644]: time=2026-09-22T17:00:13.660Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"6623lb # [ 133.418995] niks3-server[1120]: 2026/09/22 17:00:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6624worker1 # [ 133.444956] nix-grpc-daemon[1644]: time=2026-09-22T17:00:13.697Z level=INFO msg="Uploading 1 narinfos"6625lb # [ 133.424859] niks3-server[1120]: 2026/09/22 17:00:13 INFO Signed narinfos id=52 count=16626lb # [ 133.438479] niks3-server[1120]: 2026/09/22 17:00:13 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6627lb # [ 133.444144] niks3-server[1120]: 2026/09/22 17:00:13 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls6628lb # [ 133.447977] niks3-server[1120]: 2026/09/22 17:00:13 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6629lb # [ 133.456935] niks3-server[1120]: 2026/09/22 17:00:13 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6630lb # [ 133.461737] niks3-server[1120]: 2026/09/22 17:00:13 INFO Completed upload id=526631worker1 # [ 133.482453] nix-grpc-daemon[1644]: time=2026-09-22T17:00:13.734Z level=INFO msg="Upload complete. (178ms)"6632lb # [ 133.466556] niks3-server[1120]: 2026/09/22 17:00:13 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo6633worker1 # [ 133.488593] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47672 duration_s=6 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=16634worker1 # [ 133.502370] nix-daemon[861]: reaped child process 1665, status = succeeded6635client # [ 133.519539] systemd[1]: mid.service: Deactivated successfully.6636client # [ 133.522968] systemd[1]: mid.service: Consumed 133ms CPU time over 8.205s wall clock time, 41.4M memory peak, 7.6K incoming IP traffic, 8.5K outgoing IP traffic.6637client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds)6638client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6639client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)6640(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.11 seconds)6641subtest: interrupting the client stops the build on the worker6642client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr6643client # [ 134.401458] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr.6644client # Running as unit: intr.service; invocation ID: dcc8a9c7b95a42e28088988d1737d79e6645client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds)6646client # [ 134.521153] nix[1433]: don't know how to build these paths:6647client # [ 134.521970] nix[1433]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6648worker1 # [ 134.522334] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:476726649worker2 # [ 134.524994] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:14Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=06650worker2 # [ 134.529870] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:14Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=16651worker2 # [ 134.570859] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423006652worker2 # [ 134.581936] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6653worker2 # [ 134.597805] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5)6654worker2 # [ 134.650399] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 2/5)6655worker2 # [ 134.788804] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 212 ms (attempt 3/5)6656worker2 # [ 135.002875] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 542 ms (attempt 4/5)6657lb # [ 135.163994] envoy[907]: conn peer=[2001:db8:1::4]:57650 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6128 tx=495 ms=138376658lb # [ 135.168058] envoy[907]: conn peer=[2001:db8:1::1]:47992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3031 tx=1590 ms=80496659worker2 # [ 135.549832] nix-grpc-daemon[1517]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6660worker2 # [ 135.554895] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6661worker2 # [ 135.576189] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423006662client # [ 135.594619] nix[1433]: copying 1 paths to 'lb:50051'...6663client # [ 135.598098] nix[1433]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...6664worker2 # [ 135.592932] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423006665worker2 # [ 135.605735] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6666worker2 # [ 135.625835] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:15Z level=info event=niks3_push_started pid=15956667worker2 # [ 135.714918] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.007Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""6668worker2 # [ 135.799088] nix-daemon[851]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6669worker2 # [ 135.810380] nix-daemon[851]: reaped child process 1611, status = succeeded6670lb # [ 135.805108] niks3-server[1120]: 2026/09/22 17:00:16 INFO Received uploads request method=POST path=/api/pending_closures6671worker2 # [ 135.821908] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.115Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6672worker2 # [ 135.823369] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.116Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6673lb # [ 135.827340] niks3-server[1120]: 2026/09/22 17:00:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6674lb # [ 135.831200] niks3-server[1120]: 2026/09/22 17:00:16 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6675lb # [ 135.833260] niks3-server[1120]: 2026/09/22 17:00:16 INFO Signed narinfos id=53 count=16676worker2 # [ 135.845790] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.138Z level=INFO msg="Uploading 1 narinfos"6677lb # [ 135.843622] niks3-server[1120]: 2026/09/22 17:00:16 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6678lb # [ 135.850564] niks3-server[1120]: 2026/09/22 17:00:16 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6679lb # [ 135.853789] niks3-server[1120]: 2026/09/22 17:00:16 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6680lb # [ 135.857217] niks3-server[1120]: 2026/09/22 17:00:16 INFO Completed upload id=536681worker2 # [ 135.870128] nix-grpc-daemon[1595]: time=2026-09-22T17:00:16.163Z level=INFO msg="Upload complete. (152ms)"6682worker2 # [ 135.872234] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=4246683worker2 # [ 135.875552] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423006684worker2 # [ 135.882118] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6685worker2 # [ 135.884427] nix-daemon[851]: reaped child process 1593, status = succeeded6686worker2 # [ 135.889525] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6687client # [ 135.894711] nix[1433]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6688client: must succeed: systemctl kill -s INT intr6689client # [ 137.852778] systemd[1]: intr.service: Sent signal SIGINT to main process 1433 (nix) on client request.6690worker2 # [ 137.853734] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:18Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6691client # [ 137.858767] nix[1433]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6692client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds)6693client # [ 137.865553] nix[1433]: error: interrupted by the user6694client # [ 137.900515] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6695client # [ 137.904254] systemd[1]: intr.service: Failed with result 'exit-code'.6696client # [ 137.908611] systemd[1]: intr.service: Consumed 118ms CPU time over 3.502s wall clock time, 39.5M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic.6697worker2 # [ 137.907759] nix-daemon[851]: reaped child process 1613, status = succeeded6698worker2 # [ 137.909402] nix-daemon[1615]: unexpected Nix daemon error: error: interrupted by the user6699worker2 # [ 137.916686] nix-daemon[851]: reaped child process 1615, status = failed with exit code 16700(finished: subtest: interrupting the client stops the build on the worker, in 3.56 seconds)6701subtest: a deploy mid-build drains: the build finishes, the new generation takes over6702client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw6703client # [ 137.960369] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw.6704client # Running as unit: sw.service; invocation ID: 4341feeffb5d4b4b9142e35a9ddfd9f56705client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.03 seconds)6706worker2 # [ 138.078531] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423006707client # [ 138.090136] nix[1454]: don't know how to build these paths:6708client # [ 138.090978] nix[1454]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6709worker2 # [ 138.094704] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:18Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06710worker2 # [ 138.098814] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:18Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=16711worker1 # [ 138.146876] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476726712worker1 # [ 138.160150] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476726713client # [ 138.168409] nix[1454]: copying 1 paths to 'lb:50051'...6714worker1 # [ 138.172156] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476726715client # [ 138.171157] nix[1454]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6716worker1 # [ 138.185154] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6717worker1 # [ 138.285985] nix-daemon[861]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6718worker1 # [ 138.299130] nix-daemon[861]: reaped child process 1734, status = succeeded6719lb # [ 138.284338] niks3-server[1120]: 2026/09/22 17:00:18 INFO Received uploads request method=POST path=/api/pending_closures6720worker1 # [ 138.310928] nix-grpc-daemon[1644]: time=2026-09-22T17:00:18.563Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6721worker1 # [ 138.312881] nix-grpc-daemon[1644]: time=2026-09-22T17:00:18.564Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6722lb # [ 138.313808] niks3-server[1120]: 2026/09/22 17:00:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6723lb # [ 138.324275] niks3-server[1120]: 2026/09/22 17:00:18 INFO Signed narinfos id=54 count=16724worker1 # [ 138.348797] nix-grpc-daemon[1644]: time=2026-09-22T17:00:18.601Z level=INFO msg="Uploading 1 narinfos"6725lb # [ 138.330857] niks3-server[1120]: 2026/09/22 17:00:18 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6726lb # [ 138.335522] niks3-server[1120]: 2026/09/22 17:00:18 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6727lb # [ 138.351108] niks3-server[1120]: 2026/09/22 17:00:18 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6728lb # [ 138.357439] niks3-server[1120]: 2026/09/22 17:00:18 INFO Completed upload id=546729lb # [ 138.359299] niks3-server[1120]: 2026/09/22 17:00:18 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6730worker1 # [ 138.378284] nix-grpc-daemon[1644]: time=2026-09-22T17:00:18.630Z level=INFO msg="Upload complete. (181ms)"6731worker1 # [ 138.383421] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47672 duration_s=0 paths=1 nar_bytes_in=4166732worker1 # [ 138.389646] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476726733worker1 # [ 138.399602] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6734worker1 # [ 138.409424] nix-daemon[861]: reaped child process 1729, status = succeeded6735client # [ 138.410837] nix[1454]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6736worker1 # [ 138.413844] nix-daemon[861]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6737worker1: must succeed: systemctl reload nix-grpc-daemon.service6738worker1 # [ 140.307177] systemd[1]: Reloading Nix worker-protocol over gRPC...6739worker1 # [ 140.332806] systemd[1]: Reloaded Nix worker-protocol over gRPC.6740worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds)6741worker1: must succeed: pgrep -f 'read -t [9]0 x'6742worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds)6743client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&26744client # don't know how to build these paths:6745client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6746worker2 # [ 140.510665] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423006747worker2 # [ 140.517425] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423006748worker2 # [ 140.532613] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06749worker2 # [ 140.538200] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=16750worker2 # [ 140.575933] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423006751worker2 # [ 140.586965] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423006752client # copying 1 paths to 'lb:50051'...6753worker2 # [ 140.597816] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423006754client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6755worker2 # [ 140.616801] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6756worker2 # [ 140.724463] nix-daemon[851]: accepted connection from pid 1666, user nix-grpc-daemon (trusted)6757worker2 # [ 140.737266] nix-daemon[851]: reaped child process 1669, status = succeeded6758lb # [ 140.731907] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received uploads request method=POST path=/api/pending_closures6759worker2 # [ 140.753513] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.045Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6760worker2 # [ 140.754937] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.046Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6761lb # [ 140.763661] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6762worker2 # [ 140.782973] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.075Z level=INFO msg="Uploading 1 narinfos"6763lb # [ 140.770101] niks3-server[1120]: 2026/09/22 17:00:21 INFO Signed narinfos id=55 count=16764lb # [ 140.777978] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6765lb # [ 140.784701] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6766lb # [ 140.801807] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6767lb # [ 140.804310] niks3-server[1120]: 2026/09/22 17:00:21 INFO Completed upload id=556768worker2 # [ 140.817280] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.110Z level=INFO msg="Upload complete. (185ms)"6769lb # [ 140.808694] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6770worker2 # [ 140.821758] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=5286771worker2 # [ 140.827990] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423006772worker2 # [ 140.838461] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6773worker2 # [ 140.847567] nix-daemon[851]: reaped child process 1664, status = succeeded6774worker2 # [ 140.851637] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6775client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6776client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6777client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6778worker1 # [ 141.243117] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:21Z level=info event=draining6779client # farm-a> LOG-farm-a-during-drain6780worker2 # [ 141.482862] nix-daemon[851]: reaped child process 1673, status = succeeded6781worker2 # [ 141.561340] nix-daemon[851]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6782worker2 # [ 141.573398] nix-daemon[851]: reaped child process 1692, status = succeeded6783lb # [ 141.568253] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received uploads request method=POST path=/api/pending_closures6784worker2 # [ 141.590207] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.883Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6785worker2 # [ 141.591656] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.884Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6786lb # [ 141.608700] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6787lb # [ 141.612625] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6788lb # [ 141.621904] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6789worker2 # [ 141.639304] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.932Z level=INFO msg="Uploading 1 narinfos"6790lb # [ 141.626374] niks3-server[1120]: 2026/09/22 17:00:21 INFO Signed narinfos id=56 count=16791lb # [ 141.634493] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6792lb # [ 141.638919] niks3-server[1120]: 2026/09/22 17:00:21 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6793lb # [ 141.641486] niks3-server[1120]: 2026/09/22 17:00:21 INFO Completed upload id=566794worker2 # [ 141.655685] nix-grpc-daemon[1595]: time=2026-09-22T17:00:21.948Z level=INFO msg="Upload complete. (198ms)"6795lb # [ 141.644221] niks3-server[1120]: 2026/09/22 17:00:21 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6796worker2 # [ 141.661484] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=16797worker2 # [ 141.671767] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06798worker2 # [ 141.675774] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:21Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16799worker2 # [ 141.683928] nix-daemon[851]: reaped child process 1671, status = succeeded6800worker2 # [ 141.715447] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423006801worker2 # [ 141.731727] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423006802worker2 # [ 141.743804] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.036Z level=INFO msg="All 1 paths already cached"6803client # copying 1 paths to 'lb:50051'...6804worker2 # [ 141.751212] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423006805client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6806worker2 # [ 141.766127] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6807worker2 # [ 141.861496] nix-daemon[851]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)6808worker2 # [ 141.873811] nix-daemon[851]: reaped child process 1701, status = succeeded6809lb # [ 141.870310] niks3-server[1120]: 2026/09/22 17:00:22 INFO Received uploads request method=POST path=/api/pending_closures6810worker2 # [ 141.892772] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.185Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6811worker2 # [ 141.894272] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.187Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6812lb # [ 141.906251] niks3-server[1120]: 2026/09/22 17:00:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6813lb # [ 141.911661] niks3-server[1120]: 2026/09/22 17:00:22 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6814worker2 # [ 141.933621] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.226Z level=INFO msg="Uploading 1 narinfos"6815lb # [ 141.920228] niks3-server[1120]: 2026/09/22 17:00:22 INFO Signed narinfos id=57 count=16816lb # [ 141.923445] niks3-server[1120]: 2026/09/22 17:00:22 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6817lb # [ 141.936740] niks3-server[1120]: 2026/09/22 17:00:22 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6818lb # [ 141.940041] niks3-server[1120]: 2026/09/22 17:00:22 INFO Completed upload id=576819worker2 # [ 141.952826] nix-grpc-daemon[1595]: time=2026-09-22T17:00:22.245Z level=INFO msg="Upload complete. (175ms)"6820lb # [ 141.942263] niks3-server[1120]: 2026/09/22 17:00:22 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6821worker2 # [ 141.957185] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=6406822worker2 # [ 141.962775] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423006823worker2 # [ 141.974138] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6824worker2 # [ 141.983293] nix-daemon[851]: reaped child process 1696, status = succeeded6825client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6826worker2 # [ 141.985720] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6827client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6828client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6829client # farm-b> LOG-farm-b-during-drain6830worker2 # [ 143.223523] nix-daemon[851]: reaped child process 1705, status = succeeded6831worker2 # [ 143.305954] nix-daemon[851]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6832worker2 # [ 143.318595] nix-daemon[851]: reaped child process 1724, status = succeeded6833lb # [ 143.311714] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received uploads request method=POST path=/api/pending_closures6834worker2 # [ 143.333723] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6835worker2 # [ 143.335383] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.628Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6836lb # [ 143.354832] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6837lb # [ 143.361329] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6838lb # [ 143.365142] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6839lb # [ 143.369773] niks3-server[1120]: 2026/09/22 17:00:23 INFO Signed narinfos id=58 count=16840worker2 # [ 143.385617] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.678Z level=INFO msg="Uploading 1 narinfos"6841lb # [ 143.384736] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6842lb # [ 143.389718] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6843lb # [ 143.396318] niks3-server[1120]: 2026/09/22 17:00:23 INFO Completed upload id=586844worker2 # [ 143.409259] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.702Z level=INFO msg="Upload complete. (215ms)"6845lb # [ 143.399872] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6846worker2 # [ 143.411872] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=16847worker2 # [ 143.417850] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06848worker2 # [ 143.420227] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16849worker2 # [ 143.425068] nix-daemon[851]: reaped child process 1703, status = succeeded6850worker2 # [ 143.461844] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423006851worker2 # [ 143.469484] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423006852worker2 # [ 143.477075] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.770Z level=INFO msg="All 2 paths already cached"6853client # copying 1 paths to 'lb:50051'...6854worker2 # [ 143.483336] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423006855client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6856worker2 # [ 143.493723] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6857worker2 # [ 143.579365] nix-daemon[851]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)6858worker2 # [ 143.592041] nix-daemon[851]: reaped child process 1733, status = succeeded6859lb # [ 143.587068] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received uploads request method=POST path=/api/pending_closures6860worker2 # [ 143.607346] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.900Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6861worker2 # [ 143.608828] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.902Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6862lb # [ 143.620363] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6863lb # [ 143.629571] niks3-server[1120]: 2026/09/22 17:00:23 INFO Signed narinfos id=59 count=16864worker2 # [ 143.645611] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.938Z level=INFO msg="Uploading 1 narinfos"6865lb # [ 143.635621] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6866lb # [ 143.642982] niks3-server[1120]: 2026/09/22 17:00:23 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6867lb # [ 143.654739] niks3-server[1120]: 2026/09/22 17:00:23 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6868worker2 # [ 143.672934] nix-grpc-daemon[1595]: time=2026-09-22T17:00:23.966Z level=INFO msg="Upload complete. (173ms)"6869lb # [ 143.660795] niks3-server[1120]: 2026/09/22 17:00:23 INFO Completed upload id=596870worker2 # [ 143.674937] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=7686871lb # [ 143.664713] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6872worker2 # [ 143.681413] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423006873worker2 # [ 143.685188] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6874worker2 # [ 143.687392] nix-daemon[851]: reaped child process 1728, status = succeeded6875worker2 # [ 143.692474] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6876client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6877client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6878client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6879client # farm-top> LOG-farm-top-during-drain6880worker2 # [ 144.307246] nix-daemon[851]: reaped child process 1737, status = succeeded6881worker2 # [ 144.381067] nix-daemon[851]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)6882worker2 # [ 144.393742] nix-daemon[851]: reaped child process 1756, status = succeeded6883lb # [ 144.388389] niks3-server[1120]: 2026/09/22 17:00:24 INFO Received uploads request method=POST path=/api/pending_closures6884worker2 # [ 144.405345] nix-grpc-daemon[1595]: time=2026-09-22T17:00:24.698Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6885worker2 # [ 144.406823] nix-grpc-daemon[1595]: time=2026-09-22T17:00:24.700Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6886lb # [ 144.407910] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6887lb # [ 144.411507] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6888lb # [ 144.415054] niks3-server[1120]: 2026/09/22 17:00:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6889lb # [ 144.418616] niks3-server[1120]: 2026/09/22 17:00:24 INFO Signed narinfos id=60 count=16890worker2 # [ 144.431587] nix-grpc-daemon[1595]: time=2026-09-22T17:00:24.724Z level=INFO msg="Uploading 1 narinfos"6891lb # [ 144.423958] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6892lb # [ 144.426409] niks3-server[1120]: 2026/09/22 17:00:24 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6893lb # [ 144.429780] niks3-server[1120]: 2026/09/22 17:00:24 INFO Completed upload id=606894worker2 # [ 144.442365] nix-grpc-daemon[1595]: time=2026-09-22T17:00:24.735Z level=INFO msg="Upload complete. (144ms)"6895lb # [ 144.431772] niks3-server[1120]: 2026/09/22 17:00:24 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6896worker2 # [ 144.444909] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=16897worker2 # [ 144.451631] nix-daemon[851]: reaped child process 1735, status = succeeded6898client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.16 seconds)6899client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath6900client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.11 seconds)6901worker1: must succeed: pkill -f 'read -t [9]0 x'6902worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds)6903client: waiting for success: ! systemctl is-active sw6904worker1 # [ 144.834672] nix-daemon[861]: reaped child process 1738, status = succeeded6905worker1 # [ 144.902457] nix-daemon[861]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)6906worker1 # [ 144.916055] nix-daemon[861]: reaped child process 1782, status = succeeded6907lb # [ 144.894283] niks3-server[1120]: 2026/09/22 17:00:25 INFO Received uploads request method=POST path=/api/pending_closures6908worker1 # [ 144.923534] nix-grpc-daemon[1644]: time=2026-09-22T17:00:25.175Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6909worker1 # [ 144.924961] nix-grpc-daemon[1644]: time=2026-09-22T17:00:25.177Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6910lb # [ 144.937415] niks3-server[1120]: 2026/09/22 17:00:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6911lb # [ 144.942909] niks3-server[1120]: 2026/09/22 17:00:25 INFO Signed narinfos id=61 count=16912worker1 # [ 144.967610] nix-grpc-daemon[1644]: time=2026-09-22T17:00:25.220Z level=INFO msg="Uploading 1 narinfos"6913lb # [ 144.954874] niks3-server[1120]: 2026/09/22 17:00:25 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6914lb # [ 144.960154] niks3-server[1120]: 2026/09/22 17:00:25 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6915lb # [ 144.964734] niks3-server[1120]: 2026/09/22 17:00:25 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6916lb # [ 144.975871] niks3-server[1120]: 2026/09/22 17:00:25 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6917lb # [ 144.979489] niks3-server[1120]: 2026/09/22 17:00:25 INFO Completed upload id=616918worker1 # [ 145.000153] nix-grpc-daemon[1644]: time=2026-09-22T17:00:25.252Z level=INFO msg="Upload complete. (174ms)"6919lb # [ 144.981151] niks3-server[1120]: 2026/09/22 17:00:25 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6920worker1 # [ 145.007365] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47672 duration_s=6 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=16921worker1 # [ 145.021392] nix-daemon[861]: reaped child process 1736, status = succeeded6922client # [ 145.033449] systemd[1]: sw.service: Deactivated successfully.6923client # [ 145.037655] systemd[1]: sw.service: Consumed 118ms CPU time over 7.075s wall clock time, 43.4M memory peak, 7.1K incoming IP traffic, 8.5K outgoing IP traffic.6924lb # [ 145.166168] envoy[907]: conn peer=[2001:db8:1::1]:53788 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3006 tx=853 ms=33616925lb # [ 145.169771] envoy[907]: conn peer=[2001:db8:1::1]:53808 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9551 tx=4366 ms=39926926lb # [ 145.173359] envoy[907]: conn peer=[2001:db8:1::1]:53792 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2945 tx=1498 ms=69316927worker1 # [ 145.246490] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:25Z level=info event=signal_exit6928client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds)6929client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6930client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6931worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6932worker2 # [ 147.243368] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:538526933worker2 # [ 147.247107] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:27Z level=info event=worker_gone addr=192.168.1.3:500516934worker1 # [ 147.254398] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:27Z level=info event=scheduler_restarting6935worker1 # [ 147.264499] nix-grpc-daemon[1580]: ts=2026-09-22T17:00:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6936worker1 # [ 147.283663] nix-daemon[861]: reaped child process 1636, status = succeeded6937worker1 # [ 148.145327] nix-grpc-daemon[1580]: E0000 00:00:1790096428.397598 1625 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true6938worker1 # [ 148.150286] nix-grpc-daemon[1580]: E0000 00:00:1790096428.397812 1625 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6939worker1 # [ 148.277255] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6940worker1 # [ 148.281572] systemd[1]: nix-grpc-daemon.service: Consumed 614ms CPU time over 24.152s wall clock time, 35.6M memory peak, 24.9K incoming IP traffic, 35.2K outgoing IP traffic.6941worker1 # [ 148.295838] systemd[1]: Starting Nix worker-protocol over gRPC...6942worker1 # [ 148.385805] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6943worker1 # [ 148.387842] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6944worker1 # [ 148.391042] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16945worker1 # [ 148.395051] nix-grpc-daemon[1796]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6946worker1 # [ 148.396755] nix-grpc-daemon[1796]: E0000 00:00:1790096428.647619 1796 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6947worker1 # [ 148.403106] nix-grpc-daemon[1796]: E0000 00:00:1790096428.653042 1796 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6948worker1 # [ 148.407577] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6949worker1 # [ 148.410346] systemd[1]: Started Nix worker-protocol over gRPC.6950worker1 # [ 148.412132] nix-grpc-daemon[1796]: E0000 00:00:1790096428.664104 1837 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6951worker1 # [ 148.425056] nix-grpc-daemon[1796]: E0000 00:00:1790096428.677609 1837 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6952worker1 # [ 148.428159] nix-grpc-daemon[1796]: E0000 00:00:1790096428.679852 1837 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6953worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.66 seconds)6954lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6955lb: must succeed: curl -sf localhost:9901/clusters6956worker1 # [ 148.440035] nix-grpc-daemon[1796]: E0000 00:00:1790096428.692600 1837 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6957worker1 # [ 148.452023] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:28Z level=info event=scheduler_connected addr=lb:500516958worker2 # [ 148.448201] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:28Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:538526959worker2 # [ 148.452098] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06960lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6961lb: must succeed: curl -sf localhost:9901/clusters6962lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6963lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.09 seconds)6964lb: must succeed: curl -sf localhost:9901/clusters6965lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6966worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6967worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds)6968(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 11.64 seconds)6969subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6970client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16971worker1 # [ 149.722141] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:488886972worker1 # [ 149.732906] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)6973worker2 # [ 149.739113] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423006974worker2 # [ 149.776848] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06975worker2 # [ 149.781438] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16976worker2 # [ 149.786086] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06977worker2 # [ 149.789979] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:30Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06978worker1 # [ 149.829804] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488886979worker1 # [ 149.840799] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5)6980worker1 # [ 149.864896] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 175 ms (attempt 2/5)6981worker1 # [ 150.041963] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 3/5)6982worker1 # [ 150.053424] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 747 ms (attempt 4/5)6983worker1 # [ 150.808837] nix-grpc-daemon[1796]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6984worker1 # [ 150.812755] nix-grpc-daemon[1796]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6985worker1 # [ 150.828349] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488886986worker1 # [ 150.839923] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488886987worker1 # [ 150.851073] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)6988worker1 # [ 150.870137] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=info event=niks3_push_started pid=18566989worker1 # [ 150.972495] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.224Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""6990worker1 # [ 151.054865] nix-daemon[861]: accepted connection from pid 1869, user nix-grpc-daemon (trusted)6991worker1 # [ 151.068468] nix-daemon[861]: reaped child process 1872, status = succeeded6992lb # [ 151.053580] niks3-server[1120]: 2026/09/22 17:00:31 INFO Received uploads request method=POST path=/api/pending_closures6993worker1 # [ 151.083530] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.336Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6994worker1 # [ 151.085070] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.337Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6995lb # [ 151.098797] niks3-server[1120]: 2026/09/22 17:00:31 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6996lb # [ 151.104881] niks3-server[1120]: 2026/09/22 17:00:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6997worker1 # [ 151.135093] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.387Z level=INFO msg="Uploading 1 narinfos"6998lb # [ 151.114710] niks3-server[1120]: 2026/09/22 17:00:31 INFO Signed narinfos id=62 count=16999lb # [ 151.125729] niks3-server[1120]: 2026/09/22 17:00:31 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst7000lb # [ 151.134059] niks3-server[1120]: 2026/09/22 17:00:31 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete7001lb # [ 151.141212] niks3-server[1120]: 2026/09/22 17:00:31 INFO Completed upload id=627002worker1 # [ 151.161896] nix-grpc-daemon[1856]: time=2026-09-22T17:00:31.414Z level=INFO msg="Upload complete. (185ms)"7003lb # [ 151.143081] niks3-server[1120]: 2026/09/22 17:00:31 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo7004worker1 # [ 151.166555] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=5047005worker1 # [ 151.173324] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887006worker1 # [ 151.183187] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7007worker1 # [ 151.191853] nix-daemon[861]: reaped child process 1854, status = succeeded7008worker1 # [ 151.195869] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7009worker1 # [ 152.031650] nix-daemon[861]: reaped child process 1876, status = succeeded7010worker1 # [ 152.113981] nix-daemon[861]: accepted connection from pid 1892, user nix-grpc-daemon (trusted)7011worker1 # [ 152.126890] nix-daemon[861]: reaped child process 1895, status = succeeded7012lb # [ 152.111668] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received uploads request method=POST path=/api/pending_closures7013worker1 # [ 152.142159] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.394Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7014worker1 # [ 152.143859] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.396Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"7015lb # [ 152.158677] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign7016lb # [ 152.162103] niks3-server[1120]: 2026/09/22 17:00:32 INFO Signed narinfos id=63 count=17017worker1 # [ 152.182860] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.435Z level=INFO msg="Uploading 1 narinfos"7018lb # [ 152.164376] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls7019lb # [ 152.166248] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst7020lb # [ 152.169137] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv7021lb # [ 152.176684] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete7022lb # [ 152.179979] niks3-server[1120]: 2026/09/22 17:00:32 INFO Completed upload id=637023worker1 # [ 152.200317] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.452Z level=INFO msg="Upload complete. (197ms)"7024lb # [ 152.181706] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo7025worker2 # [ 152.197492] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:32Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=17026worker1 # [ 152.204586] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=17027worker2 # [ 152.202189] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:32Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=07028worker1 # [ 152.211423] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887029worker1 # [ 152.220315] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887030worker1 # [ 152.222799] nix-daemon[861]: reaped child process 1874, status = succeeded7031worker1 # [ 152.225911] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488887032worker1 # [ 152.229429] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7033worker1 # [ 152.307518] nix-daemon[861]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)7034worker1 # [ 152.319737] nix-daemon[861]: reaped child process 1902, status = succeeded7035lb # [ 152.304901] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received uploads request method=POST path=/api/pending_closures7036worker1 # [ 152.334730] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.587Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7037worker1 # [ 152.336660] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.588Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"7038lb # [ 152.335757] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign7039lb # [ 152.339487] niks3-server[1120]: 2026/09/22 17:00:32 INFO Signed narinfos id=64 count=17040worker1 # [ 152.363401] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.615Z level=INFO msg="Uploading 1 narinfos"7041lb # [ 152.346945] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst7042lb # [ 152.353640] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls7043lb # [ 152.362450] niks3-server[1120]: 2026/09/22 17:00:32 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete7044lb # [ 152.365454] niks3-server[1120]: 2026/09/22 17:00:32 INFO Completed upload id=647045worker1 # [ 152.385983] nix-grpc-daemon[1856]: time=2026-09-22T17:00:32.638Z level=INFO msg="Upload complete. (151ms)"7046lb # [ 152.367873] niks3-server[1120]: 2026/09/22 17:00:32 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo7047worker1 # [ 152.388353] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=5047048worker1 # [ 152.392304] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887049worker1 # [ 152.399088] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7050worker1 # [ 152.400483] nix-daemon[861]: reaped child process 1897, status = succeeded7051worker1 # [ 152.405711] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7052worker1 # [ 153.632929] nix-daemon[861]: reaped child process 1906, status = succeeded7053worker1 # [ 153.709181] nix-daemon[861]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)7054worker1 # [ 153.721281] nix-daemon[861]: reaped child process 1925, status = succeeded7055lb # [ 153.708789] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received uploads request method=POST path=/api/pending_closures7056worker1 # [ 153.738294] nix-grpc-daemon[1856]: time=2026-09-22T17:00:33.990Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7057worker1 # [ 153.739891] nix-grpc-daemon[1856]: time=2026-09-22T17:00:33.992Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"7058lb # [ 153.752130] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst7059lb # [ 153.759450] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls7060lb # [ 153.766397] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign7061worker1 # [ 153.794103] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.046Z level=INFO msg="Uploading 1 narinfos"7062lb # [ 153.774102] niks3-server[1120]: 2026/09/22 17:00:34 INFO Signed narinfos id=65 count=17063lb # [ 153.779043] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv7064lb # [ 153.789223] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete7065lb # [ 153.796717] niks3-server[1120]: 2026/09/22 17:00:34 INFO Completed upload id=657066lb # [ 153.799060] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo7067worker1 # [ 153.818992] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.071Z level=INFO msg="Upload complete. (206ms)"7068worker2 # [ 153.818285] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:34Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=17069worker2 # [ 153.823173] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:34Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=07070worker1 # [ 153.826703] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=17071worker1 # [ 153.834538] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887072worker1 # [ 153.845296] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887073worker1 # [ 153.853739] nix-daemon[861]: reaped child process 1904, status = succeeded7074worker1 # [ 153.856436] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488887075worker1 # [ 153.862983] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7076worker1 # [ 153.941887] nix-daemon[861]: accepted connection from pid 1929, user nix-grpc-daemon (trusted)7077worker1 # [ 153.954806] nix-daemon[861]: reaped child process 1932, status = succeeded7078lb # [ 153.939311] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received uploads request method=POST path=/api/pending_closures7079worker1 # [ 153.967656] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.220Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7080worker1 # [ 153.969217] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.221Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"7081lb # [ 153.970753] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign7082lb # [ 153.976626] niks3-server[1120]: 2026/09/22 17:00:34 INFO Signed narinfos id=66 count=17083worker1 # [ 154.000502] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.252Z level=INFO msg="Uploading 1 narinfos"7084lb # [ 153.985348] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst7085lb # [ 153.996152] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls7086lb # [ 154.005197] niks3-server[1120]: 2026/09/22 17:00:34 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete7087lb # [ 154.011229] niks3-server[1120]: 2026/09/22 17:00:34 INFO Completed upload id=667088worker1 # [ 154.031559] nix-grpc-daemon[1856]: time=2026-09-22T17:00:34.284Z level=INFO msg="Upload complete. (161ms)"7089lb # [ 154.012922] niks3-server[1120]: 2026/09/22 17:00:34 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo7090worker1 # [ 154.035505] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=5047091worker1 # [ 154.040644] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887092worker1 # [ 154.048546] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7093worker1 # [ 154.055023] nix-daemon[861]: reaped child process 1927, status = succeeded7094worker1 # [ 154.058993] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7095worker1 # [ 154.897586] nix-daemon[861]: reaped child process 1936, status = succeeded7096worker1 # [ 154.975588] nix-daemon[861]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)7097worker1 # [ 154.986985] nix-daemon[861]: reaped child process 1955, status = succeeded7098lb # [ 154.972466] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received uploads request method=POST path=/api/pending_closures7099worker1 # [ 155.001128] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.253Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7100worker1 # [ 155.002660] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.255Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"7101lb # [ 155.015715] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv7102lb # [ 155.019809] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls7103lb # [ 155.026461] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign7104lb # [ 155.033372] niks3-server[1120]: 2026/09/22 17:00:35 INFO Signed narinfos id=67 count=17105worker1 # [ 155.056592] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.308Z level=INFO msg="Uploading 1 narinfos"7106lb # [ 155.041256] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst7107lb # [ 155.051852] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete7108lb # [ 155.054313] niks3-server[1120]: 2026/09/22 17:00:35 INFO Completed upload id=677109worker1 # [ 155.076062] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.328Z level=INFO msg="Upload complete. (210ms)"7110lb # [ 155.057433] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo7111worker1 # [ 155.078748] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=17112worker2 # [ 155.073221] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:35Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=17113worker1 # [ 155.082778] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887114worker2 # [ 155.077854] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:35Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=07115worker1 # [ 155.090088] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887116worker1 # [ 155.092320] nix-daemon[861]: reaped child process 1934, status = succeeded7117worker1 # [ 155.095745] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.348Z level=INFO msg="All 1 paths already cached"7118worker1 # [ 155.099485] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488887119worker1 # [ 155.104192] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7120worker1 # [ 155.186187] nix-daemon[861]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)7121lb # [ 155.166539] envoy[907]: conn peer=[2001:db8:1::3]:58004 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1762 tx=503 ms=229757122worker1 # [ 155.198721] nix-daemon[861]: reaped child process 1962, status = succeeded7123lb # [ 155.184596] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received uploads request method=POST path=/api/pending_closures7124worker1 # [ 155.212932] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.465Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7125worker1 # [ 155.214973] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.467Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"7126lb # [ 155.214148] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign7127worker1 # [ 155.241300] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.493Z level=INFO msg="Uploading 1 narinfos"7128lb # [ 155.220513] niks3-server[1120]: 2026/09/22 17:00:35 INFO Signed narinfos id=68 count=17129lb # [ 155.228685] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls7130lb # [ 155.232943] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst7131lb # [ 155.243651] niks3-server[1120]: 2026/09/22 17:00:35 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete7132lb # [ 155.250062] niks3-server[1120]: 2026/09/22 17:00:35 INFO Completed upload id=687133worker1 # [ 155.270332] nix-grpc-daemon[1856]: time=2026-09-22T17:00:35.522Z level=INFO msg="Upload complete. (161ms)"7134worker1 # [ 155.272431] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=6247135lb # [ 155.255303] niks3-server[1120]: 2026/09/22 17:00:35 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo7136worker1 # [ 155.276338] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887137worker1 # [ 155.286130] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7138worker1 # [ 155.289377] nix-daemon[861]: reaped child process 1957, status = succeeded7139worker1 # [ 155.294437] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7140worker1 # [ 156.511636] nix-daemon[861]: reaped child process 1966, status = succeeded7141worker1 # [ 156.582978] nix-daemon[861]: accepted connection from pid 1982, user nix-grpc-daemon (trusted)7142worker1 # [ 156.597681] nix-daemon[861]: reaped child process 1985, status = succeeded7143lb # [ 156.581249] niks3-server[1120]: 2026/09/22 17:00:36 INFO Received uploads request method=POST path=/api/pending_closures7144worker1 # [ 156.609828] nix-grpc-daemon[1856]: time=2026-09-22T17:00:36.862Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7145worker1 # [ 156.611496] nix-grpc-daemon[1856]: time=2026-09-22T17:00:36.863Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"7146lb # [ 156.623146] niks3-server[1120]: 2026/09/22 17:00:36 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls7147lb # [ 156.630364] niks3-server[1120]: 2026/09/22 17:00:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign7148worker1 # [ 156.661339] nix-grpc-daemon[1856]: time=2026-09-22T17:00:36.913Z level=INFO msg="Uploading 1 narinfos"7149lb # [ 156.641118] niks3-server[1120]: 2026/09/22 17:00:36 INFO Signed narinfos id=69 count=17150lb # [ 156.644956] niks3-server[1120]: 2026/09/22 17:00:36 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv7151lb # [ 156.648662] niks3-server[1120]: 2026/09/22 17:00:36 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst7152lb # [ 156.661396] niks3-server[1120]: 2026/09/22 17:00:36 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete7153lb # [ 156.664537] niks3-server[1120]: 2026/09/22 17:00:37 INFO Completed upload id=697154worker1 # [ 156.685281] nix-grpc-daemon[1856]: time=2026-09-22T17:00:36.937Z level=INFO msg="Upload complete. (183ms)"7155lb # [ 156.668026] niks3-server[1120]: 2026/09/22 17:00:37 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo7156worker1 # [ 156.690945] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=17157worker2 # [ 156.684709] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:36Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=17158worker2 # [ 156.694168] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:36Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=07159worker1 # [ 156.705816] nix-daemon[861]: reaped child process 1964, status = succeeded7160worker1 # [ 156.743334] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887161worker1 # [ 156.756439] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887162worker1 # [ 156.770347] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.022Z level=INFO msg="All 1 paths already cached"7163worker1 # [ 156.777788] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488887164worker1 # [ 156.785886] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7165worker1 # [ 156.883261] nix-daemon[861]: accepted connection from pid 1989, user nix-grpc-daemon (trusted)7166worker1 # [ 156.895885] nix-daemon[861]: reaped child process 1992, status = succeeded7167lb # [ 156.881662] niks3-server[1120]: 2026/09/22 17:00:37 INFO Received uploads request method=POST path=/api/pending_closures7168worker1 # [ 156.909738] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.162Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7169worker1 # [ 156.911304] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.163Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"7170lb # [ 156.913072] niks3-server[1120]: 2026/09/22 17:00:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign7171worker1 # [ 156.938251] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.190Z level=INFO msg="Uploading 1 narinfos"7172lb # [ 156.918126] niks3-server[1120]: 2026/09/22 17:00:37 INFO Signed narinfos id=70 count=17173lb # [ 156.925638] niks3-server[1120]: 2026/09/22 17:00:37 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst7174lb # [ 156.935543] niks3-server[1120]: 2026/09/22 17:00:37 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls7175lb # [ 156.945055] niks3-server[1120]: 2026/09/22 17:00:37 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete7176lb # [ 156.950301] niks3-server[1120]: 2026/09/22 17:00:37 INFO Completed upload id=707177worker1 # [ 156.970882] nix-grpc-daemon[1856]: time=2026-09-22T17:00:37.223Z level=INFO msg="Upload complete. (171ms)"7178lb # [ 156.954816] niks3-server[1120]: 2026/09/22 17:00:37 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo7179worker1 # [ 156.975546] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=6247180worker1 # [ 156.981755] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887181worker1 # [ 156.993108] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7182worker1 # [ 157.000362] nix-daemon[861]: reaped child process 1987, status = succeeded7183worker1 # [ 157.005576] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7184worker1 # [ 158.439814] nix-daemon[861]: reaped child process 1996, status = succeeded7185worker1 # [ 158.506081] nix-daemon[861]: accepted connection from pid 2012, user nix-grpc-daemon (trusted)7186worker1 # [ 158.517392] nix-daemon[861]: reaped child process 2015, status = succeeded7187lb # [ 158.505768] niks3-server[1120]: 2026/09/22 17:00:38 INFO Received uploads request method=POST path=/api/pending_closures7188worker1 # [ 158.533628] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.786Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7189worker1 # [ 158.535116] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.787Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"7190lb # [ 158.542263] niks3-server[1120]: 2026/09/22 17:00:38 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv7191lb # [ 158.551906] niks3-server[1120]: 2026/09/22 17:00:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign7192lb # [ 158.557247] niks3-server[1120]: 2026/09/22 17:00:38 INFO Signed narinfos id=71 count=17193worker1 # [ 158.580296] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.832Z level=INFO msg="Uploading 1 narinfos"7194lb # [ 158.562445] niks3-server[1120]: 2026/09/22 17:00:38 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst7195lb # [ 158.570879] niks3-server[1120]: 2026/09/22 17:00:38 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls7196lb # [ 158.574609] niks3-server[1120]: 2026/09/22 17:00:38 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete7197lb # [ 158.579284] niks3-server[1120]: 2026/09/22 17:00:38 INFO Completed upload id=717198worker1 # [ 158.600045] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.852Z level=INFO msg="Upload complete. (186ms)"7199lb # [ 158.583437] niks3-server[1120]: 2026/09/22 17:00:38 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo7200worker2 # [ 158.599662] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:38Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=17201worker1 # [ 158.607121] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=17202worker2 # [ 158.604463] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:38Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=07203worker1 # [ 158.613500] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887204worker1 # [ 158.623541] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887205worker1 # [ 158.629933] nix-daemon[861]: reaped child process 1994, status = succeeded7206worker1 # [ 158.634067] nix-grpc-daemon[1856]: time=2026-09-22T17:00:38.886Z level=INFO msg="All 1 paths already cached"7207worker1 # [ 158.638190] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488887208worker1 # [ 158.642910] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7209worker1 # [ 158.727962] nix-daemon[861]: accepted connection from pid 2019, user nix-grpc-daemon (trusted)7210worker1 # [ 158.741795] nix-daemon[861]: reaped child process 2022, status = succeeded7211lb # [ 158.726915] niks3-server[1120]: 2026/09/22 17:00:39 INFO Received uploads request method=POST path=/api/pending_closures7212worker1 # [ 158.757719] nix-grpc-daemon[1856]: time=2026-09-22T17:00:39.010Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7213worker1 # [ 158.759668] nix-grpc-daemon[1856]: time=2026-09-22T17:00:39.011Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"7214lb # [ 158.759629] niks3-server[1120]: 2026/09/22 17:00:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign7215lb # [ 158.763812] niks3-server[1120]: 2026/09/22 17:00:39 INFO Signed narinfos id=72 count=17216worker1 # [ 158.786751] nix-grpc-daemon[1856]: time=2026-09-22T17:00:39.039Z level=INFO msg="Uploading 1 narinfos"7217lb # [ 158.768104] niks3-server[1120]: 2026/09/22 17:00:39 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst7218lb # [ 158.774636] niks3-server[1120]: 2026/09/22 17:00:39 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls7219lb # [ 158.783550] niks3-server[1120]: 2026/09/22 17:00:39 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete7220lb # [ 158.787104] niks3-server[1120]: 2026/09/22 17:00:39 INFO Completed upload id=727221worker1 # [ 158.807449] nix-grpc-daemon[1856]: time=2026-09-22T17:00:39.060Z level=INFO msg="Upload complete. (159ms)"7222lb # [ 158.789533] niks3-server[1120]: 2026/09/22 17:00:39 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo7223worker1 # [ 158.809587] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=6247224worker1 # [ 158.812402] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887225worker1 # [ 158.820718] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7226worker1 # [ 158.822131] nix-daemon[861]: reaped child process 2017, status = succeeded7227worker1 # [ 158.827213] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7228worker1 # [ 159.652420] nix-daemon[861]: reaped child process 2026, status = succeeded7229worker1 # [ 159.731758] nix-daemon[861]: accepted connection from pid 2042, user nix-grpc-daemon (trusted)7230worker1 # [ 159.744056] nix-daemon[861]: reaped child process 2045, status = succeeded7231lb # [ 159.732688] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received uploads request method=POST path=/api/pending_closures7232worker1 # [ 159.761482] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.013Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7233worker1 # [ 159.762906] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.015Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"7234lb # [ 159.774396] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign7235worker1 # [ 159.801491] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.053Z level=INFO msg="Uploading 1 narinfos"7236lb # [ 159.780764] niks3-server[1120]: 2026/09/22 17:00:40 INFO Signed narinfos id=73 count=17237lb # [ 159.789980] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst7238lb # [ 159.799111] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls7239lb # [ 159.804947] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv7240lb # [ 159.811484] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete7241lb # [ 159.817176] niks3-server[1120]: 2026/09/22 17:00:40 INFO Completed upload id=737242worker1 # [ 159.837850] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.090Z level=INFO msg="Upload complete. (204ms)"7243lb # [ 159.819578] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo7244worker1 # [ 159.843864] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=17245worker2 # [ 159.837888] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:40Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=17246worker1 # [ 159.852416] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887247worker2 # [ 159.847972] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:40Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=07248worker1 # [ 159.866335] nix-daemon[861]: reaped child process 2024, status = succeeded7249worker1 # [ 159.894094] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887250worker1 # [ 159.906816] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.159Z level=INFO msg="All 2 paths already cached"7251worker1 # [ 159.914536] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488887252worker1 # [ 159.924157] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7253worker1 # [ 160.017407] nix-daemon[861]: accepted connection from pid 2049, user nix-grpc-daemon (trusted)7254worker1 # [ 160.029801] nix-daemon[861]: reaped child process 2052, status = succeeded7255lb # [ 160.016759] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received uploads request method=POST path=/api/pending_closures7256worker1 # [ 160.045623] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.298Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7257worker1 # [ 160.047182] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.299Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"7258lb # [ 160.050248] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst7259lb # [ 160.059488] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign7260worker1 # [ 160.085160] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.337Z level=INFO msg="Uploading 1 narinfos"7261lb # [ 160.064937] niks3-server[1120]: 2026/09/22 17:00:40 INFO Signed narinfos id=74 count=17262lb # [ 160.070809] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls7263lb # [ 160.083360] niks3-server[1120]: 2026/09/22 17:00:40 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete7264lb # [ 160.089539] niks3-server[1120]: 2026/09/22 17:00:40 INFO Completed upload id=747265worker1 # [ 160.110317] nix-grpc-daemon[1856]: time=2026-09-22T17:00:40.362Z level=INFO msg="Upload complete. (174ms)"7266lb # [ 160.095064] niks3-server[1120]: 2026/09/22 17:00:40 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo7267worker1 # [ 160.115499] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=7527268worker1 # [ 160.121527] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887269worker1 # [ 160.132529] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7270worker1 # [ 160.142286] nix-daemon[861]: reaped child process 2047, status = succeeded7271worker1 # [ 160.146503] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7272worker1 # [ 160.983344] nix-daemon[861]: reaped child process 2056, status = succeeded7273worker1 # [ 161.056167] nix-daemon[861]: accepted connection from pid 2072, user nix-grpc-daemon (trusted)7274worker1 # [ 161.069025] nix-daemon[861]: reaped child process 2075, status = succeeded7275lb # [ 161.055602] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received uploads request method=POST path=/api/pending_closures7276worker1 # [ 161.084371] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.336Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7277worker1 # [ 161.085862] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.338Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"7278lb # [ 161.102373] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls7279lb # [ 161.107138] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst7280lb # [ 161.114064] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign7281lb # [ 161.119351] niks3-server[1120]: 2026/09/22 17:00:41 INFO Signed narinfos id=75 count=17282worker1 # [ 161.140724] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.392Z level=INFO msg="Uploading 1 narinfos"7283lb # [ 161.125083] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv7284lb # [ 161.130456] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete7285lb # [ 161.134751] niks3-server[1120]: 2026/09/22 17:00:41 INFO Completed upload id=757286worker1 # [ 161.155379] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.407Z level=INFO msg="Upload complete. (201ms)"7287lb # [ 161.136648] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo7288worker2 # [ 161.154920] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:41Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=17289worker1 # [ 161.161645] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=17290worker1 # [ 161.169986] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887291worker1 # [ 161.182117] nix-daemon[861]: reaped child process 2054, status = succeeded7292worker1 # [ 161.211936] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887293worker1 # [ 161.224600] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.477Z level=INFO msg="All 2 paths already cached"7294worker1 # [ 161.232532] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488887295worker1 # [ 161.242157] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7296worker1 # [ 161.337799] nix-daemon[861]: accepted connection from pid 2079, user nix-grpc-daemon (trusted)7297worker1 # [ 161.351926] nix-daemon[861]: reaped child process 2082, status = succeeded7298lb # [ 161.336623] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received uploads request method=POST path=/api/pending_closures7299worker1 # [ 161.364701] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.617Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7300worker1 # [ 161.366690] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.618Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"7301lb # [ 161.365244] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst7302lb # [ 161.375150] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign7303worker1 # [ 161.401776] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.654Z level=INFO msg="Uploading 1 narinfos"7304lb # [ 161.381092] niks3-server[1120]: 2026/09/22 17:00:41 INFO Signed narinfos id=76 count=17305lb # [ 161.389632] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls7306lb # [ 161.398748] niks3-server[1120]: 2026/09/22 17:00:41 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete7307lb # [ 161.404382] niks3-server[1120]: 2026/09/22 17:00:41 INFO Completed upload id=767308worker1 # [ 161.427215] nix-grpc-daemon[1856]: time=2026-09-22T17:00:41.679Z level=INFO msg="Upload complete. (174ms)"7309lb # [ 161.410550] niks3-server[1120]: 2026/09/22 17:00:41 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo7310worker1 # [ 161.431672] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=7527311worker1 # [ 161.436465] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887312worker1 # [ 161.447108] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7313worker1 # [ 161.451589] nix-daemon[861]: reaped child process 2077, status = succeeded7314worker1 # [ 161.456584] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7315worker1 # [ 162.688570] nix-daemon[861]: reaped child process 2086, status = succeeded7316worker1 # [ 162.761548] nix-daemon[861]: accepted connection from pid 2102, user nix-grpc-daemon (trusted)7317worker1 # [ 162.774281] nix-daemon[861]: reaped child process 2105, status = succeeded7318lb # [ 162.759821] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received uploads request method=POST path=/api/pending_closures7319worker1 # [ 162.788477] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.040Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7320worker1 # [ 162.789949] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.042Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"7321lb # [ 162.805855] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls7322lb # [ 162.809359] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst7323lb # [ 162.815843] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign7324lb # [ 162.820582] niks3-server[1120]: 2026/09/22 17:00:43 INFO Signed narinfos id=77 count=17325worker1 # [ 162.841456] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.093Z level=INFO msg="Uploading 1 narinfos"7326lb # [ 162.833658] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv7327lb # [ 162.836791] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete7328lb # [ 162.840351] niks3-server[1120]: 2026/09/22 17:00:43 INFO Completed upload id=777329lb # [ 162.842150] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo7330worker1 # [ 162.860907] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.113Z level=INFO msg="Upload complete. (196ms)"7331worker2 # [ 162.861510] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:43Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=17332worker1 # [ 162.867859] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=17333worker1 # [ 162.883809] nix-daemon[861]: reaped child process 2084, status = succeeded7334worker1 # [ 162.911954] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887335worker1 # [ 162.924595] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887336worker1 # [ 162.936827] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.189Z level=INFO msg="All 2 paths already cached"7337worker1 # [ 162.944914] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:488887338worker1 # [ 162.954157] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7339worker1 # [ 163.046965] nix-daemon[861]: accepted connection from pid 2109, user nix-grpc-daemon (trusted)7340worker1 # [ 163.059859] nix-daemon[861]: reaped child process 2112, status = succeeded7341lb # [ 163.045901] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received uploads request method=POST path=/api/pending_closures7342worker1 # [ 163.074429] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.327Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7343worker1 # [ 163.075892] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.328Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"7344lb # [ 163.077206] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls7345lb # [ 163.086345] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign7346lb # [ 163.090787] niks3-server[1120]: 2026/09/22 17:00:43 INFO Signed narinfos id=78 count=17347worker1 # [ 163.114306] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.366Z level=INFO msg="Uploading 1 narinfos"7348lb # [ 163.100566] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst7349lb # [ 163.109474] niks3-server[1120]: 2026/09/22 17:00:43 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete7350lb # [ 163.115133] niks3-server[1120]: 2026/09/22 17:00:43 INFO Completed upload id=787351worker1 # [ 163.138599] nix-grpc-daemon[1856]: time=2026-09-22T17:00:43.391Z level=INFO msg="Upload complete. (173ms)"7352lb # [ 163.120987] niks3-server[1120]: 2026/09/22 17:00:43 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo7353worker1 # [ 163.142836] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=0 paths=1 nar_bytes_in=7527354worker1 # [ 163.147487] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:488887355worker1 # [ 163.157094] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7356worker1 # [ 163.167467] nix-daemon[861]: reaped child process 2107, status = succeeded7357worker1 # [ 163.170297] nix-daemon[861]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)7358worker1 # [ 164.385194] nix-daemon[861]: reaped child process 2116, status = succeeded7359worker1 # [ 164.459323] nix-daemon[861]: accepted connection from pid 2132, user nix-grpc-daemon (trusted)7360worker1 # [ 164.470978] nix-daemon[861]: reaped child process 2135, status = succeeded7361lb # [ 164.457952] niks3-server[1120]: 2026/09/22 17:00:44 INFO Received uploads request method=POST path=/api/pending_closures7362worker1 # [ 164.487190] nix-grpc-daemon[1856]: time=2026-09-22T17:00:44.739Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7363worker1 # [ 164.488679] nix-grpc-daemon[1856]: time=2026-09-22T17:00:44.741Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"7364lb # [ 164.503118] niks3-server[1120]: 2026/09/22 17:00:44 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv7365lb # [ 164.510907] niks3-server[1120]: 2026/09/22 17:00:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign7366worker1 # [ 164.538159] nix-grpc-daemon[1856]: time=2026-09-22T17:00:44.790Z level=INFO msg="Uploading 1 narinfos"7367lb # [ 164.517082] niks3-server[1120]: 2026/09/22 17:00:44 INFO Signed narinfos id=79 count=17368lb # [ 164.524950] niks3-server[1120]: 2026/09/22 17:00:44 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls7369lb # [ 164.537527] niks3-server[1120]: 2026/09/22 17:00:44 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete7370lb # [ 164.541713] niks3-server[1120]: 2026/09/22 17:00:44 INFO Completed upload id=797371worker1 # [ 164.562320] nix-grpc-daemon[1856]: time=2026-09-22T17:00:44.814Z level=INFO msg="Upload complete. (185ms)"7372lb # [ 164.543539] niks3-server[1120]: 2026/09/22 17:00:44 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo7373lb # [ 164.545700] niks3-server[1120]: 2026/09/22 17:00:44 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst7374worker1 # [ 164.568708] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48888 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=17375worker1 # [ 164.581986] nix-daemon[861]: reaped child process 2114, status = succeeded7376client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.04 seconds)7377worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7378worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7379client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]'7380client # [ 164.690735] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]".7381client # Running as unit: gpu.service; invocation ID: e20864de03324f23b1c664899d31fc267382client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds)7383lb: must succeed: curl -sf localhost:9901/clusters7384lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7385lb: must succeed: curl -sf localhost:9901/clusters7386lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7387worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7388client # [ 164.828398] nix[1534]: don't know how to build these paths:7389client # [ 164.829239] nix[1534]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv7390worker2 # [ 164.821756] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423007391worker1 # [ 164.834623] nix-grpc-daemon[1796]: ts=2026-09-22T17:00:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887392worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)7393worker2 # [ 164.850937] nix-grpc-daemon[1517]: ts=2026-09-22T17:00:45Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=07394client # [ 164.857083] nix[1534]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker7395lb # [ 165.166243] envoy[907]: conn peer=[2001:db8:1::1]:56068 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26999 tx=12334 ms=148637396lb: must succeed: curl -sf localhost:9901/clusters7397lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7398lb: must succeed: curl -sf localhost:9901/clusters7399lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7400worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7401worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds)7402client: waiting for success: systemctl show -p Result gpu | grep -q exit-code7403client # [ 194.858561] nix[1534]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}7404client # [ 194.868509] nix[1534]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed7405client # [ 194.896367] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE7406client # [ 194.899975] systemd[1]: gpu.service: Failed with result 'exit-code'.7407client # [ 194.904504] systemd[1]: gpu.service: Consumed 146ms CPU time over 30.209s wall clock time, 37.6M memory peak, 5.2K incoming IP traffic, 5K outgoing IP traffic.7408client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.28 seconds)7409client: must succeed: journalctl -u gpu -o cat7410lb # [ 195.168634] envoy[907]: conn peer=[2001:db8:1::1]:55728 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=562 ms=300537411client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds)7412lb: must succeed: curl -sf localhost:9901/clusters7413lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7414lb: must succeed: curl -sf localhost:9901/clusters7415lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)7416worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7417worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds)7418(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.73 seconds)7419subtest: low disk drains a worker and builds go to the other7420worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill7421worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.93 seconds)7422worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'7423worker1 # [ 196.418342] nix-grpc-daemon[1796]: ts=2026-09-22T17:01:16Z level=info event=unhealthy reason=min_free7424worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds)7425client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&27426client # don't know how to build these paths:7427client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7428worker2 # [ 197.460942] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423007429worker1 # [ 197.473086] nix-grpc-daemon[1796]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:488887430worker2 # [ 197.487600] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=07431worker2 # [ 197.492383] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=17432worker2 # [ 197.531767] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423007433worker2 # [ 197.544330] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423007434client # copying 1 paths to 'lb:50051'...7435client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...7436worker2 # [ 197.556928] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423007437worker2 # [ 197.567905] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)7438worker2 # [ 197.668044] nix-daemon[851]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)7439worker2 # [ 197.680861] nix-daemon[851]: reaped child process 1793, status = succeeded7440lb # [ 197.674588] niks3-server[1120]: 2026/09/22 17:01:18 INFO Received uploads request method=POST path=/api/pending_closures7441worker2 # [ 197.692473] nix-grpc-daemon[1595]: time=2026-09-22T17:01:17.985Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7442worker2 # [ 197.694386] nix-grpc-daemon[1595]: time=2026-09-22T17:01:17.987Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"7443lb # [ 197.691145] niks3-server[1120]: 2026/09/22 17:01:18 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst7444lb # [ 197.698364] niks3-server[1120]: 2026/09/22 17:01:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign7445lb # [ 197.701109] niks3-server[1120]: 2026/09/22 17:01:18 INFO Signed narinfos id=80 count=17446worker2 # [ 197.716315] nix-grpc-daemon[1595]: time=2026-09-22T17:01:18.009Z level=INFO msg="Uploading 1 narinfos"7447lb # [ 197.705878] niks3-server[1120]: 2026/09/22 17:01:18 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls7448lb # [ 197.713431] niks3-server[1120]: 2026/09/22 17:01:18 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete7449lb # [ 197.717083] niks3-server[1120]: 2026/09/22 17:01:18 INFO Completed upload id=807450worker2 # [ 197.729878] nix-grpc-daemon[1595]: time=2026-09-22T17:01:18.023Z level=INFO msg="Upload complete. (151ms)"7451worker2 # [ 197.732059] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=5127452worker2 # [ 197.734962] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423007453lb # [ 197.724590] niks3-server[1120]: 2026/09/22 17:01:18 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo7454worker2 # [ 197.740583] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)7455worker2 # [ 197.745143] nix-daemon[851]: reaped child process 1788, status = succeeded7456worker2 # [ 197.749721] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)7457client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...7458client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv7459client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds7460client # farm-a> LOG-farm-a-drain7461worker2 # [ 198.591113] nix-daemon[851]: reaped child process 1797, status = succeeded7462worker2 # [ 198.670337] nix-daemon[851]: accepted connection from pid 1813, user nix-grpc-daemon (trusted)7463worker2 # [ 198.681269] nix-daemon[851]: reaped child process 1816, status = succeeded7464lb # [ 198.676100] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received uploads request method=POST path=/api/pending_closures7465worker2 # [ 198.693509] nix-grpc-daemon[1595]: time=2026-09-22T17:01:18.986Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7466worker2 # [ 198.695076] nix-grpc-daemon[1595]: time=2026-09-22T17:01:18.988Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"7467lb # [ 198.699282] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign7468worker2 # [ 198.716835] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.009Z level=INFO msg="Uploading 1 narinfos"7469lb # [ 198.704813] niks3-server[1120]: 2026/09/22 17:01:19 INFO Signed narinfos id=81 count=17470lb # [ 198.708850] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls7471lb # [ 198.711252] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv7472lb # [ 198.716069] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete7473lb # [ 198.718873] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7474worker2 # [ 198.734794] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.027Z level=INFO msg="Upload complete. (178ms)"7475lb # [ 198.722433] niks3-server[1120]: 2026/09/22 17:01:19 INFO Completed upload id=817476lb # [ 198.725247] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo7477worker2 # [ 198.737261] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=17478worker2 # [ 198.744277] nix-daemon[851]: reaped child process 1795, status = succeeded7479worker2 # [ 198.784194] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=07480worker2 # [ 198.788590] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=17481worker2 # [ 198.793178] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423007482worker2 # [ 198.802232] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423007483worker2 # [ 198.812631] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.105Z level=INFO msg="All 1 paths already cached"7484client # copying 1 paths to 'lb:50051'...7485client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...7486worker2 # [ 198.819776] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423007487worker2 # [ 198.826139] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)7488worker2 # [ 198.911638] nix-daemon[851]: accepted connection from pid 1822, user nix-grpc-daemon (trusted)7489worker2 # [ 198.924904] nix-daemon[851]: reaped child process 1825, status = succeeded7490lb # [ 198.917818] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received uploads request method=POST path=/api/pending_closures7491worker2 # [ 198.939396] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.232Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7492worker2 # [ 198.940799] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.234Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"7493lb # [ 198.948959] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign7494lb # [ 198.954670] niks3-server[1120]: 2026/09/22 17:01:19 INFO Signed narinfos id=82 count=17495worker2 # [ 198.973929] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.267Z level=INFO msg="Uploading 1 narinfos"7496lb # [ 198.962160] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst7497lb # [ 198.968648] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls7498lb # [ 198.980513] niks3-server[1120]: 2026/09/22 17:01:19 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete7499lb # [ 198.983896] niks3-server[1120]: 2026/09/22 17:01:19 INFO Completed upload id=827500worker2 # [ 198.996757] nix-grpc-daemon[1595]: time=2026-09-22T17:01:19.289Z level=INFO msg="Upload complete. (162ms)"7501lb # [ 198.986389] niks3-server[1120]: 2026/09/22 17:01:19 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo7502worker2 # [ 199.000427] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=6247503worker2 # [ 199.005334] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423007504worker2 # [ 199.014354] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)7505worker2 # [ 199.019874] nix-daemon[851]: reaped child process 1820, status = succeeded7506worker2 # [ 199.024050] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)7507client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...7508client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7509client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7510client # farm-b> LOG-farm-b-drain7511worker2 # [ 199.838211] nix-daemon[851]: reaped child process 1829, status = succeeded7512worker2 # [ 199.911684] nix-daemon[851]: accepted connection from pid 1845, user nix-grpc-daemon (trusted)7513worker2 # [ 199.923387] nix-daemon[851]: reaped child process 1848, status = succeeded7514lb # [ 199.917508] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received uploads request method=POST path=/api/pending_closures7515worker2 # [ 199.938713] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.231Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7516worker2 # [ 199.940494] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.233Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"7517lb # [ 199.960848] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign7518lb # [ 199.966798] niks3-server[1120]: 2026/09/22 17:01:20 INFO Signed narinfos id=83 count=17519worker2 # [ 199.983424] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.276Z level=INFO msg="Uploading 1 narinfos"7520lb # [ 199.977492] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7521lb # [ 199.983132] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst7522lb # [ 199.989245] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls7523lb # [ 200.000539] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete7524lb # [ 200.008539] niks3-server[1120]: 2026/09/22 17:01:20 INFO Completed upload id=837525lb # [ 200.009792] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo7526worker2 # [ 200.021445] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.314Z level=INFO msg="Upload complete. (191ms)"7527worker2 # [ 200.032293] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=17528worker2 # [ 200.040405] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=07529worker2 # [ 200.045296] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=17530worker2 # [ 200.054936] nix-daemon[851]: reaped child process 1827, status = succeeded7531worker2 # [ 200.083361] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423007532worker2 # [ 200.095848] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423007533worker2 # [ 200.109065] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.402Z level=INFO msg="All 2 paths already cached"7534client # copying 1 paths to 'lb:50051'...7535client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...7536worker2 # [ 200.119417] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423007537worker2 # [ 200.127730] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)7538worker2 # [ 200.225155] nix-daemon[851]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)7539worker2 # [ 200.239794] nix-daemon[851]: reaped child process 1857, status = succeeded7540lb # [ 200.232081] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received uploads request method=POST path=/api/pending_closures7541worker2 # [ 200.252678] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.545Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7542worker2 # [ 200.254196] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.547Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"7543lb # [ 200.263101] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign7544worker2 # [ 200.286207] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.579Z level=INFO msg="Uploading 1 narinfos"7545lb # [ 200.273692] niks3-server[1120]: 2026/09/22 17:01:20 INFO Signed narinfos id=84 count=17546lb # [ 200.278914] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls7547lb # [ 200.283941] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst7548lb # [ 200.297122] niks3-server[1120]: 2026/09/22 17:01:20 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete7549lb # [ 200.303699] niks3-server[1120]: 2026/09/22 17:01:20 INFO Completed upload id=847550worker2 # [ 200.316698] nix-grpc-daemon[1595]: time=2026-09-22T17:01:20.609Z level=INFO msg="Upload complete. (175ms)"7551worker2 # [ 200.320833] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=0 paths=1 nar_bytes_in=7527552lb # [ 200.309371] niks3-server[1120]: 2026/09/22 17:01:20 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo7553worker2 # [ 200.326165] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423007554worker2 # [ 200.336137] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)7555worker2 # [ 200.344266] nix-daemon[851]: reaped child process 1852, status = succeeded7556worker2 # [ 200.349183] nix-daemon[851]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)7557client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...7558client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7559client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7560client # farm-top> LOG-farm-top-drain7561worker2 # [ 201.587272] nix-daemon[851]: reaped child process 1861, status = succeeded7562worker2 # [ 201.670074] nix-daemon[851]: accepted connection from pid 1877, user nix-grpc-daemon (trusted)7563worker2 # [ 201.683041] nix-daemon[851]: reaped child process 1880, status = succeeded7564lb # [ 201.676949] niks3-server[1120]: 2026/09/22 17:01:22 INFO Received uploads request method=POST path=/api/pending_closures7565worker2 # [ 201.694239] nix-grpc-daemon[1595]: time=2026-09-22T17:01:21.987Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7566worker2 # [ 201.695771] nix-grpc-daemon[1595]: time=2026-09-22T17:01:21.988Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"7567lb # [ 201.699073] niks3-server[1120]: 2026/09/22 17:01:22 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst7568lb # [ 201.701824] niks3-server[1120]: 2026/09/22 17:01:22 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7569lb # [ 201.703842] niks3-server[1120]: 2026/09/22 17:01:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign7570lb # [ 201.706264] niks3-server[1120]: 2026/09/22 17:01:22 INFO Signed narinfos id=85 count=17571worker2 # [ 201.719267] nix-grpc-daemon[1595]: time=2026-09-22T17:01:22.012Z level=INFO msg="Uploading 1 narinfos"7572lb # [ 201.709470] niks3-server[1120]: 2026/09/22 17:01:22 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls7573lb # [ 201.713757] niks3-server[1120]: 2026/09/22 17:01:22 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete7574lb # [ 201.718258] niks3-server[1120]: 2026/09/22 17:01:22 INFO Completed upload id=857575worker2 # [ 201.730937] nix-grpc-daemon[1595]: time=2026-09-22T17:01:22.024Z level=INFO msg="Upload complete. (173ms)"7576lb # [ 201.722054] niks3-server[1120]: 2026/09/22 17:01:22 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo7577worker2 # [ 201.734257] nix-grpc-daemon[1517]: ts=2026-09-22T17:01:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42300 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=17578worker2 # [ 201.741287] nix-daemon[851]: reaped child process 1859, status = succeeded7579client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 4.45 seconds)7580client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath7581client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.11 seconds)7582worker1: must succeed: rm /nix/.rw-store/fill7583worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds)7584worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7585worker1 # [ 202.419637] nix-grpc-daemon[1796]: ts=2026-09-22T17:01:22Z level=info event=healthy reason=min_free7586worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.09 seconds)7587(finished: subtest: low disk drains a worker and builds go to the other, in 7.82 seconds)7588(finished: run the VM test script, in 204.02 seconds)7589test script finished in 204.17s7590cleanup7591kill QemuMachine (pid 49)7592client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7593client # [2026-09-22T17:01:24Z INFO virtiofsd] Client disconnected, shutting down7594client # [2026-09-22T17:01:24Z INFO virtiofsd] Client disconnected, shutting down7595client # [2026-09-22T17:01:24Z INFO virtiofsd] Client disconnected, shutting down7596kill QemuMachine (pid 50)7597lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7598lb # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down7599lb # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down7600lb # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down7601kill QemuMachine (pid 51)7602worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7603worker1 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down7604worker1 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down7605worker1 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down7606kill QemuMachine (pid 52)7607worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7608worker2 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down7609worker2 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down7610worker2 # [2026-09-22T17:01:25Z INFO virtiofsd] Client disconnected, shutting down7611(finished: cleanup, in 1.07 seconds)7612additionally exposed symbols:7613 client, lb, worker1, worker2,7614 vlan1,7615 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh