vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #510
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1: QEMU running (pid 51)14worker1 # Formatting '/build/vm-state-worker1/tmp.pd4NHiGRbo', fmt=raw size=107374182415worker1 # mke2fs 1.47.4 (6-Mar-2025)16worker1 # Discarding device blocks: 0/262144 done17worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes18worker1 # Filesystem UUID: d80a9e16-2163-42f9-9de3-690e024b836819worker1 # Superblock backups stored on blocks:20worker1 # 32768, 98304, 163840, 22937621worker1 # 22client # Disk image does not exist, creating the virtualisation disk image...23worker1 # Allocating group tables: 0/8 done24client # Formatting '/build/vm-state-client/tmp.0e8aPH9Rm0', fmt=raw size=107374182425client: QEMU running (pid 49)26worker1 # Writing inode tables: 0/8 done27worker1 # Creating journal (8192 blocks): done28client # mke2fs 1.47.4 (6-Mar-2025)29lb: QEMU running (pid 50)30lb # Disk image does not exist, creating the virtualisation disk image...31worker1 # Writing superblocks and filesystem accounting information: 0/8 done32lb # Formatting '/build/vm-state-lb/tmp.N6jPdFWUqn', fmt=raw size=107374182433client # Discarding device blocks: 0/262144 done34worker2 # Disk image does not exist, creating the virtualisation disk image...35lb # mke2fs 1.47.4 (6-Mar-2025)36client # Creating filesystem with 262144 4k blocks and 65536 inodes37worker2 # Formatting '/build/vm-state-worker2/tmp.3EPTp2HsE8', fmt=raw size=107374182438lb # Discarding device blocks: 0/262144 done39client # Filesystem UUID: 759ca026-cf93-4c44-bd04-aab8640abc4840worker2 # mke2fs 1.47.4 (6-Mar-2025)41lb # Creating filesystem with 262144 4k blocks and 65536 inodes42client # Superblock backups stored on blocks:43worker2 # Discarding device blocks: 0/262144 done44lb # Filesystem UUID: 949b70ce-620c-474d-8417-b0beaf0e348545client # 32768, 98304, 163840, 22937646worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes47lb # Superblock backups stored on blocks:48client # 49worker2 # Filesystem UUID: 239e6c9e-df98-4cbb-a903-433ce793521c50lb # 32768, 98304, 163840, 22937651client # Allocating group tables: 0/8 done52worker2 # Superblock backups stored on blocks:53worker2 # 32768, 98304, 163840, 22937654lb # 55worker2: QEMU running (pid 52)56worker1 # 57lb # Allocating group tables: 0/8 done58client # Writing inode tables: 0/8 done59lb # Writing inode tables: 0/8 done60client # Creating journal (8192 blocks): done61worker1 # Virtualisation disk image created.62lb # Creating journal (8192 blocks): done63client # Writing superblocks and filesystem accounting information: 0/8 done64worker1 # Starting virtiofs daemons...65lb # Writing superblocks and filesystem accounting information: 0/8 done66client # 67worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)68lb # 69client # Virtualisation disk image created.70worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether71lb # Virtualisation disk image created.72client # Starting virtiofs daemons...73worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...74lb # Starting virtiofs daemons...75client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)76worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)77lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)78client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether79worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether80lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether81client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)82worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...83lb # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...84client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether85worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)86lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)87client # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...88worker1 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether89lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether90client # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...91worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...92lb # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...93client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)94worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests95lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)96client # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether97worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests98lb # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether99client # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...100worker1 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests101lb # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...102client # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests103(finished: start all VMs, in 0.23 seconds)104worker2 # 105lb # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests106client # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests107client: waiting for unit network-addresses-eth1.service108worker2 # Allocating group tables: 0/8 done109lb # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests110client # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests111client: waiting for the VM to finish booting112worker2 # Writing inode tables: 0/8 done113lb # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests114worker2 # Creating journal (8192 blocks): done115worker2 # Writing superblocks and filesystem accounting information: 0/8 done116worker2 # 117worker2 # Virtualisation disk image created.118worker2 # Starting virtiofs daemons...119worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)120worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether121worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...122worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)123worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether124worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...125worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)126worker2 # [2026-09-22T22:21:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether127worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Waiting for vhost-user socket connection...128worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests129worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests130worker2 # [2026-09-22T22:21:48Z INFO virtiofsd] Client connected, servicing requests131client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)132worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)133lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)134worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)135client # 136client # 137client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00138client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...139client # 140client # 141client # 142client # 143worker1 # 144worker1 # 145client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00146worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00147lb # 148lb # 149lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00150worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...151worker1 # 152worker1 # 153worker1 # 154worker1 # 155client # Press Ctrl-B to configure iPXE (PCI 00:05.0)...156client # 157client # 158worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00159worker2 # 160worker2 # 161lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...162lb # 163lb # 164lb # 165lb # 166worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00167lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00168worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)...169worker1 # 170worker1 # 171worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...172worker2 # 173worker2 # 174worker2 # 175worker2 # 176worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00177lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)...178lb # 179lb # 180worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)...181worker2 # 182worker2 # 183client # Booting from ROM...184worker1 # Booting from ROM...185lb # Booting from ROM...186worker2 # Booting from ROM...187client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026188worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026189client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test/init regInfo=/nix/store/s9k7mpd3day04qzf19r71x8dq0q2ycs2-closure-info/registration console=ttyS0,115200n8 console=tty0190client # [ 0.000000] BIOS-provided physical RAM map:191client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable192client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved193client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved194worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dyab6c8i372v5waficb63zp79vnsaxrg-nixos-system-worker1-test/init regInfo=/nix/store/a01b4wkhhfw171hhg3lf8p5ygrq1fswf-closure-info/registration console=ttyS0,115200n8 console=tty0195client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable196worker1 # [ 0.000000] BIOS-provided physical RAM map:197client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved198worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable199client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved200worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved201client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved202worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved203lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026204client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved205worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable206client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved207worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved208client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved209worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved210client # [ 0.000000] NX (Execute Disable) protection: active211worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved212client # [ 0.000000] APIC: Static calls initialized213client # [ 0.000000] SMBIOS 2.8 present.214worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved215worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026216lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test/init regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration console=ttyS0,115200n8 console=tty0217lb # [ 0.000000] BIOS-provided physical RAM map:218worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved219client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014220lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable221client # [ 0.000000] DMI: Memory slots populated: 1/1222worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved223client # [ 0.000000] Hypervisor detected: KVM224lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved225worker1 # [ 0.000000] NX (Execute Disable) protection: active226client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000227worker1 # [ 0.000000] APIC: Static calls initialized228lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved229client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00230worker1 # [ 0.000000] SMBIOS 2.8 present.231worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gvbzy0g4j2sf3am2wkwfga8lrrdci67y-nixos-system-worker2-test/init regInfo=/nix/store/788l1h41glyfk32if77z9ksf8qk2j16n-closure-info/registration console=ttyS0,115200n8 console=tty0232client # [ 0.000000] kvm-clock: using sched offset of 445158384 cycles233lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable234worker2 # [ 0.000000] BIOS-provided physical RAM map:235worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014236lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved237worker1 # [ 0.000000] DMI: Memory slots populated: 1/1238client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns239worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable240worker1 # [ 0.000000] Hypervisor detected: KVM241lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved242client # [ 0.000005] tsc: Detected 2400.012 MHz processor243worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved244worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000245lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved246client # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000247worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00248worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved249lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved250client # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs251worker1 # [ 0.000000] kvm-clock: using sched offset of 464652817 cycles252worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable253client # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT254lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved255worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved256worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns257client # [ 0.002761] found SMP MP-table at [mem 0x000f5450-0x000f545f]258lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved259worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor260client # [ 0.002773] Using GB pages for direct mapping261lb # [ 0.000000] NX (Execute Disable) protection: active262worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved263client # [ 0.002932] RAMDISK: [mem 0x5e370000-0x5ffcffff]264worker1 # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000265lb # [ 0.000000] APIC: Static calls initialized266worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved267lb # [ 0.000000] SMBIOS 2.8 present.268client # [ 0.002940] ACPI: Early table checksum verification disabled269worker1 # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs270worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved271client # [ 0.002943] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )272lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014273worker1 # [ 0.000835] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT274worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved275lb # [ 0.000000] DMI: Memory slots populated: 1/1276client # [ 0.002947] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)277worker1 # [ 0.002721] found SMP MP-table at [mem 0x000f5450-0x000f545f]278lb # [ 0.000000] Hypervisor detected: KVM279worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved280worker1 # [ 0.002733] Using GB pages for direct mapping281lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000282worker2 # [ 0.000000] NX (Execute Disable) protection: active283client # [ 0.002951] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)284worker1 # [ 0.002839] RAMDISK: [mem 0x5e370000-0x5ffcffff]285lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00286worker2 # [ 0.000000] APIC: Static calls initialized287worker2 # [ 0.000000] SMBIOS 2.8 present.288worker1 # [ 0.002847] ACPI: Early table checksum verification disabled289client # [ 0.002957] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)290lb # [ 0.000000] kvm-clock: using sched offset of 450500607 cycles291worker1 # [ 0.002850] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )292client # [ 0.002959] ACPI: FACS 0x000000005FFE0000 000040293worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014294lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns295client # [ 0.002961] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)296worker2 # [ 0.000000] DMI: Memory slots populated: 1/1297worker1 # [ 0.002854] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)298lb # [ 0.000004] tsc: Detected 2400.012 MHz processor299worker2 # [ 0.000000] Hypervisor detected: KVM300client # [ 0.002963] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)301worker1 # [ 0.002858] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)302worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000303lb # [ 0.000803] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000304worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00305client # [ 0.002964] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)306worker1 # [ 0.002866] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)307lb # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs308worker2 # [ 0.000001] kvm-clock: using sched offset of 451213154 cycles309worker1 # [ 0.002868] ACPI: FACS 0x000000005FFE0000 000040310lb # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT311client # [ 0.002966] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)312lb # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f]313worker1 # [ 0.002869] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)314worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns315client # [ 0.002967] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]316lb # [ 0.002746] Using GB pages for direct mapping317worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor318lb # [ 0.002887] RAMDISK: [mem 0x5e36e000-0x5ffcffff]319worker1 # [ 0.002871] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)320client # [ 0.002968] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]321worker2 # [ 0.000804] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000322lb # [ 0.002894] ACPI: Early table checksum verification disabled323client # [ 0.002969] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]324worker1 # [ 0.002872] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)325worker2 # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs326lb # [ 0.002897] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )327client # [ 0.002969] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]328worker1 # [ 0.002874] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)329worker2 # [ 0.000835] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT330lb # [ 0.002901] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)331client # [ 0.002970] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]332worker2 # [ 0.002723] found SMP MP-table at [mem 0x000f5450-0x000f545f]333worker1 # [ 0.002875] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]334worker2 # [ 0.002734] Using GB pages for direct mapping335lb # [ 0.002905] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)336client # [ 0.002970] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]337worker1 # [ 0.002876] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]338worker2 # [ 0.002838] RAMDISK: [mem 0x5e36f000-0x5ffcffff]339client # [ 0.002971] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]340lb # [ 0.002912] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)341worker2 # [ 0.002848] ACPI: Early table checksum verification disabled342worker1 # [ 0.002877] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]343client # [ 0.003195] No NUMA configuration found344lb # [ 0.002914] ACPI: FACS 0x000000005FFE0000 000040345worker2 # [ 0.002851] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )346worker1 # [ 0.002877] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]347client # [ 0.003196] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]348lb # [ 0.002915] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)349worker1 # [ 0.002878] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]350client # [ 0.003198] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]351worker2 # [ 0.002855] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)352client # [ 0.005465] Zone ranges:353lb # [ 0.002917] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)354worker1 # [ 0.002878] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]355client # [ 0.005465] DMA [mem 0x0000000000001000-0x0000000000ffffff]356worker2 # [ 0.002863] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)357worker1 # [ 0.002879] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]358lb # [ 0.002918] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)359client # [ 0.005467] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]360client # [ 0.005468] Normal empty361worker2 # [ 0.002869] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)362worker1 # [ 0.003109] No NUMA configuration found363client # [ 0.005469] Device empty364worker2 # [ 0.002871] ACPI: FACS 0x000000005FFE0000 000040365lb # [ 0.002920] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)366client # [ 0.005470] Movable zone start for each node367worker1 # [ 0.003111] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]368client # [ 0.005470] Early memory node ranges369lb # [ 0.002921] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]370worker2 # [ 0.002873] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)371worker1 # [ 0.003113] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]372worker1 # [ 0.005404] Zone ranges:373client # [ 0.005471] node 0: [mem 0x0000000000001000-0x000000000009efff]374lb # [ 0.002922] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]375worker2 # [ 0.002874] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)376worker1 # [ 0.005404] DMA [mem 0x0000000000001000-0x0000000000ffffff]377client # [ 0.005472] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]378lb # [ 0.002923] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]379worker1 # [ 0.005406] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]380worker2 # [ 0.002876] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)381worker1 # [ 0.005407] Normal empty382client # [ 0.005473] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]383lb # [ 0.002923] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]384worker1 # [ 0.005408] Device empty385client # [ 0.005492] On node 0, zone DMA: 1 pages in unavailable ranges386worker1 # [ 0.005408] Movable zone start for each node387worker2 # [ 0.002877] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)388lb # [ 0.002924] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]389worker1 # [ 0.005409] Early memory node ranges390client # [ 0.005757] On node 0, zone DMA: 97 pages in unavailable ranges391worker2 # [ 0.002879] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]392lb # [ 0.002924] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]393worker1 # [ 0.005409] node 0: [mem 0x0000000000001000-0x000000000009efff]394client # [ 0.032777] On node 0, zone DMA32: 40 pages in unavailable ranges395client # [ 0.033232] ACPI: PM-Timer IO Port: 0x608396worker2 # [ 0.002880] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]397lb # [ 0.002925] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]398worker1 # [ 0.005410] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]399lb # [ 0.003144] No NUMA configuration found400client # [ 0.033242] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])401worker2 # [ 0.002880] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]402worker1 # [ 0.005411] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]403client # [ 0.033269] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23404lb # [ 0.003145] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]405worker1 # [ 0.005435] On node 0, zone DMA: 1 pages in unavailable ranges406worker2 # [ 0.002881] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]407lb # [ 0.003147] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]408client # [ 0.033271] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)409worker1 # [ 0.005699] On node 0, zone DMA: 97 pages in unavailable ranges410worker2 # [ 0.002881] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]411lb # [ 0.005886] Zone ranges:412client # [ 0.033273] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)413lb # [ 0.005887] DMA [mem 0x0000000000001000-0x0000000000ffffff]414worker1 # [ 0.031996] On node 0, zone DMA32: 40 pages in unavailable ranges415worker2 # [ 0.002882] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]416worker1 # [ 0.032453] ACPI: PM-Timer IO Port: 0x608417client # [ 0.033274] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)418lb # [ 0.005888] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]419worker2 # [ 0.002882] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]420lb # [ 0.005889] Normal empty421worker1 # [ 0.032465] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])422client # [ 0.033275] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)423lb # [ 0.005890] Device empty424worker2 # [ 0.003108] No NUMA configuration found425worker1 # [ 0.032492] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23426lb # [ 0.005890] Movable zone start for each node427client # [ 0.033276] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)428worker2 # [ 0.003109] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]429lb # [ 0.005891] Early memory node ranges430worker1 # [ 0.032495] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)431worker2 # [ 0.003111] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]432client # [ 0.033278] ACPI: Using ACPI (MADT) for SMP configuration information433lb # [ 0.005892] node 0: [mem 0x0000000000001000-0x000000000009efff]434worker2 # [ 0.005393] Zone ranges:435worker1 # [ 0.032496] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)436client # [ 0.033279] ACPI: HPET id: 0x8086a201 base: 0xfed00000437lb # [ 0.005893] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]438worker2 # [ 0.005395] DMA [mem 0x0000000000001000-0x0000000000ffffff]439client # [ 0.033282] TSC deadline timer available440worker1 # [ 0.032497] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)441client # [ 0.033286] CPU topo: Max. logical packages: 1442lb # [ 0.005894] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]443worker2 # [ 0.005396] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]444worker1 # [ 0.032498] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)445client # [ 0.033287] CPU topo: Max. logical dies: 1446worker2 # [ 0.005397] Normal empty447lb # [ 0.005913] On node 0, zone DMA: 1 pages in unavailable ranges448worker2 # [ 0.005398] Device empty449client # [ 0.033288] CPU topo: Max. dies per package: 1450worker1 # [ 0.032499] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)451worker2 # [ 0.005399] Movable zone start for each node452lb # [ 0.006187] On node 0, zone DMA: 97 pages in unavailable ranges453client # [ 0.033291] CPU topo: Max. threads per core: 1454worker2 # [ 0.005400] Early memory node ranges455worker1 # [ 0.032501] ACPI: Using ACPI (MADT) for SMP configuration information456lb # [ 0.033366] On node 0, zone DMA32: 40 pages in unavailable ranges457client # [ 0.033291] CPU topo: Num. cores per package: 1458worker2 # [ 0.005400] node 0: [mem 0x0000000000001000-0x000000000009efff]459lb # [ 0.033818] ACPI: PM-Timer IO Port: 0x608460worker1 # [ 0.032502] ACPI: HPET id: 0x8086a201 base: 0xfed00000461client # [ 0.033292] CPU topo: Num. threads per package: 1462worker1 # [ 0.032505] TSC deadline timer available463worker2 # [ 0.005401] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]464lb # [ 0.033846] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])465client # [ 0.033292] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs466worker1 # [ 0.032509] CPU topo: Max. logical packages: 1467worker2 # [ 0.005402] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]468lb # [ 0.033871] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23469worker1 # [ 0.032510] CPU topo: Max. logical dies: 1470client # [ 0.033310] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()471worker2 # [ 0.005423] On node 0, zone DMA: 1 pages in unavailable ranges472worker1 # [ 0.032510] CPU topo: Max. dies per package: 1473lb # [ 0.033874] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)474client # [ 0.033339] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]475worker1 # [ 0.032513] CPU topo: Max. threads per core: 1476worker2 # [ 0.005685] On node 0, zone DMA: 97 pages in unavailable ranges477lb # [ 0.033876] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)478worker1 # [ 0.032514] CPU topo: Num. cores per package: 1479client # [ 0.033341] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]480worker2 # [ 0.032014] On node 0, zone DMA32: 40 pages in unavailable ranges481lb # [ 0.033877] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)482worker1 # [ 0.032514] CPU topo: Num. threads per package: 1483worker2 # [ 0.032469] ACPI: PM-Timer IO Port: 0x608484client # [ 0.033342] [mem 0x60000000-0xafffffff] available for PCI devices485lb # [ 0.033878] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)486worker1 # [ 0.032515] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs487client # [ 0.033344] Booting paravirtualized kernel on KVM488worker2 # [ 0.032480] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])489lb # [ 0.033879] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)490worker1 # [ 0.032533] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()491worker2 # [ 0.032508] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23492client # [ 0.033347] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns493lb # [ 0.033881] ACPI: Using ACPI (MADT) for SMP configuration information494worker2 # [ 0.032510] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)495worker1 # [ 0.032561] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]496lb # [ 0.033882] ACPI: HPET id: 0x8086a201 base: 0xfed00000497client # [ 0.037821] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1498worker2 # [ 0.032512] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)499lb # [ 0.033885] TSC deadline timer available500worker1 # [ 0.032563] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]501client # [ 0.040021] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152502lb # [ 0.033889] CPU topo: Max. logical packages: 1503worker2 # [ 0.032513] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)504worker1 # [ 0.032564] [mem 0x60000000-0xafffffff] available for PCI devices505client # [ 0.040064] kvm-guest: PV spinlocks disabled, single CPU506lb # [ 0.033890] CPU topo: Max. logical dies: 1507worker1 # [ 0.032565] Booting paravirtualized kernel on KVM508worker2 # [ 0.032514] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)509lb # [ 0.033890] CPU topo: Max. dies per package: 1510lb # [ 0.033894] CPU topo: Max. threads per core: 1511worker2 # [ 0.032515] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)512worker1 # [ 0.032568] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns513lb # [ 0.033894] CPU topo: Num. cores per package: 1514worker2 # [ 0.032518] ACPI: Using ACPI (MADT) for SMP configuration information515lb # [ 0.033895] CPU topo: Num. threads per package: 1516worker1 # [ 0.037040] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1517worker2 # [ 0.032519] ACPI: HPET id: 0x8086a201 base: 0xfed00000518lb # [ 0.033895] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs519worker2 # [ 0.032522] TSC deadline timer available520worker1 # [ 0.039188] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152521worker2 # [ 0.032526] CPU topo: Max. logical packages: 1522client # [ 0.040065] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/g90cn3cn0g95ry9pa0dhwf3r60ijvjrh-nixos-system-client-test/init regInfo=/nix/store/s9k7mpd3day04qzf19r71x8dq0q2ycs2-closure-info/registration console=ttyS0,115200n8 console=tty0523lb # [ 0.033912] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()524worker1 # [ 0.039234] kvm-guest: PV spinlocks disabled, single CPU525worker2 # [ 0.032527] CPU topo: Max. logical dies: 1526lb # [ 0.033942] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]527worker2 # [ 0.032527] CPU topo: Max. dies per package: 1528worker2 # [ 0.032531] CPU topo: Max. threads per core: 1529client # [ 0.040156] Unknown kernel command line parameters "regInfo=/nix/store/s9k7mpd3day04qzf19r71x8dq0q2ycs2-closure-info/registration", will be passed to user space.530lb # [ 0.033944] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]531client # [ 0.040169] random: crng init done532worker2 # [ 0.032531] CPU topo: Num. cores per package: 1533lb # [ 0.033945] [mem 0x60000000-0xafffffff] available for PCI devices534worker2 # [ 0.032532] CPU topo: Num. threads per package: 1535client # [ 0.040169] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes536lb # [ 0.033947] Booting paravirtualized kernel on KVM537worker2 # [ 0.032532] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs538client # [ 0.042534] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)539worker1 # [ 0.039236] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dyab6c8i372v5waficb63zp79vnsaxrg-nixos-system-worker1-test/init regInfo=/nix/store/a01b4wkhhfw171hhg3lf8p5ygrq1fswf-closure-info/registration console=ttyS0,115200n8 console=tty0540lb # [ 0.033954] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns541worker2 # [ 0.032551] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()542client # [ 0.043638] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)543worker2 # [ 0.032584] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]544client # [ 0.043670] Fallback order for Node 0: 0545lb # [ 0.038432] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1546worker1 # [ 0.039330] Unknown kernel command line parameters "regInfo=/nix/store/a01b4wkhhfw171hhg3lf8p5ygrq1fswf-closure-info/registration", will be passed to user space.547worker1 # [ 0.039343] random: crng init done548lb # [ 0.040530] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152549worker2 # [ 0.032585] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]550client # [ 0.043673] Built 1 zonelists, mobility grouping on. Total pages: 393078551client # [ 0.043674] Policy zone: DMA32552lb # [ 0.040573] kvm-guest: PV spinlocks disabled, single CPU553worker2 # [ 0.032587] [mem 0x60000000-0xafffffff] available for PCI devices554worker1 # [ 0.039343] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes555client # [ 0.046267] mem auto-init: stack:all(zero), heap alloc:on, heap free:off556worker2 # [ 0.032588] Booting paravirtualized kernel on KVM557worker1 # [ 0.041477] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)558client # [ 0.049312] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1559client # [ 0.052495] allocated 3145728 bytes of page_ext560worker2 # [ 0.032591] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns561worker1 # [ 0.042721] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)562client # [ 0.062173] ftrace: allocating 48787 entries in 192 pages563worker1 # [ 0.042753] Fallback order for Node 0: 0564worker2 # [ 0.037060] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1565client # [ 0.062176] ftrace: allocated 192 pages with 2 groups566worker1 # [ 0.042757] Built 1 zonelists, mobility grouping on. Total pages: 393078567client # [ 0.063217] Dynamic Preempt: lazy568lb # [ 0.040574] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w2dy91fandddgvvjqa8m7gkv6yi4sgxg-nixos-system-lb-test/init regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration console=ttyS0,115200n8 console=tty0569worker1 # [ 0.042758] Policy zone: DMA32570worker2 # [ 0.039217] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152571client # [ 0.063342] rcu: Preemptible hierarchical RCU implementation.572worker2 # [ 0.039264] kvm-guest: PV spinlocks disabled, single CPU573worker1 # [ 0.045231] mem auto-init: stack:all(zero), heap alloc:on, heap free:off574client # [ 0.063343] rcu: RCU event tracing is enabled.575lb # [ 0.040664] Unknown kernel command line parameters "regInfo=/nix/store/xn52n2bv8v838xy21kw2w4b6pvfd5i39-closure-info/registration", will be passed to user space.576worker1 # [ 0.048313] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1577client # [ 0.063343] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.578lb # [ 0.040677] random: crng init done579worker1 # [ 0.051663] allocated 3145728 bytes of page_ext580client # [ 0.063345] Trampoline variant of Tasks RCU enabled.581worker1 # [ 0.061468] ftrace: allocating 48787 entries in 192 pages582lb # [ 0.040679] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes583client # [ 0.063345] Rude variant of Tasks RCU enabled.584worker1 # [ 0.061471] ftrace: allocated 192 pages with 2 groups585client # [ 0.063346] Tracing variant of Tasks RCU enabled.586worker1 # [ 0.062317] Dynamic Preempt: lazy587lb # [ 0.042748] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)588worker2 # [ 0.039266] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gvbzy0g4j2sf3am2wkwfga8lrrdci67y-nixos-system-worker2-test/init regInfo=/nix/store/788l1h41glyfk32if77z9ksf8qk2j16n-closure-info/registration console=ttyS0,115200n8 console=tty0589client # [ 0.063346] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.590worker1 # [ 0.062437] rcu: Preemptible hierarchical RCU implementation.591lb # [ 0.043778] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)592worker1 # [ 0.062437] rcu: RCU event tracing is enabled.593lb # [ 0.043808] Fallback order for Node 0: 0594client # [ 0.063347] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1595worker1 # [ 0.062438] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.596lb # [ 0.043811] Built 1 zonelists, mobility grouping on. Total pages: 393078597worker2 # [ 0.039360] Unknown kernel command line parameters "regInfo=/nix/store/788l1h41glyfk32if77z9ksf8qk2j16n-closure-info/registration", will be passed to user space.598client # [ 0.063362] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.599lb # [ 0.043812] Policy zone: DMA32600worker1 # [ 0.062440] Trampoline variant of Tasks RCU enabled.601worker2 # [ 0.039372] random: crng init done602worker1 # [ 0.062440] Rude variant of Tasks RCU enabled.603lb # [ 0.046411] mem auto-init: stack:all(zero), heap alloc:on, heap free:off604client # [ 0.063363] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.605worker2 # [ 0.039373] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes606worker1 # [ 0.062441] Tracing variant of Tasks RCU enabled.607lb # [ 0.049505] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1608worker2 # [ 0.041672] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)609client # [ 0.063364] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.610lb # [ 0.052725] allocated 3145728 bytes of page_ext611worker1 # [ 0.062441] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.612lb # [ 0.062475] ftrace: allocating 48787 entries in 192 pages613client # [ 0.067781] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16614worker2 # [ 0.042722] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)615worker1 # [ 0.062442] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1616worker2 # [ 0.042754] Fallback order for Node 0: 0617lb # [ 0.062477] ftrace: allocated 192 pages with 2 groups618client # [ 0.068047] rcu: srcu_init: Setting srcu_struct sizes based on contention.619lb # [ 0.063291] Dynamic Preempt: lazy620worker1 # [ 0.062496] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.621worker2 # [ 0.042757] Built 1 zonelists, mobility grouping on. Total pages: 393078622lb # [ 0.063428] rcu: Preemptible hierarchical RCU implementation.623worker2 # [ 0.042758] Policy zone: DMA32624client # [ 0.068053] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns625lb # [ 0.063428] rcu: RCU event tracing is enabled.626worker1 # [ 0.062497] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.627worker2 # [ 0.045233] mem auto-init: stack:all(zero), heap alloc:on, heap free:off628lb # [ 0.063429] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.629client # [ 0.068148] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)630worker2 # [ 0.048356] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1631worker1 # [ 0.062498] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.632lb # [ 0.063430] Trampoline variant of Tasks RCU enabled.633client # [ 0.071682] Console: colour VGA+ 80x25634worker2 # [ 0.051630] allocated 3145728 bytes of page_ext635worker1 # [ 0.067099] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16636client # [ 0.071686] printk: legacy console [tty0] enabled637lb # [ 0.063431] Rude variant of Tasks RCU enabled.638worker2 # [ 0.061466] ftrace: allocating 48787 entries in 192 pages639lb # [ 0.063431] Tracing variant of Tasks RCU enabled.640client # [ 0.101117] printk: legacy console [ttyS0] enabled641worker1 # [ 0.067379] rcu: srcu_init: Setting srcu_struct sizes based on contention.642worker2 # [ 0.061469] ftrace: allocated 192 pages with 2 groups643worker2 # [ 0.062508] Dynamic Preempt: lazy644client # [ 0.197594] ACPI: Core revision 20250807645lb # [ 0.063432] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.646worker1 # [ 0.067387] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns647worker2 # [ 0.062629] rcu: Preemptible hierarchical RCU implementation.648lb # [ 0.063432] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1649worker2 # [ 0.062630] rcu: RCU event tracing is enabled.650client # [ 0.198464] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns651worker1 # [ 0.067488] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)652lb # [ 0.063485] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.653worker2 # [ 0.062631] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.654worker1 # [ 0.071005] Console: colour VGA+ 80x25655client # [ 0.199935] APIC: Switch to symmetric I/O mode setup656worker2 # [ 0.062632] Trampoline variant of Tasks RCU enabled.657worker1 # [ 0.071007] printk: legacy console [tty0] enabled658lb # [ 0.063487] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.659client # [ 0.200915] x2apic enabled660worker2 # [ 0.062633] Rude variant of Tasks RCU enabled.661worker1 # [ 0.100758] printk: legacy console [ttyS0] enabled662worker2 # [ 0.062633] Tracing variant of Tasks RCU enabled.663lb # [ 0.063488] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.664worker1 # [ 0.197424] ACPI: Core revision 20250807665client # [ 0.201694] APIC: Switched APIC routing to: physical x2apic666worker2 # [ 0.062634] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.667lb # [ 0.067826] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16668worker2 # [ 0.062634] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1669lb # [ 0.068100] rcu: srcu_init: Setting srcu_struct sizes based on contention.670worker1 # [ 0.198267] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns671client # [ 0.203501] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1672worker2 # [ 0.062687] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.673worker1 # [ 0.199773] APIC: Switch to symmetric I/O mode setup674lb # [ 0.068106] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns675worker1 # [ 0.200729] x2apic enabled676worker2 # [ 0.062689] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.677lb # [ 0.068203] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)678client # [ 0.204465] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns679lb # [ 0.071714] Console: colour VGA+ 80x25680worker1 # [ 0.201505] APIC: Switched APIC routing to: physical x2apic681worker2 # [ 0.062690] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.682lb # [ 0.071717] printk: legacy console [tty0] enabled683client # [ 0.206099] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)684worker2 # [ 0.067097] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16685lb # [ 0.101170] printk: legacy console [ttyS0] enabled686worker2 # [ 0.067384] rcu: srcu_init: Setting srcu_struct sizes based on contention.687lb # [ 0.196377] ACPI: Core revision 20250807688worker1 # [ 0.203371] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1689client # [ 0.207184] x86/cpu: User Mode Instruction Prevention (UMIP) activated690worker2 # [ 0.067391] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns691client # [ 0.208218] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127692lb # [ 0.197210] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns693worker1 # [ 0.204348] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns694client # [ 0.209097] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0695worker2 # [ 0.067494] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)696lb # [ 0.198704] APIC: Switch to symmetric I/O mode setup697worker2 # [ 0.071025] Console: colour VGA+ 80x25698worker1 # [ 0.205975] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)699lb # [ 0.199687] x2apic enabled700worker2 # [ 0.071029] printk: legacy console [tty0] enabled701worker2 # [ 0.100666] printk: legacy console [ttyS0] enabled702client # [ 0.210100] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto703worker1 # [ 0.207062] x86/cpu: User Mode Instruction Prevention (UMIP) activated704lb # [ 0.200456] APIC: Switched APIC routing to: physical x2apic705worker2 # [ 0.197015] ACPI: Core revision 20250807706client # [ 0.212097] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl707worker1 # [ 0.208105] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127708client # [ 0.213097] Transient Scheduler Attacks: Vulnerable: No microcode709worker2 # [ 0.197905] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns710worker1 # [ 0.209732] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0711lb # [ 0.202247] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1712client # [ 0.214096] Spectre V2 : Mitigation: Enhanced / Automatic IBRS713worker2 # [ 0.199420] APIC: Switch to symmetric I/O mode setup714lb # [ 0.203263] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns715worker2 # [ 0.200430] x2apic enabled716worker1 # [ 0.210721] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto717client # [ 0.215097] Speculative Return Stack Overflow: Mitigation: Safe RET718worker2 # [ 0.201215] APIC: Switched APIC routing to: physical x2apic719lb # [ 0.204930] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)720worker1 # [ 0.211972] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl721worker1 # [ 0.212972] Transient Scheduler Attacks: Vulnerable: No microcode722lb # [ 0.206015] x86/cpu: User Mode Instruction Prevention (UMIP) activated723worker2 # [ 0.203074] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1724worker1 # [ 0.214723] Spectre V2 : Mitigation: Enhanced / Automatic IBRS725lb # [ 0.207075] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127726client # [ 0.216096] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization727worker1 # [ 0.215653] Speculative Return Stack Overflow: Mitigation: Safe RET728lb # [ 0.208603] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0729worker2 # [ 0.204074] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns730client # [ 0.218104] Spectre V2 : Enabling IBPB for BPF731worker2 # [ 0.205744] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)732lb # [ 0.209671] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto733client # [ 0.218866] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier734client # [ 0.220097] active return thunk: srso_alias_return_thunk735worker2 # [ 0.206829] x86/cpu: User Mode Instruction Prevention (UMIP) activated736lb # [ 0.210927] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl737worker1 # [ 0.215972] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization738worker2 # [ 0.208687] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127739lb # [ 0.211927] Transient Scheduler Attacks: Vulnerable: No microcode740client # [ 0.221119] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'741worker1 # [ 0.217979] Spectre V2 : Enabling IBPB for BPF742worker2 # [ 0.209429] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0743client # [ 0.222097] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'744lb # [ 0.213621] Spectre V2 : Mitigation: Enhanced / Automatic IBRS745worker1 # [ 0.218973] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier746client # [ 0.223811] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'747lb # [ 0.213927] Speculative Return Stack Overflow: Mitigation: Safe RET748worker2 # [ 0.210488] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto749worker1 # [ 0.219973] active return thunk: srso_alias_return_thunk750client # [ 0.224097] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'751client # [ 0.225097] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'752worker2 # [ 0.211741] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl753worker1 # [ 0.221629] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'754worker2 # [ 0.212742] Transient Scheduler Attacks: Vulnerable: No microcode755client # [ 0.226096] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'756worker1 # [ 0.221972] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'757worker2 # [ 0.214466] Spectre V2 : Mitigation: Enhanced / Automatic IBRS758lb # [ 0.214927] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization759worker1 # [ 0.223694] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'760client # [ 0.227096] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'761lb # [ 0.216934] Spectre V2 : Enabling IBPB for BPF762worker2 # [ 0.215420] Speculative Return Stack Overflow: Mitigation: Safe RET763worker1 # [ 0.224700] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'764client # [ 0.228983] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256765worker1 # [ 0.225704] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'766lb # [ 0.217928] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier767client # [ 0.229805] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64768lb # [ 0.218927] active return thunk: srso_alias_return_thunk769client # [ 0.230805] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512770worker1 # [ 0.226698] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'771client # [ 0.231825] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024772lb # [ 0.219949] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'773worker1 # [ 0.226972] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'774worker2 # [ 0.216469] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization775client # [ 0.232812] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8776lb # [ 0.220927] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'777worker1 # [ 0.228972] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256778worker2 # [ 0.217749] Spectre V2 : Enabling IBPB for BPF779lb # [ 0.222648] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'780worker1 # [ 0.229972] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64781client # [ 0.233096] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.782worker2 # [ 0.218742] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier783lb # [ 0.222927] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'784worker1 # [ 0.230882] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512785worker2 # [ 0.219741] active return thunk: srso_alias_return_thunk786lb # [ 0.223927] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'787worker1 # [ 0.231680] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024788worker2 # [ 0.221400] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'789lb # [ 0.224927] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'790worker1 # [ 0.232693] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8791worker2 # [ 0.222649] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'792lb # [ 0.225927] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'793worker1 # [ 0.233694] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.794worker2 # [ 0.223481] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'795lb # [ 0.227836] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256796worker2 # [ 0.224504] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'797lb # [ 0.228681] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64798worker2 # [ 0.225533] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'799lb # [ 0.229696] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512800worker2 # [ 0.226523] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'801lb # [ 0.230699] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024802lb # [ 0.231685] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8803worker2 # [ 0.227566] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'804worker2 # [ 0.228741] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256805lb # [ 0.232687] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.806worker2 # [ 0.229740] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64807worker2 # [ 0.230741] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512808worker2 # [ 0.231741] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024809worker2 # [ 0.232741] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8810worker2 # [ 0.233741] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.811client # [ 0.268101] Freeing SMP alternatives memory: 44K812client # [ 0.268918] pid_max: default: 32768 minimum: 301813client # [ 0.269775] LSM: initializing lsm=capability,landlock,yama,bpf,ima814client # [ 0.270206] landlock: Up and running.815client # [ 0.271572] Yama: becoming mindful.816worker1 # [ 0.267928] Freeing SMP alternatives memory: 44K817client # [ 0.272315] LSM support for eBPF active818worker1 # [ 0.268554] pid_max: default: 32768 minimum: 301819client # [ 0.273212] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)820worker1 # [ 0.269625] LSM: initializing lsm=capability,landlock,yama,bpf,ima821worker1 # [ 0.270068] landlock: Up and running.822client # [ 0.274133] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)823worker1 # [ 0.270973] Yama: becoming mindful.824worker1 # [ 0.272192] LSM support for eBPF active825client # [ 0.276745] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)826worker1 # [ 0.273111] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)827lb # [ 0.266932] Freeing SMP alternatives memory: 44K828lb # [ 0.267725] pid_max: default: 32768 minimum: 301829client # [ 0.277609] Performance Events: Fam17h+ core perfctr, AMD PMU driver.830worker1 # [ 0.274012] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)831client # [ 0.278101] ... version: 2832lb # [ 0.268012] LSM: initializing lsm=capability,landlock,yama,bpf,ima833client # [ 0.278824] ... bit width: 48834lb # [ 0.269036] landlock: Up and running.835client # [ 0.279099] ... generic counters: 6836lb # [ 0.269928] Yama: becoming mindful.837worker1 # [ 0.276722] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)838client # [ 0.279798] ... generic bitmap: 000000000000003f839lb # [ 0.271099] LSM support for eBPF active840client # [ 0.280144] ... fixed-purpose counters: 0841worker1 # [ 0.277483] Performance Events: Fam17h+ core perfctr, AMD PMU driver.842lb # [ 0.271830] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)843client # [ 0.280865] ... fixed-purpose bitmap: 0000000000000000844worker1 # [ 0.277978] ... version: 2845worker2 # [ 0.268842] Freeing SMP alternatives memory: 44K846worker1 # [ 0.278679] ... bit width: 48847client # [ 0.281100] ... value mask: 0000ffffffffffff848worker2 # [ 0.269633] pid_max: default: 32768 minimum: 301849lb # [ 0.272969] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)850worker1 # [ 0.278974] ... generic counters: 6851client # [ 0.281962] ... max period: 00007fffffffffff852worker2 # [ 0.270369] LSM: initializing lsm=capability,landlock,yama,bpf,ima853worker1 # [ 0.279652] ... generic bitmap: 000000000000003f854client # [ 0.282785] ... global_ctrl mask: 000000000000003f855worker2 # [ 0.270837] landlock: Up and running.856worker1 # [ 0.280021] ... fixed-purpose counters: 0857worker2 # [ 0.271742] Yama: becoming mindful.858lb # [ 0.275238] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)859client # [ 0.283210] signal: max sigframe size: 3376860worker1 # [ 0.280731] ... fixed-purpose bitmap: 0000000000000000861worker2 # [ 0.272927] LSM support for eBPF active862client # [ 0.283987] rcu: Hierarchical SRCU implementation.863worker1 # [ 0.280975] ... value mask: 0000ffffffffffff864lb # [ 0.276484] Performance Events: Fam17h+ core perfctr, AMD PMU driver.865client # [ 0.284661] rcu: Max phase no-delay instances is 400.866worker2 # [ 0.273695] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)867lb # [ 0.276936] ... version: 2868worker1 # [ 0.281858] ... max period: 00007fffffffffff869lb # [ 0.277654] ... bit width: 48870worker1 # [ 0.282657] ... global_ctrl mask: 000000000000003f871worker2 # [ 0.274784] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)872lb # [ 0.277929] ... generic counters: 6873worker1 # [ 0.283105] signal: max sigframe size: 3376874lb # [ 0.278677] ... generic bitmap: 000000000000003f875worker1 # [ 0.283932] rcu: Hierarchical SRCU implementation.876lb # [ 0.278929] ... fixed-purpose counters: 0877worker1 # [ 0.284541] rcu: Max phase no-delay instances is 400.878worker2 # [ 0.277260] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)879lb # [ 0.279643] ... fixed-purpose bitmap: 0000000000000000880client # [ 0.289603] smp: Bringing up secondary CPUs ...881lb # [ 0.279929] ... value mask: 0000ffffffffffff882worker2 # [ 0.278305] Performance Events: Fam17h+ core perfctr, AMD PMU driver.883client # [ 0.290113] smp: Brought up 1 node, 1 CPU884lb # [ 0.280821] ... max period: 00007fffffffffff885worker2 # [ 0.278746] ... version: 2886client # [ 0.290762] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)887lb # [ 0.281586] ... global_ctrl mask: 000000000000003f888worker2 # [ 0.279459] ... bit width: 48889worker2 # [ 0.279744] ... generic counters: 6890lb # [ 0.282026] signal: max sigframe size: 3376891worker2 # [ 0.280439] ... generic bitmap: 000000000000003f892lb # [ 0.282985] rcu: Hierarchical SRCU implementation.893client # [ 0.291275] Memory: 1454604K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved)894worker1 # [ 0.289605] smp: Bringing up secondary CPUs ...895worker2 # [ 0.280755] ... fixed-purpose counters: 0896lb # [ 0.283777] rcu: Max phase no-delay instances is 400.897client # [ 0.292324] devtmpfs: initialized898worker1 # [ 0.289988] smp: Brought up 1 node, 1 CPU899worker2 # [ 0.281464] ... fixed-purpose bitmap: 0000000000000000900client # [ 0.293141] x86/mm: Memory block size: 128MB901worker1 # [ 0.290631] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)902worker2 # [ 0.281743] ... value mask: 0000ffffffffffff903worker2 # [ 0.282636] ... max period: 00007fffffffffff904worker2 # [ 0.283443] ... global_ctrl mask: 000000000000003f905client # [ 0.294941] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)906worker1 # [ 0.291153] Memory: 1454608K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved)907worker2 # [ 0.283869] signal: max sigframe size: 3376908worker1 # [ 0.292231] devtmpfs: initialized909client # [ 0.295932] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).910worker2 # [ 0.284688] rcu: Hierarchical SRCU implementation.911worker1 # [ 0.293019] x86/mm: Memory block size: 128MB912lb # [ 0.289127] smp: Bringing up secondary CPUs ...913client # [ 0.297188] pinctrl core: initialized pinctrl subsystem914worker2 # [ 0.285319] rcu: Max phase no-delay instances is 400.915lb # [ 0.289885] smp: Brought up 1 node, 1 CPU916client # [ 0.298267] PM: RTC time: 22:21:48, date: 2026-09-22917lb # [ 0.290434] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)918worker1 # [ 0.294780] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)919worker1 # [ 0.295933] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).920lb # [ 0.291169] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved)921worker1 # [ 0.297063] pinctrl core: initialized pinctrl subsystem922lb # [ 0.292175] devtmpfs: initialized923client # [ 0.301783] NET: Registered PF_NETLINK/PF_ROUTE protocol family924worker1 # [ 0.298227] PM: RTC time: 22:21:48, date: 2026-09-22925worker2 # [ 0.290340] smp: Bringing up secondary CPUs ...926lb # [ 0.293009] x86/mm: Memory block size: 128MB927worker2 # [ 0.290757] smp: Brought up 1 node, 1 CPU928client # [ 0.302608] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations929worker2 # [ 0.291432] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)930client # [ 0.303123] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations931lb # [ 0.294770] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)932client # [ 0.304370] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations933worker1 # [ 0.301773] NET: Registered PF_NETLINK/PF_ROUTE protocol family934lb # [ 0.295859] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).935worker2 # [ 0.291909] Memory: 1454612K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved)936client # [ 0.305109] audit: initializing netlink subsys (disabled)937lb # [ 0.297000] pinctrl core: initialized pinctrl subsystem938worker2 # [ 0.292991] devtmpfs: initialized939worker1 # [ 0.303205] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations940worker2 # [ 0.293853] x86/mm: Memory block size: 128MB941lb # [ 0.298112] PM: RTC time: 22:21:48, date: 2026-09-22942client # [ 0.306102] audit: type=2000 audit(1790115708.965:1): state=initialized audit_enabled=0 res=1943worker1 # [ 0.303998] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations944client # [ 0.307213] thermal_sys: Registered thermal governor 'fair_share'945worker2 # [ 0.295658] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)946client # [ 0.307215] thermal_sys: Registered thermal governor 'bang_bang'947worker1 # [ 0.305253] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations948client # [ 0.308100] thermal_sys: Registered thermal governor 'step_wise'949worker1 # [ 0.305984] audit: initializing netlink subsys (disabled)950worker2 # [ 0.296612] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).951lb # [ 0.301604] NET: Registered PF_NETLINK/PF_ROUTE protocol family952client # [ 0.309000] thermal_sys: Registered thermal governor 'user_space'953worker2 # [ 0.297849] pinctrl core: initialized pinctrl subsystem954worker1 # [ 0.306976] audit: type=2000 audit(1790115708.969:1): state=initialized audit_enabled=0 res=1955client # [ 0.309823] thermal_sys: Registered thermal governor 'power_allocator'956lb # [ 0.302422] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations957worker2 # [ 0.298929] PM: RTC time: 22:21:48, date: 2026-09-22958client # [ 0.310112] cpuidle: using governor menu959worker1 # [ 0.308086] thermal_sys: Registered thermal governor 'fair_share'960lb # [ 0.302951] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations961worker1 # [ 0.308088] thermal_sys: Registered thermal governor 'bang_bang'962client # [ 0.312291] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5963worker1 # [ 0.308976] thermal_sys: Registered thermal governor 'step_wise'964lb # [ 0.304204] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations965client # [ 0.313334] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]966lb # [ 0.304939] audit: initializing netlink subsys (disabled)967worker1 # [ 0.309976] thermal_sys: Registered thermal governor 'user_space'968worker2 # [ 0.302481] NET: Registered PF_NETLINK/PF_ROUTE protocol family969client # [ 0.314102] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry970worker1 # [ 0.310974] thermal_sys: Registered thermal governor 'power_allocator'971lb # [ 0.306077] thermal_sys: Registered thermal governor 'fair_share'972worker1 # [ 0.311943] cpuidle: using governor menu973client # [ 0.315111] PCI: Using configuration type 1 for base access974worker2 # [ 0.303253] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations975lb # [ 0.306080] thermal_sys: Registered thermal governor 'bang_bang'976lb # [ 0.306931] thermal_sys: Registered thermal governor 'step_wise'977worker2 # [ 0.303768] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations978worker1 # [ 0.313530] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5979client # [ 0.316189] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.980lb # [ 0.307863] thermal_sys: Registered thermal governor 'user_space'981worker2 # [ 0.305024] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations982worker1 # [ 0.314211] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]983lb # [ 0.308648] audit: type=2000 audit(1790115708.977:1): state=initialized audit_enabled=0 res=1984worker2 # [ 0.305753] audit: initializing netlink subsys (disabled)985worker1 # [ 0.314977] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry986lb # [ 0.309932] thermal_sys: Registered thermal governor 'power_allocator'987worker2 # [ 0.306894] thermal_sys: Registered thermal governor 'fair_share'988worker1 # [ 0.315987] PCI: Using configuration type 1 for base access989lb # [ 0.309958] cpuidle: using governor menu990worker2 # [ 0.306897] thermal_sys: Registered thermal governor 'bang_bang'991worker1 # [ 0.317091] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.992lb # [ 0.312099] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5993worker2 # [ 0.307745] thermal_sys: Registered thermal governor 'step_wise'994worker2 # [ 0.308711] thermal_sys: Registered thermal governor 'user_space'995lb # [ 0.313206] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]996client # [ 0.323113] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages997worker2 # [ 0.309479] audit: type=2000 audit(1790115708.982:1): state=initialized audit_enabled=0 res=1998lb # [ 0.313933] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry999client # [ 0.324100] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1000worker2 # [ 0.310746] thermal_sys: Registered thermal governor 'power_allocator'1001lb # [ 0.314942] PCI: Using configuration type 1 for base access1002worker2 # [ 0.310760] cpuidle: using governor menu1003lb # [ 0.316028] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.1004worker2 # [ 0.312996] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.51005worker1 # [ 0.323989] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1006worker2 # [ 0.313995] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]1007client # [ 0.329100] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1008worker1 # [ 0.324975] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1009worker2 # [ 0.314746] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry1010client # [ 0.330100] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1011worker2 # [ 0.315757] PCI: Using configuration type 1 for base access1012lb # [ 0.321169] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1013worker2 # [ 0.316899] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.1014lb # [ 0.321931] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1015worker1 # [ 0.329976] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1016worker1 # [ 0.330975] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1017worker2 # [ 0.321986] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1018lb # [ 0.326931] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1019worker2 # [ 0.322744] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1020lb # [ 0.327929] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1021client # [ 0.341351] ACPI: Added _OSI(Module Device)1022client # [ 0.342101] ACPI: Added _OSI(Processor Device)1023client # [ 0.342890] ACPI: Added _OSI(Processor Aggregator Device)1024worker2 # [ 0.327744] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1025worker2 # [ 0.328743] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1026worker1 # [ 0.341318] ACPI: Added _OSI(Module Device)1027worker1 # [ 0.341977] ACPI: Added _OSI(Processor Device)1028worker1 # [ 0.342744] ACPI: Added _OSI(Processor Aggregator Device)1029lb # [ 0.338273] ACPI: Added _OSI(Module Device)1030client # [ 0.349631] ACPI: 1 ACPI AML tables successfully acquired and loaded1031lb # [ 0.338931] ACPI: Added _OSI(Processor Device)1032lb # [ 0.339654] ACPI: Added _OSI(Processor Aggregator Device)1033client # [ 0.353510] ACPI: Interpreter enabled1034client # [ 0.354114] ACPI: PM: (supports S0 S3 S4 S5)1035worker2 # [ 0.339177] ACPI: Added _OSI(Module Device)1036client # [ 0.354835] ACPI: Using IOAPIC for interrupt routing1037worker2 # [ 0.339746] ACPI: Added _OSI(Processor Device)1038worker1 # [ 0.350538] ACPI: 1 ACPI AML tables successfully acquired and loaded1039worker2 # [ 0.340442] ACPI: Added _OSI(Processor Aggregator Device)1040lb # [ 0.345815] ACPI: 1 ACPI AML tables successfully acquired and loaded1041client # [ 0.357145] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1042worker1 # [ 0.354346] ACPI: Interpreter enabled1043client # [ 0.358100] PCI: Using E820 reservations for host bridge windows1044worker1 # [ 0.354990] ACPI: PM: (supports S0 S3 S4 S5)1045worker1 # [ 0.355728] ACPI: Using IOAPIC for interrupt routing1046client # [ 0.361237] ACPI: Enabled 2 GPEs in block 00 to 3F1047worker1 # [ 0.356053] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1048lb # [ 0.352366] ACPI: Interpreter enabled1049worker1 # [ 0.356975] PCI: Using E820 reservations for host bridge windows1050lb # [ 0.352945] ACPI: PM: (supports S0 S3 S4 S5)1051worker2 # [ 0.348091] ACPI: 1 ACPI AML tables successfully acquired and loaded1052lb # [ 0.353665] ACPI: Using IOAPIC for interrupt routing1053worker1 # [ 0.360127] ACPI: Enabled 2 GPEs in block 00 to 3F1054lb # [ 0.353981] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1055lb # [ 0.354930] PCI: Using E820 reservations for host bridge windows1056worker2 # [ 0.352150] ACPI: Interpreter enabled1057worker2 # [ 0.352760] ACPI: PM: (supports S0 S3 S4 S5)1058client # [ 0.368107] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1059worker2 # [ 0.353471] ACPI: Using IOAPIC for interrupt routing1060lb # [ 0.358067] ACPI: Enabled 2 GPEs in block 00 to 3F1061client # [ 0.369104] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1062client # [ 0.370190] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1063client # [ 0.371225] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1064worker2 # [ 0.355809] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1065worker2 # [ 0.356753] PCI: Using E820 reservations for host bridge windows1066client # [ 0.372470] PCI host bridge to bus 0000:001067worker1 # [ 0.368446] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1068client # [ 0.373104] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1069worker1 # [ 0.368983] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1070client # [ 0.374099] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1071worker2 # [ 0.359866] ACPI: Enabled 2 GPEs in block 00 to 3F1072worker1 # [ 0.370054] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1073client # [ 0.375099] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1074client # [ 0.376099] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1075worker1 # [ 0.371097] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1076lb # [ 0.366762] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1077worker1 # [ 0.372338] PCI host bridge to bus 0000:001078client # [ 0.377099] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1079lb # [ 0.367700] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1080worker1 # [ 0.372978] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1081client # [ 0.378100] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1082worker1 # [ 0.373975] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1083client # [ 0.379100] pci_bus 0000:00: root bus resource [bus 00-ff]1084lb # [ 0.369504] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1085worker1 # [ 0.374974] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1086client # [ 0.380048] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1087lb # [ 0.370052] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1088worker1 # [ 0.375974] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1089lb # [ 0.371261] PCI host bridge to bus 0000:001090client # [ 0.381531] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1091worker2 # [ 0.367880] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1092lb # [ 0.371935] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1093worker1 # [ 0.376975] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1094worker2 # [ 0.368750] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1095lb # [ 0.372930] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1096worker1 # [ 0.377975] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1097worker1 # [ 0.378975] pci_bus 0000:00: root bus resource [bus 00-ff]1098lb # [ 0.373930] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1099worker2 # [ 0.369823] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1100lb # [ 0.374929] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1101worker2 # [ 0.370867] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1102worker1 # [ 0.379883] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1103worker2 # [ 0.372083] PCI host bridge to bus 0000:001104lb # [ 0.375930] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1105worker1 # [ 0.381407] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1106worker2 # [ 0.372747] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1107lb # [ 0.376934] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1108worker2 # [ 0.373744] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1109lb # [ 0.377957] pci_bus 0000:00: root bus resource [bus 00-ff]1110worker2 # [ 0.374744] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1111lb # [ 0.379004] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1112client # [ 0.384228] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1113worker2 # [ 0.375744] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1114client # [ 0.385112] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1115lb # [ 0.380364] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1116worker2 # [ 0.376744] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1117client # [ 0.386191] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1118worker2 # [ 0.377744] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1119client # [ 0.387606] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1120worker2 # [ 0.378744] pci_bus 0000:00: root bus resource [bus 00-ff]1121worker1 # [ 0.384041] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1122worker2 # [ 0.379766] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1123worker1 # [ 0.384987] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1124client # [ 0.388818] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1125worker1 # [ 0.385959] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1126worker2 # [ 0.381197] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1127worker1 # [ 0.386999] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1128client # [ 0.391137] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1129client # [ 0.391991] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1130lb # [ 0.383017] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1131client # [ 0.392910] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1132worker1 # [ 0.388927] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1133lb # [ 0.383942] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1134client # [ 0.393932] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1135lb # [ 0.384870] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1136worker1 # [ 0.392013] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1137client # [ 0.395768] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1138lb # [ 0.386104] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1139worker1 # [ 0.392881] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1140worker2 # [ 0.383861] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1141worker1 # [ 0.393768] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1142lb # [ 0.387659] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1143worker2 # [ 0.384826] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1144client # [ 0.397148] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1145worker1 # [ 0.394821] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1146worker2 # [ 0.385762] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1147client # [ 0.398005] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1148client # [ 0.398852] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1149lb # [ 0.390971] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1150worker2 # [ 0.387093] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1151worker1 # [ 0.396262] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1152lb # [ 0.391815] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1153client # [ 0.399650] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1154lb # [ 0.392704] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1155worker2 # [ 0.388522] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1156worker1 # [ 0.399011] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1157lb # [ 0.393793] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1158worker1 # [ 0.399883] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1159worker2 # [ 0.390783] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1160worker1 # [ 0.400779] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1161lb # [ 0.395763] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1162worker2 # [ 0.391592] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1163client # [ 0.402903] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1164client # [ 0.403765] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1165worker2 # [ 0.392459] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1166worker1 # [ 0.402498] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1167worker2 # [ 0.392750] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1168client # [ 0.404121] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1169lb # [ 0.397937] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1170lb # [ 0.398780] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1171client # [ 0.405690] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1172worker2 # [ 0.394287] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1173lb # [ 0.399680] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1174worker1 # [ 0.404984] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1175client # [ 0.407107] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1176lb # [ 0.401320] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1177worker2 # [ 0.395782] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1178worker1 # [ 0.406643] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1179client # [ 0.407959] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1180worker2 # [ 0.396611] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1181worker1 # [ 0.406997] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1182client # [ 0.408819] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1183worker2 # [ 0.397503] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1184client # [ 0.409105] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1185worker1 # [ 0.408527] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1186worker2 # [ 0.399193] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1187lb # [ 0.403938] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1188client # [ 0.411188] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1189lb # [ 0.405591] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1190worker1 # [ 0.410012] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1191lb # [ 0.405952] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1192worker1 # [ 0.410919] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1193client # [ 0.412972] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1194worker1 # [ 0.411684] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1195client # [ 0.413869] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1196worker2 # [ 0.401781] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1197lb # [ 0.407502] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1198worker2 # [ 0.402750] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1199worker1 # [ 0.411980] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1200client # [ 0.415515] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1201worker2 # [ 0.403765] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1202lb # [ 0.408966] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1203worker1 # [ 0.413574] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1204lb # [ 0.409783] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1205client # [ 0.417145] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1206worker2 # [ 0.405317] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1207lb # [ 0.410685] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1208client # [ 0.418104] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1209worker1 # [ 0.414988] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1210worker2 # [ 0.406751] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1211lb # [ 0.410935] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1212worker1 # [ 0.415960] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1213worker2 # [ 0.407616] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1214client # [ 0.420111] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1215lb # [ 0.412481] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1216worker2 # [ 0.408472] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1217worker1 # [ 0.417431] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1218client # [ 0.421899] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1219worker2 # [ 0.408749] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1220lb # [ 0.413942] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1221client # [ 0.422845] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1222worker1 # [ 0.419017] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1223lb # [ 0.414929] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1224worker2 # [ 0.410822] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1225client # [ 0.423673] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1226worker1 # [ 0.419996] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1227lb # [ 0.416523] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1228worker2 # [ 0.412617] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1229client # [ 0.425112] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1230worker1 # [ 0.421545] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1231worker2 # [ 0.413480] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1232client # [ 0.426071] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1233lb # [ 0.417942] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1234worker1 # [ 0.422987] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1235worker2 # [ 0.414331] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1236lb # [ 0.418906] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1237worker1 # [ 0.423942] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1238client # [ 0.428014] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1239worker2 # [ 0.415768] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1240lb # [ 0.420517] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1241worker1 # [ 0.425402] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1242worker2 # [ 0.416732] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1243client # [ 0.430148] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1244client # [ 0.431106] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1245lb # [ 0.421942] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1246worker1 # [ 0.427018] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1247client # [ 0.432073] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1248lb # [ 0.422897] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1249worker2 # [ 0.418625] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1250worker1 # [ 0.427997] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1251worker2 # [ 0.420550] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1252client # [ 0.433469] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1253lb # [ 0.424291] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1254worker2 # [ 0.421450] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1255worker1 # [ 0.429555] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1256lb # [ 0.425952] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1257worker2 # [ 0.422284] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1258client # [ 0.435116] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1259worker1 # [ 0.431020] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1260lb # [ 0.426914] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1261client # [ 0.436106] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1262worker1 # [ 0.431905] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1263worker2 # [ 0.423750] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1264client # [ 0.437060] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1265lb # [ 0.428459] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1266worker1 # [ 0.432727] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1267worker2 # [ 0.424766] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1268client # [ 0.438499] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1269worker1 # [ 0.433519] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1270lb # [ 0.429976] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1271client # [ 0.439647] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1272worker2 # [ 0.426755] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1273lb # [ 0.430813] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1274client # [ 0.440308] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1275lb # [ 0.431693] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1276worker2 # [ 0.428798] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1277worker1 # [ 0.436013] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1278client # [ 0.441766] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1279worker2 # [ 0.429686] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1280lb # [ 0.432463] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1281worker1 # [ 0.436896] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1282worker2 # [ 0.430474] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1283worker1 # [ 0.437714] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1284client # [ 0.442315] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1285worker2 # [ 0.431295] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1286client # [ 0.443642] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1287worker1 # [ 0.438567] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1288lb # [ 0.433946] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1289lb # [ 0.435563] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1290worker1 # [ 0.439639] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1291lb # [ 0.435952] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1292worker2 # [ 0.432775] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1293worker1 # [ 0.440210] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1294worker2 # [ 0.433750] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1295lb # [ 0.437519] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1296worker2 # [ 0.434728] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1297worker1 # [ 0.441607] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1298lb # [ 0.438669] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1299worker2 # [ 0.436156] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1300worker1 # [ 0.442193] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1301lb # [ 0.439135] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1302worker2 # [ 0.437283] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1303worker1 # [ 0.443637] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1304lb # [ 0.440537] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1305worker2 # [ 0.437941] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1306worker2 # [ 0.439271] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1307lb # [ 0.441120] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1308client # [ 0.444347] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1309lb # [ 0.442612] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1310worker2 # [ 0.439949] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1311client # [ 0.446680] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1312worker2 # [ 0.441771] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1313client # [ 0.447332] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1314client # [ 0.448390] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1315client # [ 0.449380] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1316client # [ 0.451041] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1317worker1 # [ 0.444229] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1318client # [ 0.451748] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1319worker1 # [ 0.446641] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1320client # [ 0.452414] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1321worker1 # [ 0.447220] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1322client # [ 0.453661] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1323lb # [ 0.443163] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1324worker1 # [ 0.448269] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1325lb # [ 0.445567] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1326worker2 # [ 0.442904] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1327worker1 # [ 0.449222] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1328lb # [ 0.446236] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1329worker2 # [ 0.445260] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1330client # [ 0.457175] ACPI: PCI: Interrupt link LNKA configured for IRQ 101331worker1 # [ 0.451004] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1332lb # [ 0.447225] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1333worker2 # [ 0.446037] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1334client # [ 0.458232] ACPI: PCI: Interrupt link LNKB configured for IRQ 101335worker1 # [ 0.451839] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1336client # [ 0.459197] ACPI: PCI: Interrupt link LNKC configured for IRQ 111337lb # [ 0.448182] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1338worker2 # [ 0.447029] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1339worker1 # [ 0.453067] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1340client # [ 0.460196] ACPI: PCI: Interrupt link LNKD configured for IRQ 111341worker2 # [ 0.448008] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1342client # [ 0.461207] ACPI: PCI: Interrupt link LNKE configured for IRQ 101343lb # [ 0.449968] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1344worker1 # [ 0.454646] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1345lb # [ 0.450797] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1346client # [ 0.462204] ACPI: PCI: Interrupt link LNKF configured for IRQ 101347worker2 # [ 0.449806] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1348client # [ 0.463200] ACPI: PCI: Interrupt link LNKG configured for IRQ 111349lb # [ 0.451975] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1350worker2 # [ 0.450717] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1351client # [ 0.464197] ACPI: PCI: Interrupt link LNKH configured for IRQ 111352client # [ 0.465137] ACPI: PCI: Interrupt link GSIA configured for IRQ 161353lb # [ 0.453628] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1354worker2 # [ 0.451806] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1355client # [ 0.466100] ACPI: PCI: Interrupt link GSIB configured for IRQ 171356worker1 # [ 0.458515] ACPI: PCI: Interrupt link LNKA configured for IRQ 101357worker2 # [ 0.453351] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1358client # [ 0.467065] ACPI: PCI: Interrupt link GSIC configured for IRQ 181359worker1 # [ 0.459093] ACPI: PCI: Interrupt link LNKB configured for IRQ 101360client # [ 0.467999] ACPI: PCI: Interrupt link GSID configured for IRQ 191361worker1 # [ 0.460078] ACPI: PCI: Interrupt link LNKC configured for IRQ 111362client # [ 0.468865] ACPI: PCI: Interrupt link GSIE configured for IRQ 201363worker1 # [ 0.461073] ACPI: PCI: Interrupt link LNKD configured for IRQ 111364lb # [ 0.456925] ACPI: PCI: Interrupt link LNKA configured for IRQ 101365client # [ 0.469112] ACPI: PCI: Interrupt link GSIF configured for IRQ 211366worker1 # [ 0.462070] ACPI: PCI: Interrupt link LNKE configured for IRQ 101367lb # [ 0.458032] ACPI: PCI: Interrupt link LNKB configured for IRQ 101368worker2 # [ 0.456788] ACPI: PCI: Interrupt link LNKA configured for IRQ 101369client # [ 0.470082] ACPI: PCI: Interrupt link GSIG configured for IRQ 221370worker1 # [ 0.463070] ACPI: PCI: Interrupt link LNKF configured for IRQ 101371lb # [ 0.459029] ACPI: PCI: Interrupt link LNKC configured for IRQ 111372client # [ 0.470938] ACPI: PCI: Interrupt link GSIH configured for IRQ 231373worker2 # [ 0.457863] ACPI: PCI: Interrupt link LNKB configured for IRQ 101374worker1 # [ 0.464074] ACPI: PCI: Interrupt link LNKG configured for IRQ 111375lb # [ 0.460026] ACPI: PCI: Interrupt link LNKD configured for IRQ 111376worker2 # [ 0.458846] ACPI: PCI: Interrupt link LNKC configured for IRQ 111377worker1 # [ 0.465070] ACPI: PCI: Interrupt link LNKH configured for IRQ 111378lb # [ 0.461029] ACPI: PCI: Interrupt link LNKE configured for IRQ 101379client # [ 0.472816] iommu: Default domain type: Translated1380worker2 # [ 0.459841] ACPI: PCI: Interrupt link LNKD configured for IRQ 111381lb # [ 0.462029] ACPI: PCI: Interrupt link LNKF configured for IRQ 101382worker1 # [ 0.466011] ACPI: PCI: Interrupt link GSIA configured for IRQ 161383client # [ 0.473108] iommu: DMA domain TLB invalidation policy: lazy mode1384worker2 # [ 0.460839] ACPI: PCI: Interrupt link LNKE configured for IRQ 101385lb # [ 0.463028] ACPI: PCI: Interrupt link LNKG configured for IRQ 111386worker1 # [ 0.466992] ACPI: PCI: Interrupt link GSIB configured for IRQ 171387client # [ 0.474295] ACPI: bus type USB registered1388worker2 # [ 0.461843] ACPI: PCI: Interrupt link LNKF configured for IRQ 101389worker1 # [ 0.467986] ACPI: PCI: Interrupt link GSIC configured for IRQ 181390client # [ 0.475007] usbcore: registered new interface driver usbfs1391lb # [ 0.464043] ACPI: PCI: Interrupt link LNKH configured for IRQ 111392worker2 # [ 0.462841] ACPI: PCI: Interrupt link LNKG configured for IRQ 111393client # [ 0.475731] usbcore: registered new interface driver hub1394worker1 # [ 0.468907] ACPI: PCI: Interrupt link GSID configured for IRQ 191395lb # [ 0.464966] ACPI: PCI: Interrupt link GSIA configured for IRQ 161396client # [ 0.476108] usbcore: registered new device driver usb1397worker2 # [ 0.463841] ACPI: PCI: Interrupt link LNKH configured for IRQ 111398worker1 # [ 0.469672] ACPI: PCI: Interrupt link GSIE configured for IRQ 201399lb # [ 0.465888] ACPI: PCI: Interrupt link GSIB configured for IRQ 171400worker2 # [ 0.464781] ACPI: PCI: Interrupt link GSIA configured for IRQ 161401worker1 # [ 0.469986] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402client # [ 0.477753] NetLabel: Initializing1403lb # [ 0.466629] ACPI: PCI: Interrupt link GSIC configured for IRQ 181404worker2 # [ 0.465732] ACPI: PCI: Interrupt link GSIB configured for IRQ 171405client # [ 0.478100] NetLabel: domain hash size = 1281406worker1 # [ 0.470965] ACPI: PCI: Interrupt link GSIG configured for IRQ 221407lb # [ 0.466943] ACPI: PCI: Interrupt link GSID configured for IRQ 191408worker2 # [ 0.466452] ACPI: PCI: Interrupt link GSIC configured for IRQ 181409client # [ 0.478788] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1410worker1 # [ 0.471674] ACPI: PCI: Interrupt link GSIH configured for IRQ 231411lb # [ 0.467916] ACPI: PCI: Interrupt link GSIE configured for IRQ 201412client # [ 0.479137] NetLabel: unlabeled traffic allowed by default1413worker2 # [ 0.466758] ACPI: PCI: Interrupt link GSID configured for IRQ 191414lb # [ 0.468646] ACPI: PCI: Interrupt link GSIF configured for IRQ 211415client # [ 0.480041] PCI: Using ACPI for IRQ routing1416worker1 # [ 0.473042] iommu: Default domain type: Translated1417worker2 # [ 0.467757] ACPI: PCI: Interrupt link GSIE configured for IRQ 201418lb # [ 0.468958] ACPI: PCI: Interrupt link GSIG configured for IRQ 221419worker1 # [ 0.473850] iommu: DMA domain TLB invalidation policy: lazy mode1420worker2 # [ 0.468723] ACPI: PCI: Interrupt link GSIF configured for IRQ 211421lb # [ 0.469903] ACPI: PCI: Interrupt link GSIH configured for IRQ 231422worker1 # [ 0.474997] ACPI: bus type USB registered1423worker2 # [ 0.469458] ACPI: PCI: Interrupt link GSIG configured for IRQ 221424worker1 # [ 0.475777] usbcore: registered new interface driver usbfs1425worker2 # [ 0.469756] ACPI: PCI: Interrupt link GSIH configured for IRQ 231426lb # [ 0.471677] iommu: Default domain type: Translated1427worker1 # [ 0.476692] usbcore: registered new interface driver hub1428lb # [ 0.471942] iommu: DMA domain TLB invalidation policy: lazy mode1429worker1 # [ 0.476983] usbcore: registered new device driver usb1430worker2 # [ 0.471809] iommu: Default domain type: Translated1431lb # [ 0.473165] ACPI: bus type USB registered1432worker2 # [ 0.472600] iommu: DMA domain TLB invalidation policy: lazy mode1433lb # [ 0.473919] usbcore: registered new interface driver usbfs1434worker1 # [ 0.478699] NetLabel: Initializing1435lb # [ 0.474610] usbcore: registered new interface driver hub1436worker2 # [ 0.473807] ACPI: bus type USB registered1437worker1 # [ 0.478981] NetLabel: domain hash size = 1281438lb # [ 0.474949] usbcore: registered new device driver usb1439worker1 # [ 0.479703] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1440worker2 # [ 0.474575] usbcore: registered new interface driver usbfs1441worker2 # [ 0.475427] usbcore: registered new interface driver hub1442worker1 # [ 0.480012] NetLabel: unlabeled traffic allowed by default1443lb # [ 0.476588] NetLabel: Initializing1444worker1 # [ 0.480966] PCI: Using ACPI for IRQ routing1445worker2 # [ 0.475753] usbcore: registered new device driver usb1446lb # [ 0.476936] NetLabel: domain hash size = 1281447lb # [ 0.477665] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1448worker2 # [ 0.477454] NetLabel: Initializing1449lb # [ 0.477968] NetLabel: unlabeled traffic allowed by default1450worker2 # [ 0.477750] NetLabel: domain hash size = 1281451lb # [ 0.478929] PCI: Using ACPI for IRQ routing1452worker2 # [ 0.478509] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1453worker2 # [ 0.478782] NetLabel: unlabeled traffic allowed by default1454worker2 # [ 0.479755] PCI: Using ACPI for IRQ routing1455client # [ 0.523962] pci 0000:00:01.0: vgaarb: setting as boot VGA device1456client # [ 0.524095] pci 0000:00:01.0: vgaarb: bridge control possible1457client # [ 0.524095] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1458client # [ 0.524105] vgaarb: loaded1459client # [ 0.524864] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01460client # [ 0.525100] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1461worker1 # [ 0.524918] pci 0000:00:01.0: vgaarb: setting as boot VGA device1462worker1 # [ 0.524971] pci 0000:00:01.0: vgaarb: bridge control possible1463worker1 # [ 0.524971] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1464lb # [ 0.522493] pci 0000:00:01.0: vgaarb: setting as boot VGA device1465client # [ 0.532187] clocksource: Switched to clocksource kvm-clock1466worker1 # [ 0.524980] vgaarb: loaded1467lb # [ 0.522926] pci 0000:00:01.0: vgaarb: bridge control possible1468worker1 # [ 0.525741] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01469client # [ 0.533818] VFS: Disk quotas dquot_6.6.01470lb # [ 0.522926] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1471worker1 # [ 0.525975] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1472lb # [ 0.522934] vgaarb: loaded1473worker2 # [ 0.524232] pci 0000:00:01.0: vgaarb: setting as boot VGA device1474lb # [ 0.523655] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01475worker2 # [ 0.524740] pci 0000:00:01.0: vgaarb: bridge control possible1476client # [ 0.536259] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1477lb # [ 0.523932] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1478worker2 # [ 0.524740] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1479client # [ 0.537573] pnp: PnP ACPI init1480worker2 # [ 0.524749] vgaarb: loaded1481worker1 # [ 0.529061] clocksource: Switched to clocksource kvm-clock1482client # [ 0.538414] ACPI: IRQ 4 override to edge(!), high(!)1483worker2 # [ 0.525489] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01484worker2 # [ 0.525745] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1485client # [ 0.539372] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1486client # [ 0.540913] pnp: PnP ACPI: found 5 devices1487lb # [ 0.528010] clocksource: Switched to clocksource kvm-clock1488worker1 # [ 0.532629] VFS: Disk quotas dquot_6.6.01489worker1 # [ 0.533357] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1490lb # [ 0.529701] VFS: Disk quotas dquot_6.6.01491worker1 # [ 0.534749] pnp: PnP ACPI init1492worker1 # [ 0.535569] ACPI: IRQ 4 override to edge(!), high(!)1493worker2 # [ 0.530828] clocksource: Switched to clocksource kvm-clock1494lb # [ 0.532292] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1495worker1 # [ 0.536578] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1496lb # [ 0.533606] pnp: PnP ACPI init1497worker1 # [ 0.538128] pnp: PnP ACPI: found 5 devices1498lb # [ 0.534418] ACPI: IRQ 4 override to edge(!), high(!)1499worker2 # [ 0.534301] VFS: Disk quotas dquot_6.6.01500client # [ 0.548519] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1501lb # [ 0.535386] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1502client # [ 0.549946] clocksource: Switched to clocksource acpi_pm1503worker2 # [ 0.535015] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1504lb # [ 0.536862] pnp: PnP ACPI: found 5 devices1505client # [ 0.550914] NET: Registered PF_INET protocol family1506worker2 # [ 0.536398] pnp: PnP ACPI init1507worker2 # [ 0.537219] ACPI: IRQ 4 override to edge(!), high(!)1508client # [ 0.552124] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1509worker2 # [ 0.538236] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1510worker2 # [ 0.539845] pnp: PnP ACPI: found 5 devices1511worker1 # [ 0.546049] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1512worker1 # [ 0.547525] clocksource: Switched to clocksource acpi_pm1513worker1 # [ 0.548575] NET: Registered PF_INET protocol family1514lb # [ 0.544426] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1515lb # [ 0.545866] clocksource: Switched to clocksource acpi_pm1516worker1 # [ 0.549794] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1517lb # [ 0.546793] NET: Registered PF_INET protocol family1518lb # [ 0.548021] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1519worker2 # [ 0.547457] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1520worker2 # [ 0.548905] clocksource: Switched to clocksource acpi_pm1521worker2 # [ 0.549938] NET: Registered PF_INET protocol family1522worker2 # [ 0.551177] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1523client # [ 0.568758] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1524client # [ 0.570360] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1525client # [ 0.571700] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1526client # [ 0.573090] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1527client # [ 0.574357] TCP: Hash tables configured (established 16384 bind 16384)1528client # [ 0.575508] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1529worker1 # [ 0.566338] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1530client # [ 0.576774] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1531worker1 # [ 0.567889] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1532client # [ 0.577870] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1533lb # [ 0.564605] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1534worker1 # [ 0.569194] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1535client # [ 0.579092] NET: Registered PF_UNIX/PF_LOCAL protocol family1536client # [ 0.580013] NET: Registered PF_XDP protocol family1537lb # [ 0.566124] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1538worker1 # [ 0.570523] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1539client # [ 0.580832] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1540worker1 # [ 0.571777] TCP: Hash tables configured (established 16384 bind 16384)1541lb # [ 0.567416] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1542client # [ 0.581821] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1543worker1 # [ 0.572886] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1544lb # [ 0.568722] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1545worker2 # [ 0.567678] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1546client # [ 0.582834] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1547lb # [ 0.569917] TCP: Hash tables configured (established 16384 bind 16384)1548worker1 # [ 0.574139] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1549client # [ 0.583873] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1550worker2 # [ 0.569181] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1551worker1 # [ 0.575160] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1552lb # [ 0.570970] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1553client # [ 0.584932] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1554worker2 # [ 0.570512] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1555worker1 # [ 0.576322] NET: Registered PF_UNIX/PF_LOCAL protocol family1556lb # [ 0.572146] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1557client # [ 0.585986] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1558worker1 # [ 0.577218] NET: Registered PF_XDP protocol family1559worker2 # [ 0.571801] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1560lb # [ 0.573177] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1561client # [ 0.587631] ACPI: \_SB_.GSIA: Enabled at IRQ 161562worker1 # [ 0.578048] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1563lb # [ 0.574335] NET: Registered PF_UNIX/PF_LOCAL protocol family1564worker2 # [ 0.573012] TCP: Hash tables configured (established 16384 bind 16384)1565worker1 # [ 0.579033] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1566lb # [ 0.575261] NET: Registered PF_XDP protocol family1567worker2 # [ 0.574099] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1568worker1 # [ 0.580037] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1569client # [ 0.589773] ACPI: \_SB_.GSIB: Enabled at IRQ 171570lb # [ 0.576070] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1571worker2 # [ 0.575384] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1572worker1 # [ 0.581112] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1573lb # [ 0.577012] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1574worker2 # [ 0.576459] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1575worker1 # [ 0.582211] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1576lb # [ 0.578033] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1577client # [ 0.592025] ACPI: \_SB_.GSIC: Enabled at IRQ 181578worker2 # [ 0.577656] NET: Registered PF_UNIX/PF_LOCAL protocol family1579worker1 # [ 0.583242] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1580lb # [ 0.579054] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1581worker2 # [ 0.578602] NET: Registered PF_XDP protocol family1582lb # [ 0.580110] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1583client # [ 0.593996] ACPI: \_SB_.GSID: Enabled at IRQ 191584worker1 # [ 0.584891] ACPI: \_SB_.GSIA: Enabled at IRQ 161585worker2 # [ 0.579436] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1586lb # [ 0.581156] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1587worker2 # [ 0.580431] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1588client # [ 0.595694] PCI: CLS 0 bytes, default 641589lb # [ 0.582877] ACPI: \_SB_.GSIA: Enabled at IRQ 161590worker2 # [ 0.581444] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1591worker1 # [ 0.587097] ACPI: \_SB_.GSIB: Enabled at IRQ 171592client # [ 0.596596] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1593worker2 # [ 0.582534] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1594client # [ 0.598289] Trying to unpack rootfs image as initramfs...1595lb # [ 0.585047] ACPI: \_SB_.GSIB: Enabled at IRQ 171596worker2 # [ 0.583613] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1597worker1 # [ 0.589448] ACPI: \_SB_.GSIC: Enabled at IRQ 181598worker2 # [ 0.584661] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1599worker1 # [ 0.591442] ACPI: \_SB_.GSID: Enabled at IRQ 191600lb # [ 0.587297] ACPI: \_SB_.GSIC: Enabled at IRQ 181601worker2 # [ 0.586460] ACPI: \_SB_.GSIA: Enabled at IRQ 161602worker1 # [ 0.593109] PCI: CLS 0 bytes, default 641603lb # [ 0.589297] ACPI: \_SB_.GSID: Enabled at IRQ 191604worker2 # [ 0.588804] ACPI: \_SB_.GSIB: Enabled at IRQ 171605worker1 # [ 0.594029] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1606lb # [ 0.591037] PCI: CLS 0 bytes, default 641607worker1 # [ 0.595801] Trying to unpack rootfs image as initramfs...1608worker2 # [ 0.591079] ACPI: \_SB_.GSIC: Enabled at IRQ 181609lb # [ 0.591992] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1610lb # [ 0.593737] Trying to unpack rootfs image as initramfs...1611worker2 # [ 0.593010] ACPI: \_SB_.GSID: Enabled at IRQ 191612worker2 # [ 0.594782] PCI: CLS 0 bytes, default 641613worker2 # [ 0.595707] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1614worker2 # [ 0.597487] Trying to unpack rootfs image as initramfs...1615client # [ 0.644087] Initialise system trusted keyrings1616client # [ 0.645090] workingset: timestamp_bits=40 max_order=19 bucket_order=01617worker1 # [ 0.639641] Initialise system trusted keyrings1618lb # [ 0.638233] Initialise system trusted keyrings1619worker1 # [ 0.642657] workingset: timestamp_bits=40 max_order=19 bucket_order=01620lb # [ 0.639202] workingset: timestamp_bits=40 max_order=19 bucket_order=01621worker2 # [ 0.642218] Initialise system trusted keyrings1622worker2 # [ 0.644431] workingset: timestamp_bits=40 max_order=19 bucket_order=01623client # [ 0.668121] Key type asymmetric registered1624client # [ 0.668864] Asymmetric key parser 'x509' registered1625client # [ 0.669762] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1626worker1 # [ 0.664252] Key type asymmetric registered1627client # [ 0.675173] io scheduler mq-deadline registered1628client # [ 0.675951] io scheduler kyber registered1629worker1 # [ 0.666622] Asymmetric key parser 'x509' registered1630lb # [ 0.662958] Key type asymmetric registered1631lb # [ 0.663685] Asymmetric key parser 'x509' registered1632worker1 # [ 0.667460] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1633lb # [ 0.664534] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1634client # [ 0.678613] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1635worker1 # [ 0.670718] io scheduler mq-deadline registered1636client # [ 0.679847] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1637worker1 # [ 0.671479] io scheduler kyber registered1638worker2 # [ 0.666654] Key type asymmetric registered1639lb # [ 0.667985] io scheduler mq-deadline registered1640lb # [ 0.668730] io scheduler kyber registered1641worker1 # [ 0.674214] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1642worker2 # [ 0.669382] Asymmetric key parser 'x509' registered1643client # [ 0.685213] Linux agpgart interface v0.1031644worker1 # [ 0.675522] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1645worker2 # [ 0.670274] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1646client # [ 0.685949] ACPI: bus type drm_connector registered1647lb # [ 0.672441] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1648lb # [ 0.673736] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1649worker2 # [ 0.673523] io scheduler mq-deadline registered1650worker2 # [ 0.674300] io scheduler kyber registered1651client # [ 0.689205] usbcore: registered new interface driver usbserial_generic1652client # [ 0.690283] usbserial: USB Serial support registered for generic1653worker1 # [ 0.681214] Linux agpgart interface v0.1031654lb # [ 0.677608] Linux agpgart interface v0.1031655worker1 # [ 0.681990] ACPI: bus type drm_connector registered1656lb # [ 0.678395] ACPI: bus type drm_connector registered1657worker2 # [ 0.677968] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1658client # [ 0.693084] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1659worker2 # [ 0.679307] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1660client # [ 0.693084] Please enable it if your BIOS has the CPPC option.1661worker1 # [ 0.685094] usbcore: registered new interface driver usbserial_generic1662lb # [ 0.681280] usbcore: registered new interface driver usbserial_generic1663worker1 # [ 0.686165] usbserial: USB Serial support registered for generic1664client # [ 0.695358] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1665lb # [ 0.682343] usbserial: USB Serial support registered for generic1666worker2 # [ 0.683176] Linux agpgart interface v0.1031667client # [ 0.698200] drop_monitor: Initializing network drop monitor service1668worker1 # [ 0.688626] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1669worker2 # [ 0.683941] ACPI: bus type drm_connector registered1670lb # [ 0.684855] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1671worker1 # [ 0.688626] Please enable it if your BIOS has the CPPC option.1672client # [ 0.699335] NET: Registered PF_INET6 protocol family1673lb # [ 0.684855] Please enable it if your BIOS has the CPPC option.1674worker1 # [ 0.690816] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1675lb # [ 0.686951] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1676worker2 # [ 0.688499] usbcore: registered new interface driver usbserial_generic1677client # [ 0.704371] Segment Routing with IPv61678worker1 # [ 0.694738] drop_monitor: Initializing network drop monitor service1679worker2 # [ 0.689605] usbserial: USB Serial support registered for generic1680client # [ 0.705069] In-situ OAM (IOAM) with IPv61681worker1 # [ 0.695896] NET: Registered PF_INET6 protocol family1682lb # [ 0.691981] drop_monitor: Initializing network drop monitor service1683lb # [ 0.693105] NET: Registered PF_INET6 protocol family1684client # [ 0.707350] IPI shorthand broadcast: enabled1685worker2 # [ 0.692388] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1686worker1 # [ 0.699082] Segment Routing with IPv61687worker2 # [ 0.692388] Please enable it if your BIOS has the CPPC option.1688lb # [ 0.696285] Segment Routing with IPv61689worker2 # [ 0.694660] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1690worker1 # [ 0.701646] In-situ OAM (IOAM) with IPv61691worker1 # [ 0.702768] IPI shorthand broadcast: enabled1692lb # [ 0.698865] In-situ OAM (IOAM) with IPv61693worker2 # [ 0.697579] drop_monitor: Initializing network drop monitor service1694lb # [ 0.699927] IPI shorthand broadcast: enabled1695worker2 # [ 0.698721] NET: Registered PF_INET6 protocol family1696client # [ 0.715539] sched_clock: Marking stable (581015462, 134042979)->(785350403, -70291962)1697worker2 # [ 0.703678] Segment Routing with IPv61698worker2 # [ 0.704394] In-situ OAM (IOAM) with IPv61699client # [ 0.719165] registered taskstats version 11700client # [ 0.720150] Loading compiled-in X.509 certificates1701worker1 # [ 0.711154] sched_clock: Marking stable (576016011, 134584557)->(786036469, -75435901)1702worker2 # [ 0.706662] IPI shorthand broadcast: enabled1703lb # [ 0.708108] sched_clock: Marking stable (575013908, 132820176)->(780346398, -72512314)1704lb # [ 0.712064] registered taskstats version 11705worker1 # [ 0.716810] registered taskstats version 11706lb # [ 0.713024] Loading compiled-in X.509 certificates1707worker1 # [ 0.717828] Loading compiled-in X.509 certificates1708worker2 # [ 0.714875] sched_clock: Marking stable (581015187, 133349288)->(784098629, -69734154)1709worker2 # [ 0.720523] registered taskstats version 11710worker2 # [ 0.721524] Loading compiled-in X.509 certificates1711client # [ 0.738076] Demotion targets for Node 0: null1712client # [ 0.741103] Key type .fscrypt registered1713client # [ 0.741816] Key type fscrypt-provisioning registered1714client # [ 0.742799] ima: No TPM chip found, activating TPM-bypass!1715client # [ 0.745074] ima: Allocated hash algorithm: sha11716lb # [ 0.731849] Demotion targets for Node 0: null1717client # [ 0.745895] ima: No architecture policies found1718worker1 # [ 0.736608] Demotion targets for Node 0: null1719lb # [ 0.732723] Key type .fscrypt registered1720worker1 # [ 0.737504] Key type .fscrypt registered1721worker1 # [ 0.739610] Key type fscrypt-provisioning registered1722lb # [ 0.735841] Key type fscrypt-provisioning registered1723client # [ 0.750077] PM: Magic number: 10:829:4011724worker1 # [ 0.740576] ima: No TPM chip found, activating TPM-bypass!1725lb # [ 0.736768] ima: No TPM chip found, activating TPM-bypass!1726worker1 # [ 0.741497] ima: Allocated hash algorithm: sha11727lb # [ 0.737659] ima: Allocated hash algorithm: sha11728client # [ 0.751699] RAS: Correctable Errors collector initialized.1729lb # [ 0.738487] ima: No architecture policies found1730worker2 # [ 0.738028] Demotion targets for Node 0: null1731worker1 # [ 0.743676] ima: No architecture policies found1732lb # [ 0.740847] PM: Magic number: 10:829:4011733worker1 # [ 0.746621] PM: Magic number: 10:829:4011734worker2 # [ 0.741408] Key type .fscrypt registered1735lb # [ 0.742539] RAS: Correctable Errors collector initialized.1736worker2 # [ 0.742090] Key type fscrypt-provisioning registered1737worker1 # [ 0.748240] RAS: Correctable Errors collector initialized.1738worker2 # [ 0.743089] ima: No TPM chip found, activating TPM-bypass!1739client # [ 0.759762] clk: Disabling unused clocks1740worker2 # [ 0.745376] ima: Allocated hash algorithm: sha11741worker2 # [ 0.746201] ima: No architecture policies found1742client # [ 0.764077] PM: genpd: Disabling unused power domains1743lb # [ 0.751565] clk: Disabling unused clocks1744worker2 # [ 0.750388] PM: Magic number: 10:829:4011745worker1 # [ 0.757273] clk: Disabling unused clocks1746worker2 # [ 0.752018] RAS: Correctable Errors collector initialized.1747lb # [ 0.754872] PM: genpd: Disabling unused power domains1748worker1 # [ 0.759634] PM: genpd: Disabling unused power domains1749worker2 # [ 0.760069] clk: Disabling unused clocks1750worker2 # [ 0.764378] PM: genpd: Disabling unused power domains1751client # [ 0.918620] Freeing initrd memory: 29056K1752client # [ 0.921806] Freeing unused decrypted memory: 2028K1753client # [ 0.924507] Freeing unused kernel image (initmem) memory: 3652K1754client # [ 0.925613] Write protecting the kernel read-only data: 32768k1755client # [ 0.927508] Freeing unused kernel image (text/rodata gap) memory: 1184K1756client # [ 0.928993] Freeing unused kernel image (rodata/data gap) memory: 720K1757lb # [ 0.917936] Freeing initrd memory: 29064K1758worker1 # [ 0.924944] Freeing initrd memory: 29056K1759worker2 # [ 0.919530] Freeing initrd memory: 29060K1760lb # [ 0.921129] Freeing unused decrypted memory: 2028K1761lb # [ 0.923740] Freeing unused kernel image (initmem) memory: 3652K1762worker1 # [ 0.928153] Freeing unused decrypted memory: 2028K1763worker2 # [ 0.922707] Freeing unused decrypted memory: 2028K1764lb # [ 0.924793] Write protecting the kernel read-only data: 32768k1765worker2 # [ 0.925275] Freeing unused kernel image (initmem) memory: 3652K1766worker1 # [ 0.930753] Freeing unused kernel image (initmem) memory: 3652K1767lb # [ 0.926689] Freeing unused kernel image (text/rodata gap) memory: 1184K1768worker2 # [ 0.926408] Write protecting the kernel read-only data: 32768k1769worker1 # [ 0.931838] Write protecting the kernel read-only data: 32768k1770lb # [ 0.928161] Freeing unused kernel image (rodata/data gap) memory: 720K1771worker1 # [ 0.933679] Freeing unused kernel image (text/rodata gap) memory: 1184K1772worker2 # [ 0.928267] Freeing unused kernel image (text/rodata gap) memory: 1184K1773worker1 # [ 0.935171] Freeing unused kernel image (rodata/data gap) memory: 720K1774worker2 # [ 0.929792] Freeing unused kernel image (rodata/data gap) memory: 720K1775client # [ 0.979731] x86/mm: Checked W+X mappings: passed, no W+X pages found.1776client # [ 0.980828] Run /init as init process1777client # [ 0.991341] systemd[1]: Inserted module 'autofs4'1778lb # [ 0.978922] x86/mm: Checked W+X mappings: passed, no W+X pages found.1779lb # [ 0.979962] Run /init as init process1780worker1 # [ 0.986054] x86/mm: Checked W+X mappings: passed, no W+X pages found.1781worker2 # [ 0.980697] x86/mm: Checked W+X mappings: passed, no W+X pages found.1782worker1 # [ 0.987110] Run /init as init process1783worker2 # [ 0.981754] Run /init as init process1784lb # [ 0.990981] systemd[1]: Inserted module 'autofs4'1785worker1 # [ 0.997838] systemd[1]: Inserted module 'autofs4'1786worker2 # [ 0.992537] systemd[1]: Inserted module 'autofs4'1787client # [ 1.010961] fuse: init (API version 7.45)1788client # [ 1.018379] ACPI: \_SB_.GSIG: Enabled at IRQ 221789client # [ 1.020755] ACPI: \_SB_.GSIH: Enabled at IRQ 231790client # [ 1.023549] ACPI: \_SB_.GSIE: Enabled at IRQ 201791lb # [ 1.010683] fuse: init (API version 7.45)1792client # [ 1.025682] ACPI: \_SB_.GSIF: Enabled at IRQ 211793worker2 # [ 1.012398] fuse: init (API version 7.45)1794worker1 # [ 1.017906] fuse: init (API version 7.45)1795client # [ 1.031026] virtiofs virtio5: discovered new tag: nix-store1796lb # [ 1.018103] ACPI: \_SB_.GSIG: Enabled at IRQ 221797client # [ 1.032610] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1798lb # [ 1.020443] ACPI: \_SB_.GSIH: Enabled at IRQ 231799worker2 # [ 1.019821] ACPI: \_SB_.GSIG: Enabled at IRQ 221800worker1 # [ 1.025308] ACPI: \_SB_.GSIG: Enabled at IRQ 221801lb # [ 1.023249] ACPI: \_SB_.GSIE: Enabled at IRQ 201802worker2 # [ 1.022198] ACPI: \_SB_.GSIH: Enabled at IRQ 231803worker1 # [ 1.027680] ACPI: \_SB_.GSIH: Enabled at IRQ 231804lb # [ 1.025172] ACPI: \_SB_.GSIF: Enabled at IRQ 211805client # [ 1.039096] virtiofs virtio6: discovered new tag: shared1806worker2 # [ 1.025107] ACPI: \_SB_.GSIE: Enabled at IRQ 201807worker1 # [ 1.030632] ACPI: \_SB_.GSIE: Enabled at IRQ 201808client # [ 1.040569] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1809worker1 # [ 1.032521] ACPI: \_SB_.GSIF: Enabled at IRQ 211810worker2 # [ 1.027412] ACPI: \_SB_.GSIF: Enabled at IRQ 211811client # [ 1.043607] virtiofs virtio7: discovered new tag: xchg1812lb # [ 1.029910] virtiofs virtio5: discovered new tag: nix-store1813client # [ 1.045079] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1814lb # [ 1.031761] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1815worker1 # [ 1.037764] virtiofs virtio5: discovered new tag: nix-store1816worker2 # [ 1.032501] virtiofs virtio5: discovered new tag: nix-store1817worker1 # [ 1.039287] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1818worker2 # [ 1.034032] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1819lb # [ 1.037966] virtiofs virtio6: discovered new tag: shared1820lb # [ 1.039413] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1821worker2 # [ 1.040620] virtiofs virtio6: discovered new tag: shared1822lb # [ 1.042566] virtiofs virtio7: discovered new tag: xchg1823worker2 # [ 1.042234] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1824worker1 # [ 1.047138] virtiofs virtio6: discovered new tag: shared1825lb # [ 1.043986] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1826worker1 # [ 1.049922] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1827worker2 # [ 1.046901] virtiofs virtio7: discovered new tag: xchg1828worker1 # [ 1.053733] virtiofs virtio7: discovered new tag: xchg1829worker2 # [ 1.048570] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1830worker1 # [ 1.055263] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1831client # [ 1.064826] systemd[1]: Successfully made /usr/ read-only.1832lb # [ 1.063626] systemd[1]: Successfully made /usr/ read-only.1833worker2 # [ 1.071468] systemd[1]: Successfully made /usr/ read-only.1834worker1 # [ 1.079701] systemd[1]: Successfully made /usr/ read-only.1835client # [ 1.401427] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1836client # [ 1.413410] systemd[1]: Detected virtualization kvm.1837client # [ 1.415508] systemd[1]: Detected architecture x86-64.1838client # [ 1.417593] systemd[1]: Running in initrd.1839client # [ 1.420039] systemd[1]: Initializing machine ID from random generator.1840client # [ 1.422907] systemd[1]: Hostname set to <client>.1841lb # [ 1.399866] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1842lb # [ 1.411717] systemd[1]: Detected virtualization kvm.1843lb # [ 1.413894] systemd[1]: Detected architecture x86-64.1844lb # [ 1.415974] systemd[1]: Running in initrd.1845lb # [ 1.418434] systemd[1]: Initializing machine ID from random generator.1846worker2 # [ 1.408075] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1847lb # [ 1.421268] systemd[1]: Hostname set to <lb>.1848worker2 # [ 1.420076] systemd[1]: Detected virtualization kvm.1849worker1 # [ 1.416345] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1850worker2 # [ 1.422238] systemd[1]: Detected architecture x86-64.1851worker1 # [ 1.428364] systemd[1]: Detected virtualization kvm.1852worker2 # [ 1.424398] systemd[1]: Running in initrd.1853worker1 # [ 1.430515] systemd[1]: Detected architecture x86-64.1854worker1 # [ 1.432684] systemd[1]: Running in initrd.1855worker2 # [ 1.426944] systemd[1]: Initializing machine ID from random generator.1856worker2 # [ 1.429921] systemd[1]: Hostname set to <worker2>.1857worker1 # [ 1.435254] systemd[1]: Initializing machine ID from random generator.1858worker1 # [ 1.438149] systemd[1]: Hostname set to <worker1>.1859worker2 # [ 1.534526] systemd[1]: bpf-restrict-fs: LSM BPF program attached1860worker2 # [ 1.573628] systemd[1]: Queued start job for default target Initrd Default Target.1861worker2 # [ 1.577687] systemd[1]: Created slice Slice /system/modprobe.1862worker2 # [ 1.578886] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1863worker2 # [ 1.580330] systemd[1]: Expecting device /dev/disk/by-label/nixos...1864worker2 # [ 1.581548] systemd[1]: Reached target Path Units.1865worker2 # [ 1.582480] systemd[1]: Reached target Slice Units.1866worker2 # [ 1.583400] systemd[1]: Reached target Swaps.1867worker2 # [ 1.584226] systemd[1]: Reached target Timer Units.1868worker2 # [ 1.585254] systemd[1]: Listening on D-Bus System Message Bus Socket.1869worker2 # [ 1.586546] systemd[1]: Listening on Journal Socket (/dev/log).1870worker2 # [ 1.587721] systemd[1]: Listening on Journal Sockets.1871worker2 # [ 1.588719] systemd[1]: Listening on udev Control Socket.1872worker2 # [ 1.589736] systemd[1]: Listening on udev Kernel Socket.1873worker2 # [ 1.590686] systemd[1]: Reached target Socket Units.1874worker2 # [ 1.592604] systemd[1]: Starting Create List of Static Device Nodes...1875worker2 # [ 1.596438] systemd[1]: Starting Load Kernel Module configfs...1876worker2 # [ 1.605551] systemd[1]: Starting Journal Service...1877client # [ 1.643257] systemd[1]: bpf-restrict-fs: LSM BPF program attached1878worker2 # [ 1.631034] systemd[1]: Starting Load Kernel Modules...1879worker2 # [ 1.635500] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1880lb # [ 1.642236] systemd[1]: bpf-restrict-fs: LSM BPF program attached1881worker2 # [ 1.645431] systemd[1]: Starting Coldplug All udev Devices...1882worker1 # [ 1.659282] systemd[1]: bpf-restrict-fs: LSM BPF program attached1883worker2 # [ 1.656560] systemd-journald[66]: Collecting audit messages is disabled.1884worker2 # [ 1.659853] systemd[1]: Finished Create List of Static Device Nodes.1885worker2 # [ 1.665023] systemd[1]: modprobe@configfs.service: Deactivated successfully.1886worker2 # [ 1.673972] systemd[1]: Finished Load Kernel Module configfs.1887worker2 # [ 1.679847] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1888client # [ 1.695604] systemd[1]: Queued start job for default target Initrd Default Target.1889client # [ 1.699347] systemd[1]: Created slice Slice /system/modprobe.1890client # [ 1.700525] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1891client # [ 1.701988] systemd[1]: Expecting device /dev/disk/by-label/nixos...1892client # [ 1.703153] systemd[1]: Reached target Path Units.1893client # [ 1.704090] systemd[1]: Reached target Slice Units.1894client # [ 1.704973] systemd[1]: Reached target Swaps.1895client # [ 1.705783] systemd[1]: Reached target Timer Units.1896worker2 # [ 1.691456] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1897client # [ 1.706748] systemd[1]: Listening on D-Bus System Message Bus Socket.1898client # [ 1.707956] systemd[1]: Listening on Journal Socket (/dev/log).1899lb # [ 1.695069] systemd[1]: Queued start job for default target Initrd Default Target.1900client # [ 1.709155] systemd[1]: Listening on Journal Sockets.1901client # [ 1.710143] systemd[1]: Listening on udev Control Socket.1902worker2 # [ 1.694685] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1903client # [ 1.711182] systemd[1]: Listening on udev Kernel Socket.1904client # [ 1.712162] systemd[1]: Reached target Socket Units.1905lb # [ 1.699080] systemd[1]: Created slice Slice /system/modprobe.1906client # [ 1.713911] systemd[1]: Starting Create List of Static Device Nodes...1907lb # [ 1.700247] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1908lb # [ 1.701669] systemd[1]: Expecting device /dev/disk/by-label/nixos...1909lb # [ 1.702795] systemd[1]: Reached target Path Units.1910lb # [ 1.703706] systemd[1]: Reached target Slice Units.1911client # [ 1.717849] systemd[1]: Starting Load Kernel Module configfs...1912lb # [ 1.704610] systemd[1]: Reached target Swaps.1913lb # [ 1.705480] systemd[1]: Reached target Timer Units.1914lb # [ 1.706464] systemd[1]: Listening on D-Bus System Message Bus Socket.1915lb # [ 1.707695] systemd[1]: Listening on Journal Socket (/dev/log).1916lb # [ 1.708897] systemd[1]: Listening on Journal Sockets.1917worker1 # [ 1.712663] systemd[1]: Queued start job for default target Initrd Default Target.1918lb # [ 1.709887] systemd[1]: Listening on udev Control Socket.1919worker2 # [ 1.708558] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1920lb # [ 1.710916] systemd[1]: Listening on udev Kernel Socket.1921lb # [ 1.711895] systemd[1]: Reached target Socket Units.1922worker1 # [ 1.715985] systemd[1]: Created slice Slice /system/modprobe.1923worker1 # [ 1.717208] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1924lb # [ 1.713657] systemd[1]: Starting Create List of Static Device Nodes...1925worker1 # [ 1.718658] systemd[1]: Expecting device /dev/disk/by-label/nixos...1926worker1 # [ 1.719810] systemd[1]: Reached target Path Units.1927worker1 # [ 1.720764] systemd[1]: Reached target Slice Units.1928worker1 # [ 1.721690] systemd[1]: Reached target Swaps.1929lb # [ 1.717903] systemd[1]: Starting Load Kernel Module configfs...1930worker1 # [ 1.722508] systemd[1]: Reached target Timer Units.1931worker1 # [ 1.723502] systemd[1]: Listening on D-Bus System Message Bus Socket.1932worker1 # [ 1.724783] systemd[1]: Listening on Journal Socket (/dev/log).1933worker1 # [ 1.725995] systemd[1]: Listening on Journal Sockets.1934worker1 # [ 1.727052] systemd[1]: Listening on udev Control Socket.1935worker1 # [ 1.728129] systemd[1]: Listening on udev Kernel Socket.1936client # [ 1.726695] systemd[1]: Starting Journal Service...1937worker1 # [ 1.729136] systemd[1]: Reached target Socket Units.1938worker1 # [ 1.731066] systemd[1]: Starting Create List of Static Device Nodes...1939worker1 # [ 1.735665] systemd[1]: Starting Load Kernel Module configfs...1940worker2 # [ 1.732466] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1941client # [ 1.750678] systemd[1]: Starting Load Kernel Modules...1942lb # [ 1.727480] systemd[1]: Starting Journal Service...1943client # [ 1.755184] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1944worker2 # [ 1.742635] systemd[1]: Starting Create Static Device Nodes in /dev...1945client # [ 1.762123] systemd[1]: Starting Coldplug All udev Devices...1946lb # [ 1.751432] systemd[1]: Starting Load Kernel Modules...1947worker1 # [ 1.745296] systemd[1]: Starting Journal Service...1948worker2 # [ 1.754446] systemd[1]: Finished Load Kernel Modules.1949lb # [ 1.755958] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1950client # [ 1.775609] systemd[1]: Finished Create List of Static Device Nodes.1951client # [ 1.777296] systemd-journald[66]: Collecting audit messages is disabled.1952lb # [ 1.763909] systemd[1]: Starting Coldplug All udev Devices...1953worker1 # [ 1.768842] systemd[1]: Starting Load Kernel Modules...1954worker2 # [ 1.765089] systemd[1]: Starting Apply Kernel Variables...1955client # [ 1.780658] systemd[1]: modprobe@configfs.service: Deactivated successfully.1956worker1 # [ 1.775703] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1957lb # [ 1.775920] systemd-journald[66]: Collecting audit messages is disabled.1958client # [ 1.790426] systemd[1]: Finished Load Kernel Module configfs.1959lb # [ 1.777437] systemd[1]: Finished Create List of Static Device Nodes.1960worker1 # [ 1.784227] systemd[1]: Starting Coldplug All udev Devices...1961client # [ 1.794502] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1962worker2 # [ 1.645274] systemd-modules-load[67]: Inserted module 'dm_mod'[ 1.781112] systemd[1]: Started Journal Service.1963worker2 # 1964worker2 # [ 1.649317] systemd-modules-load[67]: Inserted module 'virtio_balloon'1965lb # [ 1.784429] systemd[1]: modprobe@configfs.service: Deactivated successfully.1966worker2 # [ 1.652320] systemd-modules-load[67]: Inserted module 'virtio_gpu'1967worker1 # [ 1.793398] systemd-journald[66]: Collecting audit messages is disabled.1968lb # [ 1.790271] systemd[1]: Finished Load Kernel Module configfs.1969worker2 # [ 1.658065] systemd[1]: Finished Create Static Device Nodes in /dev.1970client # [ 1.808133] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1971worker1 # [ 1.799670] systemd[1]: Finished Create List of Static Device Nodes.1972lb # [ 1.797232] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1973worker2 # [ 1.666146] systemd[1]: Reached target Preparation for Local File Systems.1974worker1 # [ 1.804532] systemd[1]: modprobe@configfs.service: Deactivated successfully.1975client # [ 1.813785] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1976worker2 # [ 1.667180] systemd[1]: Reached target Local File Systems.1977worker2 # [ 1.669611] systemd[1]: Starting Create System Files and Directories...1978worker1 # [ 1.811651] systemd[1]: Finished Load Kernel Module configfs.1979lb # [ 1.807897] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1980worker2 # [ 1.675743] systemd[1]: Starting Rule-based Manager for Device Events and Files...1981client # [ 1.825226] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1982worker1 # [ 1.818083] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1983worker2 # [ 1.682703] systemd[1]: Finished Apply Kernel Variables.1984lb # [ 1.818031] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1985worker1 # [ 1.829860] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1986lb # [ 1.825920] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1987worker1 # [ 1.837916] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1988client # [ 1.848637] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1989worker2 # [ 1.704921] systemd[1]: Finished Create System Files and Directories.1990client # [ 1.857272] systemd[1]: Starting Create Static Device Nodes in /dev...1991worker1 # [ 1.849816] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1992lb # [ 1.848395] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1993client # [ 1.869129] systemd[1]: Finished Load Kernel Modules.1994lb # [ 1.857018] systemd[1]: Starting Create Static Device Nodes in /dev...1995worker2 # [ 1.729263] systemd-udevd[79]: Using default interface naming scheme 'v261'.1996client # [ 1.881224] systemd[1]: Starting Apply Kernel Variables...1997lb # [ 1.868950] systemd[1]: Finished Load Kernel Modules.1998worker1 # [ 1.878260] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1999lb # [ 1.876907] systemd[1]: Starting Apply Kernel Variables...2000client # [ 1.894614] systemd[1]: Started Journal Service.
loading 2,880 hidden lines…
4881lb # [ 42.668276] niks3-server[966]: 2026/09/22 22:22:31 INFO Signed narinfos id=9 count=14882worker2 # [ 42.670853] nix-grpc-daemon[923]: time=2026-09-22T22:22:30.962Z level=INFO msg="Uploading 1 narinfos"4883lb # [ 42.678546] niks3-server[966]: 2026/09/22 22:22:31 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls4884lb # [ 42.684854] niks3-server[966]: 2026/09/22 22:22:31 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst4885lb # [ 42.698482] niks3-server[966]: 2026/09/22 22:22:31 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4886lb # [ 42.707066] niks3-server[966]: 2026/09/22 22:22:31 INFO Completed upload id=94887worker2 # [ 42.705382] nix-grpc-daemon[923]: time=2026-09-22T22:22:30.997Z level=INFO msg="Upload complete. (187ms)"4888lb # [ 42.710683] niks3-server[966]: 2026/09/22 22:22:31 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo4889worker2 # [ 42.709667] nix-grpc-daemon[784]: ts=2026-09-22T22:22:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=5044890worker2 # [ 42.715676] nix-grpc-daemon[784]: ts=2026-09-22T22:22:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484264891worker2 # [ 42.724592] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4892worker2 # [ 42.731691] nix-daemon[869]: reaped child process 921, status = succeeded4893worker2 # [ 42.734535] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4894client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051...4895client # farm-a> worker2: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv4896client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4897client # farm-a> LOG-farm-a-sig4898worker2 # [ 43.953244] nix-daemon[869]: reaped child process 943, status = succeeded4899worker2 # [ 44.023291] nix-daemon[869]: accepted connection from pid 959, user nix-grpc-daemon (trusted)4900worker2 # [ 44.035842] nix-daemon[869]: reaped child process 962, status = succeeded4901lb # [ 44.045416] niks3-server[966]: 2026/09/22 22:22:32 INFO Received uploads request method=POST path=/api/pending_closures4902worker2 # [ 44.052782] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.345Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4903worker2 # [ 44.054505] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.346Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)"4904lb # [ 44.090345] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4905lb # [ 44.099097] niks3-server[966]: 2026/09/22 22:22:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4906lb # [ 44.103092] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls4907worker2 # [ 44.109800] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.401Z level=INFO msg="Uploading 1 narinfos"4908lb # [ 44.111867] niks3-server[966]: 2026/09/22 22:22:32 INFO Signed narinfos id=10 count=14909lb # [ 44.114457] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv4910lb # [ 44.125626] niks3-server[966]: 2026/09/22 22:22:32 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4911lb # [ 44.129444] niks3-server[966]: 2026/09/22 22:22:32 INFO Completed upload id=104912worker2 # [ 44.128131] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.420Z level=INFO msg="Upload complete. (186ms)"4913lb # [ 44.133616] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo4914worker2 # [ 44.135612] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=14915worker2 # [ 44.146380] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=04916worker2 # [ 44.150669] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=14917worker2 # [ 44.161120] nix-daemon[869]: reaped child process 941, status = succeeded4918worker2 # [ 44.194338] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484264919worker2 # [ 44.207426] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484264920worker2 # [ 44.219867] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.512Z level=INFO msg="All 1 paths already cached"4921client # copying 1 paths to 'lb:50051'...4922client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'...4923worker2 # [ 44.228632] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484264924worker2 # [ 44.236729] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4925worker2 # [ 44.335069] nix-daemon[869]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4926worker2 # [ 44.350189] nix-daemon[869]: reaped child process 971, status = succeeded4927lb # [ 44.356828] niks3-server[966]: 2026/09/22 22:22:32 INFO Received uploads request method=POST path=/api/pending_closures4928worker2 # [ 44.363187] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.655Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4929worker2 # [ 44.364848] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.657Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)"4930lb # [ 44.388545] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst4931lb # [ 44.396078] niks3-server[966]: 2026/09/22 22:22:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4932lb # [ 44.400366] niks3-server[966]: 2026/09/22 22:22:32 INFO Signed narinfos id=11 count=14933worker2 # [ 44.401848] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.694Z level=INFO msg="Uploading 1 narinfos"4934lb # [ 44.411488] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls4935lb # [ 44.419794] niks3-server[966]: 2026/09/22 22:22:32 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4936lb # [ 44.425656] niks3-server[966]: 2026/09/22 22:22:32 INFO Completed upload id=114937worker2 # [ 44.424281] nix-grpc-daemon[923]: time=2026-09-22T22:22:32.716Z level=INFO msg="Upload complete. (174ms)"4938worker2 # [ 44.428235] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=6244939lb # [ 44.433679] niks3-server[966]: 2026/09/22 22:22:32 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo4940worker2 # [ 44.434092] nix-grpc-daemon[784]: ts=2026-09-22T22:22:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484264941worker2 # [ 44.443488] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4942worker2 # [ 44.450115] nix-daemon[869]: reaped child process 966, status = succeeded4943worker2 # [ 44.453250] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4944client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051...4945client # farm-b> worker2: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv4946lb # [ 45.180888] envoy[904]: conn peer=[2001:db8:1::1]:58456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9464 tx=4327 ms=49244947lb # [ 45.184735] envoy[904]: conn peer=[2001:db8:1::1]:58462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=594948lb # [ 45.188216] envoy[904]: conn peer=[2001:db8:1::1]:58468 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4135 tx=1881 ms=15574949client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4950client # farm-b> LOG-farm-b-sig4951worker2 # [ 45.869518] nix-daemon[869]: reaped child process 975, status = succeeded4952worker2 # [ 45.943516] nix-daemon[869]: accepted connection from pid 991, user nix-grpc-daemon (trusted)4953worker2 # [ 45.956751] nix-daemon[869]: reaped child process 994, status = succeeded4954lb # [ 45.965769] niks3-server[966]: 2026/09/22 22:22:34 INFO Received uploads request method=POST path=/api/pending_closures4955worker2 # [ 45.973677] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.265Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4956worker2 # [ 45.975674] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.267Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)"4957lb # [ 46.003123] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv4958lb # [ 46.009809] niks3-server[966]: 2026/09/22 22:22:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4959worker2 # [ 46.016282] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.308Z level=INFO msg="Uploading 1 narinfos"4960lb # [ 46.018122] niks3-server[966]: 2026/09/22 22:22:34 INFO Signed narinfos id=12 count=14961lb # [ 46.020247] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst4962lb # [ 46.026304] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls4963lb # [ 46.034477] niks3-server[966]: 2026/09/22 22:22:34 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4964lb # [ 46.038693] niks3-server[966]: 2026/09/22 22:22:34 INFO Completed upload id=124965worker2 # [ 46.037257] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.329Z level=INFO msg="Upload complete. (176ms)"4966lb # [ 46.040509] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo4967worker2 # [ 46.043094] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=14968worker2 # [ 46.052619] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=04969worker2 # [ 46.056677] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=14970worker2 # [ 46.064348] nix-daemon[869]: reaped child process 973, status = succeeded4971worker2 # [ 46.097413] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484264972worker2 # [ 46.109578] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484264973worker2 # [ 46.122891] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.415Z level=INFO msg="All 2 paths already cached"4974client # copying 1 paths to 'lb:50051'...4975client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'...4976worker2 # [ 46.131930] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484264977worker2 # [ 46.140334] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4978worker2 # [ 46.236081] nix-daemon[869]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)4979worker2 # [ 46.249753] nix-daemon[869]: reaped child process 1003, status = succeeded4980lb # [ 46.257293] niks3-server[966]: 2026/09/22 22:22:34 INFO Received uploads request method=POST path=/api/pending_closures4981worker2 # [ 46.263594] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.556Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4982worker2 # [ 46.265042] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.557Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)"4983lb # [ 46.290305] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls4984lb # [ 46.296382] niks3-server[966]: 2026/09/22 22:22:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4985lb # [ 46.301359] niks3-server[966]: 2026/09/22 22:22:34 INFO Signed narinfos id=13 count=14986worker2 # [ 46.302904] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.595Z level=INFO msg="Uploading 1 narinfos"4987lb # [ 46.316938] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst4988lb # [ 46.323884] niks3-server[966]: 2026/09/22 22:22:34 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4989lb # [ 46.328220] niks3-server[966]: 2026/09/22 22:22:34 INFO Completed upload id=134990worker2 # [ 46.328319] nix-grpc-daemon[923]: time=2026-09-22T22:22:34.620Z level=INFO msg="Upload complete. (176ms)"4991lb # [ 46.331253] niks3-server[966]: 2026/09/22 22:22:34 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo4992worker2 # [ 46.332491] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=7524993worker2 # [ 46.337331] nix-grpc-daemon[784]: ts=2026-09-22T22:22:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484264994worker2 # [ 46.347891] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4995worker2 # [ 46.353132] nix-daemon[869]: reaped child process 998, status = succeeded4996worker2 # [ 46.358092] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4997client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051...4998client # farm-top> worker2: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv4999client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5000client # farm-top> LOG-farm-top-sig5001worker2 # [ 47.773522] nix-daemon[869]: reaped child process 1007, status = succeeded5002worker2 # [ 47.848829] nix-daemon[869]: accepted connection from pid 1023, user nix-grpc-daemon (trusted)5003worker2 # [ 47.863591] nix-daemon[869]: reaped child process 1026, status = succeeded5004lb # [ 47.872702] niks3-server[966]: 2026/09/22 22:22:36 INFO Received uploads request method=POST path=/api/pending_closures5005worker2 # [ 47.878072] nix-grpc-daemon[923]: time=2026-09-22T22:22:36.170Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5006worker2 # [ 47.881055] nix-grpc-daemon[923]: time=2026-09-22T22:22:36.172Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)"5007lb # [ 47.910565] niks3-server[966]: 2026/09/22 22:22:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign5008lb # [ 47.917933] niks3-server[966]: 2026/09/22 22:22:36 INFO Signed narinfos id=14 count=15009worker2 # [ 47.919735] nix-grpc-daemon[923]: time=2026-09-22T22:22:36.212Z level=INFO msg="Uploading 1 narinfos"5010lb # [ 47.924314] niks3-server[966]: 2026/09/22 22:22:36 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst5011lb # [ 47.929415] niks3-server[966]: 2026/09/22 22:22:36 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls5012lb # [ 47.943335] niks3-server[966]: 2026/09/22 22:22:36 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv5013lb # [ 47.946910] niks3-server[966]: 2026/09/22 22:22:36 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete5014lb # [ 47.950990] niks3-server[966]: 2026/09/22 22:22:36 INFO Completed upload id=145015worker2 # [ 47.949573] nix-grpc-daemon[923]: time=2026-09-22T22:22:36.242Z level=INFO msg="Upload complete. (184ms)"5016lb # [ 47.953202] niks3-server[966]: 2026/09/22 22:22:36 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo5017worker2 # [ 47.955242] nix-grpc-daemon[784]: ts=2026-09-22T22:22:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=15018worker2 # [ 47.967555] nix-daemon[869]: reaped child process 1005, status = succeeded5019client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.83 seconds)5020client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath5021client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.11 seconds)5022client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top5023worker1 # [ 48.216892] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:557945024client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):5025client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a5026client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b5027client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top5028worker1 # [ 48.242981] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:557945029worker1 # [ 48.249976] nix-grpc-daemon[780]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'...5030worker1 # [ 48.264320] nix-grpc-daemon[780]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'...5031worker1 # [ 48.275983] nix-grpc-daemon[780]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'...5032client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.20 seconds)5033client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top5034worker2 # [ 48.420941] nix-grpc-daemon[784]: ts=2026-09-22T22:22:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:568105035worker2 # [ 48.427643] nix-grpc-daemon[784]: ts=2026-09-22T22:22:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:568105036client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.18 seconds)5037client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top5038client # finding garbage collector roots...5039client # removing stale temporary roots file "/nix/var/nix/temproots/856"5040client # removing stale temporary roots file "/nix/var/nix/temproots/878"5041client # removing stale temporary roots file "/nix/var/nix/temproots/901"5042client # removing stale temporary roots file "/nix/var/nix/temproots/864"5043client # removing stale temporary roots file "/nix/var/nix/temproots/806"5044client # removing stale temporary roots file "/nix/var/nix/temproots/886"5045client # removing stale temporary roots file "/nix/var/nix/temproots/844"5046client # removing stale temporary roots file "/nix/var/nix/temproots/823"5047client # deleting specified paths...5048client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top'5049client # deleting unused links...5050client # note: hard linking is currently saving 0.0 KiB5051worker1 # [ 48.732361] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:341805052worker1 # [ 48.739915] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805053worker1 # [ 48.750749] nix-grpc-daemon[858]: time=2026-09-22T22:22:37.936Z level=INFO msg="All 1 paths already cached"5054worker1 # [ 48.755269] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:341805055worker2 # [ 48.754294] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:484265056worker1 # [ 48.766113] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:341805057client # copying 3 paths...5058worker2 # [ 48.771537] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:484265059client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'...5060worker1 # [ 48.791844] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:341805061worker1 # [ 48.797351] nix-grpc-daemon[780]: ts=2026-09-22T22:22:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_out=2325062worker2 # [ 48.794281] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:484265063worker2 # [ 48.799870] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=1765064worker2 # [ 48.806147] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:484265065worker2 # [ 48.809747] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=1285066client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'...5067client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'...5068client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.41 seconds)5069(finished: subtest: outputs read back through any worker carry the cache signature, in 6.73 seconds)5070subtest: two clients wanting the same drv build it once5071client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup5072client # [ 48.937307] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup.5073client # Running as unit: dedup1.service; invocation ID: ae6abc0dc4134ad7a0ba5f78b2891d925074client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds)5075client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup5076client # [ 49.065067] nix[954]: don't know how to build these paths:5077client # [ 49.065955] nix[954]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv5078worker1 # [ 49.053770] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:341805079worker2 # [ 49.059938] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=05080worker1 # [ 49.066127] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805081worker2 # [ 49.064402] nix-grpc-daemon[784]: ts=2026-09-22T22:22:37Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=15082worker1 # [ 49.077985] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805083client # [ 49.098080] nix[954]: copying 1 paths to 'lb:50051'...5084client # [ 49.099248] nix[954]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...5085worker1 # [ 49.089571] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:341805086worker1 # [ 49.100297] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5087worker1 # [ 49.204228] nix-daemon[846]: accepted connection from pid 1010, user nix-grpc-daemon (trusted)5088worker1 # [ 49.217560] nix-daemon[846]: reaped child process 1013, status = succeeded5089lb # [ 49.222391] niks3-server[966]: 2026/09/22 22:22:37 INFO Received uploads request method=POST path=/api/pending_closures5090worker1 # [ 49.234105] nix-grpc-daemon[858]: time=2026-09-22T22:22:38.421Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5091worker1 # [ 49.235616] nix-grpc-daemon[858]: time=2026-09-22T22:22:38.423Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"5092lb # [ 49.255349] niks3-server[966]: 2026/09/22 22:22:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign5093lb # [ 49.261970] niks3-server[966]: 2026/09/22 22:22:37 INFO Signed narinfos id=15 count=15094worker1 # [ 49.268028] nix-grpc-daemon[858]: time=2026-09-22T22:22:38.455Z level=INFO msg="Uploading 1 narinfos"5095lb # [ 49.272211] niks3-server[966]: 2026/09/22 22:22:37 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst5096lb # [ 49.284119] niks3-server[966]: 2026/09/22 22:22:37 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls5097lb # [ 49.290354] niks3-server[966]: 2026/09/22 22:22:37 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete5098lb # [ 49.297162] niks3-server[966]: 2026/09/22 22:22:37 INFO Completed upload id=155099worker1 # [ 49.299785] nix-grpc-daemon[858]: time=2026-09-22T22:22:38.487Z level=INFO msg="Upload complete. (187ms)"5100worker1 # [ 49.306300] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=4325101lb # [ 49.305991] niks3-server[966]: 2026/09/22 22:22:37 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo5102worker1 # [ 49.312866] nix-grpc-daemon[780]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805103worker1 # [ 49.324237] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5104worker1 # [ 49.331195] nix-daemon[846]: reaped child process 1008, status = succeeded5105worker1 # [ 49.336724] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5106client # [ 49.346597] nix[954]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...5107client # [ 49.991973] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup.5108client # Running as unit: dedup2.service; invocation ID: 2b3ac724bc9a46d78484ed69d951d18b5109client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.07 seconds)5110client: must succeed: sleep 25111client # [ 50.164313] nix[970]: don't know how to build these paths:5112worker2 # [ 50.147419] nix-grpc-daemon[784]: ts=2026-09-22T22:22:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:484265113client # [ 50.165179] nix[970]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv5114worker2 # [ 50.160408] nix-grpc-daemon[784]: ts=2026-09-22T22:22:38Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=05115worker1 # [ 50.167076] nix-grpc-daemon[780]: ts=2026-09-22T22:22:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805116client # [ 50.179757] nix[970]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...5117client: (finished: must succeed: sleep 2, in 2.05 seconds)5118client: waiting for success: ! systemctl is-active dedup1 dedup25119worker1 # [ 52.357492] nix-daemon[846]: reaped child process 1017, status = succeeded5120worker1 # [ 52.440361] nix-daemon[846]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)5121worker1 # [ 52.455653] nix-daemon[846]: reaped child process 1046, status = succeeded5122lb # [ 52.464421] niks3-server[966]: 2026/09/22 22:22:40 INFO Received uploads request method=POST path=/api/pending_closures5123worker1 # [ 52.474146] nix-grpc-daemon[858]: time=2026-09-22T22:22:41.661Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5124worker1 # [ 52.475625] nix-grpc-daemon[858]: time=2026-09-22T22:22:41.663Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"5125lb # [ 52.510388] niks3-server[966]: 2026/09/22 22:22:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign5126lb # [ 52.518118] niks3-server[966]: 2026/09/22 22:22:40 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv5127worker1 # [ 52.527288] nix-grpc-daemon[858]: time=2026-09-22T22:22:41.714Z level=INFO msg="Uploading 1 narinfos"5128lb # [ 52.524365] niks3-server[966]: 2026/09/22 22:22:40 INFO Signed narinfos id=16 count=15129lb # [ 52.535088] niks3-server[966]: 2026/09/22 22:22:40 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete5130lb # [ 52.559562] niks3-server[966]: 2026/09/22 22:22:40 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls5131lb # [ 52.578833] niks3-server[966]: 2026/09/22 22:22:40 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst5132worker1 # [ 52.859398] nix-grpc-daemon[858]: time=2026-09-22T22:22:42.046Z level=INFO msg="Upload complete. (513ms)"5133lb # [ 52.856621] niks3-server[966]: 2026/09/22 22:22:41 INFO Completed upload id=165134worker1 # [ 52.864183] nix-grpc-daemon[780]: ts=2026-09-22T22:22:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=15135worker1 # [ 52.866920] nix-grpc-daemon[780]: ts=2026-09-22T22:22:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=2 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=15136worker1 # [ 52.873974] nix-daemon[846]: reaped child process 1015, status = succeeded5137lb # [ 52.869604] niks3-server[966]: 2026/09/22 22:22:41 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo5138client # [ 52.909386] systemd[1]: dedup1.service: Deactivated successfully.5139client # [ 52.913363] systemd[1]: dedup1.service: Consumed 114ms CPU time over 3.975s wall clock time, 41.5M memory peak, 7.2K incoming IP traffic, 8.5K outgoing IP traffic.5140client # [ 52.948394] systemd[1]: dedup2.service: Deactivated successfully.5141client # [ 52.950534] systemd[1]: dedup2.service: Consumed 135ms CPU time over 2.956s wall clock time, 35.4M memory peak, 5.9K incoming IP traffic, 5.7K outgoing IP traffic.5142client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.08 seconds)5143client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }5144client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)5145worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true5146worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)5147worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true5148worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)5149worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5150worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5151worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5152worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5153(finished: subtest: two clients wanting the same drv build it once, in 4.66 seconds)5154subtest: --timeout and --max-silent-time reach the builder5155worker1 # [ 53.711553] nix-grpc-daemon[780]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:341805156worker2 # [ 53.723975] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=05157worker2 # [ 53.730220] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.4:50051 clients=15158worker2 # [ 53.734695] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484265159worker2 # [ 53.746222] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484265160worker2 # [ 53.757480] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484265161worker2 # [ 53.768659] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5162worker2 # [ 53.866664] nix-daemon[869]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)5163worker2 # [ 53.880599] nix-daemon[869]: reaped child process 1056, status = succeeded5164lb # [ 53.889347] niks3-server[966]: 2026/09/22 22:22:42 INFO Received uploads request method=POST path=/api/pending_closures5165worker2 # [ 53.895790] nix-grpc-daemon[923]: time=2026-09-22T22:22:42.188Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5166worker2 # [ 53.897702] nix-grpc-daemon[923]: time=2026-09-22T22:22:42.189Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)"5167lb # [ 53.919812] niks3-server[966]: 2026/09/22 22:22:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign5168lb # [ 53.926630] niks3-server[966]: 2026/09/22 22:22:42 INFO Signed narinfos id=17 count=15169worker2 # [ 53.928843] nix-grpc-daemon[923]: time=2026-09-22T22:22:42.221Z level=INFO msg="Uploading 1 narinfos"5170lb # [ 53.932320] niks3-server[966]: 2026/09/22 22:22:42 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls5171lb # [ 53.947086] niks3-server[966]: 2026/09/22 22:22:42 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5172lb # [ 53.953140] niks3-server[966]: 2026/09/22 22:22:42 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst5173lb # [ 53.959435] niks3-server[966]: 2026/09/22 22:22:42 INFO Completed upload id=175174worker2 # [ 53.958092] nix-grpc-daemon[923]: time=2026-09-22T22:22:42.250Z level=INFO msg="Upload complete. (177ms)"5175lb # [ 53.962438] niks3-server[966]: 2026/09/22 22:22:42 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo5176worker2 # [ 53.962693] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=4245177worker2 # [ 53.967231] nix-grpc-daemon[784]: ts=2026-09-22T22:22:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484265178worker2 # [ 53.977586] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5179worker2 # [ 53.984997] nix-daemon[869]: reaped child process 1051, status = succeeded5180worker2 # [ 53.987860] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5181lb # [ 55.182345] envoy[904]: conn peer=[2001:db8:1::1]:58478 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9537 tx=4372 ms=56785182lb # [ 55.186105] envoy[904]: conn peer=[2001:db8:1::1]:58790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1108 tx=2930 ms=1495183lb # [ 55.189603] envoy[904]: conn peer=[2001:db8:1::1]:58802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=755184lb # [ 55.192945] envoy[904]: conn peer=[2001:db8:1::1]:58798 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=895185lb # [ 55.196379] envoy[904]: conn peer=[2001:db8:1::1]:58800 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=376 ms=845186lb # [ 55.200293] envoy[904]: conn peer=[2001:db8:1::1]:58810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3011 tx=1536 ms=38255187lb # [ 55.203744] envoy[904]: conn peer=[2001:db8:1::1]:58822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1197 ms=27785188worker2 # [ 59.599233] nix-grpc-daemon[784]: ts=2026-09-22T22:22:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=5 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=05189worker2 # [ 59.615798] nix-daemon[869]: reaped child process 1060, status = succeeded5190worker2 # [ 59.616988] nix-daemon[869]: reaped child process 1058, status = succeeded5191worker1 # [ 59.805775] nix-grpc-daemon[780]: ts=2026-09-22T22:22:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:341805192worker2 # [ 59.809910] nix-grpc-daemon[784]: ts=2026-09-22T22:22:48Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=05193worker1 # [ 59.816428] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805194worker2 # [ 59.814549] nix-grpc-daemon[784]: ts=2026-09-22T22:22:48Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.3:50051 clients=15195worker1 # [ 59.828775] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805196worker1 # [ 59.839622] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:341805197worker1 # [ 59.851445] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5198worker1 # [ 59.965572] nix-daemon[846]: accepted connection from pid 1059, user nix-grpc-daemon (trusted)5199worker1 # [ 59.982407] nix-daemon[846]: reaped child process 1062, status = succeeded5200lb # [ 59.987393] niks3-server[966]: 2026/09/22 22:22:48 INFO Received uploads request method=POST path=/api/pending_closures5201worker1 # [ 59.998210] nix-grpc-daemon[858]: time=2026-09-22T22:22:49.185Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5202worker1 # [ 60.000240] nix-grpc-daemon[858]: time=2026-09-22T22:22:49.187Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)"5203lb # [ 60.019261] niks3-server[966]: 2026/09/22 22:22:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5204worker1 # [ 60.027706] nix-grpc-daemon[858]: time=2026-09-22T22:22:49.215Z level=INFO msg="Uploading 1 narinfos"5205lb # [ 60.024811] niks3-server[966]: 2026/09/22 22:22:48 INFO Signed narinfos id=18 count=15206lb # [ 60.042802] niks3-server[966]: 2026/09/22 22:22:48 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst5207lb # [ 60.047654] niks3-server[966]: 2026/09/22 22:22:48 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls5208lb # [ 60.059053] niks3-server[966]: 2026/09/22 22:22:48 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5209lb # [ 60.062312] niks3-server[966]: 2026/09/22 22:22:48 INFO Completed upload id=185210worker1 # [ 60.066695] nix-grpc-daemon[858]: time=2026-09-22T22:22:49.254Z level=INFO msg="Upload complete. (203ms)"5211lb # [ 60.066665] niks3-server[966]: 2026/09/22 22:22:48 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo5212worker1 # [ 60.071472] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=4245213worker1 # [ 60.077524] nix-grpc-daemon[780]: ts=2026-09-22T22:22:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805214worker1 # [ 60.091113] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5215worker1 # [ 60.099161] nix-daemon[846]: reaped child process 1057, status = succeeded5216worker1 # [ 60.104260] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5217lb # [ 65.182333] envoy[904]: conn peer=[2001:db8:1::1]:45076 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=959 ms=59455218worker1 # [ 65.917839] nix-grpc-daemon[780]: ts=2026-09-22T22:22:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=05219worker1 # [ 65.930748] nix-daemon[846]: reaped child process 1064, status = succeeded5220worker1 # [ 65.932092] nix-daemon[846]: reaped child process 1066, status = succeeded5221(finished: subtest: --timeout and --max-silent-time reach the builder, in 12.52 seconds)5222subtest: the first client leaving does not fail the second5223client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share5224client # [ 66.139951] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share.5225client # Running as unit: share1.service; invocation ID: fd1b6042b5b941639a7460bf036ff4515226client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds)5227client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share5228client # [ 66.280587] nix[1043]: don't know how to build these paths:5229client # [ 66.281497] nix[1043]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5230worker2 # [ 66.265141] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:484265231worker2 # [ 66.275483] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=05232worker2 # [ 66.282543] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.4:50051 clients=15233worker2 # [ 66.287305] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484265234worker2 # [ 66.295191] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484265235client # [ 66.320072] nix[1043]: copying 1 paths to 'lb:50051'...5236client # [ 66.320840] nix[1043]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'...5237worker2 # [ 66.306171] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484265238worker2 # [ 66.317945] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5239worker2 # [ 66.413939] nix-daemon[869]: accepted connection from pid 1087, user nix-grpc-daemon (trusted)5240worker2 # [ 66.426704] nix-daemon[869]: reaped child process 1090, status = succeeded5241lb # [ 66.436378] niks3-server[966]: 2026/09/22 22:22:54 INFO Received uploads request method=POST path=/api/pending_closures5242worker2 # [ 66.443578] nix-grpc-daemon[923]: time=2026-09-22T22:22:54.735Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5243worker2 # [ 66.444960] nix-grpc-daemon[923]: time=2026-09-22T22:22:54.735Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)"5244lb # [ 66.472241] niks3-server[966]: 2026/09/22 22:22:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5245lb # [ 66.478886] niks3-server[966]: 2026/09/22 22:22:54 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls5246worker2 # [ 66.482472] nix-grpc-daemon[923]: time=2026-09-22T22:22:54.774Z level=INFO msg="Uploading 1 narinfos"5247lb # [ 66.484379] niks3-server[966]: 2026/09/22 22:22:54 INFO Signed narinfos id=19 count=15248lb # [ 66.498731] niks3-server[966]: 2026/09/22 22:22:54 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst5249lb # [ 66.505528] niks3-server[966]: 2026/09/22 22:22:54 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5250lb # [ 66.512227] niks3-server[966]: 2026/09/22 22:22:54 INFO Completed upload id=195251worker2 # [ 66.510771] nix-grpc-daemon[923]: time=2026-09-22T22:22:54.803Z level=INFO msg="Upload complete. (181ms)"5252lb # [ 66.514676] niks3-server[966]: 2026/09/22 22:22:54 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo5253worker2 # [ 66.514850] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=4325254worker2 # [ 66.519990] nix-grpc-daemon[784]: ts=2026-09-22T22:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484265255worker2 # [ 66.529898] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5256worker2 # [ 66.540899] nix-daemon[869]: reaped child process 1085, status = succeeded5257worker2 # [ 66.543817] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5258client # [ 66.557678] nix[1043]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051...5259client # [ 67.205684] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share.5260client # Running as unit: share2.service; invocation ID: 0b36b5fe61a248ed81e05fce6b957dd25261client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds)5262client: must succeed: sleep 2; systemctl kill -s INT share15263client # [ 67.362420] nix[1059]: don't know how to build these paths:5264client # [ 67.363362] nix[1059]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5265worker1 # [ 67.352196] nix-grpc-daemon[780]: ts=2026-09-22T22:22:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:341805266worker2 # [ 67.354243] nix-grpc-daemon[784]: ts=2026-09-22T22:22:55Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=05267worker2 # [ 67.356628] nix-grpc-daemon[784]: ts=2026-09-22T22:22:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484265268client # [ 67.373165] nix[1059]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051...5269client # [ 69.364318] systemd[1]: share1.service: Sent signal SIGINT to main process 1043 (nix) on client request.5270client # [ 69.371705] nix[1043]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5271client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds)5272client: waiting for success: ! systemctl is-active share15273client # [ 69.378477] nix[1043]: error: interrupted by the user5274client # [ 69.419360] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE5275client # [ 69.421220] systemd[1]: share1.service: Failed with result 'exit-code'.5276client # [ 69.422942] systemd[1]: share1.service: Consumed 114ms CPU time over 3.282s wall clock time, 43.5M memory peak, 6.1K incoming IP traffic, 8.1K outgoing IP traffic.5277client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds)5278client: waiting for success: ! systemctl is-active share25279worker2 # [ 70.783902] nix-daemon[869]: reaped child process 1094, status = succeeded5280worker2 # [ 70.864053] nix-daemon[869]: accepted connection from pid 1126, user nix-grpc-daemon (trusted)5281worker2 # [ 70.876411] nix-daemon[869]: reaped child process 1129, status = succeeded5282lb # [ 70.884736] niks3-server[966]: 2026/09/22 22:22:59 INFO Received uploads request method=POST path=/api/pending_closures5283worker2 # [ 70.894393] nix-grpc-daemon[923]: time=2026-09-22T22:22:59.186Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5284worker2 # [ 70.896360] nix-grpc-daemon[923]: time=2026-09-22T22:22:59.188Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)"5285lb # [ 70.929718] niks3-server[966]: 2026/09/22 22:22:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5286lb # [ 70.937904] niks3-server[966]: 2026/09/22 22:22:59 INFO Signed narinfos id=20 count=15287worker2 # [ 70.939336] nix-grpc-daemon[923]: time=2026-09-22T22:22:59.231Z level=INFO msg="Uploading 1 narinfos"5288lb # [ 70.945666] niks3-server[966]: 2026/09/22 22:22:59 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst5289lb # [ 70.952258] niks3-server[966]: 2026/09/22 22:22:59 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5290lb # [ 70.956743] niks3-server[966]: 2026/09/22 22:22:59 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls5291lb # [ 70.966826] niks3-server[966]: 2026/09/22 22:22:59 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5292lb # [ 70.973685] niks3-server[966]: 2026/09/22 22:22:59 INFO Completed upload id=205293worker2 # [ 70.972412] nix-grpc-daemon[923]: time=2026-09-22T22:22:59.264Z level=INFO msg="Upload complete. (216ms)"5294lb # [ 70.975885] niks3-server[966]: 2026/09/22 22:22:59 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo5295worker2 # [ 70.978852] nix-grpc-daemon[784]: ts=2026-09-22T22:22:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=3 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=15296worker2 # [ 70.987283] nix-grpc-daemon[784]: ts=2026-09-22T22:22:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=15297worker2 # [ 71.000667] nix-daemon[869]: reaped child process 1092, status = succeeded5298client # [ 71.065252] systemd[1]: share2.service: Deactivated successfully.5299client # [ 71.069453] systemd[1]: share2.service: Consumed 120ms CPU time over 3.862s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic.5300client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds)5301client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }5302client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.04 seconds)5303(finished: subtest: the first client leaving does not fail the second, in 5.65 seconds)5304subtest: build hook: nix-daemon with builders = grpc://lb5305client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log5306client # [ 71.839831] systemd[1]: Started Nix Daemon.5307client # [ 71.925448] nix-daemon[1110]: accepted connection from pid 1107, user root (trusted)5308worker1 # [ 72.027751] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:341805309worker1 # [ 72.034365] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805310worker2 # [ 72.039878] nix-grpc-daemon[784]: ts=2026-09-22T22:23:00Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=05311worker2 # [ 72.044715] nix-grpc-daemon[784]: ts=2026-09-22T22:23:00Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=15312worker1 # [ 72.051202] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805313worker1 # [ 72.064179] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805314worker1 # [ 72.076743] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:341805315worker1 # [ 72.088385] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5316worker1 # [ 72.197679] nix-daemon[846]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)5317worker1 # [ 72.212846] nix-daemon[846]: reaped child process 1104, status = succeeded5318lb # [ 72.218182] niks3-server[966]: 2026/09/22 22:23:00 INFO Received uploads request method=POST path=/api/pending_closures5319worker1 # [ 72.266031] nix-grpc-daemon[858]: time=2026-09-22T22:23:01.452Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5320worker1 # [ 72.267551] nix-grpc-daemon[858]: time=2026-09-22T22:23:01.452Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"5321lb # [ 72.282114] niks3-server[966]: 2026/09/22 22:23:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5322lb # [ 72.290513] niks3-server[966]: 2026/09/22 22:23:00 INFO Signed narinfos id=21 count=15323worker1 # [ 72.293170] nix-grpc-daemon[858]: time=2026-09-22T22:23:01.480Z level=INFO msg="Uploading 1 narinfos"5324lb # [ 72.294955] niks3-server[966]: 2026/09/22 22:23:00 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls5325lb # [ 72.300696] niks3-server[966]: 2026/09/22 22:23:00 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst5326lb # [ 72.310621] niks3-server[966]: 2026/09/22 22:23:00 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5327lb # [ 72.314289] niks3-server[966]: 2026/09/22 22:23:00 INFO Completed upload id=215328lb # [ 72.316257] niks3-server[966]: 2026/09/22 22:23:00 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo5329worker1 # [ 72.317413] nix-grpc-daemon[858]: time=2026-09-22T22:23:01.504Z level=INFO msg="Upload complete. (216ms)"5330worker1 # [ 72.323174] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=5125331worker1 # [ 72.329877] nix-grpc-daemon[780]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805332worker1 # [ 72.341181] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5333worker1 # [ 72.354255] nix-daemon[846]: reaped child process 1099, status = succeeded5334worker1 # [ 72.357244] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5335worker1 # [ 73.176140] nix-daemon[846]: reaped child process 1108, status = succeeded5336worker1 # [ 73.259921] nix-daemon[846]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)5337worker1 # [ 73.274312] nix-daemon[846]: reaped child process 1127, status = succeeded5338lb # [ 73.281344] niks3-server[966]: 2026/09/22 22:23:01 INFO Received uploads request method=POST path=/api/pending_closures5339worker1 # [ 73.292058] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.479Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5340worker1 # [ 73.293560] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.481Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"5341lb # [ 73.326563] niks3-server[966]: 2026/09/22 22:23:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5342lb # [ 73.337525] niks3-server[966]: 2026/09/22 22:23:01 INFO Signed narinfos id=22 count=15343worker1 # [ 73.343477] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.530Z level=INFO msg="Uploading 1 narinfos"5344lb # [ 73.344761] niks3-server[966]: 2026/09/22 22:23:01 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst5345lb # [ 73.350250] niks3-server[966]: 2026/09/22 22:23:01 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls5346lb # [ 73.355245] niks3-server[966]: 2026/09/22 22:23:01 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv5347lb # [ 73.369115] niks3-server[966]: 2026/09/22 22:23:01 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5348lb # [ 73.374094] niks3-server[966]: 2026/09/22 22:23:01 INFO Completed upload id=225349worker1 # [ 73.379544] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.566Z level=INFO msg="Upload complete. (215ms)"5350lb # [ 73.379298] niks3-server[966]: 2026/09/22 22:23:01 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo5351worker1 # [ 73.386719] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=15352worker1 # [ 73.394343] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:341805353worker1 # [ 73.407428] nix-daemon[846]: reaped child process 1106, status = succeeded5354worker2 # [ 73.409441] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:484265355worker2 # [ 73.418328] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...5356worker2 # [ 73.432746] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=1285357worker2 # [ 73.634654] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:484265358worker1 # [ 73.642197] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805359worker1 # [ 73.652698] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.839Z level=INFO msg="All 1 paths already cached"5360worker2 # [ 73.663790] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=05361worker1 # [ 73.670423] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805362worker2 # [ 73.668243] nix-grpc-daemon[784]: ts=2026-09-22T22:23:01Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=15363worker1 # [ 73.682619] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805364worker1 # [ 73.694735] nix-grpc-daemon[858]: time=2026-09-22T22:23:02.882Z level=INFO msg="All 1 paths already cached"5365worker1 # [ 73.702355] nix-grpc-daemon[780]: ts=2026-09-22T22:23:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:341805366worker1 # [ 73.713087] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5367worker1 # [ 73.824912] nix-daemon[846]: accepted connection from pid 1131, user nix-grpc-daemon (trusted)5368worker1 # [ 73.840743] nix-daemon[846]: reaped child process 1134, status = succeeded5369lb # [ 73.845656] niks3-server[966]: 2026/09/22 22:23:02 INFO Received uploads request method=POST path=/api/pending_closures5370worker1 # [ 73.856312] nix-grpc-daemon[858]: time=2026-09-22T22:23:03.043Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5371worker1 # [ 73.857857] nix-grpc-daemon[858]: time=2026-09-22T22:23:03.045Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"5372lb # [ 73.880122] niks3-server[966]: 2026/09/22 22:23:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5373worker1 # [ 73.890027] nix-grpc-daemon[858]: time=2026-09-22T22:23:03.077Z level=INFO msg="Uploading 1 narinfos"5374lb # [ 73.887619] niks3-server[966]: 2026/09/22 22:23:02 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst5375lb # [ 73.892106] niks3-server[966]: 2026/09/22 22:23:02 INFO Signed narinfos id=23 count=15376lb # [ 73.895768] niks3-server[966]: 2026/09/22 22:23:02 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls5377lb # [ 73.909802] niks3-server[966]: 2026/09/22 22:23:02 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5378worker1 # [ 73.919640] nix-grpc-daemon[858]: time=2026-09-22T22:23:03.107Z level=INFO msg="Upload complete. (193ms)"5379lb # [ 73.916920] niks3-server[966]: 2026/09/22 22:23:02 INFO Completed upload id=235380lb # [ 73.920082] niks3-server[966]: 2026/09/22 22:23:02 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo5381worker1 # [ 73.922694] nix-grpc-daemon[780]: ts=2026-09-22T22:23:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=6245382worker1 # [ 73.929122] nix-grpc-daemon[780]: ts=2026-09-22T22:23:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805383worker1 # [ 73.940629] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5384worker1 # [ 73.946101] nix-daemon[846]: reaped child process 1129, status = succeeded5385worker1 # [ 73.949757] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5386worker1 # [ 74.766803] nix-daemon[846]: reaped child process 1138, status = succeeded5387worker1 # [ 74.853986] nix-daemon[846]: accepted connection from pid 1155, user nix-grpc-daemon (trusted)5388worker1 # [ 74.869625] nix-daemon[846]: reaped child process 1158, status = succeeded5389lb # [ 74.875659] niks3-server[966]: 2026/09/22 22:23:03 INFO Received uploads request method=POST path=/api/pending_closures5390worker1 # [ 74.889216] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.076Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5391worker1 # [ 74.890776] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.078Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"5392lb # [ 74.918294] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst5393lb # [ 74.932578] niks3-server[966]: 2026/09/22 22:23:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5394lb # [ 74.938578] niks3-server[966]: 2026/09/22 22:23:03 INFO Signed narinfos id=24 count=15395worker1 # [ 74.944325] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.131Z level=INFO msg="Uploading 1 narinfos"5396lb # [ 74.946113] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls5397lb # [ 74.950526] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv5398lb # [ 74.959627] niks3-server[966]: 2026/09/22 22:23:03 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5399lb # [ 74.965104] niks3-server[966]: 2026/09/22 22:23:03 INFO Completed upload id=245400lb # [ 74.966789] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo5401worker1 # [ 74.967762] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.155Z level=INFO msg="Upload complete. (211ms)"5402worker1 # [ 74.975143] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=15403worker1 # [ 74.982815] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:341805404worker1 # [ 74.994947] nix-daemon[846]: reaped child process 1136, status = succeeded5405worker2 # [ 74.997202] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:484265406worker2 # [ 75.002814] nix-grpc-daemon[784]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...5407worker2 # [ 75.016586] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=1765408lb # [ 75.182751] envoy[904]: conn peer=[2001:db8:1::1]:45088 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=933 ms=61675409lb # [ 75.186386] envoy[904]: conn peer=[2001:db8:1::1]:42690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=772 ms=31135410lb # [ 75.189836] envoy[904]: conn peer=[2001:db8:1::1]:42702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1194 ms=36855411lb # [ 75.193337] envoy[904]: conn peer=[2001:db8:1::1]:42706 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3429 tx=1939 ms=14645412lb # [ 75.196879] envoy[904]: conn peer=[2001:db8:1::1]:51512 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=775413lb # [ 75.200429] envoy[904]: conn peer=[2001:db8:1::1]:51522 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=2163 ms=14355414lb # [ 75.203910] envoy[904]: conn peer=[2001:db8:1::1]:51538 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=735415worker2 # [ 75.219728] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:484265416worker1 # [ 75.232075] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805417worker1 # [ 75.242315] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.429Z level=INFO msg="All 2 paths already cached"5418worker2 # [ 75.254149] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=05419worker2 # [ 75.258611] nix-grpc-daemon[784]: ts=2026-09-22T22:23:03Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=15420worker1 # [ 75.265267] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805421worker1 # [ 75.278062] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805422worker1 # [ 75.291493] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.478Z level=INFO msg="All 2 paths already cached"5423worker1 # [ 75.299890] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:341805424worker1 # [ 75.308492] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5425worker1 # [ 75.419626] nix-daemon[846]: accepted connection from pid 1162, user nix-grpc-daemon (trusted)5426worker1 # [ 75.434286] nix-daemon[846]: reaped child process 1165, status = succeeded5427lb # [ 75.441127] niks3-server[966]: 2026/09/22 22:23:03 INFO Received uploads request method=POST path=/api/pending_closures5428worker1 # [ 75.452748] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.640Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5429worker1 # [ 75.454287] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.641Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"5430lb # [ 75.475441] niks3-server[966]: 2026/09/22 22:23:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5431lb # [ 75.480080] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst5432worker1 # [ 75.490756] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.678Z level=INFO msg="Uploading 1 narinfos"5433lb # [ 75.487927] niks3-server[966]: 2026/09/22 22:23:03 INFO Signed narinfos id=25 count=15434lb # [ 75.496211] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls5435lb # [ 75.509404] niks3-server[966]: 2026/09/22 22:23:03 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5436worker1 # [ 75.517736] nix-grpc-daemon[858]: time=2026-09-22T22:23:04.705Z level=INFO msg="Upload complete. (194ms)"5437lb # [ 75.516315] niks3-server[966]: 2026/09/22 22:23:03 INFO Completed upload id=255438lb # [ 75.518524] niks3-server[966]: 2026/09/22 22:23:03 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo5439worker1 # [ 75.521183] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_in=7525440worker1 # [ 75.526481] nix-grpc-daemon[780]: ts=2026-09-22T22:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805441worker1 # [ 75.538064] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5442worker1 # [ 75.544131] nix-daemon[846]: reaped child process 1160, status = succeeded5443worker1 # [ 75.547491] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5444worker1 # [ 76.188889] nix-daemon[846]: reaped child process 1169, status = succeeded5445worker1 # [ 76.264307] nix-daemon[846]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)5446worker1 # [ 76.277297] nix-daemon[846]: reaped child process 1188, status = succeeded5447lb # [ 76.282458] niks3-server[966]: 2026/09/22 22:23:04 INFO Received uploads request method=POST path=/api/pending_closures5448worker1 # [ 76.293637] nix-grpc-daemon[858]: time=2026-09-22T22:23:05.480Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5449worker1 # [ 76.295230] nix-grpc-daemon[858]: time=2026-09-22T22:23:05.482Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"5450lb # [ 76.325375] niks3-server[966]: 2026/09/22 22:23:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5451lb # [ 76.331622] niks3-server[966]: 2026/09/22 22:23:04 INFO Signed narinfos id=26 count=15452worker1 # [ 76.337782] nix-grpc-daemon[858]: time=2026-09-22T22:23:05.525Z level=INFO msg="Uploading 1 narinfos"5453lb # [ 76.339855] niks3-server[966]: 2026/09/22 22:23:04 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst5454lb # [ 76.344695] niks3-server[966]: 2026/09/22 22:23:04 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls5455lb # [ 76.357076] niks3-server[966]: 2026/09/22 22:23:04 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5456lb # [ 76.360099] niks3-server[966]: 2026/09/22 22:23:04 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv5457lb # [ 76.362922] niks3-server[966]: 2026/09/22 22:23:04 INFO Completed upload id=265458worker1 # [ 76.365791] nix-grpc-daemon[858]: time=2026-09-22T22:23:05.553Z level=INFO msg="Upload complete. (211ms)"5459lb # [ 76.367322] niks3-server[966]: 2026/09/22 22:23:04 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo5460worker1 # [ 76.373201] nix-grpc-daemon[780]: ts=2026-09-22T22:23:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=15461worker1 # [ 76.380255] nix-grpc-daemon[780]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:341805462worker1 # [ 76.391824] nix-daemon[846]: reaped child process 1167, status = succeeded5463worker1 # [ 76.395786] nix-grpc-daemon[780]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:341805464worker1 # [ 76.399920] nix-grpc-daemon[780]: ts=2026-09-22T22:23:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_out=2325465client # [ 76.521392] nix-daemon[1110]: reaped child process 1112, status = succeeded5466client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 4.78 seconds)5467client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top5468client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)5469client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5470client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds)5471client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5472client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds)5473(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 4.84 seconds)5474subtest: an input only one worker has still reaches the builder5475client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only5476client # this derivation will be built:5477client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv5478client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...5479client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.23 seconds)5480client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure5481client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.10 seconds)5482worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5483worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.12 seconds)5484worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only5485worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)5486client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&25487client # [ 77.172309] nix-daemon[1110]: accepted connection from pid 1193, user root (trusted)5488client # this derivation will be built:5489client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5490client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5491worker2 # [ 77.278186] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:484265492worker1 # [ 77.285164] nix-grpc-daemon[780]: ts=2026-09-22T22:23:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805493worker1 # [ 77.394107] nix-daemon[846]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5494worker1 # [ 77.405912] nix-daemon[846]: reaped child process 1198, status = succeeded5495lb # [ 77.410678] niks3-server[966]: 2026/09/22 22:23:05 INFO Received uploads request method=POST path=/api/pending_closures5496worker1 # [ 77.421952] nix-grpc-daemon[858]: time=2026-09-22T22:23:06.609Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5497worker1 # [ 77.423829] nix-grpc-daemon[858]: time=2026-09-22T22:23:06.610Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5498lb # [ 77.444832] niks3-server[966]: 2026/09/22 22:23:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5499lb # [ 77.451831] niks3-server[966]: 2026/09/22 22:23:05 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5500worker1 # [ 77.458923] nix-grpc-daemon[858]: time=2026-09-22T22:23:06.646Z level=INFO msg="Uploading 1 narinfos"5501lb # [ 77.456689] niks3-server[966]: 2026/09/22 22:23:05 INFO Signed narinfos id=27 count=15502lb # [ 77.463768] niks3-server[966]: 2026/09/22 22:23:05 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5503lb # [ 77.475253] niks3-server[966]: 2026/09/22 22:23:05 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5504worker1 # [ 77.484066] nix-grpc-daemon[858]: time=2026-09-22T22:23:06.671Z level=INFO msg="Upload complete. (194ms)"5505lb # [ 77.481352] niks3-server[966]: 2026/09/22 22:23:05 INFO Completed upload id=275506lb # [ 77.486864] niks3-server[966]: 2026/09/22 22:23:05 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5507worker2 # [ 77.497816] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05508worker2 # [ 77.503525] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=15509worker2 # [ 77.542758] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484265510worker2 # [ 77.556860] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484265511client # copying 2 paths to 'lb:50051'...5512client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5513worker2 # [ 77.571214] nix-grpc-daemon[784]: ts=2026-09-22T22:23:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484265514client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5515worker2 # [ 77.589108] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5516worker2 # [ 77.697510] nix-daemon[869]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)5517worker2 # [ 77.712653] nix-daemon[869]: reaped child process 1149, status = succeeded5518lb # [ 77.719531] niks3-server[966]: 2026/09/22 22:23:06 INFO Received uploads request method=POST path=/api/pending_closures5519lb # [ 77.727962] niks3-server[966]: 2026/09/22 22:23:06 INFO Received uploads request method=POST path=/api/pending_closures5520worker2 # [ 77.736329] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.028Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5521worker2 # [ 77.739892] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.030Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5522worker2 # [ 77.741642] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.030Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5523lb # [ 77.772367] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5524lb # [ 77.778082] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5525lb # [ 77.780380] niks3-server[966]: 2026/09/22 22:23:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5526lb # [ 77.782836] niks3-server[966]: 2026/09/22 22:23:06 INFO Signed narinfos id=28 count=15527lb # [ 77.785278] niks3-server[966]: 2026/09/22 22:23:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5528lb # [ 77.787133] niks3-server[966]: 2026/09/22 22:23:06 INFO Signed narinfos id=29 count=25529lb # [ 77.789070] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5530worker2 # [ 77.787796] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.079Z level=INFO msg="Uploading 3 narinfos"5531lb # [ 77.792269] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5532lb # [ 77.804199] niks3-server[966]: 2026/09/22 22:23:06 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5533lb # [ 77.810160] niks3-server[966]: 2026/09/22 22:23:06 INFO Completed upload id=285534lb # [ 77.811623] niks3-server[966]: 2026/09/22 22:23:06 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5535lb # [ 77.814485] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5536lb # [ 77.817129] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5537lb # [ 77.818880] niks3-server[966]: 2026/09/22 22:23:06 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5538lb # [ 77.821652] niks3-server[966]: 2026/09/22 22:23:06 INFO Completed upload id=295539worker2 # [ 77.820483] nix-grpc-daemon[923]: time=2026-09-22T22:23:06.112Z level=INFO msg="Upload complete. (218ms)"5540worker2 # [ 77.825832] nix-grpc-daemon[784]: ts=2026-09-22T22:23:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=2 nar_bytes_in=9765541worker2 # [ 77.831385] nix-grpc-daemon[784]: ts=2026-09-22T22:23:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484265542worker2 # [ 77.843139] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5543worker2 # [ 77.855526] nix-daemon[869]: reaped child process 1144, status = succeeded5544worker2 # [ 77.859972] nix-grpc-daemon[784]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5545worker2 # [ 77.866916] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5546client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5547client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5548client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds5549worker2 # [ 78.902673] nix-daemon[869]: reaped child process 1154, status = succeeded5550worker2 # [ 78.985509] nix-daemon[869]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5551worker2 # [ 78.999157] nix-daemon[869]: reaped child process 1173, status = succeeded5552lb # [ 79.006166] niks3-server[966]: 2026/09/22 22:23:07 INFO Received uploads request method=POST path=/api/pending_closures5553worker2 # [ 79.012637] nix-grpc-daemon[923]: time=2026-09-22T22:23:07.304Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5554lb # [ 79.037490] niks3-server[966]: 2026/09/22 22:23:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5555lb # [ 79.043268] niks3-server[966]: 2026/09/22 22:23:07 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5556worker2 # [ 79.047236] nix-grpc-daemon[923]: time=2026-09-22T22:23:07.339Z level=INFO msg="Uploading 1 narinfos"5557lb # [ 79.049212] niks3-server[966]: 2026/09/22 22:23:07 INFO Signed narinfos id=30 count=15558lb # [ 79.055440] niks3-server[966]: 2026/09/22 22:23:07 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5559lb # [ 79.068839] niks3-server[966]: 2026/09/22 22:23:07 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5560worker2 # [ 79.072357] nix-grpc-daemon[923]: time=2026-09-22T22:23:07.364Z level=INFO msg="Upload complete. (195ms)"5561lb # [ 79.074228] niks3-server[966]: 2026/09/22 22:23:07 INFO Completed upload id=305562lb # [ 79.077845] niks3-server[966]: 2026/09/22 22:23:07 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5563worker2 # [ 79.077692] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=15564client # copying 1 paths...5565worker2 # [ 79.086545] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:484265566client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5567worker2 # [ 79.094686] nix-daemon[869]: reaped child process 1151, status = succeeded5568worker1 # [ 79.112365] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:341805569worker1 # [ 79.124466] nix-grpc-daemon[780]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5570worker1 # [ 79.137549] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_out=1205571client # [ 79.216576] nix-daemon[1110]: reaped child process 1196, status = succeeded5572client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.16 seconds)5573client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&25574client # [ 79.320892] nix-daemon[1110]: accepted connection from pid 1215, user root (trusted)5575client # this derivation will be built:5576client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5577worker1 # [ 79.428708] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:341805578client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5579worker2 # [ 79.432349] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484265580worker2 # [ 79.444198] nix-grpc-daemon[923]: time=2026-09-22T22:23:07.736Z level=INFO msg="All 1 paths already cached"5581worker2 # [ 79.458518] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05582worker2 # [ 79.462982] nix-grpc-daemon[784]: ts=2026-09-22T22:23:07Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15583worker1 # [ 79.508245] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805584worker1 # [ 79.521542] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805585client # copying 1 paths to 'lb:50051'...5586client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5587worker1 # [ 79.541253] nix-grpc-daemon[780]: ts=2026-09-22T22:23:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:341805588worker1 # [ 79.553192] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5589worker1 # [ 79.569660] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 1/5)5590worker1 # [ 79.621330] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 2/5)5591worker1 # [ 79.628490] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 114 ms (attempt 3/5)5592worker1 # [ 79.750199] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 772 ms (attempt 4/5)5593worker1 # [ 80.524879] nix-grpc-daemon[780]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5594worker1 # [ 80.528990] nix-grpc-daemon[780]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5595worker1 # [ 80.535713] nix-grpc-daemon[780]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5596worker1 # [ 80.659575] nix-daemon[846]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5597worker1 # [ 80.675469] nix-daemon[846]: reaped child process 1211, status = succeeded5598lb # [ 80.677610] niks3-server[966]: 2026/09/22 22:23:09 INFO Received uploads request method=POST path=/api/pending_closures5599worker1 # [ 80.688322] nix-grpc-daemon[858]: time=2026-09-22T22:23:09.875Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5600worker1 # [ 80.690329] nix-grpc-daemon[858]: time=2026-09-22T22:23:09.877Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5601lb # [ 80.709274] niks3-server[966]: 2026/09/22 22:23:09 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5602lb # [ 80.712714] niks3-server[966]: 2026/09/22 22:23:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5603lb # [ 80.718204] niks3-server[966]: 2026/09/22 22:23:09 INFO Signed narinfos id=31 count=15604worker1 # [ 80.724561] nix-grpc-daemon[858]: time=2026-09-22T22:23:09.911Z level=INFO msg="Uploading 1 narinfos"5605lb # [ 80.728376] niks3-server[966]: 2026/09/22 22:23:09 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5606lb # [ 80.740201] niks3-server[966]: 2026/09/22 22:23:09 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5607worker1 # [ 80.749419] nix-grpc-daemon[858]: time=2026-09-22T22:23:09.936Z level=INFO msg="Upload complete. (195ms)"5608lb # [ 80.747126] niks3-server[966]: 2026/09/22 22:23:09 INFO Completed upload id=315609lb # [ 80.749723] niks3-server[966]: 2026/09/22 22:23:09 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5610worker1 # [ 80.752889] nix-grpc-daemon[780]: ts=2026-09-22T22:23:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 paths=1 nar_bytes_in=5605611worker1 # [ 80.759230] nix-grpc-daemon[780]: ts=2026-09-22T22:23:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:341805612worker1 # [ 80.769108] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5613worker1 # [ 80.773900] nix-daemon[846]: reaped child process 1201, status = succeeded5614worker1 # [ 80.778943] nix-daemon[846]: accepted connection from pid 780, user nix-grpc-daemon (trusted)5615client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5616client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5617client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5618worker1 # [ 81.794415] nix-daemon[846]: reaped child process 1215, status = succeeded5619worker1 # [ 81.868295] nix-daemon[846]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5620worker1 # [ 81.880770] nix-daemon[846]: reaped child process 1234, status = succeeded5621lb # [ 81.886745] niks3-server[966]: 2026/09/22 22:23:10 INFO Received uploads request method=POST path=/api/pending_closures5622worker1 # [ 81.897615] nix-grpc-daemon[858]: time=2026-09-22T22:23:11.084Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5623lb # [ 81.919583] niks3-server[966]: 2026/09/22 22:23:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5624lb # [ 81.924592] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5625lb # [ 81.933125] niks3-server[966]: 2026/09/22 22:23:10 INFO Signed narinfos id=32 count=15626worker1 # [ 81.938574] nix-grpc-daemon[858]: time=2026-09-22T22:23:11.126Z level=INFO msg="Uploading 1 narinfos"5627lb # [ 81.942193] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5628lb # [ 81.955582] niks3-server[966]: 2026/09/22 22:23:10 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5629lb # [ 81.961269] niks3-server[966]: 2026/09/22 22:23:10 INFO Completed upload id=325630worker1 # [ 81.964089] nix-grpc-daemon[858]: time=2026-09-22T22:23:11.151Z level=INFO msg="Upload complete. (178ms)"5631lb # [ 81.963725] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5632client # copying 1 paths...5633worker1 # [ 81.969839] nix-grpc-daemon[780]: ts=2026-09-22T22:23:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=15634worker1 # [ 81.977431] nix-grpc-daemon[780]: ts=2026-09-22T22:23:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:341805635client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5636worker1 # [ 81.987812] nix-daemon[846]: reaped child process 1213, status = succeeded5637worker2 # [ 81.993194] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:484265638worker2 # [ 82.002072] nix-grpc-daemon[784]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5639worker2 # [ 82.014870] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_out=1205640client # [ 82.139811] nix-daemon[1110]: reaped child process 1218, status = succeeded5641client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.92 seconds)5642client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&25643client # [ 82.242081] nix-daemon[1110]: accepted connection from pid 1237, user root (trusted)5644client # this derivation will be built:5645client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5646worker1 # [ 82.351339] nix-grpc-daemon[780]: ts=2026-09-22T22:23:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:341805647client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5648worker1 # [ 82.358768] nix-grpc-daemon[780]: ts=2026-09-22T22:23:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:341805649worker1 # [ 82.367390] nix-grpc-daemon[858]: time=2026-09-22T22:23:11.554Z level=INFO msg="All 1 paths already cached"5650worker2 # [ 82.377905] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05651worker2 # [ 82.383616] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15652worker2 # [ 82.389506] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484265653worker2 # [ 82.401279] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:484265654worker2 # [ 82.415617] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.707Z level=INFO msg="All 1 paths already cached"5655client # copying 1 paths to 'lb:50051'...5656client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5657worker2 # [ 82.424701] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:484265658worker2 # [ 82.435451] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5659worker2 # [ 82.533150] nix-daemon[869]: accepted connection from pid 1182, user nix-grpc-daemon (trusted)5660worker2 # [ 82.547724] nix-daemon[869]: reaped child process 1185, status = succeeded5661lb # [ 82.555722] niks3-server[966]: 2026/09/22 22:23:10 INFO Received uploads request method=POST path=/api/pending_closures5662worker2 # [ 82.564909] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.857Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5663worker2 # [ 82.566843] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.858Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5664lb # [ 82.590708] niks3-server[966]: 2026/09/22 22:23:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5665worker2 # [ 82.598143] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.890Z level=INFO msg="Uploading 1 narinfos"5666lb # [ 82.599678] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5667lb # [ 82.604949] niks3-server[966]: 2026/09/22 22:23:10 INFO Signed narinfos id=33 count=15668lb # [ 82.612643] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5669lb # [ 82.621446] niks3-server[966]: 2026/09/22 22:23:10 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5670lb # [ 82.625795] niks3-server[966]: 2026/09/22 22:23:10 INFO Completed upload id=335671worker2 # [ 82.624432] nix-grpc-daemon[923]: time=2026-09-22T22:23:10.916Z level=INFO msg="Upload complete. (177ms)"5672worker2 # [ 82.629129] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 paths=1 nar_bytes_in=5605673lb # [ 82.634087] niks3-server[966]: 2026/09/22 22:23:10 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5674worker2 # [ 82.634243] nix-grpc-daemon[784]: ts=2026-09-22T22:23:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:484265675worker2 # [ 82.645105] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5676worker2 # [ 82.649423] nix-daemon[869]: reaped child process 1180, status = succeeded5677worker2 # [ 82.654424] nix-daemon[869]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5678client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5679client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5680client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5681worker2 # [ 83.275306] nix-daemon[869]: reaped child process 1189, status = succeeded5682worker2 # [ 83.357571] nix-daemon[869]: accepted connection from pid 1205, user nix-grpc-daemon (trusted)5683worker2 # [ 83.371202] nix-daemon[869]: reaped child process 1208, status = succeeded5684lb # [ 83.379579] niks3-server[966]: 2026/09/22 22:23:11 INFO Received uploads request method=POST path=/api/pending_closures5685worker2 # [ 83.387485] nix-grpc-daemon[923]: time=2026-09-22T22:23:11.679Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5686lb # [ 83.412849] niks3-server[966]: 2026/09/22 22:23:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5687lb # [ 83.420324] niks3-server[966]: 2026/09/22 22:23:11 INFO Signed narinfos id=34 count=15688worker2 # [ 83.421587] nix-grpc-daemon[923]: time=2026-09-22T22:23:11.713Z level=INFO msg="Uploading 1 narinfos"5689lb # [ 83.424645] niks3-server[966]: 2026/09/22 22:23:11 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5690lb # [ 83.427053] niks3-server[966]: 2026/09/22 22:23:11 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5691lb # [ 83.433431] niks3-server[966]: 2026/09/22 22:23:11 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5692lb # [ 83.436563] niks3-server[966]: 2026/09/22 22:23:11 INFO Completed upload id=345693worker2 # [ 83.435283] nix-grpc-daemon[923]: time=2026-09-22T22:23:11.727Z level=INFO msg="Upload complete. (173ms)"5694lb # [ 83.439114] niks3-server[966]: 2026/09/22 22:23:11 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5695worker2 # [ 83.440877] nix-grpc-daemon[784]: ts=2026-09-22T22:23:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48426 duration_s=0 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=15696client # copying 1 paths...5697worker2 # [ 83.451516] nix-daemon[869]: reaped child process 1187, status = succeeded5698worker1 # [ 83.456109] nix-grpc-daemon[780]: ts=2026-09-22T22:23:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:341805699worker1 # [ 83.464543] nix-grpc-daemon[780]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5700client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5701worker1 # [ 83.489844] nix-grpc-daemon[780]: ts=2026-09-22T22:23:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:341805702worker1 # [ 83.495242] nix-grpc-daemon[780]: ts=2026-09-22T22:23:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34180 duration_s=0 paths=1 nar_bytes_out=1205703client # [ 83.615567] nix-daemon[1110]: reaped child process 1240, status = succeeded5704client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.48 seconds)5705(finished: subtest: an input only one worker has still reaches the builder, in 7.03 seconds)5706subtest: upload whose reference the worker lacks is completed from the cache5707client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache5708client # this derivation will be built:5709client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5710client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5711client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.25 seconds)5712client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache5713client # this derivation will be built:5714client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5715client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5716client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.24 seconds)5717client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5718client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.10 seconds)5719worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5720worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds)5721worker2 # [ 84.374584] systemd[1]: Stopping Nix worker-protocol over gRPC...5722worker2 # [ 84.420139] nix-grpc-daemon[784]: ts=2026-09-22T22:23:12Z level=info event=signal_exit5723lb # [ 84.984794] niks3-server[966]: 2026/09/22 22:23:13 INFO lead: released remote=192.168.1.4:533665724lb # [ 85.183325] envoy[904]: conn peer=[2001:db8:1::1]:51540 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4312 tx=2370 ms=12285725lb # [ 85.187380] envoy[904]: conn peer=[2001:db8:1::1]:51556 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=555726lb # [ 85.190766] envoy[904]: conn peer=[2001:db8:1::1]:51568 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=385727lb # [ 85.194184] envoy[904]: conn peer=[2001:db8:1::1]:51558 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3868 tx=2068 ms=18685728lb # [ 85.197646] envoy[904]: conn peer=[2001:db8:1::1]:51582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3745 tx=2121 ms=26435729lb # [ 85.201127] envoy[904]: conn peer=[2001:db8:1::1]:51588 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=745730lb # [ 85.204550] envoy[904]: conn peer=[2001:db8:1::1]:51598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3730 tx=2082 ms=11955731lb # [ 85.207965] envoy[904]: conn peer=[2001:db8:1::1]:37582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=575732worker1 # [ 85.990949] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_restarting addr=lb:500515733worker2 # [ 85.988444] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=scheduler_restarting5734worker2 # [ 85.991976] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:484145735worker2 # [ 85.997610] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=worker_gone addr=192.168.1.4:500515736worker2 # [ 86.000859] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=scheduler_restarting addr=lb:500515737worker2 # [ 86.004207] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:484145738worker2 # [ 86.007817] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=worker_gone addr=192.168.1.3:500515739worker2 # [ 86.028953] nix-daemon[869]: reaped child process 872, status = succeeded5740worker1 # [ 86.191366] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_connected addr=lb:500515741worker1 # [ 86.195592] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5742worker2 # [ 86.199613] nix-grpc-daemon[784]: ts=2026-09-22T22:23:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5743worker1 # [ 86.396569] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_connected addr=lb:500515744worker1 # [ 86.400579] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5745worker2 # [ 86.566264] nix-grpc-daemon[784]: E0000 00:00:1790115794.858404 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true5746worker2 # [ 86.572110] nix-grpc-daemon[784]: E0000 00:00:1790115794.859010 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5747worker1 # [ 86.601429] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_connected addr=lb:500515748worker1 # [ 86.605493] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5749worker1 # [ 86.806483] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_connected addr=lb:500515750worker1 # [ 86.810483] nix-grpc-daemon[780]: ts=2026-09-22T22:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5751worker1 # [ 87.012243] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_connected addr=lb:500515752worker1 # [ 87.016153] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5753worker1 # [ 87.217428] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_connected addr=lb:500515754worker1 # [ 87.221375] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5755worker1 # [ 87.422137] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_connected addr=lb:500515756worker1 # [ 87.426190] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5757worker2 # [ 87.620986] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5758worker1 # [ 87.627061] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_connected addr=lb:500515759worker2 # [ 87.624955] systemd[1]: Stopped Nix worker-protocol over gRPC.5760worker1 # [ 87.631122] nix-grpc-daemon[780]: ts=2026-09-22T22:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5761worker2 # [ 87.628990] systemd[1]: nix-grpc-daemon.service: Consumed 1.928s CPU time over 1min 12.361s wall clock time, 63.8M memory peak, 87.5K incoming IP traffic, 236.6K outgoing IP traffic.5762worker2 # [ 87.642449] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5763worker2 # [ 87.646923] systemd[1]: Closed Nix worker-protocol over gRPC.5764worker2 # [ 87.650670] systemd[1]: nix-grpc-daemon.socket: Consumed 291us CPU time over 1min 19.784s wall clock time, 256K memory peak, 104.7K incoming IP traffic, 87K outgoing IP traffic.5765lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5766lb: must succeed: curl -sf localhost:9901/clusters5767lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5768lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds)5769client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25770worker1 # [ 87.831939] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:500515771worker1 # [ 87.836175] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5772worker1 # [ 87.855832] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:341805773client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5774worker1 # [ 87.860923] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:341805775client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.17 seconds)5776worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5777worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5778worker2 # [ 87.939346] systemd[1]: Listening on Nix worker-protocol over gRPC.5779worker1 # [ 87.996145] systemd[1]: Stopping Nix worker-protocol over gRPC...5780worker1 # [ 88.037649] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:500515781worker1 # [ 88.041415] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5782worker1 # [ 88.242411] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:500515783worker1 # [ 88.246505] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5784worker1 # [ 88.384718] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=signal_exit5785worker1 # [ 88.447282] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:500515786worker1 # [ 88.451198] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5787worker2 # [ 88.616178] systemd[1]: Starting scheduler-token.service...5788worker1 # [ 88.651946] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:500515789worker1 # [ 88.655850] nix-grpc-daemon[780]: ts=2026-09-22T22:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5790worker2 # [ 88.676154] systemd[1]: scheduler-token.service: Deactivated successfully.5791worker2 # [ 88.679308] systemd[1]: Finished scheduler-token.service.5792worker2 # [ 88.682114] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 62ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5793worker2 # [ 88.692102] systemd[1]: Starting Nix worker-protocol over gRPC...5794worker2 # [ 88.769352] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5795worker2 # [ 88.771342] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5796worker2 # [ 88.774434] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15797worker2 # [ 88.778651] nix-grpc-daemon[1232]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5798worker2 # [ 88.779982] nix-grpc-daemon[1232]: E0000 00:00:1790115797.070898 1232 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5799worker2 # [ 88.785504] nix-grpc-daemon[1232]: E0000 00:00:1790115797.076168 1232 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5800worker2 # [ 88.789986] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5801worker2 # [ 88.791683] systemd[1]: Started Nix worker-protocol over gRPC.5802worker2 # [ 88.797070] nix-grpc-daemon[1232]: E0000 00:00:1790115797.089123 1274 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5803lb # [ 88.801541] niks3-server[966]: 2026/09/22 22:23:17 INFO lead: acquired remote=192.168.1.4:432285804worker2 # [ 88.802055] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=scheduler_take_over5805worker2 # [ 88.812052] nix-grpc-daemon[1232]: E0000 00:00:1790115797.104451 1274 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5806worker2 # [ 88.816052] nix-grpc-daemon[1232]: E0000 00:00:1790115797.106741 1274 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5807worker2 # [ 88.826193] nix-grpc-daemon[1232]: E0000 00:00:1790115797.118627 1274 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5808worker2 # [ 88.835385] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=scheduler_connected addr=lb:500515809worker2 # [ 88.842062] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=oidc_jwks provider=mock keys=15810worker2 # [ 88.843534] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:547545811worker2 # [ 88.845181] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05812worker2 # [ 88.853379] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:547545813worker1 # [ 88.856722] nix-grpc-daemon[780]: ts=2026-09-22T22:23:18Z level=info event=scheduler_connected addr=lb:500515814worker2 # [ 88.854882] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05815worker2 # [ 89.988954] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:547545816worker2 # [ 89.992650] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:18Z level=info event=worker_gone addr=192.168.1.3:500515817worker1 # [ 89.994576] nix-grpc-daemon[780]: ts=2026-09-22T22:23:19Z level=info event=scheduler_restarting5818worker1 # [ 90.009871] nix-grpc-daemon[780]: ts=2026-09-22T22:23:19Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5819worker1 # [ 90.030224] nix-daemon[846]: reaped child process 848, status = succeeded5820worker1 # [ 90.556351] nix-grpc-daemon[780]: E0000 00:00:1790115799.743473 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true5821worker1 # [ 90.562463] nix-grpc-daemon[780]: E0000 00:00:1790115799.749545 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5822worker1 # [ 91.583934] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5823worker1 # [ 91.587442] systemd[1]: Stopped Nix worker-protocol over gRPC.5824worker1 # [ 91.592187] systemd[1]: nix-grpc-daemon.service: Consumed 2.527s CPU time over 1min 16.398s wall clock time, 65.8M memory peak, 107.2K incoming IP traffic, 199.9K outgoing IP traffic.5825worker1 # [ 91.604431] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5826worker1 # [ 91.609190] systemd[1]: Closed Nix worker-protocol over gRPC.5827worker1 # [ 91.612975] systemd[1]: nix-grpc-daemon.socket: Consumed 316us CPU time over 1min 24.081s wall clock time, 256K memory peak, 100.6K incoming IP traffic, 87.1K outgoing IP traffic.5828lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5829lb: must succeed: curl -sf localhost:9901/clusters5830lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5831lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.05 seconds)5832client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25833worker2 # [ 91.814461] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547585834worker2 # [ 91.826066] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)5835worker2 # [ 91.842459] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 1/5)5836worker2 # [ 91.863605] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 2/5)5837worker2 # [ 91.953235] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 3/5)5838worker2 # [ 92.111625] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 4/5)5839worker2 # [ 92.174670] nix-grpc-daemon[1232]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5840worker2 # [ 92.178254] nix-grpc-daemon[1232]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5841client # copying 2 paths...5842client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5843worker2 # [ 92.200146] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547585844client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5845worker2 # [ 92.212164] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)5846worker2 # [ 92.235394] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:20Z level=info event=niks3_push_started pid=12935847worker2 # [ 92.336765] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.628Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""5848worker2 # [ 92.422219] nix-daemon[869]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)5849worker2 # [ 92.436622] nix-daemon[869]: reaped child process 1309, status = succeeded5850lb # [ 92.444345] niks3-server[966]: 2026/09/22 22:23:20 INFO Received uploads request method=POST path=/api/pending_closures5851lb # [ 92.454732] niks3-server[966]: 2026/09/22 22:23:20 INFO Received uploads request method=POST path=/api/pending_closures5852worker2 # [ 92.461034] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.753Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5853worker2 # [ 92.462585] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.755Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5854worker2 # [ 92.464431] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.756Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5855lb # [ 92.500052] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5856lb # [ 92.522863] niks3-server[966]: 2026/09/22 22:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5857lb # [ 92.530839] niks3-server[966]: 2026/09/22 22:23:20 INFO Signed narinfos id=35 count=15858lb # [ 92.532854] niks3-server[966]: 2026/09/22 22:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5859lb # [ 92.534765] niks3-server[966]: 2026/09/22 22:23:20 INFO Signed narinfos id=36 count=25860lb # [ 92.536415] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5861worker2 # [ 92.534136] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.825Z level=INFO msg="Uploading 3 narinfos"5862lb # [ 92.542969] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5863lb # [ 92.546254] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5864lb # [ 92.554841] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5865lb # [ 92.558876] niks3-server[966]: 2026/09/22 22:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5866lb # [ 92.565726] niks3-server[966]: 2026/09/22 22:23:20 INFO Completed upload id=355867lb # [ 92.567269] niks3-server[966]: 2026/09/22 22:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5868lb # [ 92.570536] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5869lb # [ 92.575369] niks3-server[966]: 2026/09/22 22:23:20 INFO Completed upload id=365870worker2 # [ 92.573130] nix-grpc-daemon[1293]: time=2026-09-22T22:23:20.865Z level=INFO msg="Upload complete. (232ms)"5871lb # [ 92.580183] niks3-server[966]: 2026/09/22 22:23:20 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5872worker2 # [ 92.578862] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 paths=2 nar_bytes_in=3125873worker2 # [ 92.592794] nix-daemon[869]: reaped child process 1291, status = succeeded5874client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 0.94 seconds)5875worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5876worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5877worker1 # [ 92.685711] systemd[1]: Listening on Nix worker-protocol over gRPC.5878worker1 # [ 92.694421] systemd[1]: Starting Nix worker-protocol over gRPC...5879worker1 # [ 92.777223] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:21Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5880worker1 # [ 92.779505] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5881worker1 # [ 92.783444] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15882worker1 # [ 92.788148] nix-grpc-daemon[1258]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5883worker1 # [ 92.789685] nix-grpc-daemon[1258]: E0000 00:00:1790115801.974765 1258 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5884worker1 # [ 92.796891] nix-grpc-daemon[1258]: E0000 00:00:1790115801.980594 1258 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5885worker1 # [ 92.801382] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5886worker1 # [ 92.805620] systemd[1]: Started Nix worker-protocol over gRPC.5887worker1 # [ 92.807157] nix-grpc-daemon[1258]: E0000 00:00:1790115801.991431 1301 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5888worker1 # [ 92.820099] nix-grpc-daemon[1258]: E0000 00:00:1790115802.006341 1301 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5889worker1 # [ 92.824133] nix-grpc-daemon[1258]: E0000 00:00:1790115802.006648 1301 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5890lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5891lb: must succeed: curl -sf localhost:9901/clusters5892worker1 # [ 92.834428] nix-grpc-daemon[1258]: E0000 00:00:1790115802.021930 1301 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5893worker1 # [ 92.847950] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:22Z level=info event=scheduler_connected addr=lb:500515894worker2 # [ 92.846701] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:21Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:547545895worker2 # [ 92.850437] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05896lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5897lb: must succeed: curl -sf localhost:9901/clusters5898lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5899lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds)5900(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.31 seconds)5901subtest: a niks3 restart does not cost the leader its role5902lb: must succeed: curl -sf localhost:9901/clusters5903lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5904lb: must succeed: curl -sf localhost:9901/clusters5905lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5906lb # [ 93.998336] systemd[1]: Stopping niks3 server...5907lb # [ 94.000368] niks3-server[966]: 2026/09/22 22:23:22 INFO Shutdown signal received, draining in-flight requests timeout=10s5908worker1 # [ 94.004219] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:23Z level=info event=scheduler_lock_lost status=2005909lb # [ 94.004438] niks3-server[966]: 2026/09/22 22:23:22 INFO lead: released remote=192.168.1.4:432285910worker2 # [ 94.004137] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:22Z level=info event=scheduler_lock_lost status=2005911lb # [ 94.018714] systemd[1]: niks3.service: Deactivated successfully.5912lb # [ 94.020250] systemd[1]: Stopped niks3 server.5913lb # [ 94.021203] systemd[1]: niks3.service: Consumed 753ms CPU time over 1min 15.260s wall clock time, 28.9M memory peak, 97.6K incoming IP traffic, 140.2K outgoing IP traffic.5914lb # [ 94.028252] systemd[1]: Starting niks3 server...5915lb # [ 94.076352] niks3-server[1108]: 2026/09/22 22:23:22 goose: no migrations to run. current version: 202609200000005916lb # [ 94.082778] niks3-server[1108]: 2026/09/22 22:23:22 OK 1_commit_pending_closure.sql (4.52ms)5917lb # [ 94.086463] niks3-server[1108]: 2026/09/22 22:23:22 OK 2_object_stats_trigger.sql (3.3ms)5918lb # [ 94.087543] niks3-server[1108]: 2026/09/22 22:23:22 goose: up to current file version: 25919lb # [ 94.088845] niks3-server[1108]: 2026/09/22 22:23:22 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key5920lb # [ 94.099404] niks3-server[1108]: 2026/09/22 22:23:22 INFO Read proxy enabled — serving cache objects from S35921lb # [ 94.101198] niks3-server[1108]: 2026/09/22 22:23:22 INFO Using socket-activated listener address=0.0.0.0:57515922lb # [ 94.103407] systemd[1]: Started niks3 server.5923lb # [ 94.104137] niks3-server[1108]: 2026/09/22 22:23:22 INFO systemd watchdog enabled interval=15s5924lb # [ 94.105312] niks3-server[1108]: 2026/09/22 22:23:22 INFO Starting HTTP server address=0.0.0.0:57515925lb: waiting for unit niks3.service5926lb: (finished: waiting for unit niks3.service, in 0.02 seconds)5927lb: must succeed: curl -sf localhost:9901/clusters5928lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5929worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5930worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5931lb: must succeed: curl -sf localhost:9901/clusters5932lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5933lb: must succeed: curl -sf localhost:9901/clusters5934lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5935worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5936worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.05 seconds)5937client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&25938worker2 # [ 94.432488] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:547585939client # don't know how to build these paths:5940client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv5941worker1 # [ 94.449939] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440905942worker1 # [ 94.462671] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)5943worker1 # [ 94.479142] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5)5944worker1 # [ 94.570872] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 2/5)5945worker1 # [ 94.613787] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 119 ms (attempt 3/5)5946worker1 # [ 94.735193] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 401 ms (attempt 4/5)5947lb # [ 95.010277] niks3-server[1108]: 2026/09/22 22:23:23 INFO lead: acquired remote=192.168.1.4:577105948worker1 # [ 95.139956] nix-grpc-daemon[1258]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5949worker1 # [ 95.144085] nix-grpc-daemon[1258]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5950worker2 # [ 95.179949] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=05951lb # [ 95.184061] envoy[904]: conn peer=[2001:db8:1::4]:34632 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=59481 tx=3132 ms=707465952worker2 # [ 95.184083] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=15953lb # [ 95.187901] envoy[904]: conn peer=[2001:db8:1::1]:37598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=145954lb # [ 95.191469] envoy[904]: conn peer=[2001:db8:1::3]:39502 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=19017 tx=3803 ms=745865955lb # [ 95.195194] envoy[904]: conn peer=[2001:db8:1::1]:37614 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1009 tx=282 ms=7815956worker2 # [ 95.223205] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547585957worker2 # [ 95.237399] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547585958client # copying 1 paths to 'lb:50051'...5959client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'...5960worker2 # [ 95.250613] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547585961worker2 # [ 95.261850] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)5962worker2 # [ 95.365848] nix-daemon[869]: accepted connection from pid 1328, user nix-grpc-daemon (trusted)5963worker2 # [ 95.379349] nix-daemon[869]: reaped child process 1331, status = succeeded5964lb # [ 95.387648] niks3-server[1108]: 2026/09/22 22:23:23 INFO Received uploads request method=POST path=/api/pending_closures5965worker2 # [ 95.401213] nix-grpc-daemon[1293]: time=2026-09-22T22:23:23.693Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5966worker2 # [ 95.403371] nix-grpc-daemon[1293]: time=2026-09-22T22:23:23.695Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)"5967lb # [ 95.427308] niks3-server[1108]: 2026/09/22 22:23:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5968lb # [ 95.452870] niks3-server[1108]: 2026/09/22 22:23:23 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls5969lb # [ 95.460021] niks3-server[1108]: 2026/09/22 22:23:23 INFO Signed narinfos id=37 count=15970worker2 # [ 95.462271] nix-grpc-daemon[1293]: time=2026-09-22T22:23:23.753Z level=INFO msg="Uploading 1 narinfos"5971lb # [ 95.468530] niks3-server[1108]: 2026/09/22 22:23:23 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst5972lb # [ 95.473158] niks3-server[1108]: 2026/09/22 22:23:23 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5973lb # [ 95.480187] niks3-server[1108]: 2026/09/22 22:23:23 INFO Completed upload id=375974worker2 # [ 95.478872] nix-grpc-daemon[1293]: time=2026-09-22T22:23:23.771Z level=INFO msg="Upload complete. (205ms)"5975lb # [ 95.483648] niks3-server[1108]: 2026/09/22 22:23:23 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo5976worker2 # [ 95.483740] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 paths=1 nar_bytes_in=5365977worker2 # [ 95.490986] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547585978worker2 # [ 95.503115] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)5979worker2 # [ 95.513220] nix-daemon[869]: reaped child process 1326, status = succeeded5980worker2 # [ 95.517944] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)5981client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051...5982client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv5983client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5984client # farm-a> LOG-farm-a-after-niks3-restart5985worker2 # [ 96.130533] nix-daemon[869]: reaped child process 1335, status = succeeded5986worker2 # [ 96.209480] nix-daemon[869]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5987worker2 # [ 96.222694] nix-daemon[869]: reaped child process 1354, status = succeeded5988lb # [ 96.231628] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received uploads request method=POST path=/api/pending_closures5989worker2 # [ 96.243068] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.534Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5990worker2 # [ 96.244529] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.534Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)"5991lb # [ 96.271342] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5992worker2 # [ 96.276977] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.569Z level=INFO msg="Uploading 1 narinfos"5993lb # [ 96.279161] niks3-server[1108]: 2026/09/22 22:23:24 INFO Signed narinfos id=38 count=15994lb # [ 96.293982] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv5995lb # [ 96.300109] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5996lb # [ 96.306252] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls5997lb # [ 96.310330] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5998lb # [ 96.317904] niks3-server[1108]: 2026/09/22 22:23:24 INFO Completed upload id=385999lb # [ 96.319187] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo6000worker2 # [ 96.316648] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.609Z level=INFO msg="Upload complete. (192ms)"6001worker2 # [ 96.323692] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=16002worker2 # [ 96.337623] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=06003worker2 # [ 96.342564] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=16004worker2 # [ 96.350480] nix-daemon[869]: reaped child process 1333, status = succeeded6005worker2 # [ 96.382813] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547586006worker2 # [ 96.395242] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547586007worker2 # [ 96.409684] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.701Z level=INFO msg="All 1 paths already cached"6008client # copying 1 paths to 'lb:50051'...6009client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'...6010worker2 # [ 96.418880] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547586011worker2 # [ 96.429181] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)6012worker2 # [ 96.527253] nix-daemon[869]: accepted connection from pid 1360, user nix-grpc-daemon (trusted)6013worker2 # [ 96.540899] nix-daemon[869]: reaped child process 1363, status = succeeded6014lb # [ 96.550761] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received uploads request method=POST path=/api/pending_closures6015worker2 # [ 96.559618] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.852Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6016worker2 # [ 96.561138] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.853Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)"6017lb # [ 96.584991] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst6018lb # [ 96.593917] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6019lb # [ 96.598821] niks3-server[1108]: 2026/09/22 22:23:24 INFO Signed narinfos id=39 count=16020worker2 # [ 96.600284] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.892Z level=INFO msg="Uploading 1 narinfos"6021lb # [ 96.610492] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls6022lb # [ 96.619301] niks3-server[1108]: 2026/09/22 22:23:24 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6023lb # [ 96.626281] niks3-server[1108]: 2026/09/22 22:23:24 INFO Completed upload id=396024worker2 # [ 96.625057] nix-grpc-daemon[1293]: time=2026-09-22T22:23:24.917Z level=INFO msg="Upload complete. (185ms)"6025lb # [ 96.629069] niks3-server[1108]: 2026/09/22 22:23:24 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo6026worker2 # [ 96.629674] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 paths=1 nar_bytes_in=6566027worker2 # [ 96.635896] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547586028worker2 # [ 96.649110] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)6029worker2 # [ 96.655913] nix-daemon[869]: reaped child process 1358, status = succeeded6030worker2 # [ 96.660411] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)6031client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051...6032client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv6033client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6034client # farm-b> LOG-farm-b-after-niks3-restart6035worker2 # [ 97.703968] nix-daemon[869]: reaped child process 1367, status = succeeded6036worker2 # [ 97.782347] nix-daemon[869]: accepted connection from pid 1383, user nix-grpc-daemon (trusted)6037worker2 # [ 97.796223] nix-daemon[869]: reaped child process 1386, status = succeeded6038lb # [ 97.805877] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received uploads request method=POST path=/api/pending_closures6039worker2 # [ 97.813301] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.105Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6040worker2 # [ 97.814795] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.107Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)"6041lb # [ 97.850182] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv6042lb # [ 97.853629] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6043worker2 # [ 97.858522] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.150Z level=INFO msg="Uploading 1 narinfos"6044lb # [ 97.859901] niks3-server[1108]: 2026/09/22 22:23:26 INFO Signed narinfos id=40 count=16045lb # [ 97.869535] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst6046lb # [ 97.878209] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls6047lb # [ 97.881938] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6048lb # [ 97.889372] niks3-server[1108]: 2026/09/22 22:23:26 INFO Completed upload id=406049worker2 # [ 97.888158] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.180Z level=INFO msg="Upload complete. (220ms)"6050lb # [ 97.892791] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo6051worker2 # [ 97.894600] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=16052worker2 # [ 97.904569] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=06053worker2 # [ 97.908208] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=16054worker2 # [ 97.917618] nix-daemon[869]: reaped child process 1365, status = succeeded6055worker2 # [ 97.949185] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547586056worker2 # [ 97.961400] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:547586057worker2 # [ 97.975233] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.267Z level=INFO msg="All 2 paths already cached"6058client # copying 1 paths to 'lb:50051'...6059client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'...6060worker2 # [ 97.984681] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:547586061worker2 # [ 97.995137] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)6062worker2 # [ 98.091839] nix-daemon[869]: accepted connection from pid 1392, user nix-grpc-daemon (trusted)6063worker2 # [ 98.104953] nix-daemon[869]: reaped child process 1395, status = succeeded6064lb # [ 98.114775] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received uploads request method=POST path=/api/pending_closures6065worker2 # [ 98.121339] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.413Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6066worker2 # [ 98.122809] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.415Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)"6067lb # [ 98.147265] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls6068lb # [ 98.154453] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6069lb # [ 98.159240] niks3-server[1108]: 2026/09/22 22:23:26 INFO Signed narinfos id=41 count=16070worker2 # [ 98.160436] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.452Z level=INFO msg="Uploading 1 narinfos"6071lb # [ 98.169385] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst6072lb # [ 98.180561] niks3-server[1108]: 2026/09/22 22:23:26 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6073lb # [ 98.183324] niks3-server[1108]: 2026/09/22 22:23:26 INFO Completed upload id=416074worker2 # [ 98.181755] nix-grpc-daemon[1293]: time=2026-09-22T22:23:26.474Z level=INFO msg="Upload complete. (175ms)"6075lb # [ 98.186052] niks3-server[1108]: 2026/09/22 22:23:26 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo6076worker2 # [ 98.185809] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 paths=1 nar_bytes_in=7846077worker2 # [ 98.190543] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:547586078worker2 # [ 98.200483] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)6079worker2 # [ 98.205519] nix-daemon[869]: reaped child process 1390, status = succeeded6080worker2 # [ 98.210347] nix-daemon[869]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)6081client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051...6082client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv6083client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6084client # farm-top> LOG-farm-top-after-niks3-restart6085worker2 # [ 98.849278] nix-daemon[869]: reaped child process 1399, status = succeeded6086worker2 # [ 98.929609] nix-daemon[869]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)6087worker2 # [ 98.941297] nix-daemon[869]: reaped child process 1418, status = succeeded6088lb # [ 98.951481] niks3-server[1108]: 2026/09/22 22:23:27 INFO Received uploads request method=POST path=/api/pending_closures6089worker2 # [ 98.959456] nix-grpc-daemon[1293]: time=2026-09-22T22:23:27.251Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6090worker2 # [ 98.960921] nix-grpc-daemon[1293]: time=2026-09-22T22:23:27.253Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)"6091lb # [ 98.993621] niks3-server[1108]: 2026/09/22 22:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6092worker2 # [ 98.998322] nix-grpc-daemon[1293]: time=2026-09-22T22:23:27.290Z level=INFO msg="Uploading 1 narinfos"6093lb # [ 98.999610] niks3-server[1108]: 2026/09/22 22:23:27 INFO Signed narinfos id=42 count=16094lb # [ 99.006647] niks3-server[1108]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst6095lb # [ 99.012232] niks3-server[1108]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv6096lb # [ 99.015994] niks3-server[1108]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls6097lb # [ 99.021967] niks3-server[1108]: 2026/09/22 22:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6098lb # [ 99.025246] niks3-server[1108]: 2026/09/22 22:23:27 INFO Completed upload id=426099lb # [ 99.027503] niks3-server[1108]: 2026/09/22 22:23:27 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo6100worker2 # [ 99.025250] nix-grpc-daemon[1293]: time=2026-09-22T22:23:27.317Z level=INFO msg="Upload complete. (208ms)"6101worker2 # [ 99.031616] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54758 duration_s=0 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=16102worker2 # [ 99.046673] nix-daemon[869]: reaped child process 1397, status = succeeded6103client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 4.79 seconds)6104client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath6105client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.12 seconds)6106(finished: subtest: a niks3 restart does not cost the leader its role, in 5.26 seconds)6107subtest: scheduler down: the other node takes the lock and keeps it6108lb: must succeed: curl -sf localhost:9901/clusters6109lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6110lb: must succeed: curl -sf localhost:9901/clusters6111lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6112lb: must succeed: curl -sf localhost:9901/clusters6113lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6114lb: must succeed: curl -sf localhost:9901/clusters6115lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6116worker2 # [ 99.341586] systemd[1]: Stopping Nix worker-protocol over gRPC...6117worker2 # [ 99.792285] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:28Z level=info event=signal_exit6118lb # [ 100.011465] niks3-server[1108]: 2026/09/22 22:23:28 INFO lead: released remote=192.168.1.4:577106119worker1 # [ 101.018448] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_restarting addr=lb:500516120worker2 # [ 101.016744] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=scheduler_restarting6121worker2 # [ 101.020840] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=scheduler_restarting addr=lb:500516122worker2 # [ 101.023995] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:547546123worker2 # [ 101.027846] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=worker_gone addr=192.168.1.3:500516124worker2 # [ 101.031107] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:547546125worker2 # [ 101.035823] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=worker_gone addr=192.168.1.4:500516126worker2 # [ 101.053123] nix-daemon[869]: reaped child process 1285, status = succeeded6127worker1 # [ 101.217857] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_connected addr=lb:500516128worker1 # [ 101.222358] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6129worker2 # [ 101.227490] nix-grpc-daemon[1232]: ts=2026-09-22T22:23:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6130worker1 # [ 101.423118] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_connected addr=lb:500516131worker1 # [ 101.427352] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6132worker1 # [ 101.627802] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_connected addr=lb:500516133worker1 # [ 101.631802] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6134worker1 # [ 101.832613] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:500516135worker1 # [ 101.836690] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6136worker2 # [ 101.832803] nix-grpc-daemon[1232]: E0000 00:00:1790115810.125004 1278 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true6137worker2 # [ 101.838384] nix-grpc-daemon[1232]: E0000 00:00:1790115810.130333 1278 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6138worker1 # [ 102.038557] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:500516139worker1 # [ 102.042500] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6140worker2 # [ 102.215261] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6141worker2 # [ 102.216873] systemd[1]: Stopped Nix worker-protocol over gRPC.6142worker2 # [ 102.219439] systemd[1]: nix-grpc-daemon.service: Consumed 891ms CPU time over 13.525s wall clock time, 37.5M memory peak, 45.2K incoming IP traffic, 79.4K outgoing IP traffic.6143worker2 # [ 102.225311] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.6144worker2 # [ 102.227588] systemd[1]: Closed Nix worker-protocol over gRPC.6145worker2 # [ 102.229182] systemd[1]: nix-grpc-daemon.socket: Consumed 514us CPU time over 14.293s wall clock time, 256K memory peak, 37.5K incoming IP traffic, 27.5K outgoing IP traffic.6146worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over6147worker1 # [ 102.244536] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:500516148worker1 # [ 102.248631] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6149worker1 # [ 102.449481] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:500516150worker1 # [ 102.453726] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6151worker1 # [ 102.654546] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_connected addr=lb:500516152worker1 # [ 102.658792] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6153worker1 # [ 102.859615] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:500516154worker1 # [ 102.863736] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6155worker1 # [ 103.065499] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:500516156worker1 # [ 103.069496] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6157worker1 # [ 103.270399] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:500516158worker1 # [ 103.274579] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6159worker1 # [ 103.475467] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:500516160worker1 # [ 103.479588] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6161worker1 # [ 103.680447] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_connected addr=lb:500516162worker1 # [ 103.684519] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6163worker1 # [ 103.885347] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:500516164worker1 # [ 103.889475] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6165worker1 # [ 104.091327] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:500516166worker1 # [ 104.095499] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6167worker1 # [ 104.296808] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:500516168worker1 # [ 104.300758] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6169worker1 # [ 104.501702] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:500516170worker1 # [ 104.505768] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6171worker1 # [ 104.706559] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_connected addr=lb:500516172worker1 # [ 104.711229] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6173worker1 # [ 104.911728] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:500516174worker1 # [ 104.916366] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6175lb # [ 105.008417] niks3-server[1108]: 2026/09/22 22:23:33 INFO lead: acquired remote=192.168.1.3:375726176worker1 # [ 105.010741] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_take_over6177worker1 # [ 105.117987] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:500516178worker1 # [ 105.122425] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6179lb # [ 105.184469] envoy[904]: conn peer=[2001:db8:1::1]:46574 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9692 tx=4404 ms=46156180lb # [ 105.188278] envoy[904]: conn peer=[2001:db8:1::4]:58286 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1755 tx=425 ms=123856181worker1 # [ 105.323498] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:500516182worker1 # [ 105.328166] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6183worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 3.23 seconds)6184worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6185worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds)6186worker1 # [ 105.528678] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:500516187worker1 # [ 105.532794] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6188worker1 # [ 105.733747] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=scheduler_connected addr=lb:500516189worker1 # [ 105.742126] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:444246190worker1 # [ 105.746442] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06191worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6192worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6193client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&26194worker1 # [ 106.671425] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:440906195client # don't know how to build these paths:6196client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6197worker1 # [ 106.680986] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440906198worker1 # [ 106.704894] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=06199worker1 # [ 106.710988] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=16200worker1 # [ 106.754795] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440906201worker1 # [ 106.768799] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440906202client # copying 1 paths to 'lb:50051'...6203client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...6204worker1 # [ 106.782257] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440906205worker1 # [ 106.794177] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6206worker1 # [ 106.816166] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:36Z level=info event=niks3_push_started pid=13536207worker1 # [ 106.916576] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.103Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""6208worker1 # [ 107.002150] nix-daemon[846]: accepted connection from pid 1365, user nix-grpc-daemon (trusted)6209worker1 # [ 107.014414] nix-daemon[846]: reaped child process 1368, status = succeeded6210lb # [ 107.020709] niks3-server[1108]: 2026/09/22 22:23:35 INFO Received uploads request method=POST path=/api/pending_closures6211worker1 # [ 107.031779] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.219Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6212worker1 # [ 107.033517] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.221Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"6213lb # [ 107.063415] niks3-server[1108]: 2026/09/22 22:23:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6214lb # [ 107.071189] niks3-server[1108]: 2026/09/22 22:23:35 INFO Signed narinfos id=43 count=16215worker1 # [ 107.077845] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.264Z level=INFO msg="Uploading 1 narinfos"6216lb # [ 107.078480] niks3-server[1108]: 2026/09/22 22:23:35 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst6217lb # [ 107.098947] niks3-server[1108]: 2026/09/22 22:23:35 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6218lb # [ 107.106108] niks3-server[1108]: 2026/09/22 22:23:35 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls6219lb # [ 107.110157] niks3-server[1108]: 2026/09/22 22:23:35 INFO Completed upload id=436220worker1 # [ 107.113085] nix-grpc-daemon[1353]: time=2026-09-22T22:23:36.300Z level=INFO msg="Upload complete. (193ms)"6221lb # [ 107.112254] niks3-server[1108]: 2026/09/22 22:23:35 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo6222worker1 # [ 107.117936] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=0 paths=1 nar_bytes_in=5206223worker1 # [ 107.124256] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440906224worker1 # [ 107.134831] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6225worker1 # [ 107.141774] nix-daemon[846]: reaped child process 1351, status = succeeded6226worker1 # [ 107.147085] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6227client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...6228client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv6229client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6230client # farm-a> LOG-farm-a-on-standby6231worker1 # [ 108.186579] nix-daemon[846]: reaped child process 1372, status = succeeded6232worker1 # [ 108.272310] nix-daemon[846]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)6233worker1 # [ 108.285097] nix-daemon[846]: reaped child process 1391, status = succeeded6234lb # [ 108.288336] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received uploads request method=POST path=/api/pending_closures6235worker1 # [ 108.299905] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.487Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6236worker1 # [ 108.303954] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.489Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"6237lb # [ 108.328590] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv6238lb # [ 108.335930] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst6239lb # [ 108.346264] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6240lb # [ 108.353598] niks3-server[1108]: 2026/09/22 22:23:36 INFO Signed narinfos id=44 count=16241worker1 # [ 108.356675] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.543Z level=INFO msg="Uploading 1 narinfos"6242lb # [ 108.360132] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls6243lb # [ 108.368716] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6244lb # [ 108.371738] niks3-server[1108]: 2026/09/22 22:23:36 INFO Completed upload id=446245worker1 # [ 108.374617] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.562Z level=INFO msg="Upload complete. (219ms)"6246lb # [ 108.375042] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo6247worker1 # [ 108.390534] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=16248worker1 # [ 108.397632] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=06249worker1 # [ 108.402387] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=16250worker1 # [ 108.410885] nix-daemon[846]: reaped child process 1370, status = succeeded6251worker1 # [ 108.434329] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440906252worker1 # [ 108.445577] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440906253worker1 # [ 108.458363] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.645Z level=INFO msg="All 1 paths already cached"6254client # copying 1 paths to 'lb:50051'...6255client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...6256worker1 # [ 108.466618] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440906257worker1 # [ 108.475269] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6258worker1 # [ 108.563383] nix-daemon[846]: accepted connection from pid 1397, user nix-grpc-daemon (trusted)6259worker1 # [ 108.578687] nix-daemon[846]: reaped child process 1400, status = succeeded6260lb # [ 108.580301] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received uploads request method=POST path=/api/pending_closures6261worker1 # [ 108.591854] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.779Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6262worker1 # [ 108.593577] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.781Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"6263lb # [ 108.615625] niks3-server[1108]: 2026/09/22 22:23:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6264lb # [ 108.622175] niks3-server[1108]: 2026/09/22 22:23:36 INFO Signed narinfos id=45 count=16265worker1 # [ 108.627862] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.815Z level=INFO msg="Uploading 1 narinfos"6266lb # [ 108.630976] niks3-server[1108]: 2026/09/22 22:23:36 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst6267lb # [ 108.640430] niks3-server[1108]: 2026/09/22 22:23:37 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls6268lb # [ 108.651448] niks3-server[1108]: 2026/09/22 22:23:37 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6269lb # [ 108.657202] niks3-server[1108]: 2026/09/22 22:23:37 INFO Completed upload id=456270worker1 # [ 108.660190] nix-grpc-daemon[1353]: time=2026-09-22T22:23:37.847Z level=INFO msg="Upload complete. (175ms)"6271lb # [ 108.661378] niks3-server[1108]: 2026/09/22 22:23:37 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo6272worker1 # [ 108.665490] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=0 paths=1 nar_bytes_in=6406273worker1 # [ 108.673231] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440906274worker1 # [ 108.683209] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6275worker1 # [ 108.692086] nix-daemon[846]: reaped child process 1395, status = succeeded6276worker1 # [ 108.697883] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6277client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...6278client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv6279client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6280client # farm-b> LOG-farm-b-on-standby6281worker1 # [ 110.133917] nix-daemon[846]: reaped child process 1404, status = succeeded6282worker1 # [ 110.222122] nix-daemon[846]: accepted connection from pid 1420, user nix-grpc-daemon (trusted)6283worker1 # [ 110.237427] nix-daemon[846]: reaped child process 1423, status = succeeded6284lb # [ 110.236665] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received uploads request method=POST path=/api/pending_closures6285worker1 # [ 110.247810] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.435Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6286worker1 # [ 110.250432] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.436Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"6287lb # [ 110.276215] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6288worker1 # [ 110.282142] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.469Z level=INFO msg="Uploading 1 narinfos"6289lb # [ 110.279244] niks3-server[1108]: 2026/09/22 22:23:38 INFO Signed narinfos id=46 count=16290lb # [ 110.289953] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls6291lb # [ 110.292733] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv6292lb # [ 110.295529] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst6293lb # [ 110.302060] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6294lb # [ 110.307965] niks3-server[1108]: 2026/09/22 22:23:38 INFO Completed upload id=466295worker1 # [ 110.310813] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.498Z level=INFO msg="Upload complete. (203ms)"6296lb # [ 110.310452] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo6297worker1 # [ 110.317608] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=16298worker1 # [ 110.328210] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=06299worker1 # [ 110.332117] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=16300worker1 # [ 110.336706] nix-daemon[846]: reaped child process 1402, status = succeeded6301worker1 # [ 110.372681] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440906302worker1 # [ 110.385983] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440906303worker1 # [ 110.400156] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.587Z level=INFO msg="All 2 paths already cached"6304client # copying 1 paths to 'lb:50051'...6305client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...6306worker1 # [ 110.409477] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440906307worker1 # [ 110.420182] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6308worker1 # [ 110.512223] nix-daemon[846]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)6309worker1 # [ 110.527498] nix-daemon[846]: reaped child process 1432, status = succeeded6310lb # [ 110.530292] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received uploads request method=POST path=/api/pending_closures6311worker1 # [ 110.548225] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.735Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6312worker1 # [ 110.549981] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.737Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"6313lb # [ 110.567379] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6314worker1 # [ 110.573251] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.760Z level=INFO msg="Uploading 1 narinfos"6315lb # [ 110.571653] niks3-server[1108]: 2026/09/22 22:23:38 INFO Signed narinfos id=47 count=16316lb # [ 110.577027] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls6317lb # [ 110.581087] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst6318lb # [ 110.585148] niks3-server[1108]: 2026/09/22 22:23:38 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6319lb # [ 110.593391] niks3-server[1108]: 2026/09/22 22:23:38 INFO Completed upload id=476320worker1 # [ 110.595944] nix-grpc-daemon[1353]: time=2026-09-22T22:23:39.783Z level=INFO msg="Upload complete. (165ms)"6321worker1 # [ 110.598286] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=0 paths=1 nar_bytes_in=7686322lb # [ 110.597676] niks3-server[1108]: 2026/09/22 22:23:38 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo6323worker1 # [ 110.601430] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440906324worker1 # [ 110.609588] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6325worker1 # [ 110.612917] nix-daemon[846]: reaped child process 1427, status = succeeded6326worker1 # [ 110.617084] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6327client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...6328client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6329client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6330client # farm-top> LOG-farm-top-on-standby6331worker1 # [ 111.656829] nix-daemon[846]: reaped child process 1436, status = succeeded6332worker1 # [ 111.731161] nix-daemon[846]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)6333worker1 # [ 111.746725] nix-daemon[846]: reaped child process 1455, status = succeeded6334lb # [ 111.746695] niks3-server[1108]: 2026/09/22 22:23:40 INFO Received uploads request method=POST path=/api/pending_closures6335worker1 # [ 111.758564] nix-grpc-daemon[1353]: time=2026-09-22T22:23:40.945Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6336worker1 # [ 111.760101] nix-grpc-daemon[1353]: time=2026-09-22T22:23:40.947Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"6337lb # [ 111.791824] niks3-server[1108]: 2026/09/22 22:23:40 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls6338lb # [ 111.797081] niks3-server[1108]: 2026/09/22 22:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6339lb # [ 111.803712] niks3-server[1108]: 2026/09/22 22:23:40 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6340lb # [ 111.807081] niks3-server[1108]: 2026/09/22 22:23:40 INFO Signed narinfos id=48 count=16341worker1 # [ 111.812312] nix-grpc-daemon[1353]: time=2026-09-22T22:23:40.999Z level=INFO msg="Uploading 1 narinfos"6342lb # [ 111.814276] niks3-server[1108]: 2026/09/22 22:23:40 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst6343lb # [ 111.822983] niks3-server[1108]: 2026/09/22 22:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6344lb # [ 111.825740] niks3-server[1108]: 2026/09/22 22:23:40 INFO Completed upload id=486345worker1 # [ 111.828376] nix-grpc-daemon[1353]: time=2026-09-22T22:23:41.015Z level=INFO msg="Upload complete. (202ms)"6346lb # [ 111.829761] niks3-server[1108]: 2026/09/22 22:23:40 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo6347worker1 # [ 111.834761] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=16348worker1 # [ 111.850837] nix-daemon[846]: reaped child process 1434, status = succeeded6349client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.34 seconds)6350client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath6351client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.12 seconds)6352worker2 # [ 112.038697] systemd[1]: Listening on Nix worker-protocol over gRPC.6353worker2 # [ 112.045756] systemd[1]: Starting scheduler-token.service...6354worker2 # [ 112.092439] systemd[1]: scheduler-token.service: Deactivated successfully.6355worker2 # [ 112.093960] systemd[1]: Finished scheduler-token.service.6356worker2 # [ 112.095388] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 48ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6357worker2 # [ 112.099681] systemd[1]: Starting Nix worker-protocol over gRPC...6358worker2 # [ 112.177674] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6359worker2 # [ 112.182049] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6360worker2 # [ 112.186048] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16361worker2 # [ 112.187961] nix-grpc-daemon[1439]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6362worker2 # [ 112.189213] nix-grpc-daemon[1439]: E0000 00:00:1790115820.477039 1439 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6363worker2 # [ 112.193121] nix-grpc-daemon[1439]: E0000 00:00:1790115820.484353 1439 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6364worker2 # [ 112.200044] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6365worker2 # [ 112.202166] systemd[1]: Started Nix worker-protocol over gRPC.6366worker2 # [ 112.202972] nix-grpc-daemon[1439]: E0000 00:00:1790115820.494417 1481 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6367worker2 # [ 112.217136] nix-grpc-daemon[1439]: E0000 00:00:1790115820.508854 1481 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6368worker2 # [ 112.220116] nix-grpc-daemon[1439]: E0000 00:00:1790115820.509001 1481 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6369lb: must succeed: curl -sf localhost:9901/clusters6370worker2 # [ 112.234544] nix-grpc-daemon[1439]: E0000 00:00:1790115820.526978 1481 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6371worker2 # [ 112.249381] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=info event=scheduler_connected addr=lb:500516372worker1 # [ 112.263165] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=info event=oidc_jwks provider=mock keys=16373worker1 # [ 112.267402] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:444246374worker1 # [ 112.271338] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06375lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6376worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6377worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6378lb: must succeed: curl -sf localhost:9901/clusters6379lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6380lb: must succeed: curl -sf localhost:9901/clusters6381lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6382worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6383worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6384(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.24 seconds)6385subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise6386client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs6387client # [ 112.484566] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs.6388client # Running as unit: rs.service; invocation ID: a4d5d5302b4a4a3a982633045b256edb6389client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds)6390worker2 # [ 112.610156] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:455786391worker2 # [ 112.621751] nix-daemon[869]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6392client # [ 112.647871] nix[1362]: don't know how to build these paths:6393client # [ 112.648919] nix[1362]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv6394worker1 # [ 112.644718] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=06395worker1 # [ 112.650113] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=16396worker1 # [ 112.690475] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440906397worker1 # [ 112.703496] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440906398client # [ 112.724156] nix[1362]: copying 1 paths to 'lb:50051'...6399worker1 # [ 112.715247] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440906400client # [ 112.726059] nix[1362]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...6401worker1 # [ 112.727383] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6402worker1 # [ 112.823171] nix-daemon[846]: accepted connection from pid 1468, user nix-grpc-daemon (trusted)6403worker1 # [ 112.836399] nix-daemon[846]: reaped child process 1471, status = succeeded6404lb # [ 112.839599] niks3-server[1108]: 2026/09/22 22:23:41 INFO Received uploads request method=POST path=/api/pending_closures6405worker1 # [ 112.850875] nix-grpc-daemon[1353]: time=2026-09-22T22:23:42.038Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6406worker1 # [ 112.852930] nix-grpc-daemon[1353]: time=2026-09-22T22:23:42.039Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"6407lb # [ 112.871214] niks3-server[1108]: 2026/09/22 22:23:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6408lb # [ 112.879317] niks3-server[1108]: 2026/09/22 22:23:41 INFO Signed narinfos id=49 count=16409worker1 # [ 112.885196] nix-grpc-daemon[1353]: time=2026-09-22T22:23:42.072Z level=INFO msg="Uploading 1 narinfos"6410lb # [ 112.883531] niks3-server[1108]: 2026/09/22 22:23:41 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst6411lb # [ 112.892863] niks3-server[1108]: 2026/09/22 22:23:41 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls6412lb # [ 112.902261] niks3-server[1108]: 2026/09/22 22:23:41 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6413lb # [ 112.910711] niks3-server[1108]: 2026/09/22 22:23:41 INFO Completed upload id=496414worker1 # [ 112.913524] nix-grpc-daemon[1353]: time=2026-09-22T22:23:42.100Z level=INFO msg="Upload complete. (174ms)"6415lb # [ 112.914838] niks3-server[1108]: 2026/09/22 22:23:41 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo6416worker1 # [ 112.918701] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=0 paths=1 nar_bytes_in=4166417worker1 # [ 112.925311] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440906418worker1 # [ 112.934632] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6419worker1 # [ 112.943607] nix-daemon[846]: reaped child process 1466, status = succeeded6420worker1 # [ 112.948197] nix-daemon[846]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)6421client # [ 112.958190] nix[1362]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...6422lb: must succeed: curl -sf localhost:9901/clusters6423lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6424lb: must succeed: curl -sf localhost:9901/clusters6425lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6426lb: must succeed: curl -sf localhost:9901/clusters6427lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6428lb: must succeed: curl -sf localhost:9901/clusters6429lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6430worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true6431worker2 # [ 115.131172] systemd-journald[284]: Received client request to rotate journal, rotating.6432worker2 # [ 115.150152] systemd-journald[284]: Vacuuming done, freed 0B of archived journals from /var/log/journal/0d3681033c0d4c5fab8e6499b4bc6e17.6433worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds)6434worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service6435worker1 # [ 115.062515] systemd[1]: Stopping Nix worker-protocol over gRPC...6436worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds)6437client: must succeed: sleep 5.06438lb # [ 115.184382] envoy[904]: conn peer=[2001:db8:1::1]:52926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9560 tx=4369 ms=51806439worker1 # [ 115.804480] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:44Z level=info event=draining6440client: (finished: must succeed: sleep 5.0, in 5.03 seconds)6441worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='6442worker1 # [ 120.397235] nix-daemon[846]: reaped child process 1475, status = succeeded6443worker1 # [ 120.476108] nix-daemon[846]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)6444worker1 # [ 120.487922] nix-daemon[846]: reaped child process 1519, status = succeeded6445lb # [ 120.495902] niks3-server[1108]: 2026/09/22 22:23:48 INFO Received uploads request method=POST path=/api/pending_closures6446worker1 # [ 120.506251] nix-grpc-daemon[1353]: time=2026-09-22T22:23:49.693Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6447worker1 # [ 120.510146] nix-grpc-daemon[1353]: time=2026-09-22T22:23:49.695Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"6448lb # [ 120.541871] niks3-server[1108]: 2026/09/22 22:23:48 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst6449lb # [ 120.546752] niks3-server[1108]: 2026/09/22 22:23:48 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls6450lb # [ 120.555927] niks3-server[1108]: 2026/09/22 22:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6451lb # [ 120.561615] niks3-server[1108]: 2026/09/22 22:23:48 INFO Signed narinfos id=50 count=16452worker1 # [ 120.564695] nix-grpc-daemon[1353]: time=2026-09-22T22:23:49.751Z level=INFO msg="Uploading 1 narinfos"6453lb # [ 120.564206] niks3-server[1108]: 2026/09/22 22:23:48 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv6454lb # [ 120.575138] niks3-server[1108]: 2026/09/22 22:23:48 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6455lb # [ 120.579967] niks3-server[1108]: 2026/09/22 22:23:48 INFO Completed upload id=506456worker1 # [ 120.582890] nix-grpc-daemon[1353]: time=2026-09-22T22:23:49.770Z level=INFO msg="Upload complete. (221ms)"6457lb # [ 120.583787] niks3-server[1108]: 2026/09/22 22:23:48 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo6458worker1 # [ 120.591676] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44090 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=16459worker1 # [ 120.605772] nix-daemon[846]: reaped child process 1473, status = succeeded6460client # [ 120.631923] systemd[1]: rs.service: Deactivated successfully.6461client # [ 120.636147] systemd[1]: rs.service: Consumed 128ms CPU time over 8.150s wall clock time, 43.4M memory peak, 7.1K incoming IP traffic, 8.2K outgoing IP traffic.6462worker1 # [ 120.805125] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:49Z level=info event=signal_exit6463lb # [ 121.012194] niks3-server[1108]: 2026/09/22 22:23:49 INFO lead: released remote=192.168.1.3:375726464worker2 # [ 122.013610] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_restarting addr=lb:500516465worker1 # [ 122.014996] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=scheduler_restarting6466worker1 # [ 122.024307] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=scheduler_restarting addr=lb:500516467worker1 # [ 122.028299] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:444246468worker1 # [ 122.031852] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=worker_gone addr=192.168.1.4:500516469worker1 # [ 122.035409] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:444246470worker1 # [ 122.038932] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=worker_gone addr=192.168.1.3:500516471worker1 # [ 122.055461] nix-daemon[846]: reaped child process 1311, status = succeeded6472worker2 # [ 122.204217] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_take_over6473lb # [ 122.206408] niks3-server[1108]: 2026/09/22 22:23:50 INFO lead: acquired remote=192.168.1.4:496446474worker2 # [ 122.213582] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_connected addr=lb:500516475worker2 # [ 122.217589] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6476worker1 # [ 122.229875] nix-grpc-daemon[1258]: ts=2026-09-22T22:23:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6477worker1 # [ 122.356564] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6478worker1 # [ 122.359889] systemd[1]: Stopped Nix worker-protocol over gRPC.6479worker1 # [ 122.362800] systemd[1]: nix-grpc-daemon.service: Consumed 1.108s CPU time over 29.665s wall clock time, 37.6M memory peak, 50.3K incoming IP traffic, 105.2K outgoing IP traffic.6480worker1 # [ 122.377917] systemd[1]: Starting Nix worker-protocol over gRPC...6481worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.11 seconds)6482client: waiting for success: ! systemctl is-active rs6483worker2 # [ 122.418691] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_connected addr=lb:500516484client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds)6485client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }6486worker2 # [ 122.422579] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6487client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)6488client: must fail: journalctl -u rs | grep -q 'reconnecting'6489worker1 # [ 122.465349] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6490worker1 # [ 122.467546] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6491worker1 # [ 122.470921] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16492client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)6493lb: must succeed: curl -sf localhost:9901/clusters6494worker1 # [ 122.475054] nix-grpc-daemon[1526]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6495worker1 # [ 122.477152] nix-grpc-daemon[1526]: E0000 00:00:1790115831.662347 1526 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6496worker1 # [ 122.482599] nix-grpc-daemon[1526]: E0000 00:00:1790115831.667845 1526 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6497worker1 # [ 122.486116] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6498worker1 # [ 122.488580] systemd[1]: Started Nix worker-protocol over gRPC.6499worker1 # [ 122.491064] nix-grpc-daemon[1526]: E0000 00:00:1790115831.677774 1567 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6500worker1 # [ 122.502358] nix-grpc-daemon[1526]: E0000 00:00:1790115831.689816 1567 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6501worker1 # [ 122.507054] nix-grpc-daemon[1526]: E0000 00:00:1790115831.692139 1567 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6502worker1 # [ 122.516419] nix-grpc-daemon[1526]: E0000 00:00:1790115831.703885 1567 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6503lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6504worker1 # [ 122.528397] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:500516505worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6506worker1 # [ 122.529885] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6507worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6508worker2 # [ 122.623947] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_connected addr=lb:500516509worker2 # [ 122.627877] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6510worker1 # [ 122.731061] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:500516511worker1 # [ 122.734957] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6512worker2 # [ 122.829129] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:500516513worker2 # [ 122.833227] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6514worker1 # [ 122.936115] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_connected addr=lb:500516515worker1 # [ 122.940255] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6516worker2 # [ 123.035148] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:500516517worker2 # [ 123.038942] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6518worker1 # [ 123.140881] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_connected addr=lb:500516519worker1 # [ 123.144983] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6520worker2 # [ 123.239977] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:500516521worker2 # [ 123.243915] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6522worker1 # [ 123.345897] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:52Z level=info event=scheduler_connected addr=lb:500516523worker2 # [ 123.352164] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:346026524worker2 # [ 123.355933] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06525worker2 # [ 123.445121] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=scheduler_connected addr=lb:500516526worker2 # [ 123.455144] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=oidc_jwks provider=mock keys=16527worker2 # [ 123.459099] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:346026528worker2 # [ 123.463903] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06529lb: must succeed: curl -sf localhost:9901/clusters6530lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6531worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6532worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6533(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 11.24 seconds)6534subtest: scheduler restart mid-build: build finishes, no double build6535client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid6536client # [ 123.721570] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid.6537client # Running as unit: mid.service; invocation ID: a1bb53bb50aa430384720bd9dc1074ba6538client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds)6539worker2 # [ 123.848198] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:455786540client # [ 123.869138] nix[1398]: don't know how to build these paths:6541client # [ 123.870110] nix[1398]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6542worker2 # [ 123.863265] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:52Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=06543worker2 # [ 123.867369] nix-grpc-daemon[1439]: ts=2026-09-22T22:23:52Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=16544worker1 # [ 123.916878] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:385306545worker1 # [ 123.928382] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6546worker1 # [ 123.945617] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5)6547worker1 # [ 124.020429] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 150 ms (attempt 2/5)6548worker1 # [ 124.172612] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 3/5)6549worker1 # [ 124.179774] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 798 ms (attempt 4/5)6550worker1 # [ 124.987386] nix-grpc-daemon[1526]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6551worker1 # [ 124.990736] nix-grpc-daemon[1526]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6552worker1 # [ 125.009669] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:385306553client # [ 125.031345] nix[1398]: copying 1 paths to 'lb:50051'...6554worker1 # [ 125.022400] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:385306555client # [ 125.034675] nix[1398]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...6556worker1 # [ 125.034099] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6557worker1 # [ 125.054707] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=info event=niks3_push_started pid=15956558worker1 # [ 125.156482] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.343Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""6559lb # [ 125.185657] envoy[904]: conn peer=[2001:db8:1::1]:52942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2943 tx=1519 ms=79916560lb # [ 125.189505] envoy[904]: conn peer=[2001:db8:1::3]:47432 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6017 tx=1407 ms=293806561worker1 # [ 125.242402] nix-daemon[846]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)6562worker1 # [ 125.257087] nix-daemon[846]: reaped child process 1611, status = succeeded6563lb # [ 125.261579] niks3-server[1108]: 2026/09/22 22:23:53 INFO Received uploads request method=POST path=/api/pending_closures6564worker1 # [ 125.274841] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.462Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6565worker1 # [ 125.276360] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.463Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"6566lb # [ 125.304588] niks3-server[1108]: 2026/09/22 22:23:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6567lb # [ 125.311859] niks3-server[1108]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst6568lb # [ 125.328450] niks3-server[1108]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls6569lb # [ 125.337148] niks3-server[1108]: 2026/09/22 22:23:53 INFO Signed narinfos id=51 count=16570worker1 # [ 125.339923] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.527Z level=INFO msg="Uploading 1 narinfos"6571lb # [ 125.345399] niks3-server[1108]: 2026/09/22 22:23:53 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6572lb # [ 125.349069] niks3-server[1108]: 2026/09/22 22:23:53 INFO Completed upload id=516573worker1 # [ 125.351922] nix-grpc-daemon[1595]: time=2026-09-22T22:23:54.539Z level=INFO msg="Upload complete. (192ms)"6574lb # [ 125.355238] niks3-server[1108]: 2026/09/22 22:23:53 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo6575worker1 # [ 125.356236] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38530 duration_s=0 paths=1 nar_bytes_in=4246576worker1 # [ 125.362521] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:385306577worker1 # [ 125.374060] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6578worker1 # [ 125.378424] nix-daemon[846]: reaped child process 1593, status = succeeded6579worker1 # [ 125.383348] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6580client # [ 125.393357] nix[1398]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...6581lb: must succeed: curl -sf localhost:9901/clusters6582lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6583lb: must succeed: curl -sf localhost:9901/clusters6584lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6585worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6586worker2 # [ 127.321270] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1439 (nix-grpc-daemon) on client request.6587worker2 # [ 127.339856] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6588lb # [ 127.339068] niks3-server[1108]: 2026/09/22 22:23:55 INFO lead: released remote=192.168.1.4:496446589worker1 # [ 127.350434] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"6590client # [ 127.361331] nix[1398]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6591worker2 # [ 127.355237] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6592worker2 # [ 127.356737] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6593worker2 # [ 127.358103] systemd[1]: nix-grpc-daemon.service: Consumed 218ms CPU time over 15.253s wall clock time, 13.8M memory peak, 11.3K incoming IP traffic, 24.2K outgoing IP traffic.6594worker2 # [ 127.370283] systemd[1]: Starting scheduler-token.service...6595worker2 # [ 127.375280] nix-daemon[869]: reaped child process 1499, status = succeeded6596worker2 # [ 127.410572] systemd[1]: scheduler-token.service: Deactivated successfully.6597worker2 # [ 127.411671] systemd[1]: Finished scheduler-token.service.6598worker2 # [ 127.413378] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 41ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6599worker2 # [ 127.415986] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6600worker2 # [ 127.419763] systemd[1]: Starting scheduler-token.service...6601worker2 # [ 127.454249] systemd[1]: scheduler-token.service: Deactivated successfully.6602worker2 # [ 127.455864] systemd[1]: Finished scheduler-token.service.6603worker2 # [ 127.457344] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 36ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6604worker2 # [ 127.461793] systemd[1]: Starting Nix worker-protocol over gRPC...6605lb # [ 127.489561] niks3-server[1108]: 2026/09/22 22:23:55 INFO lead: acquired remote=192.168.1.3:484606606worker1 # [ 127.495636] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_take_over6607worker2 # [ 127.541349] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6608worker2 # [ 127.543531] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6609worker1 # [ 127.550545] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:500516610worker2 # [ 127.546766] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16611worker2 # [ 127.551646] nix-grpc-daemon[1586]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6612worker2 # [ 127.554883] nix-grpc-daemon[1586]: E0000 00:00:1790115835.844123 1586 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6613worker2 # [ 127.560246] nix-grpc-daemon[1586]: E0000 00:00:1790115835.847198 1586 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6614worker2 # [ 127.562389] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6615worker2 # [ 127.563956] systemd[1]: Started Nix worker-protocol over gRPC.6616worker2 # [ 127.571129] nix-grpc-daemon[1586]: E0000 00:00:1790115835.862510 1629 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6617worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.29 seconds)6618worker1 # [ 127.581308] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6619client: must succeed: sleep 5.06620worker2 # [ 127.584470] nix-grpc-daemon[1586]: E0000 00:00:1790115835.876899 1629 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6621worker2 # [ 127.589053] nix-grpc-daemon[1586]: E0000 00:00:1790115835.879138 1629 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6622worker2 # [ 127.598517] nix-grpc-daemon[1586]: E0000 00:00:1790115835.890948 1629 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6623worker2 # [ 127.607766] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=scheduler_connected addr=lb:500516624worker2 # [ 127.610189] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6625worker1 # [ 127.783699] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:500516626worker1 # [ 127.791169] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:385346627worker1 # [ 127.792913] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=16628worker2 # [ 127.811606] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:500516629worker2 # [ 127.816671] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6630worker2 # [ 128.018203] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:500516631worker2 # [ 128.023333] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6632worker2 # [ 128.224715] nix-grpc-daemon[1586]: ts=2026-09-22T22:23:56Z level=info event=scheduler_connected addr=lb:500516633worker1 # [ 128.235655] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:57Z level=info event=oidc_jwks provider=mock keys=16634worker1 # [ 128.237157] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:57Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:385346635worker1 # [ 128.238732] nix-grpc-daemon[1526]: ts=2026-09-22T22:23:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06636client: (finished: must succeed: sleep 5.0, in 5.03 seconds)6637client: waiting for success: ! systemctl is-active mid6638worker1 # [ 132.803701] nix-daemon[846]: reaped child process 1615, status = succeeded6639worker1 # [ 132.877996] nix-daemon[846]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6640worker1 # [ 132.891405] nix-daemon[846]: reaped child process 1655, status = succeeded6641lb # [ 132.895411] niks3-server[1108]: 2026/09/22 22:24:01 INFO Received uploads request method=POST path=/api/pending_closures6642worker1 # [ 132.906799] nix-grpc-daemon[1595]: time=2026-09-22T22:24:02.094Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6643worker1 # [ 132.908352] nix-grpc-daemon[1595]: time=2026-09-22T22:24:02.095Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"6644lb # [ 132.947765] niks3-server[1108]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6645lb # [ 132.951701] niks3-server[1108]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6646lb # [ 132.961490] niks3-server[1108]: 2026/09/22 22:24:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6647lb # [ 132.966894] niks3-server[1108]: 2026/09/22 22:24:01 INFO Signed narinfos id=52 count=16648worker1 # [ 132.973934] nix-grpc-daemon[1595]: time=2026-09-22T22:24:02.160Z level=INFO msg="Uploading 1 narinfos"6649lb # [ 132.974865] niks3-server[1108]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls6650lb # [ 132.979058] niks3-server[1108]: 2026/09/22 22:24:01 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6651lb # [ 132.982925] niks3-server[1108]: 2026/09/22 22:24:01 INFO Completed upload id=526652worker1 # [ 132.985600] nix-grpc-daemon[1595]: time=2026-09-22T22:24:02.173Z level=INFO msg="Upload complete. (190ms)"6653lb # [ 132.984938] niks3-server[1108]: 2026/09/22 22:24:01 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo6654worker1 # [ 132.992648] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38530 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=16655worker1 # [ 133.008741] nix-daemon[846]: reaped child process 1613, status = succeeded6656client # [ 133.042160] systemd[1]: mid.service: Deactivated successfully.6657client # [ 133.044906] systemd[1]: mid.service: Consumed 133ms CPU time over 9.320s wall clock time, 43.4M memory peak, 7.8K incoming IP traffic, 8.9K outgoing IP traffic.6658client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds)6659client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6660client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)6661(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.24 seconds)6662subtest: interrupting the client stops the build on the worker6663client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr6664client # [ 133.934772] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr.6665client # Running as unit: intr.service; invocation ID: ebbf4c93d79042cb81fb6c6c4e01a8086666client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds)6667worker2 # [ 134.046717] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546046668worker2 # [ 134.058148] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6669client # [ 134.085068] nix[1434]: don't know how to build these paths:6670client # [ 134.085940] nix[1434]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6671worker1 # [ 134.085752] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:03Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=06672worker1 # [ 134.089977] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:03Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=16673worker2 # [ 134.126325] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546046674worker2 # [ 134.137693] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5)6675worker2 # [ 134.244559] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 2/5)6676worker2 # [ 134.417581] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 138 ms (attempt 3/5)6677worker2 # [ 134.557616] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 682 ms (attempt 4/5)6678lb # [ 135.187203] envoy[904]: conn peer=[2001:db8:1::4]:53738 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6953 tx=523 ms=151056679lb # [ 135.191245] envoy[904]: conn peer=[2001:db8:1::1]:52314 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3074 tx=1606 ms=91586680worker2 # [ 135.248902] nix-grpc-daemon[1586]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6681worker2 # [ 135.252347] nix-grpc-daemon[1586]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6682worker2 # [ 135.271921] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546046683client # [ 135.297626] nix[1434]: copying 1 paths to 'lb:50051'...6684client # [ 135.300775] nix[1434]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...6685worker2 # [ 135.287548] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546046686worker2 # [ 135.299100] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6687worker2 # [ 135.323387] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=info event=niks3_push_started pid=16636688worker2 # [ 135.431701] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.722Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""6689worker2 # [ 135.519385] nix-daemon[869]: accepted connection from pid 1676, user nix-grpc-daemon (trusted)6690worker2 # [ 135.532352] nix-daemon[869]: reaped child process 1679, status = succeeded6691lb # [ 135.544568] niks3-server[1108]: 2026/09/22 22:24:03 INFO Received uploads request method=POST path=/api/pending_closures6692worker2 # [ 135.556146] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.848Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6693worker2 # [ 135.557719] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.850Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6694lb # [ 135.589361] niks3-server[1108]: 2026/09/22 22:24:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6695lb # [ 135.601400] niks3-server[1108]: 2026/09/22 22:24:03 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6696lb # [ 135.605622] niks3-server[1108]: 2026/09/22 22:24:03 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6697lb # [ 135.619353] niks3-server[1108]: 2026/09/22 22:24:03 INFO Signed narinfos id=53 count=16698worker2 # [ 135.617824] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.910Z level=INFO msg="Uploading 1 narinfos"6699lb # [ 135.630489] niks3-server[1108]: 2026/09/22 22:24:03 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6700lb # [ 135.638872] niks3-server[1108]: 2026/09/22 22:24:03 INFO Completed upload id=536701worker2 # [ 135.637560] nix-grpc-daemon[1663]: time=2026-09-22T22:24:03.929Z level=INFO msg="Upload complete. (206ms)"6702lb # [ 135.640488] niks3-server[1108]: 2026/09/22 22:24:04 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6703worker2 # [ 135.642250] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=4246704worker2 # [ 135.648533] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546046705worker2 # [ 135.660111] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6706worker2 # [ 135.668458] nix-daemon[869]: reaped child process 1661, status = succeeded6707worker2 # [ 135.672655] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6708client # [ 135.686597] nix[1434]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6709client: must succeed: systemctl kill -s INT intr6710client # [ 137.361651] systemd[1]: intr.service: Sent signal SIGINT to main process 1434 (nix) on client request.6711worker2 # [ 137.348940] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:05Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6712client # [ 137.367793] nix[1434]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6713client # [ 137.374781] nix[1434]: error: interrupted by the user6714client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)6715client # [ 137.403492] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6716client # [ 137.406305] systemd[1]: intr.service: Failed with result 'exit-code'.6717client # [ 137.410215] systemd[1]: intr.service: Consumed 117ms CPU time over 3.473s wall clock time, 41.4M memory peak, 6.3K incoming IP traffic, 8.3K outgoing IP traffic.6718worker2 # [ 137.491245] nix-daemon[869]: reaped child process 1681, status = succeeded6719worker2 # [ 137.493749] nix-daemon[1683]: unexpected Nix daemon error: error: interrupted by the user6720worker2 # [ 137.498507] nix-daemon[869]: reaped child process 1683, status = failed with exit code 16721(finished: subtest: interrupting the client stops the build on the worker, in 4.65 seconds)6722subtest: a deploy mid-build drains: the build finishes, the new generation takes over6723client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw6724client # [ 138.605985] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw.6725client # Running as unit: sw.service; invocation ID: 5bfb8a43338e4d5caf02069ad03d18326726client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.06 seconds)6727worker1 # [ 138.732312] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:385306728client # [ 138.748722] nix[1454]: don't know how to build these paths:6729client # [ 138.749614] nix[1454]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6730worker1 # [ 138.746589] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06731worker1 # [ 138.751878] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=16732worker1 # [ 138.791217] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:385306733worker1 # [ 138.804646] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:385306734client # [ 138.825215] nix[1454]: copying 1 paths to 'lb:50051'...6735client # [ 138.827114] nix[1454]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6736worker1 # [ 138.816406] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:385306737worker1 # [ 138.825991] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6738worker1 # [ 138.924786] nix-daemon[846]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)6739worker1 # [ 138.937523] nix-daemon[846]: reaped child process 1694, status = succeeded6740lb # [ 138.942687] niks3-server[1108]: 2026/09/22 22:24:07 INFO Received uploads request method=POST path=/api/pending_closures6741worker1 # [ 138.954864] nix-grpc-daemon[1595]: time=2026-09-22T22:24:08.142Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6742worker1 # [ 138.956920] nix-grpc-daemon[1595]: time=2026-09-22T22:24:08.143Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6743lb # [ 138.975158] niks3-server[1108]: 2026/09/22 22:24:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6744worker1 # [ 138.982320] nix-grpc-daemon[1595]: time=2026-09-22T22:24:08.169Z level=INFO msg="Uploading 1 narinfos"6745lb # [ 138.980088] niks3-server[1108]: 2026/09/22 22:24:07 INFO Signed narinfos id=54 count=16746lb # [ 138.987547] niks3-server[1108]: 2026/09/22 22:24:07 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6747lb # [ 138.999693] niks3-server[1108]: 2026/09/22 22:24:07 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6748lb # [ 139.002453] niks3-server[1108]: 2026/09/22 22:24:07 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6749lb # [ 139.006785] niks3-server[1108]: 2026/09/22 22:24:07 INFO Completed upload id=546750worker1 # [ 139.009439] nix-grpc-daemon[1595]: time=2026-09-22T22:24:08.196Z level=INFO msg="Upload complete. (169ms)"6751lb # [ 139.009804] niks3-server[1108]: 2026/09/22 22:24:07 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6752worker1 # [ 139.013438] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38530 duration_s=0 paths=1 nar_bytes_in=4166753worker1 # [ 139.018298] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:385306754worker1 # [ 139.027815] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6755worker1 # [ 139.033115] nix-daemon[846]: reaped child process 1689, status = succeeded6756worker1 # [ 139.037888] nix-daemon[846]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)6757client # [ 139.047499] nix[1454]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6758worker1: must succeed: systemctl reload nix-grpc-daemon.service6759worker1 # [ 141.026824] systemd[1]: Reloading Nix worker-protocol over gRPC...6760worker1 # [ 141.052935] systemd[1]: Reloaded Nix worker-protocol over gRPC.6761worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds)6762worker1: must succeed: pgrep -f 'read -t [9]0 x'6763worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds)6764client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&26765client # don't know how to build these paths:6766client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6767worker2 # [ 141.232950] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546046768worker2 # [ 141.239135] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546046769worker1 # [ 141.260583] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:10Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06770worker1 # [ 141.263170] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:10Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=16771worker2 # [ 141.305792] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546046772worker2 # [ 141.318564] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546046773client # copying 1 paths to 'lb:50051'...6774worker2 # [ 141.333243] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546046775client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6776worker2 # [ 141.357993] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6777worker2 # [ 141.466038] nix-daemon[869]: accepted connection from pid 1734, user nix-grpc-daemon (trusted)6778worker2 # [ 141.479134] nix-daemon[869]: reaped child process 1737, status = succeeded6779worker1 # [ 141.488241] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:10Z level=info event=draining6780lb # [ 141.489353] niks3-server[1108]: 2026/09/22 22:24:09 INFO Received uploads request method=POST path=/api/pending_closures6781worker2 # [ 141.499844] nix-grpc-daemon[1663]: time=2026-09-22T22:24:09.792Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6782worker2 # [ 141.502230] nix-grpc-daemon[1663]: time=2026-09-22T22:24:09.793Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6783lb # [ 141.520492] niks3-server[1108]: 2026/09/22 22:24:09 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6784lb # [ 141.531448] niks3-server[1108]: 2026/09/22 22:24:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6785lb # [ 141.536933] niks3-server[1108]: 2026/09/22 22:24:09 INFO Signed narinfos id=55 count=16786worker2 # [ 141.540660] nix-grpc-daemon[1663]: time=2026-09-22T22:24:09.832Z level=INFO msg="Uploading 1 narinfos"6787lb # [ 141.546085] niks3-server[1108]: 2026/09/22 22:24:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6788lb # [ 141.558214] niks3-server[1108]: 2026/09/22 22:24:09 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6789lb # [ 141.565240] niks3-server[1108]: 2026/09/22 22:24:09 INFO Completed upload id=556790worker2 # [ 141.563544] nix-grpc-daemon[1663]: time=2026-09-22T22:24:09.855Z level=INFO msg="Upload complete. (191ms)"6791lb # [ 141.568278] niks3-server[1108]: 2026/09/22 22:24:09 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6792worker2 # [ 141.568726] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=5286793worker2 # [ 141.574671] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546046794worker2 # [ 141.584118] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6795worker2 # [ 141.596214] nix-daemon[869]: reaped child process 1732, status = succeeded6796worker2 # [ 141.599886] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6797client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6798client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6799client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6800client # farm-a> LOG-farm-a-during-drain6801worker2 # [ 142.636255] nix-daemon[869]: reaped child process 1741, status = succeeded6802worker2 # [ 142.712337] nix-daemon[869]: accepted connection from pid 1757, user nix-grpc-daemon (trusted)6803worker2 # [ 142.724892] nix-daemon[869]: reaped child process 1760, status = succeeded6804lb # [ 142.736477] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received uploads request method=POST path=/api/pending_closures6805worker2 # [ 142.745403] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.037Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6806worker2 # [ 142.746929] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.039Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6807lb # [ 142.782989] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6808lb # [ 142.787463] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6809lb # [ 142.794283] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6810lb # [ 142.798921] niks3-server[1108]: 2026/09/22 22:24:11 INFO Signed narinfos id=56 count=16811worker2 # [ 142.800338] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.092Z level=INFO msg="Uploading 1 narinfos"6812lb # [ 142.809096] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6813lb # [ 142.818285] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6814lb # [ 142.822416] niks3-server[1108]: 2026/09/22 22:24:11 INFO Completed upload id=566815lb # [ 142.824823] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6816worker2 # [ 142.822336] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.114Z level=INFO msg="Upload complete. (215ms)"6817worker2 # [ 142.828839] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=16818worker1 # [ 142.837244] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:12Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06819worker1 # [ 142.840319] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:12Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16820worker2 # [ 142.844392] nix-daemon[869]: reaped child process 1739, status = succeeded6821worker2 # [ 142.879543] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546046822worker2 # [ 142.895064] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546046823worker2 # [ 142.908408] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.200Z level=INFO msg="All 1 paths already cached"6824client # copying 1 paths to 'lb:50051'...6825client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6826worker2 # [ 142.917081] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546046827worker2 # [ 142.930336] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6828worker2 # [ 143.032770] nix-daemon[869]: accepted connection from pid 1764, user nix-grpc-daemon (trusted)6829worker2 # [ 143.046073] nix-daemon[869]: reaped child process 1767, status = succeeded6830lb # [ 143.055760] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received uploads request method=POST path=/api/pending_closures6831worker2 # [ 143.063210] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.355Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6832worker2 # [ 143.065045] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.357Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6833lb # [ 143.088431] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6834lb # [ 143.096275] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6835worker2 # [ 143.103380] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.395Z level=INFO msg="Uploading 1 narinfos"6836lb # [ 143.104587] niks3-server[1108]: 2026/09/22 22:24:11 INFO Signed narinfos id=57 count=16837lb # [ 143.111064] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6838lb # [ 143.124105] niks3-server[1108]: 2026/09/22 22:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6839lb # [ 143.131808] niks3-server[1108]: 2026/09/22 22:24:11 INFO Completed upload id=576840worker2 # [ 143.130238] nix-grpc-daemon[1663]: time=2026-09-22T22:24:11.422Z level=INFO msg="Upload complete. (187ms)"6841lb # [ 143.135299] niks3-server[1108]: 2026/09/22 22:24:11 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6842worker2 # [ 143.134241] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=6406843worker2 # [ 143.138929] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546046844worker2 # [ 143.150125] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6845worker2 # [ 143.157213] nix-daemon[869]: reaped child process 1762, status = succeeded6846worker2 # [ 143.162253] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6847client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6848client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6849client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6850client # farm-b> LOG-farm-b-during-drain6851worker2 # [ 143.795860] nix-daemon[869]: reaped child process 1771, status = succeeded6852worker2 # [ 143.878398] nix-daemon[869]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)6853worker2 # [ 143.889728] nix-daemon[869]: reaped child process 1790, status = succeeded6854lb # [ 143.900990] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received uploads request method=POST path=/api/pending_closures6855worker2 # [ 143.907821] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.200Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6856worker2 # [ 143.909442] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.201Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6857lb # [ 143.937857] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6858lb # [ 143.951117] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6859lb # [ 143.958759] niks3-server[1108]: 2026/09/22 22:24:12 INFO Signed narinfos id=58 count=16860worker2 # [ 143.960641] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.252Z level=INFO msg="Uploading 1 narinfos"6861lb # [ 143.962853] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6862lb # [ 143.972119] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6863lb # [ 143.980355] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6864lb # [ 143.984340] niks3-server[1108]: 2026/09/22 22:24:12 INFO Completed upload id=586865worker2 # [ 143.983152] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.275Z level=INFO msg="Upload complete. (215ms)"6866lb # [ 143.986911] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6867worker1 # [ 143.998343] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:13Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06868worker2 # [ 143.989735] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=16869worker1 # [ 144.001174] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:13Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16870worker2 # [ 144.005606] nix-daemon[869]: reaped child process 1769, status = succeeded6871worker2 # [ 144.037992] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546046872worker2 # [ 144.050818] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546046873worker2 # [ 144.063320] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.355Z level=INFO msg="All 2 paths already cached"6874client # copying 1 paths to 'lb:50051'...6875worker2 # [ 144.072718] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546046876client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6877worker2 # [ 144.092161] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6878worker2 # [ 144.197186] nix-daemon[869]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)6879worker2 # [ 144.211217] nix-daemon[869]: reaped child process 1797, status = succeeded6880lb # [ 144.220669] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received uploads request method=POST path=/api/pending_closures6881worker2 # [ 144.227200] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.519Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6882worker2 # [ 144.228742] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.521Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6883lb # [ 144.254714] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6884lb # [ 144.259900] niks3-server[1108]: 2026/09/22 22:24:12 INFO Signed narinfos id=59 count=16885worker2 # [ 144.261269] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.553Z level=INFO msg="Uploading 1 narinfos"6886lb # [ 144.263766] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6887lb # [ 144.273732] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6888lb # [ 144.283522] niks3-server[1108]: 2026/09/22 22:24:12 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6889lb # [ 144.288823] niks3-server[1108]: 2026/09/22 22:24:12 INFO Completed upload id=596890worker2 # [ 144.289858] nix-grpc-daemon[1663]: time=2026-09-22T22:24:12.582Z level=INFO msg="Upload complete. (184ms)"6891lb # [ 144.295045] niks3-server[1108]: 2026/09/22 22:24:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6892worker2 # [ 144.294598] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=7686893worker2 # [ 144.300247] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546046894worker2 # [ 144.311495] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6895worker2 # [ 144.319881] nix-daemon[869]: reaped child process 1792, status = succeeded6896worker2 # [ 144.324409] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)6897client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6898client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6899client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6900lb # [ 145.187517] envoy[904]: conn peer=[2001:db8:1::1]:39422 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2993 tx=827 ms=33286901client # farm-top> LOG-farm-top-during-drain6902worker2 # [ 145.360989] nix-daemon[869]: reaped child process 1801, status = succeeded6903worker2 # [ 145.444499] nix-daemon[869]: accepted connection from pid 1817, user nix-grpc-daemon (trusted)6904worker2 # [ 145.458364] nix-daemon[869]: reaped child process 1820, status = succeeded6905lb # [ 145.467270] niks3-server[1108]: 2026/09/22 22:24:13 INFO Received uploads request method=POST path=/api/pending_closures6906worker2 # [ 145.476294] nix-grpc-daemon[1663]: time=2026-09-22T22:24:13.768Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6907worker2 # [ 145.477852] nix-grpc-daemon[1663]: time=2026-09-22T22:24:13.770Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6908lb # [ 145.507065] niks3-server[1108]: 2026/09/22 22:24:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6909lb # [ 145.511331] niks3-server[1108]: 2026/09/22 22:24:13 INFO Signed narinfos id=60 count=16910worker2 # [ 145.512699] nix-grpc-daemon[1663]: time=2026-09-22T22:24:13.805Z level=INFO msg="Uploading 1 narinfos"6911lb # [ 145.523602] niks3-server[1108]: 2026/09/22 22:24:13 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6912lb # [ 145.528211] niks3-server[1108]: 2026/09/22 22:24:13 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6913lb # [ 145.536100] niks3-server[1108]: 2026/09/22 22:24:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6914lb # [ 145.545266] niks3-server[1108]: 2026/09/22 22:24:13 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6915lb # [ 145.548192] niks3-server[1108]: 2026/09/22 22:24:13 INFO Completed upload id=606916worker2 # [ 145.548271] nix-grpc-daemon[1663]: time=2026-09-22T22:24:13.840Z level=INFO msg="Upload complete. (214ms)"6917lb # [ 145.551771] niks3-server[1108]: 2026/09/22 22:24:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6918worker2 # [ 145.554812] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=16919worker2 # [ 145.569607] nix-daemon[869]: reaped child process 1799, status = succeeded6920client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.51 seconds)6921client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath6922client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds)6923worker1: must succeed: pkill -f 'read -t [9]0 x'6924worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds)6925client: waiting for success: ! systemctl is-active sw6926worker1 # [ 145.859603] nix-daemon[846]: reaped child process 1698, status = succeeded6927worker1 # [ 145.932876] nix-daemon[846]: accepted connection from pid 1745, user nix-grpc-daemon (trusted)6928worker1 # [ 145.945462] nix-daemon[846]: reaped child process 1748, status = succeeded6929lb # [ 145.950389] niks3-server[1108]: 2026/09/22 22:24:14 INFO Received uploads request method=POST path=/api/pending_closures6930worker1 # [ 145.961000] nix-grpc-daemon[1595]: time=2026-09-22T22:24:15.148Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6931worker1 # [ 145.962550] nix-grpc-daemon[1595]: time=2026-09-22T22:24:15.150Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6932lb # [ 145.986460] niks3-server[1108]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6933lb # [ 145.996586] niks3-server[1108]: 2026/09/22 22:24:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6934lb # [ 146.005688] niks3-server[1108]: 2026/09/22 22:24:14 INFO Signed narinfos id=61 count=16935worker1 # [ 146.011334] nix-grpc-daemon[1595]: time=2026-09-22T22:24:15.198Z level=INFO msg="Uploading 1 narinfos"6936lb # [ 146.009746] niks3-server[1108]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6937lb # [ 146.017305] niks3-server[1108]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6938lb # [ 146.029057] niks3-server[1108]: 2026/09/22 22:24:14 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6939lb # [ 146.033181] niks3-server[1108]: 2026/09/22 22:24:14 INFO Completed upload id=616940lb # [ 146.035783] niks3-server[1108]: 2026/09/22 22:24:14 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6941worker1 # [ 146.036320] nix-grpc-daemon[1595]: time=2026-09-22T22:24:15.223Z level=INFO msg="Upload complete. (185ms)"6942worker1 # [ 146.042816] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38530 duration_s=7 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=16943worker1 # [ 146.058515] nix-daemon[846]: reaped child process 1696, status = succeeded6944client # [ 146.091334] systemd[1]: sw.service: Deactivated successfully.6945client # [ 146.094490] systemd[1]: sw.service: Consumed 121ms CPU time over 7.484s wall clock time, 43.4M memory peak, 7.1K incoming IP traffic, 8.3K outgoing IP traffic.6946worker1 # [ 146.491712] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:15Z level=info event=signal_exit6947lb # [ 146.494786] niks3-server[1108]: 2026/09/22 22:24:14 INFO lead: released remote=192.168.1.3:484606948client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds)6949client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6950client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6951worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6952worker2 # [ 147.494583] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:15Z level=info event=scheduler_restarting addr=lb:500516953worker1 # [ 147.496831] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=scheduler_restarting6954worker1 # [ 147.506906] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=scheduler_restarting addr=lb:500516955worker1 # [ 147.510709] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:385346956worker1 # [ 147.514111] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=worker_gone addr=192.168.1.4:500516957worker1 # [ 147.517297] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:385346958worker1 # [ 147.520914] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=worker_gone addr=192.168.1.3:500516959worker1 # [ 147.540603] nix-daemon[846]: reaped child process 1583, status = succeeded6960lb # [ 147.572602] niks3-server[1108]: 2026/09/22 22:24:15 INFO lead: acquired remote=192.168.1.4:404446961worker2 # [ 147.574110] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:15Z level=info event=scheduler_take_over6962worker2 # [ 147.694926] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:15Z level=info event=scheduler_connected addr=lb:500516963worker2 # [ 147.698985] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6964worker1 # [ 147.706797] nix-grpc-daemon[1526]: E0000 00:00:1790115856.893981 1572 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 22, started true, shutdown true6965worker1 # [ 147.715366] nix-grpc-daemon[1526]: E0000 00:00:1790115856.894214 1572 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6966worker1 # [ 147.724294] nix-grpc-daemon[1526]: ts=2026-09-22T22:24:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6967worker2 # [ 147.899892] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_connected addr=lb:500516968worker2 # [ 147.903892] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6969worker2 # [ 148.104981] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_connected addr=lb:500516970worker2 # [ 148.109226] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6971worker2 # [ 148.310178] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_connected addr=lb:500516972worker2 # [ 148.314156] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6973worker2 # [ 148.515935] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=scheduler_connected addr=lb:500516974worker1 # [ 148.521891] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6975worker1 # [ 148.526144] systemd[1]: nix-grpc-daemon.service: Consumed 671ms CPU time over 26.147s wall clock time, 36.5M memory peak, 28.8K incoming IP traffic, 40K outgoing IP traffic.6976worker2 # [ 148.529137] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=oidc_jwks provider=mock keys=16977worker2 # [ 148.533156] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:354126978worker1 # [ 148.542283] systemd[1]: Starting Nix worker-protocol over gRPC...6979worker2 # [ 148.537180] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06980worker1 # [ 148.632358] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6981worker1 # [ 148.634493] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6982worker1 # [ 148.637778] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16983worker1 # [ 148.642053] nix-grpc-daemon[1762]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6984worker1 # [ 148.643605] nix-grpc-daemon[1762]: E0000 00:00:1790115857.829378 1762 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6985worker1 # [ 148.649635] nix-grpc-daemon[1762]: E0000 00:00:1790115857.834832 1762 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6986worker1 # [ 148.651849] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6987worker1 # [ 148.656583] systemd[1]: Started Nix worker-protocol over gRPC.6988worker1 # [ 148.659152] nix-grpc-daemon[1762]: E0000 00:00:1790115857.845664 1804 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6989worker1 # [ 148.671878] nix-grpc-daemon[1762]: E0000 00:00:1790115857.859379 1804 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6990worker1 # [ 148.677150] nix-grpc-daemon[1762]: E0000 00:00:1790115857.861697 1804 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6991worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.84 seconds)6992lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6993lb: must succeed: curl -sf localhost:9901/clusters6994worker1 # [ 148.687543] nix-grpc-daemon[1762]: E0000 00:00:1790115857.875006 1804 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6995worker1 # [ 148.699371] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:17Z level=info event=scheduler_connected addr=lb:500516996worker2 # [ 148.696272] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:354126997worker2 # [ 148.701360] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06998lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6999lb: must succeed: curl -sf localhost:9901/clusters7000lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7001lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds)7002lb: must succeed: curl -sf localhost:9901/clusters7003lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7004worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7005worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)7006(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 11.30 seconds)7007subtest: queue gauges show a burst while every build blocks7008lb: must succeed: curl -sf localhost:9901/clusters7009lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)7010lb: must succeed: curl -sf localhost:9901/clusters7011lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7012worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7013worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7014client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]'7015client # [ 150.009225] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]".7016client # Running as unit: burst.service; invocation ID: 7a01a1542df74a4fadc33e80335ab1947017client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.06 seconds)7018lb: must succeed: curl -sf localhost:9901/clusters7019lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7020lb: must succeed: curl -sf localhost:9901/clusters7021lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7022worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7023worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7024worker2 # [ 150.136646] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546047025client # [ 150.156210] nix[1510]: don't know how to build these paths:7026client # [ 150.157210] nix[1510]: /nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv7027client # [ 150.158174] nix[1510]: /nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv7028client # [ 150.159338] nix[1510]: /nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv7029client # [ 150.160443] nix[1510]: /nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv7030worker2 # [ 150.148284] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=want client=1 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv cached=07031worker2 # [ 150.153567] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=assigned drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv worker=192.168.1.4:50051 clients=17032worker2 # [ 150.157589] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=want client=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv cached=07033worker2 # [ 150.160698] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=assigned drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker=192.168.1.3:50051 clients=17034worker2 # [ 150.164219] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=want client=1 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv cached=07035worker2 # [ 150.167325] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=want client=1 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv cached=07036worker2 # [ 150.197862] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047037worker1 # [ 150.205790] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087038worker2 # [ 150.210890] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546047039worker1 # [ 150.217201] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7040client # [ 150.236156] nix[1510]: copying 1 paths to 'lb:50051'...7041worker2 # [ 150.222969] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546047042client # [ 150.238235] nix[1510]: copying path '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' to 'lb:50051'...7043worker1 # [ 150.233820] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)7044worker2 # [ 150.235377] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7045worker1 # [ 150.326478] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 2/5)7046worker2 # [ 150.332889] nix-daemon[869]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)7047worker2 # [ 150.345743] nix-daemon[869]: reaped child process 1838, status = succeeded7048lb # [ 150.356739] niks3-server[1108]: 2026/09/22 22:24:18 INFO Received uploads request method=POST path=/api/pending_closures7049worker2 # [ 150.364460] nix-grpc-daemon[1663]: time=2026-09-22T22:24:18.656Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7050worker2 # [ 150.366422] nix-grpc-daemon[1663]: time=2026-09-22T22:24:18.658Z level=INFO msg="Uploading 2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv (416B)"7051lb # [ 150.390316] niks3-server[1108]: 2026/09/22 22:24:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign7052lb # [ 150.396518] niks3-server[1108]: 2026/09/22 22:24:18 INFO Registered completed upload object_key=nar/0raymp7y3ngiv7lj2qq6nkp63sms2510yhhlnr7hnz7ldnl7b3qc.nar.zst7053lb # [ 150.407189] niks3-server[1108]: 2026/09/22 22:24:18 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.ls7054lb # [ 150.415040] niks3-server[1108]: 2026/09/22 22:24:18 INFO Signed narinfos id=62 count=17055worker2 # [ 150.413972] nix-grpc-daemon[1663]: time=2026-09-22T22:24:18.705Z level=INFO msg="Uploading 1 narinfos"7056lb # [ 150.420701] niks3-server[1108]: 2026/09/22 22:24:18 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete7057lb # [ 150.430988] niks3-server[1108]: 2026/09/22 22:24:18 INFO Completed upload id=627058worker2 # [ 150.429594] nix-grpc-daemon[1663]: time=2026-09-22T22:24:18.722Z level=INFO msg="Upload complete. (183ms)"7059lb # [ 150.432511] niks3-server[1108]: 2026/09/22 22:24:18 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.narinfo7060worker2 # [ 150.433567] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=4167061worker2 # [ 150.438758] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047062worker2 # [ 150.450105] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7063worker2 # [ 150.454506] nix-daemon[869]: reaped child process 1833, status = succeeded7064worker2 # [ 150.459391] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7065client # [ 150.473233] nix[1510]: building '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' on lb:50051...7066worker1 # [ 150.479477] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 3/5)7067worker1 # [ 150.547222] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 554 ms (attempt 4/5)7068worker1 # [ 151.104277] nix-grpc-daemon[1762]: disabling binary cache 'https://cache.nixos.org' for 60 seconds7069worker1 # [ 151.107666] nix-grpc-daemon[1762]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org7070worker1 # [ 151.125454] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087071client # [ 151.145215] nix[1510]: copying 1 paths to 'lb:50051'...7072lb: must succeed: curl -sf localhost:9901/clusters7073client # [ 151.149162] nix[1510]: copying path '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' to 'lb:50051'...7074worker1 # [ 151.139499] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087075worker1 # [ 151.148322] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7076worker1 # [ 151.173247] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=info event=niks3_push_started pid=18237077lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7078lb: must succeed: curl -sf localhost:9901/clusters7079lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7080worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7081worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)7082worker1 # [ 151.279341] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.466Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""7083worker1 # [ 151.373731] nix-daemon[846]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)7084worker1 # [ 151.384683] nix-daemon[846]: reaped child process 1842, status = succeeded7085lb # [ 151.393488] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received uploads request method=POST path=/api/pending_closures7086worker1 # [ 151.404168] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.591Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7087worker1 # [ 151.405674] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.593Z level=INFO msg="Uploading 885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv (416B)"7088lb # [ 151.434455] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=nar/0mmcg3cvna05ngbx6v5vspkmc5gj8lna2zc48rllhxr0g8i9mg6y.nar.zst7089lb # [ 151.440194] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign7090lb # [ 151.449283] niks3-server[1108]: 2026/09/22 22:24:19 INFO Signed narinfos id=63 count=17091worker1 # [ 151.455297] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.642Z level=INFO msg="Uploading 1 narinfos"7092lb # [ 151.461093] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.ls7093lb # [ 151.470867] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete7094worker2 # [ 151.472065] nix-daemon[869]: reaped child process 1842, status = succeeded7095lb # [ 151.477552] niks3-server[1108]: 2026/09/22 22:24:19 INFO Completed upload id=637096worker1 # [ 151.480404] nix-grpc-daemon[1823]: time=2026-09-22T22:24:20.667Z level=INFO msg="Upload complete. (197ms)"7097lb # [ 151.479838] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.narinfo7098worker1 # [ 151.485563] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=4167099worker1 # [ 151.493199] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087100worker1 # [ 151.501547] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7101worker1 # [ 151.509677] nix-daemon[846]: reaped child process 1821, status = succeeded7102worker1 # [ 151.515438] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7103client # [ 151.525170] nix[1510]: building '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' on lb:50051...7104worker2 # [ 151.553845] nix-daemon[869]: accepted connection from pid 1866, user nix-grpc-daemon (trusted)7105worker2 # [ 151.567949] nix-daemon[869]: reaped child process 1869, status = succeeded7106lb # [ 151.575733] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received uploads request method=POST path=/api/pending_closures7107worker2 # [ 151.582236] nix-grpc-daemon[1663]: time=2026-09-22T22:24:19.874Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7108worker2 # [ 151.583945] nix-grpc-daemon[1663]: time=2026-09-22T22:24:19.876Z level=INFO msg="Uploading vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq-slow-q3 (120B)"7109lb # [ 151.612730] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst7110lb # [ 151.623250] niks3-server[1108]: 2026/09/22 22:24:19 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.ls7111lb # [ 151.626788] niks3-server[1108]: 2026/09/22 22:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign7112lb # [ 151.630538] niks3-server[1108]: 2026/09/22 22:24:19 INFO Signed narinfos id=64 count=17113worker2 # [ 151.631323] nix-grpc-daemon[1663]: time=2026-09-22T22:24:19.923Z level=INFO msg="Uploading 1 narinfos"7114lb # [ 151.641678] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=log/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv7115lb # [ 151.643319] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete7116lb # [ 151.646880] niks3-server[1108]: 2026/09/22 22:24:20 INFO Completed upload id=647117lb # [ 151.648725] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.narinfo7118worker2 # [ 151.646935] nix-grpc-daemon[1663]: time=2026-09-22T22:24:19.939Z level=INFO msg="Upload complete. (180ms)"7119worker2 # [ 151.653407] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv assign_id=1 outputs=17120worker2 # [ 151.660522] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:19Z level=debug event=assigned drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker=192.168.1.4:50051 clients=17121worker2 # [ 151.669588] nix-daemon[869]: reaped child process 1840, status = succeeded7122worker2 # [ 151.703505] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047123worker2 # [ 151.716057] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546047124client # [ 151.740166] nix[1510]: copying 1 paths to 'lb:50051'...7125client # [ 151.743811] nix[1510]: copying path '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' to 'lb:50051'...7126worker2 # [ 151.729996] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546047127worker2 # [ 151.738651] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7128worker2 # [ 151.838833] nix-daemon[869]: accepted connection from pid 1873, user nix-grpc-daemon (trusted)7129worker2 # [ 151.852653] nix-daemon[869]: reaped child process 1876, status = succeeded7130lb # [ 151.861724] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received uploads request method=POST path=/api/pending_closures7131worker2 # [ 151.867886] nix-grpc-daemon[1663]: time=2026-09-22T22:24:20.160Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7132worker2 # [ 151.869491] nix-grpc-daemon[1663]: time=2026-09-22T22:24:20.161Z level=INFO msg="Uploading 8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv (416B)"7133lb # [ 151.894850] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign7134lb # [ 151.903273] niks3-server[1108]: 2026/09/22 22:24:20 INFO Signed narinfos id=65 count=17135worker2 # [ 151.904895] nix-grpc-daemon[1663]: time=2026-09-22T22:24:20.197Z level=INFO msg="Uploading 1 narinfos"7136lb # [ 151.909143] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=nar/1xibay372y9by9a678y9h7bfzwahsxi0vq51acgywak31q6q2m87.nar.zst7137lb # [ 151.913258] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.ls7138lb # [ 151.925137] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete7139lb # [ 151.932960] niks3-server[1108]: 2026/09/22 22:24:20 INFO Completed upload id=657140worker2 # [ 151.931388] nix-grpc-daemon[1663]: time=2026-09-22T22:24:20.223Z level=INFO msg="Upload complete. (180ms)"7141lb # [ 151.936593] niks3-server[1108]: 2026/09/22 22:24:20 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.narinfo7142worker2 # [ 151.935400] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=4167143worker2 # [ 151.941677] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047144worker2 # [ 151.953106] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7145worker2 # [ 151.960170] nix-daemon[869]: reaped child process 1871, status = succeeded7146worker2 # [ 151.964651] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7147client # [ 151.978821] nix[1510]: building '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' on lb:50051...7148worker1 # [ 152.530520] nix-daemon[846]: reaped child process 1847, status = succeeded7149worker1 # [ 152.606333] nix-daemon[846]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)7150worker1 # [ 152.619054] nix-daemon[846]: reaped child process 1871, status = succeeded7151lb # [ 152.621871] niks3-server[1108]: 2026/09/22 22:24:20 INFO Received uploads request method=POST path=/api/pending_closures7152worker1 # [ 152.633737] nix-grpc-daemon[1823]: time=2026-09-22T22:24:21.821Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7153worker1 # [ 152.635421] nix-grpc-daemon[1823]: time=2026-09-22T22:24:21.822Z level=INFO msg="Uploading nv0kp5b571hsjibnd9v06981i024iima-slow-q2 (120B)"7154lb # [ 152.656104] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=log/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv7155lb # [ 152.674708] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign7156lb # [ 152.680094] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst7157worker1 # [ 152.687550] nix-grpc-daemon[1823]: time=2026-09-22T22:24:21.875Z level=INFO msg="Uploading 1 narinfos"7158lb # [ 152.684816] niks3-server[1108]: 2026/09/22 22:24:21 INFO Signed narinfos id=66 count=17159lb # [ 152.691996] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.ls7160lb # [ 152.698115] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete7161lb # [ 152.701151] niks3-server[1108]: 2026/09/22 22:24:21 INFO Completed upload id=667162worker1 # [ 152.703827] nix-grpc-daemon[1823]: time=2026-09-22T22:24:21.891Z level=INFO msg="Upload complete. (182ms)"7163lb # [ 152.704277] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.narinfo7164worker1 # [ 152.709853] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv assign_id=2 outputs=17165worker2 # [ 152.706495] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:20Z level=debug event=assigned drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker=192.168.1.3:50051 clients=17166worker1 # [ 152.722959] nix-daemon[846]: reaped child process 1845, status = succeeded7167worker1 # [ 152.761725] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087168worker1 # [ 152.773691] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087169client # [ 152.794811] nix[1510]: copying 1 paths to 'lb:50051'...7170worker1 # [ 152.785530] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087171client # [ 152.796648] nix[1510]: copying path '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' to 'lb:50051'...7172worker1 # [ 152.795174] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7173worker1 # [ 152.893884] nix-daemon[846]: accepted connection from pid 1875, user nix-grpc-daemon (trusted)7174worker1 # [ 152.906801] nix-daemon[846]: reaped child process 1878, status = succeeded7175lb # [ 152.911110] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received uploads request method=POST path=/api/pending_closures7176worker1 # [ 152.923680] nix-grpc-daemon[1823]: time=2026-09-22T22:24:22.111Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7177worker1 # [ 152.925453] nix-grpc-daemon[1823]: time=2026-09-22T22:24:22.112Z level=INFO msg="Uploading qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv (416B)"7178lb # [ 152.946340] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign7179lb # [ 152.950644] niks3-server[1108]: 2026/09/22 22:24:21 INFO Signed narinfos id=67 count=17180worker1 # [ 152.957023] nix-grpc-daemon[1823]: time=2026-09-22T22:24:22.144Z level=INFO msg="Uploading 1 narinfos"7181lb # [ 152.959628] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.ls7182lb # [ 152.965286] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=nar/1spxkiwzvlj9sgbjal4jf4p68h5kbylxymfww73s5va157qxgafi.nar.zst7183lb # [ 152.978197] niks3-server[1108]: 2026/09/22 22:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete7184lb # [ 152.985460] niks3-server[1108]: 2026/09/22 22:24:21 INFO Completed upload id=677185worker1 # [ 152.988112] nix-grpc-daemon[1823]: time=2026-09-22T22:24:22.175Z level=INFO msg="Upload complete. (180ms)"7186lb # [ 152.989391] niks3-server[1108]: 2026/09/22 22:24:21 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.narinfo7187worker1 # [ 152.991258] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=4167188worker1 # [ 152.996313] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087189worker1 # [ 153.005658] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7190worker1 # [ 153.013949] nix-daemon[846]: reaped child process 1873, status = succeeded7191worker1 # [ 153.019555] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7192client # [ 153.028448] nix[1510]: building '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' on lb:50051...7193worker2 # [ 153.808852] nix-daemon[869]: reaped child process 1880, status = succeeded7194worker2 # [ 153.883979] nix-daemon[869]: accepted connection from pid 1905, user nix-grpc-daemon (trusted)7195worker2 # [ 153.897828] nix-daemon[869]: reaped child process 1908, status = succeeded7196lb # [ 153.905983] niks3-server[1108]: 2026/09/22 22:24:22 INFO Received uploads request method=POST path=/api/pending_closures7197worker2 # [ 153.913726] nix-grpc-daemon[1663]: time=2026-09-22T22:24:22.205Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7198worker2 # [ 153.915260] nix-grpc-daemon[1663]: time=2026-09-22T22:24:22.207Z level=INFO msg="Uploading wmw8972gq2nf739xhg7is7lylxf8299y-slow-q0 (120B)"7199lb # [ 153.952721] niks3-server[1108]: 2026/09/22 22:24:22 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.ls7200lb # [ 153.958352] niks3-server[1108]: 2026/09/22 22:24:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign7201worker2 # [ 153.961765] nix-grpc-daemon[1663]: time=2026-09-22T22:24:22.254Z level=INFO msg="Uploading 1 narinfos"7202lb # [ 153.963403] niks3-server[1108]: 2026/09/22 22:24:22 INFO Signed narinfos id=68 count=17203lb # [ 153.968555] niks3-server[1108]: 2026/09/22 22:24:22 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst7204lb # [ 153.973384] niks3-server[1108]: 2026/09/22 22:24:22 INFO Registered completed upload object_key=log/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv7205lb # [ 153.982663] niks3-server[1108]: 2026/09/22 22:24:22 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete7206lb # [ 153.985588] niks3-server[1108]: 2026/09/22 22:24:22 INFO Completed upload id=687207worker2 # [ 153.984061] nix-grpc-daemon[1663]: time=2026-09-22T22:24:22.276Z level=INFO msg="Upload complete. (210ms)"7208lb # [ 153.987881] niks3-server[1108]: 2026/09/22 22:24:22 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.narinfo7209worker2 # [ 153.990664] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=2 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv assign_id=3 outputs=17210worker2 # [ 154.004905] nix-daemon[869]: reaped child process 1878, status = succeeded7211worker1 # [ 154.851948] nix-daemon[846]: reaped child process 1882, status = succeeded7212worker1 # [ 154.928431] nix-daemon[846]: accepted connection from pid 1907, user nix-grpc-daemon (trusted)7213worker1 # [ 154.939809] nix-daemon[846]: reaped child process 1910, status = succeeded7214lb # [ 154.945345] niks3-server[1108]: 2026/09/22 22:24:23 INFO Received uploads request method=POST path=/api/pending_closures7215worker1 # [ 154.955864] nix-grpc-daemon[1823]: time=2026-09-22T22:24:24.143Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7216worker1 # [ 154.957509] nix-grpc-daemon[1823]: time=2026-09-22T22:24:24.144Z level=INFO msg="Uploading 106i40yblbkazayvn9ppswrq6kqs26sj-slow-q1 (120B)"7217lb # [ 154.982794] niks3-server[1108]: 2026/09/22 22:24:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign7218worker1 # [ 154.990373] nix-grpc-daemon[1823]: time=2026-09-22T22:24:24.177Z level=INFO msg="Uploading 1 narinfos"7219lb # [ 154.988175] niks3-server[1108]: 2026/09/22 22:24:23 INFO Signed narinfos id=69 count=17220lb # [ 154.997306] niks3-server[1108]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=log/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv7221lb # [ 155.005879] niks3-server[1108]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst7222lb # [ 155.017405] niks3-server[1108]: 2026/09/22 22:24:23 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete7223lb # [ 155.024289] niks3-server[1108]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.ls7224lb # [ 155.027406] niks3-server[1108]: 2026/09/22 22:24:23 INFO Completed upload id=697225worker1 # [ 155.030270] nix-grpc-daemon[1823]: time=2026-09-22T22:24:24.217Z level=INFO msg="Upload complete. (203ms)"7226lb # [ 155.030682] niks3-server[1108]: 2026/09/22 22:24:23 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.narinfo7227worker1 # [ 155.036653] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=2 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv assign_id=4 outputs=17228worker1 # [ 155.050748] nix-daemon[846]: reaped child process 1880, status = succeeded7229client # [ 155.079212] systemd[1]: burst.service: Deactivated successfully.7230client # [ 155.082329] systemd[1]: burst.service: Consumed 156ms CPU time over 5.070s wall clock time, 57.9M memory peak, 14.3K incoming IP traffic, 18.8K outgoing IP traffic.7231lb # [ 155.187754] envoy[904]: conn peer=[2001:db8:1::1]:39444 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9525 tx=4336 ms=43407232lb # [ 155.191369] envoy[904]: conn peer=[2001:db8:1::1]:39428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2945 tx=1522 ms=73277233lb # [ 155.194915] envoy[904]: conn peer=[2001:db8:1::3]:32882 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2254 tx=669 ms=251827234lb # [ 155.198525] envoy[904]: conn peer=[2001:db8:1::1]:35138 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9608 tx=5180 ms=49107235client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }7236client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.05 seconds)7237lb: must succeed: curl -sf localhost:9901/clusters7238lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7239lb: must succeed: curl -sf localhost:9901/clusters7240lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)7241worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7242worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7243(finished: subtest: queue gauges show a burst while every build blocks, in 6.25 seconds)7244subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does7245client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&17246worker2 # [ 156.243366] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546047247worker1 # [ 156.251770] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087248worker2 # [ 156.286830] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=want client=2 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=07249worker2 # [ 156.291250] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=17250worker2 # [ 156.295681] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=want client=2 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=07251worker2 # [ 156.299585] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:24Z level=debug event=want client=2 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=07252worker1 # [ 156.336126] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087253worker1 # [ 156.348761] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087254worker1 # [ 156.360087] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087255worker1 # [ 156.371266] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7256worker1 # [ 156.472299] nix-daemon[846]: accepted connection from pid 1918, user nix-grpc-daemon (trusted)7257worker1 # [ 156.485207] nix-daemon[846]: reaped child process 1921, status = succeeded7258lb # [ 156.490537] niks3-server[1108]: 2026/09/22 22:24:24 INFO Received uploads request method=POST path=/api/pending_closures7259worker1 # [ 156.501877] nix-grpc-daemon[1823]: time=2026-09-22T22:24:25.689Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7260worker1 # [ 156.503949] nix-grpc-daemon[1823]: time=2026-09-22T22:24:25.690Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"7261lb # [ 156.520518] niks3-server[1108]: 2026/09/22 22:24:24 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst7262lb # [ 156.530424] niks3-server[1108]: 2026/09/22 22:24:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign7263worker1 # [ 156.541435] nix-grpc-daemon[1823]: time=2026-09-22T22:24:25.728Z level=INFO msg="Uploading 1 narinfos"7264lb # [ 156.538536] niks3-server[1108]: 2026/09/22 22:24:24 INFO Signed narinfos id=70 count=17265lb # [ 156.549621] niks3-server[1108]: 2026/09/22 22:24:24 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls7266lb # [ 156.558300] niks3-server[1108]: 2026/09/22 22:24:24 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete7267lb # [ 156.563769] niks3-server[1108]: 2026/09/22 22:24:24 INFO Completed upload id=707268worker1 # [ 156.566648] nix-grpc-daemon[1823]: time=2026-09-22T22:24:25.754Z level=INFO msg="Upload complete. (184ms)"7269lb # [ 156.568108] niks3-server[1108]: 2026/09/22 22:24:24 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo7270worker1 # [ 156.571349] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=5047271worker1 # [ 156.577294] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087272worker1 # [ 156.587147] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7273worker1 # [ 156.596243] nix-daemon[846]: reaped child process 1916, status = succeeded7274worker1 # [ 156.600331] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7275worker1 # [ 157.816249] nix-daemon[846]: reaped child process 1925, status = succeeded7276worker1 # [ 157.890168] nix-daemon[846]: accepted connection from pid 1941, user nix-grpc-daemon (trusted)7277worker1 # [ 157.903396] nix-daemon[846]: reaped child process 1944, status = succeeded7278lb # [ 157.909743] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received uploads request method=POST path=/api/pending_closures7279worker1 # [ 157.921445] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.108Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7280worker1 # [ 157.923073] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.110Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"7281lb # [ 157.954108] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign7282worker1 # [ 157.962490] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.149Z level=INFO msg="Uploading 1 narinfos"7283lb # [ 157.959745] niks3-server[1108]: 2026/09/22 22:24:26 INFO Signed narinfos id=71 count=17284lb # [ 157.968382] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv7285lb # [ 157.972900] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls7286lb # [ 157.977522] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst7287lb # [ 157.985333] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete7288lb # [ 157.991986] niks3-server[1108]: 2026/09/22 22:24:26 INFO Completed upload id=717289lb # [ 157.993832] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo7290worker1 # [ 157.996249] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.183Z level=INFO msg="Upload complete. (188ms)"7291worker1 # [ 158.002830] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=5 outputs=17292worker2 # [ 157.999848] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:26Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=17293worker2 # [ 158.009182] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:26Z level=debug event=want client=2 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=07294worker1 # [ 158.018126] nix-daemon[846]: reaped child process 1923, status = succeeded7295worker1 # [ 158.054507] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087296worker1 # [ 158.067666] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087297worker1 # [ 158.079603] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087298worker1 # [ 158.087650] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7299worker1 # [ 158.186523] nix-daemon[846]: accepted connection from pid 1948, user nix-grpc-daemon (trusted)7300worker1 # [ 158.201164] nix-daemon[846]: reaped child process 1951, status = succeeded7301lb # [ 158.202467] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received uploads request method=POST path=/api/pending_closures7302worker1 # [ 158.213054] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.400Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7303worker1 # [ 158.214570] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.402Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"7304lb # [ 158.234692] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls7305lb # [ 158.243550] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign7306lb # [ 158.250687] niks3-server[1108]: 2026/09/22 22:24:26 INFO Signed narinfos id=72 count=17307worker1 # [ 158.256118] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.443Z level=INFO msg="Uploading 1 narinfos"7308lb # [ 158.255274] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst7309lb # [ 158.269420] niks3-server[1108]: 2026/09/22 22:24:26 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete7310lb # [ 158.275546] niks3-server[1108]: 2026/09/22 22:24:26 INFO Completed upload id=727311worker1 # [ 158.277755] nix-grpc-daemon[1823]: time=2026-09-22T22:24:27.465Z level=INFO msg="Upload complete. (176ms)"7312lb # [ 158.278390] niks3-server[1108]: 2026/09/22 22:24:26 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo7313worker1 # [ 158.281796] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=5047314worker1 # [ 158.288437] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087315worker1 # [ 158.300059] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7316worker1 # [ 158.307517] nix-daemon[846]: reaped child process 1946, status = succeeded7317worker1 # [ 158.312646] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7318worker1 # [ 159.127890] nix-daemon[846]: reaped child process 1955, status = succeeded7319worker1 # [ 159.201237] nix-daemon[846]: accepted connection from pid 1971, user nix-grpc-daemon (trusted)7320worker1 # [ 159.215372] nix-daemon[846]: reaped child process 1974, status = succeeded7321lb # [ 159.217986] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received uploads request method=POST path=/api/pending_closures7322worker1 # [ 159.228757] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.416Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7323worker1 # [ 159.230269] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.417Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"7324lb # [ 159.257784] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv7325lb # [ 159.270101] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign7326worker1 # [ 159.277740] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.465Z level=INFO msg="Uploading 1 narinfos"7327lb # [ 159.276596] niks3-server[1108]: 2026/09/22 22:24:27 INFO Signed narinfos id=73 count=17328lb # [ 159.280831] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls7329lb # [ 159.288848] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst7330lb # [ 159.297161] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete7331lb # [ 159.304983] niks3-server[1108]: 2026/09/22 22:24:27 INFO Completed upload id=737332worker1 # [ 159.307640] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.495Z level=INFO msg="Upload complete. (188ms)"7333lb # [ 159.306775] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo7334worker1 # [ 159.314573] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=6 outputs=17335worker2 # [ 159.311372] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:27Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=17336worker1 # [ 159.323318] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087337worker2 # [ 159.320658] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:27Z level=debug event=want client=2 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=07338worker1 # [ 159.333824] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087339worker1 # [ 159.342408] nix-daemon[846]: reaped child process 1953, status = succeeded7340worker1 # [ 159.345733] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087341worker1 # [ 159.349947] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7342worker1 # [ 159.433518] nix-daemon[846]: accepted connection from pid 1978, user nix-grpc-daemon (trusted)7343worker1 # [ 159.447978] nix-daemon[846]: reaped child process 1981, status = succeeded7344lb # [ 159.449361] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received uploads request method=POST path=/api/pending_closures7345worker1 # [ 159.459704] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.647Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7346worker1 # [ 159.461562] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.648Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"7347lb # [ 159.480286] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign7348worker1 # [ 159.492560] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.679Z level=INFO msg="Uploading 1 narinfos"7349lb # [ 159.489668] niks3-server[1108]: 2026/09/22 22:24:27 INFO Signed narinfos id=74 count=17350lb # [ 159.493901] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls7351lb # [ 159.504549] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst7352lb # [ 159.512293] niks3-server[1108]: 2026/09/22 22:24:27 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete7353lb # [ 159.517727] niks3-server[1108]: 2026/09/22 22:24:27 INFO Completed upload id=747354worker1 # [ 159.519763] nix-grpc-daemon[1823]: time=2026-09-22T22:24:28.707Z level=INFO msg="Upload complete. (164ms)"7355lb # [ 159.522619] niks3-server[1108]: 2026/09/22 22:24:27 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo7356worker1 # [ 159.523730] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=5047357worker1 # [ 159.528407] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087358worker1 # [ 159.536603] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7359worker1 # [ 159.546114] nix-daemon[846]: reaped child process 1976, status = succeeded7360worker1 # [ 159.549351] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7361worker1 # [ 160.589802] nix-daemon[846]: reaped child process 1985, status = succeeded7362worker1 # [ 160.671730] nix-daemon[846]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)7363worker1 # [ 160.683922] nix-daemon[846]: reaped child process 2004, status = succeeded7364lb # [ 160.687985] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received uploads request method=POST path=/api/pending_closures7365worker1 # [ 160.698656] nix-grpc-daemon[1823]: time=2026-09-22T22:24:29.885Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7366worker1 # [ 160.700350] nix-grpc-daemon[1823]: time=2026-09-22T22:24:29.887Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"7367lb # [ 160.730433] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls7368lb # [ 160.738171] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign7369worker1 # [ 160.748131] nix-grpc-daemon[1823]: time=2026-09-22T22:24:29.935Z level=INFO msg="Uploading 1 narinfos"7370lb # [ 160.745870] niks3-server[1108]: 2026/09/22 22:24:29 INFO Signed narinfos id=75 count=17371lb # [ 160.751908] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst7372lb # [ 160.755620] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv7373lb # [ 160.767088] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete7374lb # [ 160.771053] niks3-server[1108]: 2026/09/22 22:24:29 INFO Completed upload id=757375lb # [ 160.772871] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo7376worker1 # [ 160.773825] nix-grpc-daemon[1823]: time=2026-09-22T22:24:29.961Z level=INFO msg="Upload complete. (216ms)"7377worker2 # [ 160.777850] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:29Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=17378worker1 # [ 160.780956] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=7 outputs=17379worker2 # [ 160.786885] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:29Z level=debug event=want client=2 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=07380worker1 # [ 160.797329] nix-daemon[846]: reaped child process 1983, status = succeeded7381worker1 # [ 160.825523] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087382worker1 # [ 160.838214] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087383worker1 # [ 160.851142] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.038Z level=INFO msg="All 1 paths already cached"7384worker1 # [ 160.859181] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087385worker1 # [ 160.869553] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7386worker1 # [ 160.964894] nix-daemon[846]: accepted connection from pid 2008, user nix-grpc-daemon (trusted)7387worker1 # [ 160.978593] nix-daemon[846]: reaped child process 2011, status = succeeded7388lb # [ 160.981921] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received uploads request method=POST path=/api/pending_closures7389worker1 # [ 160.992484] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.179Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7390worker1 # [ 160.994033] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.181Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"7391lb # [ 161.011836] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign7392worker1 # [ 161.020272] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.207Z level=INFO msg="Uploading 1 narinfos"7393lb # [ 161.017903] niks3-server[1108]: 2026/09/22 22:24:29 INFO Signed narinfos id=76 count=17394lb # [ 161.026969] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls7395lb # [ 161.032263] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst7396lb # [ 161.044305] niks3-server[1108]: 2026/09/22 22:24:29 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete7397lb # [ 161.050715] niks3-server[1108]: 2026/09/22 22:24:29 INFO Completed upload id=767398worker1 # [ 161.053174] nix-grpc-daemon[1823]: time=2026-09-22T22:24:30.240Z level=INFO msg="Upload complete. (172ms)"7399lb # [ 161.054112] niks3-server[1108]: 2026/09/22 22:24:29 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo7400worker1 # [ 161.057465] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=6247401worker1 # [ 161.063154] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087402worker1 # [ 161.074137] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7403worker1 # [ 161.079132] nix-daemon[846]: reaped child process 2006, status = succeeded7404worker1 # [ 161.082860] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7405worker1 # [ 162.320697] nix-daemon[846]: reaped child process 2015, status = succeeded7406worker1 # [ 162.405466] nix-daemon[846]: accepted connection from pid 2031, user nix-grpc-daemon (trusted)7407worker1 # [ 162.416891] nix-daemon[846]: reaped child process 2034, status = succeeded7408lb # [ 162.422403] niks3-server[1108]: 2026/09/22 22:24:30 INFO Received uploads request method=POST path=/api/pending_closures7409worker1 # [ 162.433260] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.620Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7410worker1 # [ 162.437530] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.622Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"7411lb # [ 162.466487] niks3-server[1108]: 2026/09/22 22:24:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign7412lb # [ 162.474567] niks3-server[1108]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv7413lb # [ 162.482261] niks3-server[1108]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst7414lb # [ 162.489763] niks3-server[1108]: 2026/09/22 22:24:30 INFO Signed narinfos id=77 count=17415worker1 # [ 162.492676] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.680Z level=INFO msg="Uploading 1 narinfos"7416lb # [ 162.493616] niks3-server[1108]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls7417lb # [ 162.504398] niks3-server[1108]: 2026/09/22 22:24:30 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete7418lb # [ 162.507436] niks3-server[1108]: 2026/09/22 22:24:30 INFO Completed upload id=777419worker1 # [ 162.510267] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.697Z level=INFO msg="Upload complete. (219ms)"7420lb # [ 162.511393] niks3-server[1108]: 2026/09/22 22:24:30 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo7421worker1 # [ 162.516958] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=8 outputs=17422worker2 # [ 162.513624] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:30Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=17423worker2 # [ 162.523304] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:30Z level=debug event=want client=2 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=07424worker1 # [ 162.531946] nix-daemon[846]: reaped child process 2013, status = succeeded7425worker1 # [ 162.567174] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087426worker1 # [ 162.580075] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087427worker1 # [ 162.593712] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.781Z level=INFO msg="All 1 paths already cached"7428worker1 # [ 162.601404] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087429worker1 # [ 162.611169] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7430worker1 # [ 162.708464] nix-daemon[846]: accepted connection from pid 2038, user nix-grpc-daemon (trusted)7431worker1 # [ 162.723873] nix-daemon[846]: reaped child process 2041, status = succeeded7432lb # [ 162.724449] niks3-server[1108]: 2026/09/22 22:24:31 INFO Received uploads request method=POST path=/api/pending_closures7433worker1 # [ 162.735484] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.922Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7434worker1 # [ 162.736996] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.924Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"7435lb # [ 162.757239] niks3-server[1108]: 2026/09/22 22:24:31 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls7436lb # [ 162.763257] niks3-server[1108]: 2026/09/22 22:24:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign7437lb # [ 162.770539] niks3-server[1108]: 2026/09/22 22:24:31 INFO Signed narinfos id=78 count=17438worker1 # [ 162.776890] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.964Z level=INFO msg="Uploading 1 narinfos"7439lb # [ 162.779205] niks3-server[1108]: 2026/09/22 22:24:31 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst7440lb # [ 162.789137] niks3-server[1108]: 2026/09/22 22:24:31 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete7441worker1 # [ 162.797840] nix-grpc-daemon[1823]: time=2026-09-22T22:24:31.985Z level=INFO msg="Upload complete. (175ms)"7442lb # [ 162.795620] niks3-server[1108]: 2026/09/22 22:24:31 INFO Completed upload id=787443lb # [ 162.800382] niks3-server[1108]: 2026/09/22 22:24:31 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo7444worker1 # [ 162.800239] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=6247445worker1 # [ 162.805661] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087446worker1 # [ 162.814699] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7447worker1 # [ 162.821317] nix-daemon[846]: reaped child process 2036, status = succeeded7448worker1 # [ 162.825461] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7449worker1 # [ 163.874764] nix-daemon[846]: reaped child process 2045, status = succeeded7450worker1 # [ 163.951797] nix-daemon[846]: accepted connection from pid 2061, user nix-grpc-daemon (trusted)7451worker1 # [ 163.965389] nix-daemon[846]: reaped child process 2064, status = succeeded7452lb # [ 163.968641] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received uploads request method=POST path=/api/pending_closures7453worker1 # [ 163.979927] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.167Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7454worker1 # [ 163.981810] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.168Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"7455lb # [ 164.009120] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign7456worker1 # [ 164.020029] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.207Z level=INFO msg="Uploading 1 narinfos"7457lb # [ 164.017831] niks3-server[1108]: 2026/09/22 22:24:32 INFO Signed narinfos id=79 count=17458lb # [ 164.022760] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls7459lb # [ 164.029424] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst7460lb # [ 164.035249] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv7461lb # [ 164.043912] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete7462lb # [ 164.050586] niks3-server[1108]: 2026/09/22 22:24:32 INFO Completed upload id=797463worker1 # [ 164.053505] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.240Z level=INFO msg="Upload complete. (220ms)"7464lb # [ 164.053882] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo7465worker1 # [ 164.059559] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=9 outputs=17466worker2 # [ 164.056809] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:32Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=17467worker1 # [ 164.075117] nix-daemon[846]: reaped child process 2043, status = succeeded7468worker1 # [ 164.105277] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087469worker2 # [ 164.103702] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:32Z level=debug event=want client=2 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=07470worker1 # [ 164.117510] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087471worker1 # [ 164.130508] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.317Z level=INFO msg="All 1 paths already cached"7472worker1 # [ 164.138221] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087473worker1 # [ 164.148167] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7474worker1 # [ 164.243457] nix-daemon[846]: accepted connection from pid 2068, user nix-grpc-daemon (trusted)7475worker1 # [ 164.258390] nix-daemon[846]: reaped child process 2071, status = succeeded7476lb # [ 164.259656] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received uploads request method=POST path=/api/pending_closures7477worker1 # [ 164.270697] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.458Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7478worker1 # [ 164.272272] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.459Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"7479lb # [ 164.292921] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign7480lb # [ 164.297996] niks3-server[1108]: 2026/09/22 22:24:32 INFO Signed narinfos id=80 count=17481worker1 # [ 164.304506] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.491Z level=INFO msg="Uploading 1 narinfos"7482lb # [ 164.304782] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst7483lb # [ 164.311577] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls7484lb # [ 164.325439] niks3-server[1108]: 2026/09/22 22:24:32 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete7485lb # [ 164.332979] niks3-server[1108]: 2026/09/22 22:24:32 INFO Completed upload id=807486worker1 # [ 164.335377] nix-grpc-daemon[1823]: time=2026-09-22T22:24:33.522Z level=INFO msg="Upload complete. (176ms)"7487lb # [ 164.336370] niks3-server[1108]: 2026/09/22 22:24:32 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo7488worker1 # [ 164.340649] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=6247489worker1 # [ 164.346509] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087490worker1 # [ 164.356107] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7491worker1 # [ 164.368485] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7492worker1 # [ 164.370681] nix-daemon[846]: reaped child process 2066, status = succeeded7493worker1 # [ 165.605674] nix-daemon[846]: reaped child process 2075, status = succeeded7494worker1 # [ 165.675361] nix-daemon[846]: accepted connection from pid 2091, user nix-grpc-daemon (trusted)7495worker1 # [ 165.688952] nix-daemon[846]: reaped child process 2094, status = succeeded7496lb # [ 165.692645] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received uploads request method=POST path=/api/pending_closures7497worker1 # [ 165.703403] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.890Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7498worker1 # [ 165.705165] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.892Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"7499lb # [ 165.733617] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst7500worker1 # [ 165.746760] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.934Z level=INFO msg="Uploading 1 narinfos"7501lb # [ 165.743985] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign7502lb # [ 165.747646] niks3-server[1108]: 2026/09/22 22:24:34 INFO Signed narinfos id=81 count=17503lb # [ 165.755794] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv7504lb # [ 165.759630] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls7505lb # [ 165.767280] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete7506lb # [ 165.773359] niks3-server[1108]: 2026/09/22 22:24:34 INFO Completed upload id=817507worker1 # [ 165.776351] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.963Z level=INFO msg="Upload complete. (199ms)"7508lb # [ 165.779056] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo7509worker1 # [ 165.781111] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=10 outputs=17510worker2 # [ 165.778261] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:34Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=17511worker1 # [ 165.789768] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087512worker2 # [ 165.787854] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:34Z level=debug event=want client=2 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=07513worker1 # [ 165.801286] nix-daemon[846]: reaped child process 2073, status = succeeded7514worker1 # [ 165.804486] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087515worker1 # [ 165.812344] nix-grpc-daemon[1823]: time=2026-09-22T22:24:34.999Z level=INFO msg="All 2 paths already cached"7516worker1 # [ 165.817625] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087517worker1 # [ 165.822281] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7518worker1 # [ 165.903053] nix-daemon[846]: accepted connection from pid 2098, user nix-grpc-daemon (trusted)7519worker1 # [ 165.915615] nix-daemon[846]: reaped child process 2101, status = succeeded7520lb # [ 165.920215] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received uploads request method=POST path=/api/pending_closures7521worker1 # [ 165.932815] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.120Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7522worker1 # [ 165.934764] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.121Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"7523lb # [ 165.954398] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst7524lb # [ 165.960134] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign7525lb # [ 165.965341] niks3-server[1108]: 2026/09/22 22:24:34 INFO Signed narinfos id=82 count=17526worker1 # [ 165.970947] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.158Z level=INFO msg="Uploading 1 narinfos"7527lb # [ 165.976162] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls7528lb # [ 165.985449] niks3-server[1108]: 2026/09/22 22:24:34 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete7529lb # [ 165.989166] niks3-server[1108]: 2026/09/22 22:24:34 INFO Completed upload id=827530worker1 # [ 165.993141] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.180Z level=INFO msg="Upload complete. (166ms)"7531lb # [ 165.992624] niks3-server[1108]: 2026/09/22 22:24:34 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo7532worker1 # [ 165.997198] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=7527533worker1 # [ 166.002104] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087534worker1 # [ 166.011706] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7535worker1 # [ 166.021112] nix-daemon[846]: reaped child process 2096, status = succeeded7536worker1 # [ 166.024165] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7537worker1 # [ 166.638196] nix-daemon[846]: reaped child process 2105, status = succeeded7538worker1 # [ 166.713089] nix-daemon[846]: accepted connection from pid 2121, user nix-grpc-daemon (trusted)7539worker1 # [ 166.725558] nix-daemon[846]: reaped child process 2124, status = succeeded7540lb # [ 166.729469] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received uploads request method=POST path=/api/pending_closures7541worker1 # [ 166.743274] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.930Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7542worker1 # [ 166.744982] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.932Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"7543lb # [ 166.778156] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign7544lb # [ 166.784860] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst7545lb # [ 166.791847] niks3-server[1108]: 2026/09/22 22:24:35 INFO Signed narinfos id=83 count=17546lb # [ 166.796375] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls7547worker1 # [ 166.799487] nix-grpc-daemon[1823]: time=2026-09-22T22:24:35.986Z level=INFO msg="Uploading 1 narinfos"7548lb # [ 166.800332] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv7549lb # [ 166.811982] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete7550lb # [ 166.815943] niks3-server[1108]: 2026/09/22 22:24:35 INFO Completed upload id=837551lb # [ 166.817832] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo7552worker1 # [ 166.818822] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.006Z level=INFO msg="Upload complete. (188ms)"7553worker2 # [ 166.823197] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:35Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=17554worker1 # [ 166.828525] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=11 outputs=17555worker1 # [ 166.843233] nix-daemon[846]: reaped child process 2103, status = succeeded7556worker1 # [ 166.872295] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087557worker1 # [ 166.885617] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087558worker1 # [ 166.899581] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.086Z level=INFO msg="All 2 paths already cached"7559worker1 # [ 166.908276] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087560worker1 # [ 166.919144] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7561worker1 # [ 167.014114] nix-daemon[846]: accepted connection from pid 2128, user nix-grpc-daemon (trusted)7562worker1 # [ 167.029510] nix-daemon[846]: reaped child process 2131, status = succeeded7563lb # [ 167.031952] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received uploads request method=POST path=/api/pending_closures7564worker1 # [ 167.042264] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.229Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7565worker1 # [ 167.043765] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.231Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"7566lb # [ 167.063447] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst7567lb # [ 167.069800] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign7568lb # [ 167.076769] niks3-server[1108]: 2026/09/22 22:24:35 INFO Signed narinfos id=84 count=17569worker1 # [ 167.084458] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.271Z level=INFO msg="Uploading 1 narinfos"7570lb # [ 167.083146] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls7571lb # [ 167.099184] niks3-server[1108]: 2026/09/22 22:24:35 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete7572lb # [ 167.104191] niks3-server[1108]: 2026/09/22 22:24:35 INFO Completed upload id=847573worker1 # [ 167.106490] nix-grpc-daemon[1823]: time=2026-09-22T22:24:36.293Z level=INFO msg="Upload complete. (174ms)"7574lb # [ 167.107414] niks3-server[1108]: 2026/09/22 22:24:35 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo7575worker1 # [ 167.111364] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=7527576worker1 # [ 167.117954] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087577worker1 # [ 167.127653] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7578worker1 # [ 167.136902] nix-daemon[846]: reaped child process 2126, status = succeeded7579worker1 # [ 167.141392] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7580worker1 # [ 168.571305] nix-daemon[846]: reaped child process 2135, status = succeeded7581worker1 # [ 168.641931] nix-daemon[846]: accepted connection from pid 2151, user nix-grpc-daemon (trusted)7582worker1 # [ 168.656347] nix-daemon[846]: reaped child process 2154, status = succeeded7583lb # [ 168.660067] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received uploads request method=POST path=/api/pending_closures7584worker1 # [ 168.670713] nix-grpc-daemon[1823]: time=2026-09-22T22:24:37.858Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7585worker1 # [ 168.673461] nix-grpc-daemon[1823]: time=2026-09-22T22:24:37.859Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"7586lb # [ 168.695934] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls7587lb # [ 168.706114] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign7588worker1 # [ 168.717410] nix-grpc-daemon[1823]: time=2026-09-22T22:24:37.904Z level=INFO msg="Uploading 1 narinfos"7589lb # [ 168.714677] niks3-server[1108]: 2026/09/22 22:24:37 INFO Signed narinfos id=85 count=17590lb # [ 168.720596] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst7591lb # [ 168.726891] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv7592lb # [ 168.737234] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete7593lb # [ 168.739692] niks3-server[1108]: 2026/09/22 22:24:37 INFO Completed upload id=857594lb # [ 168.742506] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo7595worker1 # [ 168.743657] nix-grpc-daemon[1823]: time=2026-09-22T22:24:37.931Z level=INFO msg="Upload complete. (193ms)"7596worker2 # [ 168.746828] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:37Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=17597worker1 # [ 168.751598] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=12 outputs=17598worker1 # [ 168.765200] nix-daemon[846]: reaped child process 2133, status = succeeded7599worker1 # [ 168.794776] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087600worker1 # [ 168.807814] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:608087601worker1 # [ 168.820873] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.008Z level=INFO msg="All 2 paths already cached"7602worker1 # [ 168.828952] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:608087603worker1 # [ 168.839137] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7604worker1 # [ 168.932766] nix-daemon[846]: accepted connection from pid 2158, user nix-grpc-daemon (trusted)7605worker1 # [ 168.947134] nix-daemon[846]: reaped child process 2161, status = succeeded7606lb # [ 168.949216] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received uploads request method=POST path=/api/pending_closures7607worker1 # [ 168.959650] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.147Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7608worker1 # [ 168.961205] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.148Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"7609lb # [ 168.978802] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/86/sign7610lb # [ 168.983811] niks3-server[1108]: 2026/09/22 22:24:37 INFO Signed narinfos id=86 count=17611worker1 # [ 168.989289] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.176Z level=INFO msg="Uploading 1 narinfos"7612lb # [ 168.991916] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst7613lb # [ 169.000476] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls7614lb # [ 169.011526] niks3-server[1108]: 2026/09/22 22:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/86/complete7615worker1 # [ 169.018864] nix-grpc-daemon[1823]: time=2026-09-22T22:24:38.206Z level=INFO msg="Upload complete. (168ms)"7616lb # [ 169.016465] niks3-server[1108]: 2026/09/22 22:24:37 INFO Completed upload id=867617worker1 # [ 169.021747] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=0 paths=1 nar_bytes_in=7527618lb # [ 169.021042] niks3-server[1108]: 2026/09/22 22:24:37 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo7619worker1 # [ 169.027739] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:608087620worker1 # [ 169.036727] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7621worker1 # [ 169.041686] nix-daemon[846]: reaped child process 2156, status = succeeded7622worker1 # [ 169.046740] nix-daemon[846]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)7623worker1 # [ 170.083865] nix-daemon[846]: reaped child process 2165, status = succeeded7624worker1 # [ 170.163403] nix-daemon[846]: accepted connection from pid 2181, user nix-grpc-daemon (trusted)7625worker1 # [ 170.177141] nix-daemon[846]: reaped child process 2184, status = succeeded7626lb # [ 170.181444] niks3-server[1108]: 2026/09/22 22:24:38 INFO Received uploads request method=POST path=/api/pending_closures7627worker1 # [ 170.192404] nix-grpc-daemon[1823]: time=2026-09-22T22:24:39.379Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7628worker1 # [ 170.193943] nix-grpc-daemon[1823]: time=2026-09-22T22:24:39.381Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"7629lb # [ 170.221671] niks3-server[1108]: 2026/09/22 22:24:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/87/sign7630worker1 # [ 170.232193] nix-grpc-daemon[1823]: time=2026-09-22T22:24:39.419Z level=INFO msg="Uploading 1 narinfos"7631lb # [ 170.229466] niks3-server[1108]: 2026/09/22 22:24:38 INFO Signed narinfos id=87 count=17632lb # [ 170.237105] niks3-server[1108]: 2026/09/22 22:24:38 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst7633lb # [ 170.243530] niks3-server[1108]: 2026/09/22 22:24:38 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv7634lb # [ 170.250110] niks3-server[1108]: 2026/09/22 22:24:38 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls7635lb # [ 170.257115] niks3-server[1108]: 2026/09/22 22:24:38 INFO Received complete upload request method=POST path=/api/pending_closures/87/complete7636lb # [ 170.262954] niks3-server[1108]: 2026/09/22 22:24:38 INFO Completed upload id=877637worker1 # [ 170.265330] nix-grpc-daemon[1823]: time=2026-09-22T22:24:39.452Z level=INFO msg="Upload complete. (209ms)"7638lb # [ 170.268600] niks3-server[1108]: 2026/09/22 22:24:38 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo7639worker1 # [ 170.270678] nix-grpc-daemon[1762]: ts=2026-09-22T22:24:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60808 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=13 outputs=17640worker1 # [ 170.285217] nix-daemon[846]: reaped child process 2163, status = succeeded7641client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 14.25 seconds)7642worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7643worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7644client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]'7645client # [ 170.456061] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]".7646client # Running as unit: gpu.service; invocation ID: 79b88f80a3fa43e9a3e2e2131993b9607647client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds)7648lb: must succeed: curl -sf localhost:9901/clusters7649lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)7650lb: must succeed: curl -sf localhost:9901/clusters7651lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7652worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7653worker2 # [ 170.578902] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546047654client # [ 170.599111] nix[1580]: don't know how to build these paths:7655client # [ 170.600195] nix[1580]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv7656worker2 # [ 170.587213] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546047657client # [ 170.615814] nix[1580]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker7658worker2 # [ 170.601222] nix-grpc-daemon[1586]: ts=2026-09-22T22:24:38Z level=debug event=want client=3 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=07659worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)7660lb: must succeed: curl -sf localhost:9901/clusters7661lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7662lb: must succeed: curl -sf localhost:9901/clusters7663lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7664worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7665worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7666client: waiting for success: systemctl show -p Result gpu | grep -q exit-code7667lb # [ 175.187882] envoy[904]: conn peer=[2001:db8:1::1]:46774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27051 tx=12297 ms=140827668client # [ 200.616542] nix[1580]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}7669client # [ 200.624507] nix[1580]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed7670client # [ 200.651585] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE7671client # [ 200.654910] systemd[1]: gpu.service: Failed with result 'exit-code'.7672client # [ 200.659339] systemd[1]: gpu.service: Consumed 133ms CPU time over 30.203s wall clock time, 37.6M memory peak, 5.1K incoming IP traffic, 5.1K outgoing IP traffic.7673client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.40 seconds)7674client: must succeed: journalctl -u gpu -o cat7675client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds)7676lb: must succeed: curl -sf localhost:9901/clusters7677lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7678lb: must succeed: curl -sf localhost:9901/clusters7679lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)7680worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7681worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)7682(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 45.16 seconds)7683subtest: low disk drains a worker and builds go to the other7684worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill7685worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.99 seconds)7686worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'7687worker1 # [ 202.669363] nix-grpc-daemon[1762]: ts=2026-09-22T22:25:11Z level=info event=unhealthy reason=min_free7688worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds)7689client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&27690client # don't know how to build these paths:7691client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7692worker2 # [ 203.481095] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546047693worker2 # [ 203.486694] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546047694worker2 # [ 203.507112] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=want client=4 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=07695worker2 # [ 203.512391] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=17696worker2 # [ 203.551701] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047697worker2 # [ 203.564449] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546047698client # copying 1 paths to 'lb:50051'...7699client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...7700worker2 # [ 203.577471] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546047701worker2 # [ 203.589464] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7702worker2 # [ 203.694524] nix-daemon[869]: accepted connection from pid 1950, user nix-grpc-daemon (trusted)7703worker2 # [ 203.708340] nix-daemon[869]: reaped child process 1953, status = succeeded7704lb # [ 203.719596] niks3-server[1108]: 2026/09/22 22:25:12 INFO Received uploads request method=POST path=/api/pending_closures7705worker2 # [ 203.726561] nix-grpc-daemon[1663]: time=2026-09-22T22:25:12.018Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7706worker2 # [ 203.728601] nix-grpc-daemon[1663]: time=2026-09-22T22:25:12.020Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"7707lb # [ 203.757211] niks3-server[1108]: 2026/09/22 22:25:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/88/sign7708worker2 # [ 203.763263] nix-grpc-daemon[1663]: time=2026-09-22T22:25:12.055Z level=INFO msg="Uploading 1 narinfos"7709lb # [ 203.764646] niks3-server[1108]: 2026/09/22 22:25:12 INFO Signed narinfos id=88 count=17710lb # [ 203.772492] niks3-server[1108]: 2026/09/22 22:25:12 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst7711lb # [ 203.778372] niks3-server[1108]: 2026/09/22 22:25:12 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls7712lb # [ 203.794177] niks3-server[1108]: 2026/09/22 22:25:12 INFO Received complete upload request method=POST path=/api/pending_closures/88/complete7713lb # [ 203.797223] niks3-server[1108]: 2026/09/22 22:25:12 INFO Completed upload id=887714worker2 # [ 203.795909] nix-grpc-daemon[1663]: time=2026-09-22T22:25:12.088Z level=INFO msg="Upload complete. (194ms)"7715lb # [ 203.799868] niks3-server[1108]: 2026/09/22 22:25:12 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo7716worker2 # [ 203.800847] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=5127717worker2 # [ 203.808207] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047718worker2 # [ 203.818667] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7719worker2 # [ 203.827434] nix-daemon[869]: reaped child process 1948, status = succeeded7720client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...7721worker2 # [ 203.835745] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7722client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv7723client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds7724client # farm-a> LOG-farm-a-drain7725worker2 # [ 205.050083] nix-daemon[869]: reaped child process 1957, status = succeeded7726worker2 # [ 205.127881] nix-daemon[869]: accepted connection from pid 1973, user nix-grpc-daemon (trusted)7727worker2 # [ 205.139607] nix-daemon[869]: reaped child process 1976, status = succeeded7728lb # [ 205.149638] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received uploads request method=POST path=/api/pending_closures7729worker2 # [ 205.161449] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.453Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7730worker2 # [ 205.162971] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.455Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"7731lb # [ 205.189329] envoy[904]: conn peer=[2001:db8:1::1]:33822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=561 ms=300427732lb # [ 205.197842] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv7733lb # [ 205.202419] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls7734lb # [ 205.207875] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/89/sign7735lb # [ 205.210947] niks3-server[1108]: 2026/09/22 22:25:13 INFO Signed narinfos id=89 count=17736worker2 # [ 205.209635] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.501Z level=INFO msg="Uploading 1 narinfos"7737lb # [ 205.215715] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7738lb # [ 205.219883] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received complete upload request method=POST path=/api/pending_closures/89/complete7739lb # [ 205.222894] niks3-server[1108]: 2026/09/22 22:25:13 INFO Completed upload id=897740worker2 # [ 205.221559] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.513Z level=INFO msg="Upload complete. (179ms)"7741lb # [ 205.225620] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo7742worker2 # [ 205.227644] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=14 outputs=17743worker2 # [ 205.237723] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=want client=4 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=07744worker2 # [ 205.242206] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=17745worker2 # [ 205.250457] nix-daemon[869]: reaped child process 1955, status = succeeded7746worker2 # [ 205.280818] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047747worker2 # [ 205.293076] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546047748worker2 # [ 205.305506] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.597Z level=INFO msg="All 1 paths already cached"7749client # copying 1 paths to 'lb:50051'...7750client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...7751worker2 # [ 205.313803] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546047752worker2 # [ 205.323270] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7753worker2 # [ 205.416336] nix-daemon[869]: accepted connection from pid 1982, user nix-grpc-daemon (trusted)7754worker2 # [ 205.428636] nix-daemon[869]: reaped child process 1985, status = succeeded7755lb # [ 205.438679] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received uploads request method=POST path=/api/pending_closures7756worker2 # [ 205.445435] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.737Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7757worker2 # [ 205.447836] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.740Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"7758lb # [ 205.471493] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/90/sign7759lb # [ 205.476395] niks3-server[1108]: 2026/09/22 22:25:13 INFO Signed narinfos id=90 count=17760worker2 # [ 205.477442] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.769Z level=INFO msg="Uploading 1 narinfos"7761lb # [ 205.484259] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls7762lb # [ 205.491078] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst7763lb # [ 205.498973] niks3-server[1108]: 2026/09/22 22:25:13 INFO Received complete upload request method=POST path=/api/pending_closures/90/complete7764lb # [ 205.502439] niks3-server[1108]: 2026/09/22 22:25:13 INFO Completed upload id=907765worker2 # [ 205.500927] nix-grpc-daemon[1663]: time=2026-09-22T22:25:13.793Z level=INFO msg="Upload complete. (167ms)"7766lb # [ 205.504304] niks3-server[1108]: 2026/09/22 22:25:13 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo7767worker2 # [ 205.505126] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=6247768worker2 # [ 205.511176] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047769worker2 # [ 205.518864] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7770worker2 # [ 205.525836] nix-daemon[869]: reaped child process 1980, status = succeeded7771worker2 # [ 205.528623] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7772client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...7773client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7774client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7775client # farm-b> LOG-farm-b-drain7776worker2 # [ 206.743763] nix-daemon[869]: reaped child process 1989, status = succeeded7777worker2 # [ 206.821355] nix-daemon[869]: accepted connection from pid 2005, user nix-grpc-daemon (trusted)7778worker2 # [ 206.832644] nix-daemon[869]: reaped child process 2008, status = succeeded7779lb # [ 206.843180] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received uploads request method=POST path=/api/pending_closures7780worker2 # [ 206.849651] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.141Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7781worker2 # [ 206.851187] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.143Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"7782lb # [ 206.886725] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/91/sign7783worker2 # [ 206.892239] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.184Z level=INFO msg="Uploading 1 narinfos"7784lb # [ 206.894143] niks3-server[1108]: 2026/09/22 22:25:15 INFO Signed narinfos id=91 count=17785lb # [ 206.902337] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst7786lb # [ 206.907117] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7787lb # [ 206.913829] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls7788lb # [ 206.923559] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received complete upload request method=POST path=/api/pending_closures/91/complete7789lb # [ 206.929404] niks3-server[1108]: 2026/09/22 22:25:15 INFO Completed upload id=917790worker2 # [ 206.927606] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.219Z level=INFO msg="Upload complete. (191ms)"7791lb # [ 206.931962] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo7792worker2 # [ 206.934558] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=15 outputs=17793worker2 # [ 206.946382] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=want client=4 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=07794worker2 # [ 206.950383] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=17795worker2 # [ 206.959818] nix-daemon[869]: reaped child process 1987, status = succeeded7796worker2 # [ 206.990555] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047797worker2 # [ 207.002987] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546047798worker2 # [ 207.016409] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.308Z level=INFO msg="All 2 paths already cached"7799client # copying 1 paths to 'lb:50051'...7800client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...7801worker2 # [ 207.026160] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546047802worker2 # [ 207.036164] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7803worker2 # [ 207.136386] nix-daemon[869]: accepted connection from pid 2014, user nix-grpc-daemon (trusted)7804worker2 # [ 207.151178] nix-daemon[869]: reaped child process 2017, status = succeeded7805lb # [ 207.159747] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received uploads request method=POST path=/api/pending_closures7806worker2 # [ 207.166127] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.458Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7807worker2 # [ 207.167677] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.460Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"7808lb # [ 207.188881] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/92/sign7809lb # [ 207.194300] niks3-server[1108]: 2026/09/22 22:25:15 INFO Signed narinfos id=92 count=17810worker2 # [ 207.195552] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.488Z level=INFO msg="Uploading 1 narinfos"7811lb # [ 207.205171] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls7812lb # [ 207.214808] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst7813lb # [ 207.225580] niks3-server[1108]: 2026/09/22 22:25:15 INFO Received complete upload request method=POST path=/api/pending_closures/92/complete7814worker2 # [ 207.229376] nix-grpc-daemon[1663]: time=2026-09-22T22:25:15.521Z level=INFO msg="Upload complete. (182ms)"7815lb # [ 207.230925] niks3-server[1108]: 2026/09/22 22:25:15 INFO Completed upload id=927816lb # [ 207.232843] niks3-server[1108]: 2026/09/22 22:25:15 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo7817worker2 # [ 207.231538] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=0 paths=1 nar_bytes_in=7527818worker2 # [ 207.235484] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546047819worker2 # [ 207.243995] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7820worker2 # [ 207.250965] nix-daemon[869]: reaped child process 2012, status = succeeded7821worker2 # [ 207.255892] nix-daemon[869]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)7822client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...7823client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7824client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7825client # farm-top> LOG-farm-top-drain7826worker2 # [ 208.495617] nix-daemon[869]: reaped child process 2021, status = succeeded7827worker2 # [ 208.575637] nix-daemon[869]: accepted connection from pid 2037, user nix-grpc-daemon (trusted)7828worker2 # [ 208.586983] nix-daemon[869]: reaped child process 2040, status = succeeded7829lb # [ 208.598284] niks3-server[1108]: 2026/09/22 22:25:16 INFO Received uploads request method=POST path=/api/pending_closures7830worker2 # [ 208.604683] nix-grpc-daemon[1663]: time=2026-09-22T22:25:16.896Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7831worker2 # [ 208.606333] nix-grpc-daemon[1663]: time=2026-09-22T22:25:16.898Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"7832lb # [ 208.638197] niks3-server[1108]: 2026/09/22 22:25:16 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7833lb # [ 208.647516] niks3-server[1108]: 2026/09/22 22:25:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/93/sign7834lb # [ 208.652281] niks3-server[1108]: 2026/09/22 22:25:17 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst7835lb # [ 208.660722] niks3-server[1108]: 2026/09/22 22:25:17 INFO Signed narinfos id=93 count=17836worker2 # [ 208.662592] nix-grpc-daemon[1663]: time=2026-09-22T22:25:16.954Z level=INFO msg="Uploading 1 narinfos"7837lb # [ 208.669615] niks3-server[1108]: 2026/09/22 22:25:17 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls7838lb # [ 208.677178] niks3-server[1108]: 2026/09/22 22:25:17 INFO Received complete upload request method=POST path=/api/pending_closures/93/complete7839lb # [ 208.682794] niks3-server[1108]: 2026/09/22 22:25:17 INFO Completed upload id=937840lb # [ 208.685842] niks3-server[1108]: 2026/09/22 22:25:17 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo7841worker2 # [ 208.682899] nix-grpc-daemon[1663]: time=2026-09-22T22:25:16.975Z level=INFO msg="Upload complete. (219ms)"7842worker2 # [ 208.689712] nix-grpc-daemon[1586]: ts=2026-09-22T22:25:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54604 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=16 outputs=17843worker2 # [ 208.705147] nix-daemon[869]: reaped child process 2019, status = succeeded7844client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.39 seconds)7845client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath7846client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.11 seconds)7847worker1: must succeed: rm /nix/.rw-store/fill7848worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)7849worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7850worker1 # [ 209.671494] nix-grpc-daemon[1762]: ts=2026-09-22T22:25:18Z level=info event=healthy reason=min_free7851worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds)7852(finished: subtest: low disk drains a worker and builds go to the other, in 8.84 seconds)7853(finished: run the VM test script, in 210.99 seconds)7854test script finished in 211.17s7855cleanup7856kill QemuMachine (pid 49)7857client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7858client # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down7859client # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down7860client # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down7861kill QemuMachine (pid 50)7862lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7863lb # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down7864lb # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down7865lb # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down7866kill QemuMachine (pid 51)7867worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7868worker1 # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down7869worker1 # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down7870worker1 # [2026-09-22T22:25:19Z INFO virtiofsd] Client disconnected, shutting down7871kill QemuMachine (pid 52)7872worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7873worker2 # [2026-09-22T22:25:20Z INFO virtiofsd] Client disconnected, shutting down7874worker2 # [2026-09-22T22:25:20Z INFO virtiofsd] Client disconnected, shutting down7875worker2 # [2026-09-22T22:25:20Z INFO virtiofsd] Client disconnected, shutting down7876(finished: cleanup, in 1.03 seconds)7877additionally exposed symbols:7878 client, lb, worker1, worker2,7879 vlan1,7880 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh