vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #553
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.mF3RxLCge3', fmt=raw size=107374182414worker2 # mke2fs 1.47.4 (6-Mar-2025)15worker2: QEMU running (pid 52)16worker2 # Discarding device blocks: 0/262144 done17lb # Disk image does not exist, creating the virtualisation disk image...18lb: QEMU running (pid 49)19lb # Formatting '/build/vm-state-lb/tmp.A9xlw0Tkmy', fmt=raw size=107374182420worker1 # Disk image does not exist, creating the virtualisation disk image...21worker1: QEMU running (pid 51)22worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes23lb # mke2fs 1.47.4 (6-Mar-2025)24worker2 # Filesystem UUID: 3f761b08-f94c-4ae0-af85-050b7285832325lb # Discarding device blocks: 0/262144 done26worker2 # Superblock backups stored on blocks:27lb # Creating filesystem with 262144 4k blocks and 65536 inodes28worker2 # 32768, 98304, 163840, 22937629lb # Filesystem UUID: e6b6e6b5-1dbb-4181-a281-8e85d8cebe8830worker2 # 31lb # Superblock backups stored on blocks:32worker2 # Allocating group tables: 0/8 done33lb # 32768, 98304, 163840, 22937634worker2 # Writing inode tables: 0/8 done35lb # 36worker2 # Creating journal (8192 blocks): done37lb # Allocating group tables: 0/8 done38worker2 # Writing superblocks and filesystem accounting information: 0/8 done39lb # Writing inode tables: 0/8 done40worker2 # 41lb # Creating journal (8192 blocks): done42worker2 # Virtualisation disk image created.43lb # Writing superblocks and filesystem accounting information: 0/8 done44worker2 # Starting virtiofs daemons...45lb # 46worker2 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)47lb # Virtualisation disk image created.48worker2 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether49lb # Starting virtiofs daemons...50worker2 # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...51lb # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)52worker2 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)53lb # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether54worker2 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether55lb # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)56worker2 # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...57lb # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether58worker2 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)59lb # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...60worker2 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether61lb # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...62worker2 # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...63lb # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)64worker2 # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests65lb # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether66worker2 # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests67lb # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...68worker2 # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests69lb # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests70worker1 # Formatting '/build/vm-state-worker1/tmp.7kgDKdHkcn', fmt=raw size=107374182471lb # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests72worker1 # mke2fs 1.47.4 (6-Mar-2025)73lb # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests74worker1 # Discarding device blocks: 0/262144 done75worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes76worker1 # Filesystem UUID: 995aa5d8-17b7-4d5e-ad2e-6120c2d63e6377worker1 # Superblock backups stored on blocks:78worker1 # 32768, 98304, 163840, 22937679worker1 # 80worker1 # Allocating group tables: 0/8 done81worker1 # Writing inode tables: 0/8 done82worker1 # Creating journal (8192 blocks): done83worker1 # Writing superblocks and filesystem accounting information: 0/8 done84worker1 # 85worker1 # Virtualisation disk image created.86worker1 # Starting virtiofs daemons...87worker1 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)88worker1 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether89worker1 # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...90worker1 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)91worker1 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether92worker1 # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...93worker1 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)94worker1 # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether95worker1 # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...96worker1 # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests97worker1 # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests98worker1 # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests99client: QEMU running (pid 50)100client # Disk image does not exist, creating the virtualisation disk image...101client # Formatting '/build/vm-state-client/tmp.57dBaIV3Qg', fmt=raw size=1073741824102client # mke2fs 1.47.4 (6-Mar-2025)103client # Discarding device blocks: 0/262144 done104client # Creating filesystem with 262144 4k blocks and 65536 inodes105(finished: start all VMs, in 0.33 seconds)106client # Filesystem UUID: 2ef38eb6-c4e0-4899-b284-9340fff8ee4f107client: waiting for unit network-addresses-eth1.service108client # Superblock backups stored on blocks:109client: waiting for the VM to finish booting110client # 32768, 98304, 163840, 229376111client # 112client # Allocating group tables: 0/8 done113client # Writing inode tables: 0/8 done114client # Creating journal (8192 blocks): done115client # Writing superblocks and filesystem accounting information: 0/8 done116client # 117client # Virtualisation disk image created.118client # Starting virtiofs daemons...119client # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)120client # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether121client # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...122client # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)123client # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether124client # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...125client # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)126client # [2026-09-24T12:25:18Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether127client # [2026-09-24T12:25:18Z INFO virtiofsd] Waiting for vhost-user socket connection...128client # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests129client # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests130client # [2026-09-24T12:25:18Z INFO virtiofsd] Client connected, servicing requests131worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)132worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)133client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)134lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)135worker2 # 136worker2 # 137worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00138worker1 # 139worker1 # 140worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...141worker2 # 142worker2 # 143worker2 # 144worker2 # 145worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00146worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00147client # 148worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...149client # 150worker1 # 151worker1 # 152worker1 # 153worker1 # 154client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00155worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00156worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)...157worker2 # 158worker2 # 159client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...160client # 161client # 162client # 163client # 164client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00165worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)...166worker1 # 167worker1 # 168client # Press Ctrl-B to configure iPXE (PCI 00:05.0)...169client # 170client # 171lb # 172lb # 173lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00174lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...175lb # 176lb # 177lb # 178lb # 179lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00180lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)...181lb # 182lb # 183worker2 # Booting from ROM...184worker1 # Booting from ROM...185client # Booting from ROM...186lb # Booting from ROM...187worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026188worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cifcqcvh94hgy183bpb8bfa06kal48ya-nixos-system-worker2-test/init regInfo=/nix/store/ffqz3cq9zl3yfzxsivasrv8y6vs5q11w-closure-info/registration console=ttyS0,115200n8 console=tty0189worker2 # [ 0.000000] BIOS-provided physical RAM map:190worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable191worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved192worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved193worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026194worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable195client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026196worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved197worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved198worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved199worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/il3awj39lh0735nj1qkjd3n3llc9l8n0-nixos-system-worker1-test/init regInfo=/nix/store/ymrxhpjz3nchj9rrbwj9qfzcxclq0ncs-closure-info/registration console=ttyS0,115200n8 console=tty0200worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved201worker1 # [ 0.000000] BIOS-provided physical RAM map:202client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jdhfl4hn9yxkl9i2ib2mazs46gd1pxhp-nixos-system-client-test/init regInfo=/nix/store/k54l51c9lrmwfilsaj4j1b1xgg8lyj2a-closure-info/registration console=ttyS0,115200n8 console=tty0203worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved204client # [ 0.000000] BIOS-provided physical RAM map:205worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable206worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved207client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable208worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved209worker2 # [ 0.000000] NX (Execute Disable) protection: active210client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved211worker2 # [ 0.000000] APIC: Static calls initialized212worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved213worker2 # [ 0.000000] SMBIOS 2.8 present.214client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved215worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable216client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable217worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014218worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved219worker2 # [ 0.000000] DMI: Memory slots populated: 1/1220client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved221worker2 # [ 0.000000] Hypervisor detected: KVM222worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved223worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000224client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved225worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved226worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00227client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved228worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved229worker2 # [ 0.000001] kvm-clock: using sched offset of 468574237 cycles230client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved231worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved232worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns233client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved234worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved235worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor236client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved237worker1 # [ 0.000000] NX (Execute Disable) protection: active238worker2 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000239client # [ 0.000000] NX (Execute Disable) protection: active240worker1 # [ 0.000000] APIC: Static calls initialized241worker1 # [ 0.000000] SMBIOS 2.8 present.242client # [ 0.000000] APIC: Static calls initialized243worker2 # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs244client # [ 0.000000] SMBIOS 2.8 present.245worker2 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT246worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014247client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014248worker1 # [ 0.000000] DMI: Memory slots populated: 1/1249worker2 # [ 0.002740] found SMP MP-table at [mem 0x000f5450-0x000f545f]250lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026251worker1 # [ 0.000000] Hypervisor detected: KVM252worker2 # [ 0.002752] Using GB pages for direct mapping253client # [ 0.000000] DMI: Memory slots populated: 1/1254client # [ 0.000000] Hypervisor detected: KVM255worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000256worker2 # [ 0.002833] RAMDISK: [mem 0x5e36f000-0x5ffcffff]257client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000258worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00259worker2 # [ 0.002843] ACPI: Early table checksum verification disabled260client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00261worker1 # [ 0.000001] kvm-clock: using sched offset of 459401762 cycles262worker2 # [ 0.002845] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )263client # [ 0.000000] kvm-clock: using sched offset of 442869116 cycles264worker2 # [ 0.002849] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)265lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0266worker1 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns267client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns268lb # [ 0.000000] BIOS-provided physical RAM map:269worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor270worker2 # [ 0.002853] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)271client # [ 0.000005] tsc: Detected 2400.012 MHz processor272worker1 # [ 0.000822] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000273lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable274worker2 # [ 0.002860] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)275lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved276worker1 # [ 0.000850] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs277worker2 # [ 0.002862] ACPI: FACS 0x000000005FFE0000 000040278client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000279lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved280worker1 # [ 0.000853] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT281worker2 # [ 0.002863] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)282worker1 # [ 0.002741] found SMP MP-table at [mem 0x000f5450-0x000f545f]283lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable284worker1 # [ 0.002753] Using GB pages for direct mapping285worker2 # [ 0.002865] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)286client # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs287lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved288worker1 # [ 0.002915] RAMDISK: [mem 0x5e370000-0x5ffcffff]289client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT290lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved291worker2 # [ 0.002866] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)292worker1 # [ 0.002925] ACPI: Early table checksum verification disabled293client # [ 0.002734] found SMP MP-table at [mem 0x000f5450-0x000f545f]294lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved295worker1 # [ 0.002929] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )296client # [ 0.002745] Using GB pages for direct mapping297worker2 # [ 0.002868] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)298client # [ 0.002866] RAMDISK: [mem 0x5e370000-0x5ffcffff]299lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved300worker2 # [ 0.002869] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]301worker1 # [ 0.002933] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)302client # [ 0.002874] ACPI: Early table checksum verification disabled303lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved304worker2 # [ 0.002870] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]305worker1 # [ 0.002938] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)306client # [ 0.002877] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )307lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved308worker2 # [ 0.002871] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]309lb # [ 0.000000] NX (Execute Disable) protection: active310worker1 # [ 0.002946] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)311client # [ 0.002881] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)312lb # [ 0.000000] APIC: Static calls initialized313worker2 # [ 0.002871] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]314worker1 # [ 0.002948] ACPI: FACS 0x000000005FFE0000 000040315lb # [ 0.000000] SMBIOS 2.8 present.316client # [ 0.002885] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)317worker2 # [ 0.002872] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]318worker1 # [ 0.002949] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)319lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014320client # [ 0.002892] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)321worker2 # [ 0.002872] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]322lb # [ 0.000000] DMI: Memory slots populated: 1/1323worker1 # [ 0.002951] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)324client # [ 0.002894] ACPI: FACS 0x000000005FFE0000 000040325worker2 # [ 0.002873] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]326lb # [ 0.000000] Hypervisor detected: KVM327worker2 # [ 0.003110] No NUMA configuration found328worker1 # [ 0.002952] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)329lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000330client # [ 0.002896] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)331lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00332worker2 # [ 0.003111] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]333client # [ 0.002897] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)334worker1 # [ 0.002954] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)335lb # [ 0.000000] kvm-clock: using sched offset of 490525498 cycles336worker2 # [ 0.003113] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]337worker2 # [ 0.005351] Zone ranges:338client # [ 0.002899] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)339worker1 # [ 0.002955] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]340worker2 # [ 0.005351] DMA [mem 0x0000000000001000-0x0000000000ffffff]341lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns342worker1 # [ 0.002956] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]343client # [ 0.002900] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)344worker2 # [ 0.005353] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]345lb # [ 0.000004] tsc: Detected 2400.012 MHz processor346worker2 # [ 0.005354] Normal empty347worker1 # [ 0.002957] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]348lb # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000349client # [ 0.002902] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]350worker2 # [ 0.005354] Device empty351worker2 # [ 0.005355] Movable zone start for each node352worker1 # [ 0.002957] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]353client # [ 0.002903] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]354worker2 # [ 0.005356] Early memory node ranges355lb # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs356worker1 # [ 0.002958] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]357worker2 # [ 0.005356] node 0: [mem 0x0000000000001000-0x000000000009efff]358client # [ 0.002903] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]359lb # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT360worker1 # [ 0.002958] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]361worker2 # [ 0.005357] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]362client # [ 0.002904] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]363lb # [ 0.002727] found SMP MP-table at [mem 0x000f5450-0x000f545f]364lb # [ 0.002738] Using GB pages for direct mapping365worker1 # [ 0.002959] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]366worker2 # [ 0.005358] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]367client # [ 0.002904] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]368lb # [ 0.002867] RAMDISK: [mem 0x5e36e000-0x5ffcffff]369worker1 # [ 0.003195] No NUMA configuration found370worker2 # [ 0.005383] On node 0, zone DMA: 1 pages in unavailable ranges371client # [ 0.002905] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]372lb # [ 0.002874] ACPI: Early table checksum verification disabled373worker1 # [ 0.003196] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]374worker2 # [ 0.005640] On node 0, zone DMA: 97 pages in unavailable ranges375lb # [ 0.002877] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )376client # [ 0.002905] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]377worker1 # [ 0.003198] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]378worker2 # [ 0.030917] On node 0, zone DMA32: 40 pages in unavailable ranges379worker1 # [ 0.005374] Zone ranges:380client # [ 0.003130] No NUMA configuration found381lb # [ 0.002880] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)382worker2 # [ 0.031377] ACPI: PM-Timer IO Port: 0x608383worker1 # [ 0.005375] DMA [mem 0x0000000000001000-0x0000000000ffffff]384client # [ 0.003131] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]385worker2 # [ 0.031388] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])386lb # [ 0.002884] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)387worker1 # [ 0.005377] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]388client # [ 0.003133] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]389worker1 # [ 0.005378] Normal empty390client # [ 0.005282] Zone ranges:391worker2 # [ 0.031418] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23392worker1 # [ 0.005379] Device empty393lb # [ 0.002891] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)394client # [ 0.005283] DMA [mem 0x0000000000001000-0x0000000000ffffff]395worker2 # [ 0.031421] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)396worker1 # [ 0.005379] Movable zone start for each node397lb # [ 0.002893] ACPI: FACS 0x000000005FFE0000 000040398worker1 # [ 0.005380] Early memory node ranges399client # [ 0.005285] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]400worker2 # [ 0.031422] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)401client # [ 0.005286] Normal empty402worker1 # [ 0.005381] node 0: [mem 0x0000000000001000-0x000000000009efff]403lb # [ 0.002895] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)404client # [ 0.005287] Device empty405worker2 # [ 0.031423] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)406client # [ 0.005287] Movable zone start for each node407worker1 # [ 0.005382] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]408client # [ 0.005288] Early memory node ranges409worker2 # [ 0.031424] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)410lb # [ 0.002896] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)411worker1 # [ 0.005383] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]412client # [ 0.005288] node 0: [mem 0x0000000000001000-0x000000000009efff]413worker2 # [ 0.031425] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)414lb # [ 0.002898] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)415worker1 # [ 0.005402] On node 0, zone DMA: 1 pages in unavailable ranges416client # [ 0.005289] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]417worker2 # [ 0.031427] ACPI: Using ACPI (MADT) for SMP configuration information418worker1 # [ 0.005658] On node 0, zone DMA: 97 pages in unavailable ranges419lb # [ 0.002899] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)420worker2 # [ 0.031428] ACPI: HPET id: 0x8086a201 base: 0xfed00000421client # [ 0.005290] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]422worker1 # [ 0.030984] On node 0, zone DMA32: 40 pages in unavailable ranges423worker2 # [ 0.031432] TSC deadline timer available424lb # [ 0.002901] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]425client # [ 0.005310] On node 0, zone DMA: 1 pages in unavailable ranges426worker1 # [ 0.031455] ACPI: PM-Timer IO Port: 0x608427worker2 # [ 0.031435] CPU topo: Max. logical packages: 1428client # [ 0.005559] On node 0, zone DMA: 97 pages in unavailable ranges429lb # [ 0.002902] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]430worker2 # [ 0.031436] CPU topo: Max. logical dies: 1431worker1 # [ 0.031470] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])432worker2 # [ 0.031436] CPU topo: Max. dies per package: 1433client # [ 0.030870] On node 0, zone DMA32: 40 pages in unavailable ranges434lb # [ 0.002902] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]435worker1 # [ 0.031508] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23436client # [ 0.031334] ACPI: PM-Timer IO Port: 0x608437worker2 # [ 0.031440] CPU topo: Max. threads per core: 1438lb # [ 0.002903] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]439worker2 # [ 0.031440] CPU topo: Num. cores per package: 1440worker1 # [ 0.031510] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)441client # [ 0.031347] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])442worker2 # [ 0.031441] CPU topo: Num. threads per package: 1443worker1 # [ 0.031512] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)444lb # [ 0.002903] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]445client # [ 0.031372] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23446worker2 # [ 0.031441] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs447worker1 # [ 0.031513] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)448lb # [ 0.002904] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]449client # [ 0.031375] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)450worker2 # [ 0.031460] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()451worker1 # [ 0.031514] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)452client # [ 0.031376] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)453lb # [ 0.002904] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]454lb # [ 0.003122] No NUMA configuration found455worker2 # [ 0.031493] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]456client # [ 0.031378] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)457worker1 # [ 0.031515] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)458lb # [ 0.003123] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]459worker2 # [ 0.031494] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]460client # [ 0.031379] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)461worker1 # [ 0.031518] ACPI: Using ACPI (MADT) for SMP configuration information462lb # [ 0.003125] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]463worker2 # [ 0.031495] [mem 0x60000000-0xafffffff] available for PCI devices464worker1 # [ 0.031519] ACPI: HPET id: 0x8086a201 base: 0xfed00000465lb # [ 0.005320] Zone ranges:466client # [ 0.031379] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)467worker1 # [ 0.031524] TSC deadline timer available468worker2 # [ 0.031497] Booting paravirtualized kernel on KVM469lb # [ 0.005321] DMA [mem 0x0000000000001000-0x0000000000ffffff]470worker1 # [ 0.031528] CPU topo: Max. logical packages: 1471client # [ 0.031381] ACPI: Using ACPI (MADT) for SMP configuration information472client # [ 0.031382] ACPI: HPET id: 0x8086a201 base: 0xfed00000473lb # [ 0.005322] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]474worker1 # [ 0.031529] CPU topo: Max. logical dies: 1475lb # [ 0.005323] Normal empty476worker2 # [ 0.031499] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns477client # [ 0.031386] TSC deadline timer available478worker1 # [ 0.031529] CPU topo: Max. dies per package: 1479lb # [ 0.005324] Device empty480client # [ 0.031390] CPU topo: Max. logical packages: 1481worker1 # [ 0.031532] CPU topo: Max. threads per core: 1482worker2 # [ 0.035970] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1483lb # [ 0.005325] Movable zone start for each node484client # [ 0.031391] CPU topo: Max. logical dies: 1485lb # [ 0.005325] Early memory node ranges486worker1 # [ 0.031533] CPU topo: Num. cores per package: 1487worker2 # [ 0.038061] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152488client # [ 0.031391] CPU topo: Max. dies per package: 1489worker1 # [ 0.031533] CPU topo: Num. threads per package: 1490lb # [ 0.005326] node 0: [mem 0x0000000000001000-0x000000000009efff]491worker2 # [ 0.038108] kvm-guest: PV spinlocks disabled, single CPU492client # [ 0.031394] CPU topo: Max. threads per core: 1493worker1 # [ 0.031534] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs494lb # [ 0.005327] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]495client # [ 0.031395] CPU topo: Num. cores per package: 1496client # [ 0.031395] CPU topo: Num. threads per package: 1497worker1 # [ 0.031554] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()498lb # [ 0.005328] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]499client # [ 0.031396] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs500lb # [ 0.005347] On node 0, zone DMA: 1 pages in unavailable ranges501worker1 # [ 0.031587] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]502lb # [ 0.005603] On node 0, zone DMA: 97 pages in unavailable ranges503client # [ 0.031414] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()504worker1 # [ 0.031589] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]505lb # [ 0.031150] On node 0, zone DMA32: 40 pages in unavailable ranges506worker2 # [ 0.038109] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cifcqcvh94hgy183bpb8bfa06kal48ya-nixos-system-worker2-test/init regInfo=/nix/store/ffqz3cq9zl3yfzxsivasrv8y6vs5q11w-closure-info/registration console=ttyS0,115200n8 console=tty0507client # [ 0.031445] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]508worker1 # [ 0.031591] [mem 0x60000000-0xafffffff] available for PCI devices509lb # [ 0.031608] ACPI: PM-Timer IO Port: 0x608510worker1 # [ 0.031592] Booting paravirtualized kernel on KVM511client # [ 0.031446] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]512lb # [ 0.031619] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])513client # [ 0.031448] [mem 0x60000000-0xafffffff] available for PCI devices514lb # [ 0.031645] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23515worker2 # [ 0.038200] Unknown kernel command line parameters "regInfo=/nix/store/ffqz3cq9zl3yfzxsivasrv8y6vs5q11w-closure-info/registration", will be passed to user space.516worker1 # [ 0.031595] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns517client # [ 0.031449] Booting paravirtualized kernel on KVM518worker2 # [ 0.038212] random: crng init done519lb # [ 0.031647] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)520worker1 # [ 0.036096] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1521worker2 # [ 0.038212] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes522lb # [ 0.031649] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)523client # [ 0.031452] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns524worker1 # [ 0.038186] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152525worker2 # [ 0.040257] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)526lb # [ 0.031650] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)527client # [ 0.035932] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1528worker1 # [ 0.038234] kvm-guest: PV spinlocks disabled, single CPU529worker2 # [ 0.041429] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)530lb # [ 0.031651] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)531client # [ 0.038011] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152532worker2 # [ 0.041460] Fallback order for Node 0: 0533lb # [ 0.031652] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)534client # [ 0.038050] kvm-guest: PV spinlocks disabled, single CPU535worker2 # [ 0.041463] Built 1 zonelists, mobility grouping on. Total pages: 393078536lb # [ 0.031654] ACPI: Using ACPI (MADT) for SMP configuration information537worker2 # [ 0.041464] Policy zone: DMA32538lb # [ 0.031655] ACPI: HPET id: 0x8086a201 base: 0xfed00000539worker2 # [ 0.043866] mem auto-init: stack:all(zero), heap alloc:on, heap free:off540lb # [ 0.031659] TSC deadline timer available541worker2 # [ 0.046834] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1542lb # [ 0.031663] CPU topo: Max. logical packages: 1543worker1 # [ 0.038236] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/il3awj39lh0735nj1qkjd3n3llc9l8n0-nixos-system-worker1-test/init regInfo=/nix/store/ymrxhpjz3nchj9rrbwj9qfzcxclq0ncs-closure-info/registration console=ttyS0,115200n8 console=tty0544worker2 # [ 0.050014] allocated 3145728 bytes of page_ext545lb # [ 0.031664] CPU topo: Max. logical dies: 1546lb # [ 0.031664] CPU topo: Max. dies per package: 1547worker2 # [ 0.059786] ftrace: allocating 48787 entries in 192 pages548client # [ 0.038052] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jdhfl4hn9yxkl9i2ib2mazs46gd1pxhp-nixos-system-client-test/init regInfo=/nix/store/k54l51c9lrmwfilsaj4j1b1xgg8lyj2a-closure-info/registration console=ttyS0,115200n8 console=tty0549lb # [ 0.031667] CPU topo: Max. threads per core: 1550worker1 # [ 0.038332] Unknown kernel command line parameters "regInfo=/nix/store/ymrxhpjz3nchj9rrbwj9qfzcxclq0ncs-closure-info/registration", will be passed to user space.551worker2 # [ 0.059787] ftrace: allocated 192 pages with 2 groups552worker2 # [ 0.060607] Dynamic Preempt: lazy553lb # [ 0.031668] CPU topo: Num. cores per package: 1554worker1 # [ 0.038345] random: crng init done555lb # [ 0.031669] CPU topo: Num. threads per package: 1556worker2 # [ 0.060768] rcu: Preemptible hierarchical RCU implementation.557client # [ 0.038147] Unknown kernel command line parameters "regInfo=/nix/store/k54l51c9lrmwfilsaj4j1b1xgg8lyj2a-closure-info/registration", will be passed to user space.558worker1 # [ 0.038346] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes559worker2 # [ 0.060769] rcu: RCU event tracing is enabled.560client # [ 0.038159] random: crng init done561lb # [ 0.031669] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs562worker1 # [ 0.040402] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)563worker2 # [ 0.060770] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.564client # [ 0.038160] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes565lb # [ 0.031686] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()566worker2 # [ 0.060771] Trampoline variant of Tasks RCU enabled.567worker1 # [ 0.041573] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)568client # [ 0.040205] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)569lb # [ 0.031713] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]570worker2 # [ 0.060772] Rude variant of Tasks RCU enabled.571worker1 # [ 0.041606] Fallback order for Node 0: 0572worker2 # [ 0.060772] Tracing variant of Tasks RCU enabled.573client # [ 0.041237] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)574lb # [ 0.031715] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]575worker1 # [ 0.041610] Built 1 zonelists, mobility grouping on. Total pages: 393078576client # [ 0.041266] Fallback order for Node 0: 0577worker1 # [ 0.041611] Policy zone: DMA32578worker2 # [ 0.060773] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.579lb # [ 0.031716] [mem 0x60000000-0xafffffff] available for PCI devices580lb # [ 0.031718] Booting paravirtualized kernel on KVM581worker1 # [ 0.044019] mem auto-init: stack:all(zero), heap alloc:on, heap free:off582client # [ 0.041269] Built 1 zonelists, mobility grouping on. Total pages: 393078583worker2 # [ 0.060773] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1584client # [ 0.041270] Policy zone: DMA32585worker1 # [ 0.047164] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1586client # [ 0.043813] mem auto-init: stack:all(zero), heap alloc:on, heap free:off587worker2 # [ 0.060788] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.588lb # [ 0.031720] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns589worker1 # [ 0.050354] allocated 3145728 bytes of page_ext590client # [ 0.047026] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1591worker1 # [ 0.060108] ftrace: allocating 48787 entries in 192 pages592lb # [ 0.036194] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1593client # [ 0.050210] allocated 3145728 bytes of page_ext594worker2 # [ 0.060789] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.595worker1 # [ 0.060110] ftrace: allocated 192 pages with 2 groups596lb # [ 0.038289] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152597client # [ 0.059866] ftrace: allocating 48787 entries in 192 pages598worker1 # [ 0.060957] Dynamic Preempt: lazy599worker2 # [ 0.060790] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.600lb # [ 0.038332] kvm-guest: PV spinlocks disabled, single CPU601client # [ 0.059869] ftrace: allocated 192 pages with 2 groups602worker1 # [ 0.061078] rcu: Preemptible hierarchical RCU implementation.603client # [ 0.060678] Dynamic Preempt: lazy604worker2 # [ 0.065263] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16605worker1 # [ 0.061079] rcu: RCU event tracing is enabled.606client # [ 0.060803] rcu: Preemptible hierarchical RCU implementation.607worker2 # [ 0.065540] rcu: srcu_init: Setting srcu_struct sizes based on contention.608worker1 # [ 0.061079] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.609client # [ 0.060804] rcu: RCU event tracing is enabled.610worker1 # [ 0.061081] Trampoline variant of Tasks RCU enabled.611worker2 # [ 0.065547] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns612client # [ 0.060805] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.613worker1 # [ 0.061081] Rude variant of Tasks RCU enabled.614client # [ 0.060806] Trampoline variant of Tasks RCU enabled.615worker1 # [ 0.061081] Tracing variant of Tasks RCU enabled.616lb # [ 0.038334] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0617client # [ 0.060807] Rude variant of Tasks RCU enabled.618worker2 # [ 0.065647] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)619worker2 # [ 0.069180] Console: colour VGA+ 80x25620client # [ 0.060807] Tracing variant of Tasks RCU enabled.621worker1 # [ 0.061082] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.622worker2 # [ 0.069182] printk: legacy console [tty0] enabled623worker1 # [ 0.061083] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1624client # [ 0.060808] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.625worker2 # [ 0.098701] printk: legacy console [ttyS0] enabled626lb # [ 0.038424] Unknown kernel command line parameters "regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration", will be passed to user space.627lb # [ 0.038437] random: crng init done628client # [ 0.060808] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1629worker2 # [ 0.195356] ACPI: Core revision 20250807630worker1 # [ 0.061141] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.631lb # [ 0.038438] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes632client # [ 0.060829] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.633worker1 # [ 0.061142] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.634lb # [ 0.040480] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)635worker2 # [ 0.196226] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns636client # [ 0.060831] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.637worker1 # [ 0.061143] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.638lb # [ 0.041681] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)639worker2 # [ 0.197734] APIC: Switch to symmetric I/O mode setup640lb # [ 0.041711] Fallback order for Node 0: 0641worker1 # [ 0.065674] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16642client # [ 0.060832] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.643worker2 # [ 0.198670] x2apic enabled644client # [ 0.065190] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16645lb # [ 0.041713] Built 1 zonelists, mobility grouping on. Total pages: 393078646worker1 # [ 0.065957] rcu: srcu_init: Setting srcu_struct sizes based on contention.647lb # [ 0.041714] Policy zone: DMA32648worker2 # [ 0.199399] APIC: Switched APIC routing to: physical x2apic649client # [ 0.065462] rcu: srcu_init: Setting srcu_struct sizes based on contention.650lb # [ 0.044102] mem auto-init: stack:all(zero), heap alloc:on, heap free:off651worker1 # [ 0.065964] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns652lb # [ 0.047048] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1653client # [ 0.065468] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns654worker1 # [ 0.066070] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)655lb # [ 0.050247] allocated 3145728 bytes of page_ext656worker2 # [ 0.201214] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1657worker1 # [ 0.069668] Console: colour VGA+ 80x25658lb # [ 0.059575] ftrace: allocating 48787 entries in 192 pages659client # [ 0.065570] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)660worker1 # [ 0.069671] printk: legacy console [tty0] enabled661client # [ 0.069090] Console: colour VGA+ 80x25662lb # [ 0.059576] ftrace: allocated 192 pages with 2 groups663worker1 # [ 0.099525] printk: legacy console [ttyS0] enabled664lb # [ 0.060387] Dynamic Preempt: lazy665client # [ 0.069093] printk: legacy console [tty0] enabled666worker2 # [ 0.202193] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns667client # [ 0.098532] printk: legacy console [ttyS0] enabled668worker1 # [ 0.197089] ACPI: Core revision 20250807669lb # [ 0.060529] rcu: Preemptible hierarchical RCU implementation.670lb # [ 0.060529] rcu: RCU event tracing is enabled.671client # [ 0.196180] ACPI: Core revision 20250807672worker2 # [ 0.203819] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)673lb # [ 0.060530] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.674worker1 # [ 0.197987] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns675worker2 # [ 0.204904] x86/cpu: User Mode Instruction Prevention (UMIP) activated676lb # [ 0.060531] Trampoline variant of Tasks RCU enabled.677client # [ 0.197070] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns678lb # [ 0.060532] Rude variant of Tasks RCU enabled.679worker1 # [ 0.199525] APIC: Switch to symmetric I/O mode setup680worker2 # [ 0.205944] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127681lb # [ 0.060532] Tracing variant of Tasks RCU enabled.682worker1 # [ 0.200525] x2apic enabled683client # [ 0.198662] APIC: Switch to symmetric I/O mode setup684worker2 # [ 0.206816] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0685lb # [ 0.060533] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.686client # [ 0.199633] x2apic enabled687worker1 # [ 0.201311] APIC: Switched APIC routing to: physical x2apic688lb # [ 0.060533] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1689client # [ 0.200413] APIC: Switched APIC routing to: physical x2apic690worker2 # [ 0.207820] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto691lb # [ 0.060549] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.692worker1 # [ 0.203213] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1693lb # [ 0.060551] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.694worker2 # [ 0.208816] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl695client # [ 0.202199] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1696worker2 # [ 0.209816] Transient Scheduler Attacks: Vulnerable: No microcode697lb # [ 0.060551] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.698worker1 # [ 0.204227] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns699lb # [ 0.064886] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16700worker2 # [ 0.210815] Spectre V2 : Mitigation: Enhanced / Automatic IBRS701client # [ 0.203174] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns702lb # [ 0.065489] rcu: srcu_init: Setting srcu_struct sizes based on contention.703worker1 # [ 0.205885] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)704worker2 # [ 0.211816] Speculative Return Stack Overflow: Mitigation: Safe RET705client # [ 0.204843] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)706lb # [ 0.065495] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns707worker1 # [ 0.206971] x86/cpu: User Mode Instruction Prevention (UMIP) activated708client # [ 0.205933] x86/cpu: User Mode Instruction Prevention (UMIP) activated709lb # [ 0.065596] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)710worker1 # [ 0.208792] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127711lb # [ 0.069083] Console: colour VGA+ 80x25712client # [ 0.206973] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127713lb # [ 0.069086] printk: legacy console [tty0] enabled714worker1 # [ 0.209589] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0715client # [ 0.208529] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0716lb # [ 0.098735] printk: legacy console [ttyS0] enabled717worker2 # [ 0.212815] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization718lb # [ 0.194556] ACPI: Core revision 20250807719worker2 # [ 0.214823] Spectre V2 : Enabling IBPB for BPF720worker1 # [ 0.210691] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto721client # [ 0.208843] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto722worker2 # [ 0.215523] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier723lb # [ 0.195396] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns724worker1 # [ 0.211882] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl725client # [ 0.210839] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl726worker2 # [ 0.216816] active return thunk: srso_alias_return_thunk727lb # [ 0.196943] APIC: Switch to symmetric I/O mode setup728worker1 # [ 0.213882] Transient Scheduler Attacks: Vulnerable: No microcode729lb # [ 0.197878] x2apic enabled730client # [ 0.211840] Transient Scheduler Attacks: Vulnerable: No microcode731worker2 # [ 0.217838] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'732worker1 # [ 0.214882] Spectre V2 : Mitigation: Enhanced / Automatic IBRS733client # [ 0.213542] Spectre V2 : Mitigation: Enhanced / Automatic IBRS734lb # [ 0.198611] APIC: Switched APIC routing to: physical x2apic735worker2 # [ 0.218816] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'736worker1 # [ 0.215882] Speculative Return Stack Overflow: Mitigation: Safe RET737client # [ 0.213839] Speculative Return Stack Overflow: Mitigation: Safe RET738worker2 # [ 0.219815] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'739lb # [ 0.200438] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1740worker2 # [ 0.220815] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'741worker2 # [ 0.221815] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'742lb # [ 0.201464] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns743worker2 # [ 0.222815] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'744worker1 # [ 0.216854] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization745client # [ 0.214839] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization746lb # [ 0.203170] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)747worker1 # [ 0.217890] Spectre V2 : Enabling IBPB for BPF748worker2 # [ 0.223815] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'749client # [ 0.216846] Spectre V2 : Enabling IBPB for BPF750lb # [ 0.204253] x86/cpu: User Mode Instruction Prevention (UMIP) activated751worker2 # [ 0.224816] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256752worker1 # [ 0.218603] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier753client # [ 0.217840] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier754lb # [ 0.205287] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127755worker2 # [ 0.225816] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64756worker1 # [ 0.219882] active return thunk: srso_alias_return_thunk757client # [ 0.218840] active return thunk: srso_alias_return_thunk758lb # [ 0.206167] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0759worker2 # [ 0.226815] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512760worker1 # [ 0.220905] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'761client # [ 0.220474] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'762worker2 # [ 0.227815] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024763lb # [ 0.207171] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto764worker1 # [ 0.221882] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'765client # [ 0.220839] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'766worker2 # [ 0.228815] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8767worker1 # [ 0.222882] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'768client # [ 0.222570] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'769lb # [ 0.209167] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl770worker2 # [ 0.229815] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.771worker1 # [ 0.223882] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'772client # [ 0.223567] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'773lb # [ 0.210167] Transient Scheduler Attacks: Vulnerable: No microcode774worker1 # [ 0.224882] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'775client # [ 0.224580] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'776lb # [ 0.211166] Spectre V2 : Mitigation: Enhanced / Automatic IBRS777worker1 # [ 0.225882] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'778client # [ 0.225584] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'779lb # [ 0.212167] Speculative Return Stack Overflow: Mitigation: Safe RET780worker1 # [ 0.226882] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'781client # [ 0.226623] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'782worker1 # [ 0.227882] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256783client # [ 0.227840] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256784worker1 # [ 0.228882] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64785client # [ 0.228839] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64786lb # [ 0.213167] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization787worker1 # [ 0.230629] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512788client # [ 0.229839] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512789lb # [ 0.215174] Spectre V2 : Enabling IBPB for BPF790worker1 # [ 0.231611] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024791client # [ 0.230839] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024792lb # [ 0.216167] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier793worker1 # [ 0.232614] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8794client # [ 0.231839] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8795lb # [ 0.217167] active return thunk: srso_alias_return_thunk796worker1 # [ 0.233612] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.797client # [ 0.232839] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.798lb # [ 0.218187] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'799lb # [ 0.219166] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'800lb # [ 0.220974] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'801lb # [ 0.221971] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'802lb # [ 0.222993] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'803lb # [ 0.223984] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'804lb # [ 0.225167] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'805lb # [ 0.226167] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256806lb # [ 0.227166] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64807lb # [ 0.228167] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512808lb # [ 0.229167] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024809lb # [ 0.230166] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8810lb # [ 0.231166] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.811worker2 # [ 0.263607] Freeing SMP alternatives memory: 44K812worker2 # [ 0.264421] pid_max: default: 32768 minimum: 301813worker2 # [ 0.264921] LSM: initializing lsm=capability,landlock,yama,bpf,ima814worker2 # [ 0.265924] landlock: Up and running.815worker2 # [ 0.266816] Yama: becoming mindful.816worker2 # [ 0.268022] LSM support for eBPF active817worker2 # [ 0.268834] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)818worker2 # [ 0.269855] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)819worker2 # [ 0.272488] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)820client # [ 0.266846] Freeing SMP alternatives memory: 44K821worker1 # [ 0.268033] Freeing SMP alternatives memory: 44K822client # [ 0.267693] pid_max: default: 32768 minimum: 301823worker2 # [ 0.273355] Performance Events: Fam17h+ core perfctr, AMD PMU driver.824worker1 # [ 0.268841] pid_max: default: 32768 minimum: 301825worker2 # [ 0.273821] ... version: 2826client # [ 0.268489] LSM: initializing lsm=capability,landlock,yama,bpf,ima827worker2 # [ 0.274538] ... bit width: 48828worker1 # [ 0.269535] LSM: initializing lsm=capability,landlock,yama,bpf,ima829client # [ 0.268940] landlock: Up and running.830worker2 # [ 0.274818] ... generic counters: 6831worker1 # [ 0.270749] landlock: Up and running.832client # [ 0.270289] Yama: becoming mindful.833worker1 # [ 0.271339] Yama: becoming mindful.834worker2 # [ 0.275566] ... generic bitmap: 000000000000003f835client # [ 0.271041] LSM support for eBPF active836worker2 # [ 0.275828] ... fixed-purpose counters: 0837worker1 # [ 0.272085] LSM support for eBPF active838client # [ 0.271938] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)839worker2 # [ 0.276568] ... fixed-purpose bitmap: 0000000000000000840worker1 # [ 0.272986] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)841worker2 # [ 0.276818] ... value mask: 0000ffffffffffff842client # [ 0.272899] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)843worker1 # [ 0.273926] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)844worker2 # [ 0.277768] ... max period: 00007fffffffffff845worker2 # [ 0.278518] ... global_ctrl mask: 000000000000003f846worker2 # [ 0.278930] signal: max sigframe size: 3376847client # [ 0.275503] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)848worker1 # [ 0.276792] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)849worker2 # [ 0.279764] rcu: Hierarchical SRCU implementation.850client # [ 0.276398] Performance Events: Fam17h+ core perfctr, AMD PMU driver.851worker2 # [ 0.280458] rcu: Max phase no-delay instances is 400.852worker1 # [ 0.277412] Performance Events: Fam17h+ core perfctr, AMD PMU driver.853client # [ 0.276845] ... version: 2854worker1 # [ 0.277887] ... version: 2855client # [ 0.277586] ... bit width: 48856worker1 # [ 0.278594] ... bit width: 48857client # [ 0.277842] ... generic counters: 6858lb # [ 0.264664] Freeing SMP alternatives memory: 44K859worker1 # [ 0.278885] ... generic counters: 6860client # [ 0.278595] ... generic bitmap: 000000000000003f861lb # [ 0.265169] pid_max: default: 32768 minimum: 301862worker1 # [ 0.279637] ... generic bitmap: 000000000000003f863client # [ 0.278852] ... fixed-purpose counters: 0864lb # [ 0.266260] LSM: initializing lsm=capability,landlock,yama,bpf,ima865worker1 # [ 0.279937] ... fixed-purpose counters: 0866client # [ 0.279563] ... fixed-purpose bitmap: 0000000000000000867lb # [ 0.267266] landlock: Up and running.868worker2 # [ 0.285317] smp: Bringing up secondary CPUs ...869worker1 # [ 0.280662] ... fixed-purpose bitmap: 0000000000000000870client # [ 0.279841] ... value mask: 0000ffffffffffff871lb # [ 0.267865] Yama: becoming mindful.872worker2 # [ 0.285833] smp: Brought up 1 node, 1 CPU873worker1 # [ 0.280885] ... value mask: 0000ffffffffffff874client # [ 0.280726] ... max period: 00007fffffffffff875lb # [ 0.268378] LSM support for eBPF active876worker2 # [ 0.286522] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)877worker1 # [ 0.281777] ... max period: 00007fffffffffff878client # [ 0.281524] ... global_ctrl mask: 000000000000003f879lb # [ 0.269314] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)880worker1 # [ 0.282540] ... global_ctrl mask: 000000000000003f881client # [ 0.281951] signal: max sigframe size: 3376882worker1 # [ 0.282996] signal: max sigframe size: 3376883client # [ 0.282748] rcu: Hierarchical SRCU implementation.884lb # [ 0.270204] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)885worker2 # [ 0.287014] Memory: 1454604K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved)886worker1 # [ 0.283787] rcu: Hierarchical SRCU implementation.887client # [ 0.283426] rcu: Max phase no-delay instances is 400.888worker2 # [ 0.288059] devtmpfs: initialized889worker1 # [ 0.284490] rcu: Max phase no-delay instances is 400.890worker2 # [ 0.288922] x86/mm: Memory block size: 128MB891lb # [ 0.272983] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)892lb # [ 0.273709] Performance Events: Fam17h+ core perfctr, AMD PMU driver.893worker2 # [ 0.290755] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)894lb # [ 0.274171] ... version: 2895lb # [ 0.274927] ... bit width: 48896worker2 # [ 0.291766] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).897client # [ 0.288438] smp: Bringing up secondary CPUs ...898lb # [ 0.275169] ... generic counters: 6899worker2 # [ 0.292919] pinctrl core: initialized pinctrl subsystem900worker1 # [ 0.289539] smp: Bringing up secondary CPUs ...901client # [ 0.288855] smp: Brought up 1 node, 1 CPU902lb # [ 0.275888] ... generic bitmap: 000000000000003f903worker1 # [ 0.289900] smp: Brought up 1 node, 1 CPU904worker2 # [ 0.294004] PM: RTC time: 12:25:18, date: 2026-09-24905client # [ 0.289547] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)906lb # [ 0.276180] ... fixed-purpose counters: 0907worker1 # [ 0.290599] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)908lb # [ 0.276858] ... fixed-purpose bitmap: 0000000000000000909lb # [ 0.277169] ... value mask: 0000ffffffffffff910client # [ 0.290005] Memory: 1454604K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved)911lb # [ 0.278068] ... max period: 00007fffffffffff912worker1 # [ 0.291088] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved)913worker2 # [ 0.297505] NET: Registered PF_NETLINK/PF_ROUTE protocol family914lb # [ 0.278884] ... global_ctrl mask: 000000000000003f915worker1 # [ 0.292143] devtmpfs: initialized916client # [ 0.291120] devtmpfs: initialized917lb # [ 0.279288] signal: max sigframe size: 3376918worker1 # [ 0.292947] x86/mm: Memory block size: 128MB919worker2 # [ 0.298288] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations920client # [ 0.292337] x86/mm: Memory block size: 128MB921lb # [ 0.280136] rcu: Hierarchical SRCU implementation.922lb # [ 0.280778] rcu: Max phase no-delay instances is 400.923worker2 # [ 0.298838] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations924worker1 # [ 0.294651] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)925client # [ 0.294073] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)926worker2 # [ 0.300079] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations927worker1 # [ 0.295835] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).928worker2 # [ 0.300828] audit: initializing netlink subsys (disabled)929client # [ 0.294868] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).930worker1 # [ 0.296990] pinctrl core: initialized pinctrl subsystem931client # [ 0.295941] pinctrl core: initialized pinctrl subsystem932worker2 # [ 0.301983] thermal_sys: Registered thermal governor 'fair_share'933worker1 # [ 0.298139] PM: RTC time: 12:25:18, date: 2026-09-24934worker2 # [ 0.301985] thermal_sys: Registered thermal governor 'bang_bang'935client # [ 0.297156] PM: RTC time: 12:25:18, date: 2026-09-24936lb # [ 0.285689] smp: Bringing up secondary CPUs ...937worker2 # [ 0.302819] thermal_sys: Registered thermal governor 'step_wise'938lb # [ 0.286184] smp: Brought up 1 node, 1 CPU939worker2 # [ 0.303798] thermal_sys: Registered thermal governor 'user_space'940lb # [ 0.286860] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)941worker1 # [ 0.301554] NET: Registered PF_NETLINK/PF_ROUTE protocol family942worker2 # [ 0.304586] audit: type=2000 audit(1790252719.237:1): state=initialized audit_enabled=0 res=1943client # [ 0.300886] NET: Registered PF_NETLINK/PF_ROUTE protocol family944lb # [ 0.287386] Memory: 1454640K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved)945worker2 # [ 0.305820] thermal_sys: Registered thermal governor 'power_allocator'946worker1 # [ 0.302404] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations947worker2 # [ 0.305835] cpuidle: using governor menu948lb # [ 0.288411] devtmpfs: initialized949worker1 # [ 0.302912] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations950client # [ 0.302457] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations951lb # [ 0.289224] x86/mm: Memory block size: 128MB952worker2 # [ 0.307850] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5953client # [ 0.302863] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations954worker1 # [ 0.304163] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations955worker2 # [ 0.309047] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]956worker1 # [ 0.304895] audit: initializing netlink subsys (disabled)957lb # [ 0.290962] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)958client # [ 0.304110] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations959worker2 # [ 0.309821] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry960client # [ 0.304852] audit: initializing netlink subsys (disabled)961lb # [ 0.292050] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).962worker1 # [ 0.305887] audit: type=2000 audit(1790252719.246:1): state=initialized audit_enabled=0 res=1963worker2 # [ 0.310830] PCI: Using configuration type 1 for base access964lb # [ 0.293247] pinctrl core: initialized pinctrl subsystem965client # [ 0.306016] thermal_sys: Registered thermal governor 'fair_share'966worker1 # [ 0.307059] thermal_sys: Registered thermal governor 'fair_share'967lb # [ 0.294356] PM: RTC time: 12:25:18, date: 2026-09-24968client # [ 0.306018] thermal_sys: Registered thermal governor 'bang_bang'969worker1 # [ 0.307062] thermal_sys: Registered thermal governor 'bang_bang'970client # [ 0.306843] thermal_sys: Registered thermal governor 'step_wise'971worker1 # [ 0.307885] thermal_sys: Registered thermal governor 'step_wise'972worker2 # [ 0.312151] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.973worker1 # [ 0.308794] thermal_sys: Registered thermal governor 'user_space'974client # [ 0.307784] thermal_sys: Registered thermal governor 'user_space'975worker1 # [ 0.309598] thermal_sys: Registered thermal governor 'power_allocator'976client # [ 0.308601] audit: type=2000 audit(1790252719.247:1): state=initialized audit_enabled=0 res=1977lb # [ 0.297799] NET: Registered PF_NETLINK/PF_ROUTE protocol family978worker1 # [ 0.309899] cpuidle: using governor menu979client # [ 0.309845] thermal_sys: Registered thermal governor 'power_allocator'980lb # [ 0.298672] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations981client # [ 0.309868] cpuidle: using governor menu982worker1 # [ 0.312113] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5983lb # [ 0.299189] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations984worker1 # [ 0.313116] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]985client # [ 0.312081] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5986lb # [ 0.300457] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations987worker1 # [ 0.313888] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry988worker2 # [ 0.320107] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages989lb # [ 0.301179] audit: initializing netlink subsys (disabled)990worker1 # [ 0.314912] PCI: Using configuration type 1 for base access991client # [ 0.313285] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]992worker2 # [ 0.320819] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page993lb # [ 0.302347] thermal_sys: Registered thermal governor 'fair_share'994client # [ 0.313847] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry995worker1 # [ 0.315999] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.996lb # [ 0.302350] thermal_sys: Registered thermal governor 'bang_bang'997client # [ 0.314858] PCI: Using configuration type 1 for base access998lb # [ 0.303170] thermal_sys: Registered thermal governor 'step_wise'999lb # [ 0.304069] thermal_sys: Registered thermal governor 'user_space'1000client # [ 0.316011] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.1001lb # [ 0.304885] audit: type=2000 audit(1790252719.260:1): state=initialized audit_enabled=0 res=11002worker2 # [ 0.325819] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1003lb # [ 0.306171] thermal_sys: Registered thermal governor 'power_allocator'1004lb # [ 0.306184] cpuidle: using governor menu1005worker2 # [ 0.326820] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1006lb # [ 0.308173] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.51007worker1 # [ 0.322909] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1008lb # [ 0.309390] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]1009worker1 # [ 0.323885] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1010lb # [ 0.310172] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry1011client # [ 0.323092] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1012lb # [ 0.311181] PCI: Using configuration type 1 for base access1013client # [ 0.323843] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1014lb # [ 0.312269] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.1015worker1 # [ 0.328886] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1016worker2 # [ 0.336139] ACPI: Added _OSI(Module Device)1017worker1 # [ 0.329885] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1018worker2 # [ 0.336819] ACPI: Added _OSI(Processor Device)1019worker2 # [ 0.337563] ACPI: Added _OSI(Processor Aggregator Device)1020client # [ 0.328842] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1021client # [ 0.329843] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1022lb # [ 0.319418] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1023lb # [ 0.320170] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1024worker2 # [ 0.344405] ACPI: 1 ACPI AML tables successfully acquired and loaded1025lb # [ 0.325171] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1026worker1 # [ 0.341143] ACPI: Added _OSI(Module Device)1027lb # [ 0.326170] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1028worker1 # [ 0.341867] ACPI: Added _OSI(Processor Device)1029client # [ 0.339804] ACPI: Added _OSI(Module Device)1030worker1 # [ 0.342432] ACPI: Added _OSI(Processor Aggregator Device)1031client # [ 0.340395] ACPI: Added _OSI(Processor Device)1032worker2 # [ 0.348255] ACPI: Interpreter enabled1033worker2 # [ 0.348833] ACPI: PM: (supports S0 S3 S4 S5)1034client # [ 0.340842] ACPI: Added _OSI(Processor Aggregator Device)1035worker2 # [ 0.349606] ACPI: Using IOAPIC for interrupt routing1036worker2 # [ 0.352876] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1037worker1 # [ 0.348577] ACPI: 1 ACPI AML tables successfully acquired and loaded1038worker2 # [ 0.353819] PCI: Using E820 reservations for host bridge windows1039lb # [ 0.334777] ACPI: Added _OSI(Module Device)1040lb # [ 0.335171] ACPI: Added _OSI(Processor Device)1041lb # [ 0.335881] ACPI: Added _OSI(Processor Aggregator Device)1042client # [ 0.348276] ACPI: 1 ACPI AML tables successfully acquired and loaded1043worker2 # [ 0.356941] ACPI: Enabled 2 GPEs in block 00 to 3F1044worker1 # [ 0.352296] ACPI: Interpreter enabled1045worker1 # [ 0.352903] ACPI: PM: (supports S0 S3 S4 S5)1046worker1 # [ 0.353630] ACPI: Using IOAPIC for interrupt routing1047client # [ 0.352256] ACPI: Interpreter enabled1048client # [ 0.352857] ACPI: PM: (supports S0 S3 S4 S5)1049client # [ 0.353603] ACPI: Using IOAPIC for interrupt routing1050worker1 # [ 0.355943] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1051lb # [ 0.342691] ACPI: 1 ACPI AML tables successfully acquired and loaded1052worker1 # [ 0.356886] PCI: Using E820 reservations for host bridge windows1053worker2 # [ 0.364742] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1054client # [ 0.355899] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1055client # [ 0.356843] PCI: Using E820 reservations for host bridge windows1056worker2 # [ 0.365636] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1057worker1 # [ 0.359996] ACPI: Enabled 2 GPEs in block 00 to 3F1058lb # [ 0.346121] ACPI: Interpreter enabled1059lb # [ 0.346618] ACPI: PM: (supports S0 S3 S4 S5)1060worker2 # [ 0.366905] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1061lb # [ 0.347170] ACPI: Using IOAPIC for interrupt routing1062client # [ 0.359954] ACPI: Enabled 2 GPEs in block 00 to 3F1063worker2 # [ 0.367941] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1064lb # [ 0.348019] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1065worker2 # [ 0.369176] PCI host bridge to bus 0000:001066worker2 # [ 0.369824] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1067worker2 # [ 0.370818] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1068worker2 # [ 0.371818] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1069worker1 # [ 0.367732] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1070lb # [ 0.353170] PCI: Using E820 reservations for host bridge windows1071worker2 # [ 0.372818] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1072lb # [ 0.354244] ACPI: Enabled 2 GPEs in block 00 to 3F1073worker2 # [ 0.373818] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1074worker1 # [ 0.368675] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1075client # [ 0.367295] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1076worker2 # [ 0.374818] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1077worker1 # [ 0.369966] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1078client # [ 0.367848] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1079worker2 # [ 0.375818] pci_bus 0000:00: root bus resource [bus 00-ff]1080worker1 # [ 0.371012] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1081client # [ 0.368921] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1082worker2 # [ 0.376803] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1083worker1 # [ 0.372229] PCI host bridge to bus 0000:001084client # [ 0.369964] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1085worker1 # [ 0.372890] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1086client # [ 0.371186] PCI host bridge to bus 0000:001087worker2 # [ 0.378252] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1088worker1 # [ 0.373886] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1089client # [ 0.371846] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1090worker1 # [ 0.374885] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1091client # [ 0.372843] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1092lb # [ 0.362842] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1093worker1 # [ 0.375885] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1094client # [ 0.373842] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1095worker1 # [ 0.376885] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1096client # [ 0.374842] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1097lb # [ 0.363574] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1098worker1 # [ 0.377885] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1099client # [ 0.375842] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1100lb # [ 0.364246] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1101worker1 # [ 0.378886] pci_bus 0000:00: root bus resource [bus 00-ff]1102client # [ 0.376842] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1103lb # [ 0.365293] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1104worker2 # [ 0.380935] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1105worker1 # [ 0.379852] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1106client # [ 0.377861] pci_bus 0000:00: root bus resource [bus 00-ff]1107lb # [ 0.366523] PCI host bridge to bus 0000:001108worker2 # [ 0.381830] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1109lb # [ 0.367173] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1110client # [ 0.378806] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1111worker2 # [ 0.382817] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1112worker1 # [ 0.381330] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1113lb # [ 0.368169] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1114client # [ 0.380255] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1115worker2 # [ 0.384030] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1116lb # [ 0.369169] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1117lb # [ 0.370169] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1118worker2 # [ 0.385713] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1119lb # [ 0.371170] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1120lb # [ 0.372169] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1121lb # [ 0.373169] pci_bus 0000:00: root bus resource [bus 00-ff]1122worker2 # [ 0.388861] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1123worker1 # [ 0.383978] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1124worker2 # [ 0.389825] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1125lb # [ 0.374237] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1126worker1 # [ 0.385021] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1127client # [ 0.382893] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1128worker2 # [ 0.390810] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1129worker1 # [ 0.385910] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1130lb # [ 0.375619] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1131client # [ 0.383854] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1132worker2 # [ 0.391824] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1133client # [ 0.384803] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1134worker1 # [ 0.387224] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1135worker2 # [ 0.393357] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1136client # [ 0.385923] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1137worker1 # [ 0.388606] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1138client # [ 0.387757] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1139worker2 # [ 0.395761] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1140worker2 # [ 0.396572] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1141worker1 # [ 0.391924] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1142lb # [ 0.378300] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1143worker2 # [ 0.396841] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1144worker1 # [ 0.392835] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1145client # [ 0.390883] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1146lb # [ 0.379183] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1147worker1 # [ 0.393633] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1148client # [ 0.391706] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1149lb # [ 0.380130] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1150worker2 # [ 0.398365] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1151worker1 # [ 0.393891] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1152client # [ 0.392596] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1153lb # [ 0.381051] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1154client # [ 0.392848] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1155worker1 # [ 0.395430] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1156lb # [ 0.382871] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1157client # [ 0.394415] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1158worker2 # [ 0.400861] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1159worker2 # [ 0.402485] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1160worker1 # [ 0.398903] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1161worker2 # [ 0.402840] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1162client # [ 0.395859] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1163worker1 # [ 0.399786] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1164lb # [ 0.385207] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1165client # [ 0.396723] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1166lb # [ 0.386049] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1167worker1 # [ 0.400691] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1168worker2 # [ 0.404355] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1169client # [ 0.397561] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1170lb # [ 0.386897] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1171worker1 # [ 0.402267] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1172lb # [ 0.387175] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1173client # [ 0.398396] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1174worker2 # [ 0.406747] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1175lb # [ 0.388912] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1176worker2 # [ 0.407488] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1177worker2 # [ 0.407841] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1178worker1 # [ 0.405115] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1179lb # [ 0.391209] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1180client # [ 0.400862] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1181worker1 # [ 0.406572] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1182worker2 # [ 0.408824] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1183lb # [ 0.392077] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1184client # [ 0.401849] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1185worker1 # [ 0.406907] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1186lb # [ 0.392907] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1187client # [ 0.402808] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1188worker2 # [ 0.410406] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1189worker1 # [ 0.408464] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1190lb # [ 0.393742] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1191client # [ 0.404248] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1192worker2 # [ 0.411864] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1193worker2 # [ 0.412840] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1194worker1 # [ 0.410751] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1195client # [ 0.405877] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1196worker1 # [ 0.411580] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1197client # [ 0.406753] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1198worker2 # [ 0.414430] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1199lb # [ 0.396209] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1200worker1 # [ 0.411907] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1201client # [ 0.407601] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1202lb # [ 0.397176] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1203worker1 # [ 0.412890] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1204lb # [ 0.398143] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1205client # [ 0.407848] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1206worker2 # [ 0.415865] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1207lb # [ 0.399561] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1208worker1 # [ 0.414478] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1209worker2 # [ 0.416841] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1210client # [ 0.409410] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1211worker2 # [ 0.418357] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1212worker1 # [ 0.415898] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1213lb # [ 0.401177] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1214client # [ 0.410882] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1215lb # [ 0.402142] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1216worker1 # [ 0.416864] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1217client # [ 0.411842] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1218lb # [ 0.402893] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1219worker2 # [ 0.419865] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1220lb # [ 0.403175] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1221worker1 # [ 0.418316] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1222client # [ 0.413396] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1223worker2 # [ 0.420840] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1224worker2 # [ 0.422369] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1225client # [ 0.414901] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1226lb # [ 0.405186] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1227worker1 # [ 0.419937] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1228lb # [ 0.406989] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1229client # [ 0.415841] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1230worker1 # [ 0.420915] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1231lb # [ 0.407872] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1232worker2 # [ 0.423831] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1233client # [ 0.417413] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1234worker1 # [ 0.422481] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1235worker2 # [ 0.424841] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1236lb # [ 0.408735] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1237client # [ 0.418866] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1238worker2 # [ 0.426383] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1239worker1 # [ 0.423933] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1240client # [ 0.419847] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1241lb # [ 0.410219] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1242worker1 # [ 0.424908] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1243lb # [ 0.411192] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1244client # [ 0.421387] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1245worker2 # [ 0.428624] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1246worker1 # [ 0.426473] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1247worker2 # [ 0.429481] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1248lb # [ 0.413227] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1249client # [ 0.422866] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1250worker2 # [ 0.429840] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1251lb # [ 0.414962] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1252worker1 # [ 0.428198] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1253client # [ 0.423804] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1254worker2 # [ 0.431368] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1255lb # [ 0.415932] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1256worker1 # [ 0.428907] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1257client # [ 0.425377] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1258lb # [ 0.416745] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1259worker1 # [ 0.430478] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1260worker2 # [ 0.433580] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1261worker2 # [ 0.433825] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1262client # [ 0.426879] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1263lb # [ 0.418112] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1264client # [ 0.427728] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1265worker2 # [ 0.434789] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1266worker1 # [ 0.432742] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1267lb # [ 0.418935] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1268client # [ 0.428562] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1269worker1 # [ 0.433552] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1270worker2 # [ 0.436291] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1271worker1 # [ 0.433907] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1272client # [ 0.429399] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1273lb # [ 0.420524] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1274worker2 # [ 0.437536] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1275lb # [ 0.423217] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1276worker1 # [ 0.435468] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1277worker2 # [ 0.438018] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1278lb # [ 0.424095] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1279client # [ 0.430862] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1280lb # [ 0.424980] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1281client # [ 0.432582] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1282worker2 # [ 0.439672] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1283worker1 # [ 0.437888] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1284client # [ 0.432865] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1285worker1 # [ 0.438796] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1286lb # [ 0.426569] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1287worker2 # [ 0.440688] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1288worker1 # [ 0.439622] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1289client # [ 0.434405] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1290worker2 # [ 0.442557] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1291lb # [ 0.428207] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1292worker1 # [ 0.440453] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1293client # [ 0.435526] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1294lb # [ 0.429093] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1295client # [ 0.436058] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1296worker1 # [ 0.441691] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1297lb # [ 0.429979] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1298client # [ 0.437464] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1299lb # [ 0.431610] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1300worker1 # [ 0.442912] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1301client # [ 0.438036] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1302lb # [ 0.432698] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1303worker1 # [ 0.444732] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1304client # [ 0.440594] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1305lb # [ 0.433363] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1306worker1 # [ 0.445843] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1307lb # [ 0.434712] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1308worker1 # [ 0.447625] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1309lb # [ 0.435361] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1310lb # [ 0.437197] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1311worker2 # [ 0.443081] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1312worker2 # [ 0.445616] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1313worker2 # [ 0.446873] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1314worker2 # [ 0.448117] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1315worker2 # [ 0.449062] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1316client # [ 0.441076] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1317worker2 # [ 0.450879] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1318client # [ 0.443484] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1319worker2 # [ 0.451743] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1320worker1 # [ 0.448122] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1321client # [ 0.444146] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1322worker2 # [ 0.452890] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1323worker1 # [ 0.450694] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1324lb # [ 0.438305] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1325client # [ 0.445128] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1326worker2 # [ 0.454524] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1327worker1 # [ 0.451854] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1328lb # [ 0.440719] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1329client # [ 0.446108] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1330worker1 # [ 0.453171] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1331lb # [ 0.441443] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1332client # [ 0.447870] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1333client # [ 0.448707] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1334lb # [ 0.442459] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1335worker1 # [ 0.454180] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1336worker2 # [ 0.458569] ACPI: PCI: Interrupt link LNKA configured for IRQ 101337client # [ 0.449901] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1338lb # [ 0.443421] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1339worker1 # [ 0.455914] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1340worker2 # [ 0.459006] ACPI: PCI: Interrupt link LNKB configured for IRQ 101341client # [ 0.451527] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1342worker1 # [ 0.456748] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1343worker2 # [ 0.459934] ACPI: PCI: Interrupt link LNKC configured for IRQ 111344lb # [ 0.445198] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1345worker2 # [ 0.460920] ACPI: PCI: Interrupt link LNKD configured for IRQ 111346lb # [ 0.446045] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1347worker1 # [ 0.458033] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1348worker2 # [ 0.461915] ACPI: PCI: Interrupt link LNKE configured for IRQ 101349lb # [ 0.447219] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1350worker2 # [ 0.462919] ACPI: PCI: Interrupt link LNKF configured for IRQ 101351worker1 # [ 0.459693] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1352client # [ 0.455515] ACPI: PCI: Interrupt link LNKA configured for IRQ 101353lb # [ 0.448725] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1354worker2 # [ 0.463933] ACPI: PCI: Interrupt link LNKG configured for IRQ 111355client # [ 0.455945] ACPI: PCI: Interrupt link LNKB configured for IRQ 101356worker2 # [ 0.464963] ACPI: PCI: Interrupt link LNKH configured for IRQ 111357client # [ 0.456943] ACPI: PCI: Interrupt link LNKC configured for IRQ 111358worker2 # [ 0.465854] ACPI: PCI: Interrupt link GSIA configured for IRQ 161359worker2 # [ 0.466822] ACPI: PCI: Interrupt link GSIB configured for IRQ 171360client # [ 0.457940] ACPI: PCI: Interrupt link LNKD configured for IRQ 111361worker1 # [ 0.463703] ACPI: PCI: Interrupt link LNKA configured for IRQ 101362worker2 # [ 0.467776] ACPI: PCI: Interrupt link GSIC configured for IRQ 181363lb # [ 0.452269] ACPI: PCI: Interrupt link LNKA configured for IRQ 101364client # [ 0.458941] ACPI: PCI: Interrupt link LNKE configured for IRQ 101365worker1 # [ 0.464712] ACPI: PCI: Interrupt link LNKB configured for IRQ 101366worker2 # [ 0.468533] ACPI: PCI: Interrupt link GSID configured for IRQ 191367client # [ 0.459955] ACPI: PCI: Interrupt link LNKF configured for IRQ 101368lb # [ 0.453277] ACPI: PCI: Interrupt link LNKB configured for IRQ 101369worker1 # [ 0.465707] ACPI: PCI: Interrupt link LNKC configured for IRQ 111370worker2 # [ 0.468830] ACPI: PCI: Interrupt link GSIE configured for IRQ 201371lb # [ 0.454268] ACPI: PCI: Interrupt link LNKC configured for IRQ 111372client # [ 0.460973] ACPI: PCI: Interrupt link LNKG configured for IRQ 111373worker1 # [ 0.466691] ACPI: PCI: Interrupt link LNKD configured for IRQ 111374worker2 # [ 0.469743] ACPI: PCI: Interrupt link GSIF configured for IRQ 211375lb # [ 0.455266] ACPI: PCI: Interrupt link LNKD configured for IRQ 111376client # [ 0.461938] ACPI: PCI: Interrupt link LNKH configured for IRQ 111377worker2 # [ 0.470506] ACPI: PCI: Interrupt link GSIG configured for IRQ 221378worker1 # [ 0.467700] ACPI: PCI: Interrupt link LNKE configured for IRQ 101379lb # [ 0.456267] ACPI: PCI: Interrupt link LNKE configured for IRQ 101380client # [ 0.462880] ACPI: PCI: Interrupt link GSIA configured for IRQ 161381worker2 # [ 0.470831] ACPI: PCI: Interrupt link GSIH configured for IRQ 231382worker1 # [ 0.468979] ACPI: PCI: Interrupt link LNKF configured for IRQ 101383lb # [ 0.457265] ACPI: PCI: Interrupt link LNKF configured for IRQ 101384client # [ 0.463857] ACPI: PCI: Interrupt link GSIB configured for IRQ 171385worker1 # [ 0.469992] ACPI: PCI: Interrupt link LNKG configured for IRQ 111386lb # [ 0.458270] ACPI: PCI: Interrupt link LNKG configured for IRQ 111387client # [ 0.464856] ACPI: PCI: Interrupt link GSIC configured for IRQ 181388worker2 # [ 0.472988] iommu: Default domain type: Translated1389worker1 # [ 0.470986] ACPI: PCI: Interrupt link LNKH configured for IRQ 111390lb # [ 0.459284] ACPI: PCI: Interrupt link LNKH configured for IRQ 111391worker2 # [ 0.473736] iommu: DMA domain TLB invalidation policy: lazy mode1392client # [ 0.465857] ACPI: PCI: Interrupt link GSID configured for IRQ 191393worker1 # [ 0.471925] ACPI: PCI: Interrupt link GSIA configured for IRQ 161394lb # [ 0.460205] ACPI: PCI: Interrupt link GSIA configured for IRQ 161395client # [ 0.466835] ACPI: PCI: Interrupt link GSIE configured for IRQ 201396worker2 # [ 0.474809] ACPI: bus type USB registered1397worker1 # [ 0.472902] ACPI: PCI: Interrupt link GSIB configured for IRQ 171398lb # [ 0.461151] ACPI: PCI: Interrupt link GSIB configured for IRQ 171399worker2 # [ 0.475520] usbcore: registered new interface driver usbfs1400client # [ 0.467583] ACPI: PCI: Interrupt link GSIF configured for IRQ 211401worker1 # [ 0.473865] ACPI: PCI: Interrupt link GSIC configured for IRQ 181402worker2 # [ 0.475833] usbcore: registered new interface driver hub1403lb # [ 0.461874] ACPI: PCI: Interrupt link GSIC configured for IRQ 181404client # [ 0.467853] ACPI: PCI: Interrupt link GSIG configured for IRQ 221405worker1 # [ 0.474633] ACPI: PCI: Interrupt link GSID configured for IRQ 191406worker2 # [ 0.476655] usbcore: registered new device driver usb1407lb # [ 0.462182] ACPI: PCI: Interrupt link GSID configured for IRQ 191408client # [ 0.468789] ACPI: PCI: Interrupt link GSIH configured for IRQ 231409worker1 # [ 0.474899] ACPI: PCI: Interrupt link GSIE configured for IRQ 201410lb # [ 0.463181] ACPI: PCI: Interrupt link GSIE configured for IRQ 201411worker2 # [ 0.478307] NetLabel: Initializing1412worker1 # [ 0.475896] ACPI: PCI: Interrupt link GSIF configured for IRQ 211413client # [ 0.470641] iommu: Default domain type: Translated1414lb # [ 0.464147] ACPI: PCI: Interrupt link GSIF configured for IRQ 211415worker2 # [ 0.478819] NetLabel: domain hash size = 1281416worker1 # [ 0.476877] ACPI: PCI: Interrupt link GSIG configured for IRQ 221417client # [ 0.471441] iommu: DMA domain TLB invalidation policy: lazy mode1418worker2 # [ 0.479522] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1419lb # [ 0.464898] ACPI: PCI: Interrupt link GSIG configured for IRQ 221420worker1 # [ 0.477899] ACPI: PCI: Interrupt link GSIH configured for IRQ 231421worker2 # [ 0.479877] NetLabel: unlabeled traffic allowed by default1422lb # [ 0.465185] ACPI: PCI: Interrupt link GSIH configured for IRQ 231423client # [ 0.472114] ACPI: bus type USB registered1424worker2 # [ 0.480754] PCI: Using ACPI for IRQ routing1425client # [ 0.472823] usbcore: registered new interface driver usbfs1426worker1 # [ 0.479874] iommu: Default domain type: Translated1427client # [ 0.473519] usbcore: registered new interface driver hub1428lb # [ 0.467115] iommu: Default domain type: Translated1429client # [ 0.473851] usbcore: registered new device driver usb1430worker1 # [ 0.480701] iommu: DMA domain TLB invalidation policy: lazy mode1431lb # [ 0.467771] iommu: DMA domain TLB invalidation policy: lazy mode1432worker1 # [ 0.481922] ACPI: bus type USB registered1433lb # [ 0.468420] ACPI: bus type USB registered1434client # [ 0.475572] NetLabel: Initializing1435worker1 # [ 0.482743] usbcore: registered new interface driver usbfs1436lb # [ 0.469213] usbcore: registered new interface driver usbfs1437client # [ 0.475848] NetLabel: domain hash size = 1281438worker1 # [ 0.483607] usbcore: registered new interface driver hub1439lb # [ 0.470125] usbcore: registered new interface driver hub1440client # [ 0.476550] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1441worker1 # [ 0.483896] usbcore: registered new device driver usb1442lb # [ 0.470839] usbcore: registered new device driver usb1443client # [ 0.476891] NetLabel: unlabeled traffic allowed by default1444client # [ 0.477833] PCI: Using ACPI for IRQ routing1445lb # [ 0.472008] NetLabel: Initializing1446worker1 # [ 0.485668] NetLabel: Initializing1447lb # [ 0.472610] NetLabel: domain hash size = 1281448worker1 # [ 0.485892] NetLabel: domain hash size = 1281449lb # [ 0.473170] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1450worker1 # [ 0.486829] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1451lb # [ 0.474204] NetLabel: unlabeled traffic allowed by default1452worker1 # [ 0.487756] NetLabel: unlabeled traffic allowed by default1453lb # [ 0.475183] PCI: Using ACPI for IRQ routing1454worker1 # [ 0.488642] PCI: Using ACPI for IRQ routing1455worker2 # [ 0.525396] pci 0000:00:01.0: vgaarb: setting as boot VGA device1456worker2 # [ 0.525814] pci 0000:00:01.0: vgaarb: bridge control possible1457worker2 # [ 0.525814] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1458worker2 # [ 0.525824] vgaarb: loaded1459worker2 # [ 0.526614] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01460worker2 # [ 0.527484] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1461client # [ 0.522093] pci 0000:00:01.0: vgaarb: setting as boot VGA device1462client # [ 0.522838] pci 0000:00:01.0: vgaarb: bridge control possible1463client # [ 0.522838] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1464client # [ 0.522846] vgaarb: loaded1465lb # [ 0.519357] pci 0000:00:01.0: vgaarb: setting as boot VGA device1466worker2 # [ 0.531903] clocksource: Switched to clocksource kvm-clock1467client # [ 0.523572] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01468lb # [ 0.520165] pci 0000:00:01.0: vgaarb: bridge control possible1469client # [ 0.523843] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1470worker1 # [ 0.533029] pci 0000:00:01.0: vgaarb: setting as boot VGA device1471lb # [ 0.520165] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1472lb # [ 0.520175] vgaarb: loaded1473worker1 # [ 0.533881] pci 0000:00:01.0: vgaarb: bridge control possible1474worker2 # [ 0.535581] VFS: Disk quotas dquot_6.6.01475lb # [ 0.520899] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01476worker1 # [ 0.533881] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1477worker2 # [ 0.536251] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1478lb # [ 0.521171] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1479worker1 # [ 0.533890] vgaarb: loaded1480worker2 # [ 0.537542] pnp: PnP ACPI init1481worker1 # [ 0.534605] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01482worker2 # [ 0.538384] ACPI: IRQ 4 override to edge(!), high(!)1483client # [ 0.527928] clocksource: Switched to clocksource kvm-clock1484worker1 # [ 0.534885] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1485worker2 # [ 0.539317] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1486lb # [ 0.524254] clocksource: Switched to clocksource kvm-clock1487worker2 # [ 0.540912] pnp: PnP ACPI: found 5 devices1488client # [ 0.531416] VFS: Disk quotas dquot_6.6.01489client # [ 0.532183] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1490worker1 # [ 0.538970] clocksource: Switched to clocksource kvm-clock1491client # [ 0.533587] pnp: PnP ACPI init1492lb # [ 0.527842] VFS: Disk quotas dquot_6.6.01493client # [ 0.534424] ACPI: IRQ 4 override to edge(!), high(!)1494lb # [ 0.528518] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1495worker1 # [ 0.540729] VFS: Disk quotas dquot_6.6.01496lb # [ 0.529891] pnp: PnP ACPI init1497client # [ 0.535391] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1498lb # [ 0.530649] ACPI: IRQ 4 override to edge(!), high(!)1499client # [ 0.536974] pnp: PnP ACPI: found 5 devices1500worker1 # [ 0.543279] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1501lb # [ 0.531662] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1502worker1 # [ 0.544724] pnp: PnP ACPI init1503worker2 # [ 0.548643] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1504lb # [ 0.533412] pnp: PnP ACPI: found 5 devices1505worker1 # [ 0.545555] ACPI: IRQ 4 override to edge(!), high(!)1506worker2 # [ 0.550159] clocksource: Switched to clocksource acpi_pm1507worker2 # [ 0.551112] NET: Registered PF_INET protocol family1508worker1 # [ 0.546560] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1509worker1 # [ 0.548131] pnp: PnP ACPI: found 5 devices1510worker2 # [ 0.552369] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1511client # [ 0.545186] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1512client # [ 0.546709] clocksource: Switched to clocksource acpi_pm1513lb # [ 0.541041] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1514client # [ 0.547729] NET: Registered PF_INET protocol family1515lb # [ 0.542554] clocksource: Switched to clocksource acpi_pm1516lb # [ 0.543545] NET: Registered PF_INET protocol family1517client # [ 0.548918] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1518worker1 # [ 0.555794] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1519lb # [ 0.544713] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1520worker1 # [ 0.557344] clocksource: Switched to clocksource acpi_pm1521worker1 # [ 0.558369] NET: Registered PF_INET protocol family1522worker1 # [ 0.559629] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1523worker2 # [ 0.568755] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1524worker2 # [ 0.570393] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1525worker2 # [ 0.571759] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1526worker2 # [ 0.573165] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1527worker2 # [ 0.574462] TCP: Hash tables configured (established 16384 bind 16384)1528worker2 # [ 0.575723] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1529client # [ 0.565741] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1530worker2 # [ 0.577100] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1531lb # [ 0.561341] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1532client # [ 0.567340] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1533worker2 # [ 0.578300] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1534worker2 # [ 0.579499] NET: Registered PF_UNIX/PF_LOCAL protocol family1535client # [ 0.568685] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1536lb # [ 0.562903] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1537worker2 # [ 0.580460] NET: Registered PF_XDP protocol family1538client # [ 0.569996] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1539lb # [ 0.564192] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1540worker2 # [ 0.581266] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1541worker1 # [ 0.576437] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1542client # [ 0.571208] TCP: Hash tables configured (established 16384 bind 16384)1543lb # [ 0.565486] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1544worker2 # [ 0.582245] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1545worker1 # [ 0.578010] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1546client # [ 0.572311] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1547lb # [ 0.566732] TCP: Hash tables configured (established 16384 bind 16384)1548worker2 # [ 0.583212] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1549client # [ 0.573560] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1550worker1 # [ 0.579354] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1551worker2 # [ 0.584247] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1552lb # [ 0.567853] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1553client # [ 0.574618] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1554worker2 # [ 0.585288] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1555worker1 # [ 0.580669] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1556lb # [ 0.569094] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1557client # [ 0.575796] NET: Registered PF_UNIX/PF_LOCAL protocol family1558worker2 # [ 0.586381] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1559worker1 # [ 0.581883] TCP: Hash tables configured (established 16384 bind 16384)1560lb # [ 0.570139] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1561client # [ 0.576738] NET: Registered PF_XDP protocol family1562lb # [ 0.571319] NET: Registered PF_UNIX/PF_LOCAL protocol family1563worker2 # [ 0.588044] ACPI: \_SB_.GSIA: Enabled at IRQ 161564worker1 # [ 0.583006] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1565client # [ 0.577634] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1566lb # [ 0.572277] NET: Registered PF_XDP protocol family1567worker1 # [ 0.584271] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1568client # [ 0.578600] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1569lb # [ 0.573135] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1570worker1 # [ 0.585344] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1571client # [ 0.579619] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1572worker2 # [ 0.590634] ACPI: \_SB_.GSIB: Enabled at IRQ 171573lb # [ 0.574158] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1574worker1 # [ 0.586541] NET: Registered PF_UNIX/PF_LOCAL protocol family1575client # [ 0.580671] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1576lb # [ 0.575140] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1577worker1 # [ 0.587481] NET: Registered PF_XDP protocol family1578worker2 # [ 0.592531] ACPI: \_SB_.GSIC: Enabled at IRQ 181579client # [ 0.581755] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1580lb # [ 0.576225] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1581worker1 # [ 0.588333] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1582client # [ 0.582811] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1583lb # [ 0.577305] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1584worker1 # [ 0.589311] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1585worker2 # [ 0.594479] ACPI: \_SB_.GSID: Enabled at IRQ 191586lb # [ 0.578391] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1587client # [ 0.584582] ACPI: \_SB_.GSIA: Enabled at IRQ 161588worker1 # [ 0.590289] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1589worker2 # [ 0.596110] PCI: CLS 0 bytes, default 641590worker1 # [ 0.591362] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1591lb # [ 0.580043] ACPI: \_SB_.GSIA: Enabled at IRQ 161592worker1 # [ 0.592429] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1593client # [ 0.587232] ACPI: \_SB_.GSIB: Enabled at IRQ 171594worker2 # [ 0.597002] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1595worker1 # [ 0.593553] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1596lb # [ 0.582237] ACPI: \_SB_.GSIB: Enabled at IRQ 171597worker2 # [ 0.598840] Trying to unpack rootfs image as initramfs...1598worker1 # [ 0.595290] ACPI: \_SB_.GSIA: Enabled at IRQ 161599client # [ 0.589438] ACPI: \_SB_.GSIC: Enabled at IRQ 181600lb # [ 0.584505] ACPI: \_SB_.GSIC: Enabled at IRQ 181601client # [ 0.591728] ACPI: \_SB_.GSID: Enabled at IRQ 191602worker1 # [ 0.597854] ACPI: \_SB_.GSIB: Enabled at IRQ 171603lb # [ 0.586459] ACPI: \_SB_.GSID: Enabled at IRQ 191604client # [ 0.593513] PCI: CLS 0 bytes, default 641605lb # [ 0.588162] PCI: CLS 0 bytes, default 641606worker1 # [ 0.599782] ACPI: \_SB_.GSIC: Enabled at IRQ 181607client # [ 0.594597] Trying to unpack rootfs image as initramfs...1608lb # [ 0.589068] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1609worker1 # [ 0.601710] ACPI: \_SB_.GSID: Enabled at IRQ 191610lb # [ 0.590825] Trying to unpack rootfs image as initramfs...1611worker1 # [ 0.603392] PCI: CLS 0 bytes, default 641612worker1 # [ 0.604293] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1613client # [ 0.598757] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1614worker1 # [ 0.606077] Trying to unpack rootfs image as initramfs...1615worker2 # [ 0.641328] Initialise system trusted keyrings1616worker2 # [ 0.644338] workingset: timestamp_bits=40 max_order=19 bucket_order=01617lb # [ 0.633535] Initialise system trusted keyrings1618client # [ 0.640440] Initialise system trusted keyrings1619lb # [ 0.635746] workingset: timestamp_bits=40 max_order=19 bucket_order=01620client # [ 0.643451] workingset: timestamp_bits=40 max_order=19 bucket_order=01621worker1 # [ 0.652255] Initialise system trusted keyrings1622worker1 # [ 0.656089] workingset: timestamp_bits=40 max_order=19 bucket_order=01623worker2 # [ 0.667348] Key type asymmetric registered1624worker2 # [ 0.668411] Asymmetric key parser 'x509' registered1625worker2 # [ 0.669265] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1626worker2 # [ 0.672718] io scheduler mq-deadline registered1627client # [ 0.662777] Key type asymmetric registered1628worker2 # [ 0.675445] io scheduler kyber registered1629lb # [ 0.659841] Key type asymmetric registered1630lb # [ 0.660598] Asymmetric key parser 'x509' registered1631worker2 # [ 0.676768] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1632client # [ 0.667407] Asymmetric key parser 'x509' registered1633lb # [ 0.661470] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1634worker2 # [ 0.678030] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1635client # [ 0.668253] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1636worker1 # [ 0.675445] Key type asymmetric registered1637lb # [ 0.664808] io scheduler mq-deadline registered1638lb # [ 0.665607] io scheduler kyber registered1639client # [ 0.671518] io scheduler mq-deadline registered1640worker2 # [ 0.682697] Linux agpgart interface v0.1031641client # [ 0.672319] io scheduler kyber registered1642worker2 # [ 0.683493] ACPI: bus type drm_connector registered1643worker1 # [ 0.678953] Asymmetric key parser 'x509' registered1644worker1 # [ 0.679819] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1645lb # [ 0.669720] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1646client # [ 0.676096] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1647worker2 # [ 0.686737] usbcore: registered new interface driver usbserial_generic1648lb # [ 0.671084] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1649worker2 # [ 0.687807] usbserial: USB Serial support registered for generic1650worker1 # [ 0.685051] io scheduler mq-deadline registered1651worker1 # [ 0.685811] io scheduler kyber registered1652client # [ 0.679410] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1653worker2 # [ 0.691309] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1654worker2 # [ 0.691309] Please enable it if your BIOS has the CPPC option.1655lb # [ 0.676476] Linux agpgart interface v0.1031656client # [ 0.682824] Linux agpgart interface v0.1031657worker1 # [ 0.688524] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1658lb # [ 0.677258] ACPI: bus type drm_connector registered1659worker2 # [ 0.693580] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1660client # [ 0.683572] ACPI: bus type drm_connector registered1661worker1 # [ 0.689796] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1662worker2 # [ 0.696457] drop_monitor: Initializing network drop monitor service1663lb # [ 0.680162] usbcore: registered new interface driver usbserial_generic1664worker2 # [ 0.697651] NET: Registered PF_INET6 protocol family1665client # [ 0.686853] usbcore: registered new interface driver usbserial_generic1666lb # [ 0.681278] usbserial: USB Serial support registered for generic1667client # [ 0.687973] usbserial: USB Serial support registered for generic1668worker1 # [ 0.695374] Linux agpgart interface v0.1031669worker2 # [ 0.700751] Segment Routing with IPv61670worker1 # [ 0.696199] ACPI: bus type drm_connector registered1671lb # [ 0.684714] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1672lb # [ 0.684714] Please enable it if your BIOS has the CPPC option.1673client # [ 0.691526] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1674worker2 # [ 0.703310] In-situ OAM (IOAM) with IPv61675client # [ 0.691526] Please enable it if your BIOS has the CPPC option.1676lb # [ 0.687004] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1677worker1 # [ 0.699409] usbcore: registered new interface driver usbserial_generic1678worker2 # [ 0.704329] IPI shorthand broadcast: enabled1679client # [ 0.693721] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1680worker1 # [ 0.700489] usbserial: USB Serial support registered for generic1681client # [ 0.696584] drop_monitor: Initializing network drop monitor service1682client # [ 0.697819] NET: Registered PF_INET6 protocol family1683lb # [ 0.691859] drop_monitor: Initializing network drop monitor service1684worker1 # [ 0.703959] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1685lb # [ 0.693087] NET: Registered PF_INET6 protocol family1686worker1 # [ 0.703959] Please enable it if your BIOS has the CPPC option.1687client # [ 0.700900] Segment Routing with IPv61688worker1 # [ 0.706301] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1689worker2 # [ 0.711582] sched_clock: Marking stable (577016702, 134268438)->(787697722, -76412582)1690lb # [ 0.696124] Segment Routing with IPv61691client # [ 0.704436] In-situ OAM (IOAM) with IPv61692worker1 # [ 0.710096] drop_monitor: Initializing network drop monitor service1693lb # [ 0.698730] In-situ OAM (IOAM) with IPv61694worker1 # [ 0.711252] NET: Registered PF_INET6 protocol family1695lb # [ 0.699771] IPI shorthand broadcast: enabled1696client # [ 0.705576] IPI shorthand broadcast: enabled1697worker2 # [ 0.717482] registered taskstats version 11698worker2 # [ 0.718474] Loading compiled-in X.509 certificates1699worker1 # [ 0.714410] Segment Routing with IPv61700worker1 # [ 0.716977] In-situ OAM (IOAM) with IPv61701worker1 # [ 0.718101] IPI shorthand broadcast: enabled1702lb # [ 0.706938] sched_clock: Marking stable (573014901, 133671221)->(776124139, -69438017)1703client # [ 0.713929] sched_clock: Marking stable (578014997, 135371253)->(792050970, -78664720)1704lb # [ 0.712098] registered taskstats version 11705lb # [ 0.713106] Loading compiled-in X.509 certificates1706client # [ 0.719525] registered taskstats version 11707client # [ 0.720583] Loading compiled-in X.509 certificates1708worker1 # [ 0.726449] sched_clock: Marking stable (591016926, 134916900)->(800235499, -74301673)1709worker1 # [ 0.732048] registered taskstats version 11710worker2 # [ 0.737300] Demotion targets for Node 0: null1711worker1 # [ 0.733048] Loading compiled-in X.509 certificates1712worker2 # [ 0.738169] Key type .fscrypt registered1713worker2 # [ 0.741288] Key type fscrypt-provisioning registered1714worker2 # [ 0.742248] ima: No TPM chip found, activating TPM-bypass!1715worker2 # [ 0.743183] ima: Allocated hash algorithm: sha11716worker2 # [ 0.743994] ima: No architecture policies found1717worker2 # [ 0.746295] PM: Magic number: 10:469:4311718worker2 # [ 0.747891] RAS: Correctable Errors collector initialized.1719lb # [ 0.732695] Demotion targets for Node 0: null1720client # [ 0.738404] Demotion targets for Node 0: null1721lb # [ 0.733532] Key type .fscrypt registered1722client # [ 0.739324] Key type .fscrypt registered1723client # [ 0.742392] Key type fscrypt-provisioning registered1724lb # [ 0.736699] Key type fscrypt-provisioning registered1725client # [ 0.743392] ima: No TPM chip found, activating TPM-bypass!1726lb # [ 0.737665] ima: No TPM chip found, activating TPM-bypass!1727worker1 # [ 0.749621] Demotion targets for Node 0: null1728client # [ 0.744308] ima: Allocated hash algorithm: sha11729lb # [ 0.738582] ima: Allocated hash algorithm: sha11730worker2 # [ 0.756988] clk: Disabling unused clocks1731client # [ 0.746428] ima: No architecture policies found1732lb # [ 0.740725] ima: No architecture policies found1733worker1 # [ 0.752980] Key type .fscrypt registered1734lb # [ 0.741767] PM: Magic number: 10:469:4311735worker1 # [ 0.754117] Key type fscrypt-provisioning registered1736lb # [ 0.743317] RAS: Correctable Errors collector initialized.1737client # [ 0.749465] PM: Magic number: 10:469:4311738worker2 # [ 0.761313] PM: genpd: Disabling unused power domains1739client # [ 0.751270] RAS: Correctable Errors collector initialized.1740worker1 # [ 0.758090] ima: No TPM chip found, activating TPM-bypass!1741worker1 # [ 0.759052] ima: Allocated hash algorithm: sha11742worker1 # [ 0.759895] ima: No architecture policies found1743lb # [ 0.752306] clk: Disabling unused clocks1744worker1 # [ 0.764156] PM: Magic number: 10:469:4311745client # [ 0.759206] clk: Disabling unused clocks1746worker1 # [ 0.765729] RAS: Correctable Errors collector initialized.1747lb # [ 0.755711] PM: genpd: Disabling unused power domains1748client # [ 0.762422] PM: genpd: Disabling unused power domains1749worker1 # [ 0.773572] clk: Disabling unused clocks1750worker1 # [ 0.777949] PM: genpd: Disabling unused power domains1751worker2 # [ 0.922230] Freeing initrd memory: 29060K1752worker2 # [ 0.925411] Freeing unused decrypted memory: 2028K1753worker2 # [ 0.927977] Freeing unused kernel image (initmem) memory: 3652K1754worker2 # [ 0.929105] Write protecting the kernel read-only data: 32768k1755lb # [ 0.914836] Freeing initrd memory: 29064K1756worker2 # [ 0.930978] Freeing unused kernel image (text/rodata gap) memory: 1184K1757worker2 # [ 0.932495] Freeing unused kernel image (rodata/data gap) memory: 720K1758lb # [ 0.918007] Freeing unused decrypted memory: 2028K1759lb # [ 0.920572] Freeing unused kernel image (initmem) memory: 3652K1760client # [ 0.926805] Freeing initrd memory: 29056K1761lb # [ 0.921692] Write protecting the kernel read-only data: 32768k1762lb # [ 0.923535] Freeing unused kernel image (text/rodata gap) memory: 1184K1763client # [ 0.930168] Freeing unused decrypted memory: 2028K1764lb # [ 0.925096] Freeing unused kernel image (rodata/data gap) memory: 720K1765client # [ 0.933011] Freeing unused kernel image (initmem) memory: 3652K1766worker1 # [ 0.939446] Freeing initrd memory: 29056K1767client # [ 0.934111] Write protecting the kernel read-only data: 32768k1768client # [ 0.936067] Freeing unused kernel image (text/rodata gap) memory: 1184K1769worker1 # [ 0.942553] Freeing unused decrypted memory: 2028K1770client # [ 0.937674] Freeing unused kernel image (rodata/data gap) memory: 720K1771worker1 # [ 0.945155] Freeing unused kernel image (initmem) memory: 3652K1772worker1 # [ 0.946270] Write protecting the kernel read-only data: 32768k1773worker1 # [ 0.948174] Freeing unused kernel image (text/rodata gap) memory: 1184K1774worker1 # [ 0.949715] Freeing unused kernel image (rodata/data gap) memory: 720K1775worker2 # [ 0.983585] x86/mm: Checked W+X mappings: passed, no W+X pages found.1776worker2 # [ 0.984701] Run /init as init process1777lb # [ 0.976101] x86/mm: Checked W+X mappings: passed, no W+X pages found.1778lb # [ 0.977142] Run /init as init process1779worker2 # [ 0.995234] systemd[1]: Inserted module 'autofs4'1780client # [ 0.988661] x86/mm: Checked W+X mappings: passed, no W+X pages found.1781client # [ 0.989774] Run /init as init process1782lb # [ 0.987942] systemd[1]: Inserted module 'autofs4'1783worker1 # [ 1.000594] x86/mm: Checked W+X mappings: passed, no W+X pages found.1784worker1 # [ 1.001750] Run /init as init process1785client # [ 1.001274] systemd[1]: Inserted module 'autofs4'1786worker2 # [ 1.015139] fuse: init (API version 7.45)1787worker1 # [ 1.012539] systemd[1]: Inserted module 'autofs4'1788worker2 # [ 1.022468] ACPI: \_SB_.GSIG: Enabled at IRQ 221789lb # [ 1.007746] fuse: init (API version 7.45)1790worker2 # [ 1.025124] ACPI: \_SB_.GSIH: Enabled at IRQ 231791worker2 # [ 1.028355] ACPI: \_SB_.GSIE: Enabled at IRQ 201792worker2 # [ 1.030477] ACPI: \_SB_.GSIF: Enabled at IRQ 211793lb # [ 1.015174] ACPI: \_SB_.GSIG: Enabled at IRQ 221794client # [ 1.021506] fuse: init (API version 7.45)1795lb # [ 1.017609] ACPI: \_SB_.GSIH: Enabled at IRQ 231796worker2 # [ 1.035910] virtiofs virtio5: discovered new tag: nix-store1797lb # [ 1.020480] ACPI: \_SB_.GSIE: Enabled at IRQ 201798worker1 # [ 1.032382] fuse: init (API version 7.45)1799worker2 # [ 1.037463] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1800lb # [ 1.022379] ACPI: \_SB_.GSIF: Enabled at IRQ 211801client # [ 1.029053] ACPI: \_SB_.GSIG: Enabled at IRQ 221802client # [ 1.031617] ACPI: \_SB_.GSIH: Enabled at IRQ 231803lb # [ 1.027140] virtiofs virtio5: discovered new tag: nix-store1804worker1 # [ 1.039661] ACPI: \_SB_.GSIG: Enabled at IRQ 221805worker2 # [ 1.045151] virtiofs virtio6: discovered new tag: shared1806lb # [ 1.028890] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1807client # [ 1.035011] ACPI: \_SB_.GSIE: Enabled at IRQ 201808worker2 # [ 1.046609] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1809worker1 # [ 1.042392] ACPI: \_SB_.GSIH: Enabled at IRQ 231810client # [ 1.037019] ACPI: \_SB_.GSIF: Enabled at IRQ 211811worker2 # [ 1.049995] virtiofs virtio7: discovered new tag: xchg1812worker1 # [ 1.045654] ACPI: \_SB_.GSIE: Enabled at IRQ 201813worker2 # [ 1.051504] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1814lb # [ 1.035874] virtiofs virtio6: discovered new tag: shared1815worker1 # [ 1.047957] ACPI: \_SB_.GSIF: Enabled at IRQ 211816client # [ 1.042327] virtiofs virtio5: discovered new tag: nix-store1817lb # [ 1.037378] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1818client # [ 1.043957] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1819lb # [ 1.040425] virtiofs virtio7: discovered new tag: xchg1820worker1 # [ 1.053357] virtiofs virtio5: discovered new tag: nix-store1821lb # [ 1.041869] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1822worker1 # [ 1.054974] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1823client # [ 1.051884] virtiofs virtio6: discovered new tag: shared1824client # [ 1.053757] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1825worker1 # [ 1.062704] virtiofs virtio6: discovered new tag: shared1826client # [ 1.057357] virtiofs virtio7: discovered new tag: xchg1827worker1 # [ 1.064259] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1828client # [ 1.058891] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1829worker1 # [ 1.068537] virtiofs virtio7: discovered new tag: xchg1830worker2 # [ 1.074045] systemd[1]: Successfully made /usr/ read-only.1831worker1 # [ 1.070146] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1832lb # [ 1.063802] systemd[1]: Successfully made /usr/ read-only.1833client # [ 1.080297] systemd[1]: Successfully made /usr/ read-only.1834worker1 # [ 1.090721] systemd[1]: Successfully made /usr/ read-only.1835worker2 # [ 1.410544] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1836worker2 # [ 1.422653] systemd[1]: Detected virtualization kvm.1837worker2 # [ 1.424847] systemd[1]: Detected architecture x86-64.1838lb # [ 1.400446] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1839worker2 # [ 1.427067] systemd[1]: Running in initrd.1840lb # [ 1.412558] systemd[1]: Detected virtualization kvm.1841worker2 # [ 1.429541] systemd[1]: Initializing machine ID from random generator.1842lb # [ 1.414767] systemd[1]: Detected architecture x86-64.1843worker2 # [ 1.432429] systemd[1]: Hostname set to <worker2>.1844lb # [ 1.416922] systemd[1]: Running in initrd.1845worker1 # [ 1.426202] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1846worker1 # [ 1.430949] systemd[1]: Detected virtualization kvm.1847worker1 # [ 1.431790] systemd[1]: Detected architecture x86-64.1848worker1 # [ 1.432649] systemd[1]: Running in initrd.1849lb # [ 1.419523] systemd[1]: Initializing machine ID from random generator.1850worker1 # [ 1.433694] systemd[1]: Initializing machine ID from random generator.1851client # [ 1.416893] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1852worker1 # [ 1.434839] systemd[1]: Hostname set to <worker1>.1853lb # [ 1.422435] systemd[1]: Hostname set to <lb>.1854client # [ 1.429163] systemd[1]: Detected virtualization kvm.1855client # [ 1.431418] systemd[1]: Detected architecture x86-64.1856client # [ 1.433592] systemd[1]: Running in initrd.1857client # [ 1.436025] systemd[1]: Initializing machine ID from random generator.1858client # [ 1.438913] systemd[1]: Hostname set to <client>.1859worker1 # [ 1.641130] systemd[1]: bpf-restrict-fs: LSM BPF program attached1860worker2 # [ 1.656374] systemd[1]: bpf-restrict-fs: LSM BPF program attached1861lb # [ 1.648385] systemd[1]: bpf-restrict-fs: LSM BPF program attached1862client # [ 1.665578] systemd[1]: bpf-restrict-fs: LSM BPF program attached1863worker1 # [ 1.693724] systemd[1]: Queued start job for default target Initrd Default Target.1864worker1 # [ 1.698199] systemd[1]: Created slice Slice /system/modprobe.1865worker1 # [ 1.699434] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1866worker1 # [ 1.700878] systemd[1]: Expecting device /dev/disk/by-label/nixos...1867worker1 # [ 1.702030] systemd[1]: Reached target Path Units.1868worker1 # [ 1.702899] systemd[1]: Reached target Slice Units.1869worker1 # [ 1.703805] systemd[1]: Reached target Swaps.1870worker1 # [ 1.704626] systemd[1]: Reached target Timer Units.1871worker2 # [ 1.709214] systemd[1]: Queued start job for default target Initrd Default Target.1872worker1 # [ 1.705595] systemd[1]: Listening on D-Bus System Message Bus Socket.1873worker1 # [ 1.706840] systemd[1]: Listening on Journal Socket (/dev/log).1874worker1 # [ 1.708049] systemd[1]: Listening on Journal Sockets.1875worker1 # [ 1.709046] systemd[1]: Listening on udev Control Socket.1876worker2 # [ 1.713560] systemd[1]: Created slice Slice /system/modprobe.1877worker1 # [ 1.710040] systemd[1]: Listening on udev Kernel Socket.1878worker2 # [ 1.714777] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1879worker1 # [ 1.710986] systemd[1]: Reached target Socket Units.1880worker2 # [ 1.716218] systemd[1]: Expecting device /dev/disk/by-label/nixos...1881worker2 # [ 1.717427] systemd[1]: Reached target Path Units.1882worker1 # [ 1.712770] systemd[1]: Starting Create List of Static Device Nodes...1883worker2 # [ 1.718296] systemd[1]: Reached target Slice Units.1884worker2 # [ 1.719187] systemd[1]: Reached target Swaps.1885lb # [ 1.702757] systemd[1]: Queued start job for default target Initrd Default Target.1886worker2 # [ 1.719966] systemd[1]: Reached target Timer Units.1887worker2 # [ 1.720963] systemd[1]: Listening on D-Bus System Message Bus Socket.1888worker1 # [ 1.717055] systemd[1]: Starting Load Kernel Module configfs...1889worker2 # [ 1.722231] systemd[1]: Listening on Journal Socket (/dev/log).1890lb # [ 1.706214] systemd[1]: Created slice Slice /system/modprobe.1891worker2 # [ 1.723421] systemd[1]: Listening on Journal Sockets.1892lb # [ 1.707425] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1893worker2 # [ 1.724437] systemd[1]: Listening on udev Control Socket.1894lb # [ 1.708881] systemd[1]: Expecting device /dev/disk/by-label/nixos...1895worker2 # [ 1.725457] systemd[1]: Listening on udev Kernel Socket.1896lb # [ 1.710005] systemd[1]: Reached target Path Units.1897worker2 # [ 1.726422] systemd[1]: Reached target Socket Units.1898lb # [ 1.710934] systemd[1]: Reached target Slice Units.1899lb # [ 1.711870] systemd[1]: Reached target Swaps.1900worker2 # [ 1.728152] systemd[1]: Starting Create List of Static Device Nodes...1901lb # [ 1.712711] systemd[1]: Reached target Timer Units.1902lb # [ 1.713743] systemd[1]: Listening on D-Bus System Message Bus Socket.1903client # [ 1.720108] systemd[1]: Queued start job for default target Initrd Default Target.1904lb # [ 1.715000] systemd[1]: Listening on Journal Socket (/dev/log).1905worker2 # [ 1.732097] systemd[1]: Starting Load Kernel Module configfs...1906lb # [ 1.716175] systemd[1]: Listening on Journal Sockets.1907lb # [ 1.717212] systemd[1]: Listening on udev Control Socket.1908lb # [ 1.718287] systemd[1]: Listening on udev Kernel Socket.1909client # [ 1.724714] systemd[1]: Created slice Slice /system/modprobe.1910lb # [ 1.719298] systemd[1]: Reached target Socket Units.1911client # [ 1.725857] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1912lb # [ 1.721203] systemd[1]: Starting Create List of Static Device Nodes...1913client # [ 1.727213] systemd[1]: Expecting device /dev/disk/by-label/nixos...1914client # [ 1.728282] systemd[1]: Reached target Path Units.1915client # [ 1.729146] systemd[1]: Reached target Slice Units.1916client # [ 1.729983] systemd[1]: Reached target Swaps.1917client # [ 1.730805] systemd[1]: Reached target Timer Units.1918lb # [ 1.725758] systemd[1]: Starting Load Kernel Module configfs...1919client # [ 1.731740] systemd[1]: Listening on D-Bus System Message Bus Socket.1920worker1 # [ 1.726582] systemd[1]: Starting Journal Service...1921client # [ 1.732903] systemd[1]: Listening on Journal Socket (/dev/log).1922client # [ 1.733998] systemd[1]: Listening on Journal Sockets.1923client # [ 1.734950] systemd[1]: Listening on udev Control Socket.1924client # [ 1.735919] systemd[1]: Listening on udev Kernel Socket.1925client # [ 1.736841] systemd[1]: Reached target Socket Units.1926client # [ 1.738687] systemd[1]: Starting Create List of Static Device Nodes...1927worker2 # [ 1.740366] systemd[1]: Starting Journal Service...1928client # [ 1.742195] systemd[1]: Starting Load Kernel Module configfs...1929worker1 # [ 1.750518] systemd[1]: Starting Load Kernel Modules...1930worker1 # [ 1.755060] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1931lb # [ 1.735367] systemd[1]: Starting Journal Service...1932worker2 # [ 1.766455] systemd[1]: Starting Load Kernel Modules...1933worker1 # [ 1.763011] systemd[1]: Starting Coldplug All udev Devices...1934worker2 # [ 1.770380] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1935client # [ 1.751650] systemd[1]: Starting Journal Service...1936lb # [ 1.758755] systemd[1]: Starting Load Kernel Modules...1937worker2 # [ 1.778464] systemd[1]: Starting Coldplug All udev Devices...1938worker1 # [ 1.775514] systemd-journald[66]: Collecting audit messages is disabled.1939worker1 # [ 1.776750] systemd[1]: Finished Create List of Static Device Nodes.1940lb # [ 1.764793] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1941client # [ 1.777581] systemd[1]: Starting Load Kernel Modules...1942worker1 # [ 1.784350] systemd[1]: modprobe@configfs.service: Deactivated successfully.1943lb # [ 1.773895] systemd[1]: Starting Coldplug All udev Devices...1944worker2 # [ 1.790651] systemd-journald[66]: Collecting audit messages is disabled.1945client # [ 1.781499] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1946worker2 # [ 1.793348] systemd[1]: Finished Create List of Static Device Nodes.1947worker1 # [ 1.790311] systemd[1]: Finished Load Kernel Module configfs.1948worker2 # [ 1.798683] systemd[1]: modprobe@configfs.service: Deactivated successfully.1949lb # [ 1.783345] systemd-journald[66]: Collecting audit messages is disabled.1950client # [ 1.789459] systemd[1]: Starting Coldplug All udev Devices...1951worker1 # [ 1.796326] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1952lb # [ 1.788157] systemd[1]: Finished Create List of Static Device Nodes.1953worker2 # [ 1.805688] systemd[1]: Finished Load Kernel Module configfs.1954lb # [ 1.793354] systemd[1]: modprobe@configfs.service: Deactivated successfully.1955worker1 # [ 1.805706] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1956client # [ 1.800935] systemd-journald[66]: Collecting audit messages is disabled.1957worker2 # [ 1.811676] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1958client # [ 1.802669] systemd[1]: Finished Create List of Static Device Nodes.1959lb # [ 1.802442] systemd[1]: Finished Load Kernel Module configfs.1960client # [ 1.808042] systemd[1]: modprobe@configfs.service: Deactivated successfully.1961worker2 # [ 1.823390] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1962worker1 # [ 1.818099] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1963client # [ 1.813789] systemd[1]: Finished Load Kernel Module configfs.1964lb # [ 1.807874] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1965worker2 # [ 1.827165] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1966worker1 # [ 1.825969] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1967client # [ 1.819764] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1968lb # [ 1.818763] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1969worker2 # [ 1.840495] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1970client # [ 1.830184] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1971lb # [ 1.828931] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1972client # [ 1.841076] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1973worker1 # [ 1.848474] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1974lb # [ 1.837800] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1975client # [ 1.849589] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1976worker1 # [ 1.857124] systemd[1]: Starting Create Static Device Nodes in /dev...1977worker2 # [ 1.862823] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1978worker1 # [ 1.868462] systemd[1]: Finished Load Kernel Modules.1979worker2 # [ 1.874888] systemd[1]: Starting Create Static Device Nodes in /dev...1980lb # [ 1.863299] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1981worker1 # [ 1.877124] systemd[1]: Starting Apply Kernel Variables...1982client # [ 1.872947] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1983worker2 # [ 1.884811] systemd[1]: Finished Load Kernel Modules.1984lb # [ 1.873933] systemd[1]: Starting Create Static Device Nodes in /dev...1985client # [ 1.881583] systemd[1]: Starting Create Static Device Nodes in /dev...1986worker2 # [ 1.897567] systemd[1]: Starting Apply Kernel Variables...1987worker1 # [ 1.894837] systemd[1]: Finished Create Static Device Nodes in /dev.1988lb # [ 1.885772] systemd[1]: Finished Load Kernel Modules.1989worker1 # [ 1.762637] systemd-modules-load[67]: Inserted module 'dm_mod'1990client # [ 1.894474] systemd[1]: Finished Load Kernel Modules.1991worker1 # [ 1.766266] systemd-modules-load[67]: Inserted module 'virtio_balloon'1992worker1 # [ 1.767266] systemd-modules-load[67]: Inserted module 'virtio_gpu'1993worker1 # [ 1.903128] systemd[1]: Started Journal Service.1994lb # [ 1.894777] systemd[1]: Starting Apply Kernel Variables...1995worker2 # [ 1.776469] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.912390] systemd[1]: Started Journal Service.1996client # [ 1.903471] systemd[1]: Starting Apply Kernel Variables...1997worker2 # 1998worker2 # [ 1.782321] systemd-modules-load[68]: Inserted module 'virtio_balloon'1999worker2 # [ 1.783368] systemd-modules-load[68]: Inserted module 'virtio_gpu'2000worker1 # [ 1.779768] systemd[1]: Reached target Preparation for Local File Systems.
loading 2,529 hidden lines…
4530worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4531worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4532worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4533worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds)4534worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4535worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds)4536(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.39 seconds)4537subtest: repeat is answered Cached by the scheduler without building4538worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4539worker1 # finding garbage collector roots...4540worker1 # deleting specified paths...4541worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4542worker1 # deleting unused links...4543worker1 # note: hard linking is currently saving 0.0 KiB4544worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.17 seconds)4545worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4546worker2 # finding garbage collector roots...4547worker2 # deleting specified paths...4548worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4549worker2 # deleting unused links...4550worker2 # note: hard linking is currently saving 0.0 KiB4551worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.17 seconds)4552client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&24553worker2 # [ 64.811629] nix-grpc-daemon[798]: ts=2026-09-24T12:26:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523324554client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4555client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4556worker1 # [ 64.824275] nix-grpc-daemon[512]: ts=2026-09-24T12:26:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532324557worker1 # [ 64.852764] nix-grpc-daemon[512]: ts=2026-09-24T12:26:23Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14558client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 >&2, in 0.23 seconds)4559client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath4560client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 outPath, in 0.11 seconds)4561lb: must succeed: curl -sf localhost:9901/clusters4562lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4563lb: must succeed: curl -sf localhost:9901/clusters4564lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)4565worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4566worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4567(finished: subtest: repeat is answered Cached by the scheduler without building, in 0.84 seconds)4568subtest: inputs already in the cache are not sent to the scheduler4569lb: must succeed: curl -sf localhost:9901/clusters4570lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)4571lb: must succeed: curl -sf localhost:9901/clusters4572lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)4573worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4574worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds)4575client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&24576worker2 # [ 65.401359] nix-grpc-daemon[798]: ts=2026-09-24T12:26:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523324577client # don't know how to build these paths:4578client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4579worker1 # [ 65.405714] nix-grpc-daemon[512]: ts=2026-09-24T12:26:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532324580worker1 # [ 65.419879] nix-grpc-daemon[512]: ts=2026-09-24T12:26:23Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04581worker2 # [ 65.428517] nix-grpc-daemon[798]: ts=2026-09-24T12:26:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523324582worker1 # [ 65.425114] nix-grpc-daemon[512]: ts=2026-09-24T12:26:23Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=14583worker2 # [ 65.439636] nix-grpc-daemon[798]: ts=2026-09-24T12:26:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523324584worker2 # [ 65.452470] nix-grpc-daemon[868]: time=2026-09-24T12:26:24.621Z level=INFO msg="All 2 paths already cached"4585client # copying 1 paths to 'lb:50051'...4586client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4587worker2 # [ 65.460142] nix-grpc-daemon[798]: ts=2026-09-24T12:26:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523324588worker2 # [ 65.472140] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4589worker2 # [ 65.584099] nix-daemon[856]: accepted connection from pid 993, user nix-grpc-daemon (trusted)4590worker2 # [ 65.598674] nix-daemon[856]: reaped child process 996, status = succeeded4591lb # [ 65.591625] niks3-server[987]: 2026/09/24 12:26:23 INFO Received push request method=POST path=/api/pushes4592worker2 # [ 65.615903] nix-grpc-daemon[868]: time=2026-09-24T12:26:24.785Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4593worker2 # [ 65.617412] nix-grpc-daemon[868]: time=2026-09-24T12:26:24.786Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4594lb # [ 65.627206] niks3-server[987]: 2026/09/24 12:26:23 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign4595worker2 # [ 65.651057] nix-grpc-daemon[868]: time=2026-09-24T12:26:24.820Z level=INFO msg="Uploading 1 narinfos"4596lb # [ 65.635224] niks3-server[987]: 2026/09/24 12:26:23 INFO Signed narinfos id=7 count=14597lb # [ 65.639698] niks3-server[987]: 2026/09/24 12:26:23 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4598lb # [ 65.648384] niks3-server[987]: 2026/09/24 12:26:23 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4599lb # [ 65.659149] niks3-server[987]: 2026/09/24 12:26:23 INFO Received complete push request method=POST path=/api/pushes/7/complete4600worker2 # [ 65.684791] nix-grpc-daemon[868]: time=2026-09-24T12:26:24.853Z level=INFO msg="Upload complete. (199ms)"4601lb # [ 65.670256] niks3-server[987]: 2026/09/24 12:26:23 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4602worker2 # [ 65.690145] nix-grpc-daemon[798]: ts=2026-09-24T12:26:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=7524603worker2 # [ 65.696801] nix-grpc-daemon[798]: ts=2026-09-24T12:26:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523324604worker2 # [ 65.710110] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4605worker2 # [ 65.717204] nix-daemon[856]: reaped child process 991, status = succeeded4606worker2 # [ 65.724353] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4607client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4608client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4609lb # [ 66.350440] envoy[907]: conn peer=[2001:db8:1::1]:35496 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=124610lb # [ 66.354163] envoy[907]: conn peer=[2001:db8:1::1]:35500 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84611lb # [ 66.357666] envoy[907]: conn peer=[2001:db8:1::1]:35502 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9507 tx=4343 ms=56814612lb # [ 66.361238] envoy[907]: conn peer=[2001:db8:1::1]:59222 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=634613client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4614client # farm-top> LOG-farm-top-t1b4615worker2 # [ 66.747612] nix-daemon[856]: reaped child process 1000, status = succeeded4616worker2 # [ 66.826839] nix-daemon[856]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)4617worker2 # [ 66.838797] nix-daemon[856]: reaped child process 1019, status = succeeded4618lb # [ 66.830188] niks3-server[987]: 2026/09/24 12:26:25 INFO Received push request method=POST path=/api/pushes4619worker2 # [ 66.854273] nix-grpc-daemon[868]: time=2026-09-24T12:26:26.023Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4620worker2 # [ 66.855947] nix-grpc-daemon[868]: time=2026-09-24T12:26:26.025Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4621lb # [ 66.872397] niks3-server[987]: 2026/09/24 12:26:25 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign4622lb # [ 66.879384] niks3-server[987]: 2026/09/24 12:26:25 INFO Signed narinfos id=8 count=14623worker2 # [ 66.898357] nix-grpc-daemon[868]: time=2026-09-24T12:26:26.067Z level=INFO msg="Uploading 1 narinfos"4624lb # [ 66.888565] niks3-server[987]: 2026/09/24 12:26:25 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4625lb # [ 66.894952] niks3-server[987]: 2026/09/24 12:26:25 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4626lb # [ 66.903658] niks3-server[987]: 2026/09/24 12:26:25 INFO Received complete push request method=POST path=/api/pushes/8/complete4627lb # [ 66.907499] niks3-server[987]: 2026/09/24 12:26:25 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4628worker2 # [ 66.931943] nix-grpc-daemon[868]: time=2026-09-24T12:26:26.101Z level=INFO msg="Upload complete. (198ms)"4629lb # [ 66.918475] niks3-server[987]: 2026/09/24 12:26:25 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4630worker2 # [ 66.938466] nix-grpc-daemon[798]: ts=2026-09-24T12:26:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=04631worker2 # [ 66.955070] nix-daemon[856]: reaped child process 998, status = succeeded4632client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.72 seconds)4633client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath4634client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.12 seconds)4635lb: must succeed: curl -sf localhost:9901/clusters4636lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4637lb: must succeed: curl -sf localhost:9901/clusters4638lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4639worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4640worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds)4641(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.04 seconds)4642subtest: outputs read back through any worker carry the cache signature4643client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&24644worker2 # [ 67.362274] nix-grpc-daemon[798]: ts=2026-09-24T12:26:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523324645client # don't know how to build these paths:4646client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv4647worker1 # [ 67.367801] nix-grpc-daemon[512]: ts=2026-09-24T12:26:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532324648worker1 # [ 67.387252] nix-grpc-daemon[512]: ts=2026-09-24T12:26:25Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=04649worker1 # [ 67.392769] nix-grpc-daemon[512]: ts=2026-09-24T12:26:25Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.3:50051 clients=14650worker1 # [ 67.397951] nix-grpc-daemon[512]: ts=2026-09-24T12:26:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532324651worker1 # [ 67.409765] nix-grpc-daemon[512]: ts=2026-09-24T12:26:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532324652client # copying 1 paths to 'lb:50051'...4653worker1 # [ 67.420792] nix-grpc-daemon[512]: ts=2026-09-24T12:26:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532324654client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'...4655worker1 # [ 67.434229] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4656worker1 # [ 67.451787] nix-grpc-daemon[512]: ts=2026-09-24T12:26:25Z level=info event=niks3_push_started pid=9254657worker1 # [ 67.577906] nix-grpc-daemon[925]: time=2026-09-24T12:26:25.866Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""4658worker1 # [ 67.669644] nix-daemon[866]: accepted connection from pid 938, user nix-grpc-daemon (trusted)4659worker1 # [ 67.683137] nix-daemon[866]: reaped child process 941, status = succeeded4660lb # [ 67.678153] niks3-server[987]: 2026/09/24 12:26:25 INFO Received push request method=POST path=/api/pushes4661worker1 # [ 67.696431] nix-grpc-daemon[925]: time=2026-09-24T12:26:25.985Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4662worker1 # [ 67.697969] nix-grpc-daemon[925]: time=2026-09-24T12:26:25.987Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)"4663lb # [ 67.714867] niks3-server[987]: 2026/09/24 12:26:26 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign4664lb # [ 67.719353] niks3-server[987]: 2026/09/24 12:26:26 INFO Signed narinfos id=9 count=14665worker1 # [ 67.733371] nix-grpc-daemon[925]: time=2026-09-24T12:26:26.022Z level=INFO msg="Uploading 1 narinfos"4666lb # [ 67.729846] niks3-server[987]: 2026/09/24 12:26:26 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls4667lb # [ 67.735580] niks3-server[987]: 2026/09/24 12:26:26 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst4668lb # [ 67.746583] niks3-server[987]: 2026/09/24 12:26:26 INFO Received complete push request method=POST path=/api/pushes/9/complete4669worker1 # [ 67.766265] nix-grpc-daemon[925]: time=2026-09-24T12:26:26.055Z level=INFO msg="Upload complete. (183ms)"4670lb # [ 67.756768] niks3-server[987]: 2026/09/24 12:26:26 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo4671worker1 # [ 67.771402] nix-grpc-daemon[512]: ts=2026-09-24T12:26:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 paths=1 nar_bytes_in=5044672worker1 # [ 67.776431] nix-grpc-daemon[512]: ts=2026-09-24T12:26:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532324673worker1 # [ 67.785797] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4674worker1 # [ 67.791775] nix-daemon[866]: reaped child process 923, status = succeeded4675worker1 # [ 67.794625] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4676client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051...4677client # farm-a> node-a: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv4678client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4679client # farm-a> LOG-farm-a-sig4680worker1 # [ 68.630454] nix-daemon[866]: reaped child process 945, status = succeeded4681worker1 # [ 68.707818] nix-daemon[866]: accepted connection from pid 961, user nix-grpc-daemon (trusted)4682worker1 # [ 68.722306] nix-daemon[866]: reaped child process 964, status = succeeded4683lb # [ 68.711660] niks3-server[987]: 2026/09/24 12:26:27 INFO Received push request method=POST path=/api/pushes4684worker1 # [ 68.734313] nix-grpc-daemon[925]: time=2026-09-24T12:26:27.023Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4685worker1 # [ 68.737746] nix-grpc-daemon[925]: time=2026-09-24T12:26:27.024Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)"4686lb # [ 68.744842] niks3-server[987]: 2026/09/24 12:26:27 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign4687lb # [ 68.746987] niks3-server[987]: 2026/09/24 12:26:27 INFO Signed narinfos id=10 count=14688worker1 # [ 68.758087] nix-grpc-daemon[925]: time=2026-09-24T12:26:27.046Z level=INFO msg="Uploading 1 narinfos"4689lb # [ 68.751505] niks3-server[987]: 2026/09/24 12:26:27 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls4690lb # [ 68.754379] niks3-server[987]: 2026/09/24 12:26:27 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4691lb # [ 68.757591] niks3-server[987]: 2026/09/24 12:26:27 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv4692lb # [ 68.762065] niks3-server[987]: 2026/09/24 12:26:27 INFO Received complete push request method=POST path=/api/pushes/10/complete4693worker1 # [ 68.776910] nix-grpc-daemon[925]: time=2026-09-24T12:26:27.065Z level=INFO msg="Upload complete. (174ms)"4694worker1 # [ 68.780176] nix-grpc-daemon[512]: ts=2026-09-24T12:26:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04695lb # [ 68.771210] niks3-server[987]: 2026/09/24 12:26:27 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo4696worker1 # [ 68.786302] nix-grpc-daemon[512]: ts=2026-09-24T12:26:27Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=04697worker1 # [ 68.789065] nix-grpc-daemon[512]: ts=2026-09-24T12:26:27Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.3:50051 clients=14698worker1 # [ 68.790916] nix-grpc-daemon[512]: ts=2026-09-24T12:26:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532324699worker1 # [ 68.796341] nix-daemon[866]: reaped child process 943, status = succeeded4700worker1 # [ 68.800073] nix-grpc-daemon[512]: ts=2026-09-24T12:26:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532324701worker1 # [ 68.805759] nix-grpc-daemon[925]: time=2026-09-24T12:26:27.094Z level=INFO msg="All 1 paths already cached"4702client # copying 1 paths to 'lb:50051'...4703worker1 # [ 68.810766] nix-grpc-daemon[512]: ts=2026-09-24T12:26:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532324704client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'...4705worker1 # [ 68.815801] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4706worker1 # [ 68.901063] nix-daemon[866]: accepted connection from pid 970, user nix-grpc-daemon (trusted)4707worker1 # [ 68.914497] nix-daemon[866]: reaped child process 973, status = succeeded4708lb # [ 68.911991] niks3-server[987]: 2026/09/24 12:26:27 INFO Received push request method=POST path=/api/pushes4709worker1 # [ 68.932386] nix-grpc-daemon[925]: time=2026-09-24T12:26:27.221Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4710worker1 # [ 68.933825] nix-grpc-daemon[925]: time=2026-09-24T12:26:27.222Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)"4711lb # [ 68.945606] niks3-server[987]: 2026/09/24 12:26:27 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst4712lb # [ 68.951937] niks3-server[987]: 2026/09/24 12:26:27 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign4713lb # [ 68.956216] niks3-server[987]: 2026/09/24 12:26:27 INFO Signed narinfos id=11 count=14714worker1 # [ 68.969282] nix-grpc-daemon[925]: time=2026-09-24T12:26:27.258Z level=INFO msg="Uploading 1 narinfos"4715lb # [ 68.963321] niks3-server[987]: 2026/09/24 12:26:27 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls4716lb # [ 68.968060] niks3-server[987]: 2026/09/24 12:26:27 INFO Received complete push request method=POST path=/api/pushes/11/complete4717worker1 # [ 68.983609] nix-grpc-daemon[925]: time=2026-09-24T12:26:27.272Z level=INFO msg="Upload complete. (162ms)"4718worker1 # [ 68.985714] nix-grpc-daemon[512]: ts=2026-09-24T12:26:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 paths=1 nar_bytes_in=6244719lb # [ 68.976346] niks3-server[987]: 2026/09/24 12:26:27 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo4720worker1 # [ 68.989346] nix-grpc-daemon[512]: ts=2026-09-24T12:26:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532324721worker1 # [ 68.995909] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4722worker1 # [ 68.998208] nix-daemon[866]: reaped child process 968, status = succeeded4723worker1 # [ 69.003341] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4724client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051...4725client # farm-b> node-a: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv4726client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4727client # farm-b> LOG-farm-b-sig4728worker1 # [ 69.616369] nix-daemon[866]: reaped child process 977, status = succeeded4729worker1 # [ 69.691990] nix-daemon[866]: accepted connection from pid 993, user nix-grpc-daemon (trusted)4730worker1 # [ 69.704875] nix-daemon[866]: reaped child process 996, status = succeeded4731lb # [ 69.700748] niks3-server[987]: 2026/09/24 12:26:28 INFO Received push request method=POST path=/api/pushes4732worker1 # [ 69.718530] nix-grpc-daemon[925]: time=2026-09-24T12:26:28.007Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4733worker1 # [ 69.720031] nix-grpc-daemon[925]: time=2026-09-24T12:26:28.009Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)"4734lb # [ 69.739668] niks3-server[987]: 2026/09/24 12:26:28 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign4735lb # [ 69.744290] niks3-server[987]: 2026/09/24 12:26:28 INFO Signed narinfos id=12 count=14736worker1 # [ 69.758660] nix-grpc-daemon[925]: time=2026-09-24T12:26:28.047Z level=INFO msg="Uploading 1 narinfos"4737lb # [ 69.754468] niks3-server[987]: 2026/09/24 12:26:28 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv4738lb # [ 69.760652] niks3-server[987]: 2026/09/24 12:26:28 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls4739lb # [ 69.773672] niks3-server[987]: 2026/09/24 12:26:28 INFO Received complete push request method=POST path=/api/pushes/12/complete4740lb # [ 69.777889] niks3-server[987]: 2026/09/24 12:26:28 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst4741lb # [ 69.787378] niks3-server[987]: 2026/09/24 12:26:28 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo4742worker1 # [ 69.801268] nix-grpc-daemon[925]: time=2026-09-24T12:26:28.090Z level=INFO msg="Upload complete. (191ms)"4743worker1 # [ 69.807863] nix-grpc-daemon[512]: ts=2026-09-24T12:26:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=04744worker1 # [ 69.820821] nix-grpc-daemon[512]: ts=2026-09-24T12:26:28Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=04745worker1 # [ 69.825255] nix-grpc-daemon[512]: ts=2026-09-24T12:26:28Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.3:50051 clients=14746worker1 # [ 69.830155] nix-grpc-daemon[512]: ts=2026-09-24T12:26:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532324747worker1 # [ 69.839767] nix-daemon[866]: reaped child process 975, status = succeeded4748worker1 # [ 69.840991] nix-grpc-daemon[512]: ts=2026-09-24T12:26:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532324749worker1 # [ 69.849422] nix-grpc-daemon[925]: time=2026-09-24T12:26:28.138Z level=INFO msg="All 2 paths already cached"4750client # copying 1 paths to 'lb:50051'...4751worker1 # [ 69.855419] nix-grpc-daemon[512]: ts=2026-09-24T12:26:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532324752client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'...4753worker1 # [ 69.860403] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4754worker1 # [ 69.944642] nix-daemon[866]: accepted connection from pid 1002, user nix-grpc-daemon (trusted)4755worker1 # [ 69.959581] nix-daemon[866]: reaped child process 1005, status = succeeded4756lb # [ 69.953684] niks3-server[987]: 2026/09/24 12:26:28 INFO Received push request method=POST path=/api/pushes4757worker1 # [ 69.973338] nix-grpc-daemon[925]: time=2026-09-24T12:26:28.262Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4758worker1 # [ 69.975547] nix-grpc-daemon[925]: time=2026-09-24T12:26:28.264Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)"4759lb # [ 69.985149] niks3-server[987]: 2026/09/24 12:26:28 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign4760worker1 # [ 70.001445] nix-grpc-daemon[925]: time=2026-09-24T12:26:28.290Z level=INFO msg="Uploading 1 narinfos"4761lb # [ 69.990661] niks3-server[987]: 2026/09/24 12:26:28 INFO Signed narinfos id=13 count=14762lb # [ 69.998992] niks3-server[987]: 2026/09/24 12:26:28 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls4763lb # [ 70.010381] niks3-server[987]: 2026/09/24 12:26:28 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst4764lb # [ 70.015849] niks3-server[987]: 2026/09/24 12:26:28 INFO Received complete push request method=POST path=/api/pushes/13/complete4765lb # [ 70.025722] niks3-server[987]: 2026/09/24 12:26:28 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo4766worker1 # [ 70.035635] nix-grpc-daemon[925]: time=2026-09-24T12:26:28.324Z level=INFO msg="Upload complete. (169ms)"4767worker1 # [ 70.039688] nix-grpc-daemon[512]: ts=2026-09-24T12:26:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 paths=1 nar_bytes_in=7524768worker1 # [ 70.045317] nix-grpc-daemon[512]: ts=2026-09-24T12:26:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532324769worker1 # [ 70.055901] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4770worker1 # [ 70.063072] nix-daemon[866]: reaped child process 1000, status = succeeded4771worker1 # [ 70.065970] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4772client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051...4773client # farm-top> node-a: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv4774client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4775client # farm-top> LOG-farm-top-sig4776worker1 # [ 70.908599] nix-daemon[866]: reaped child process 1009, status = succeeded4777worker1 # [ 70.985089] nix-daemon[866]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4778worker1 # [ 70.998153] nix-daemon[866]: reaped child process 1028, status = succeeded4779lb # [ 70.992327] niks3-server[987]: 2026/09/24 12:26:29 INFO Received push request method=POST path=/api/pushes4780worker1 # [ 71.011480] nix-grpc-daemon[925]: time=2026-09-24T12:26:29.300Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4781worker1 # [ 71.014054] nix-grpc-daemon[925]: time=2026-09-24T12:26:29.302Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)"4782lb # [ 71.032602] niks3-server[987]: 2026/09/24 12:26:29 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign4783worker1 # [ 71.049470] nix-grpc-daemon[925]: time=2026-09-24T12:26:29.338Z level=INFO msg="Uploading 1 narinfos"4784lb # [ 71.038662] niks3-server[987]: 2026/09/24 12:26:29 INFO Signed narinfos id=14 count=14785lb # [ 71.047459] niks3-server[987]: 2026/09/24 12:26:29 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls4786lb # [ 71.053621] niks3-server[987]: 2026/09/24 12:26:29 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv4787lb # [ 71.058109] niks3-server[987]: 2026/09/24 12:26:29 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst4788lb # [ 71.066858] niks3-server[987]: 2026/09/24 12:26:29 INFO Received complete push request method=POST path=/api/pushes/14/complete4789lb # [ 71.078696] niks3-server[987]: 2026/09/24 12:26:29 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo4790worker1 # [ 71.089150] nix-grpc-daemon[925]: time=2026-09-24T12:26:29.378Z level=INFO msg="Upload complete. (216ms)"4791worker1 # [ 71.096111] nix-grpc-daemon[512]: ts=2026-09-24T12:26:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=1 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=04792worker1 # [ 71.112303] nix-daemon[866]: reaped child process 1007, status = succeeded4793client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 3.93 seconds)4794client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath4795client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.12 seconds)4796client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top4797worker1 # [ 71.363165] nix-grpc-daemon[512]: ts=2026-09-24T12:26:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:342104798worker1 # [ 71.370154] nix-grpc-daemon[512]: ts=2026-09-24T12:26:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:342104799client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.13 seconds)4800client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top4801worker2 # [ 71.495736] nix-grpc-daemon[798]: ts=2026-09-24T12:26:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:498664802client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):4803client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a4804client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b4805client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top4806worker2 # [ 71.516380] nix-grpc-daemon[798]: ts=2026-09-24T12:26:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:498664807worker2 # [ 71.523083] nix-grpc-daemon[798]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'...4808worker2 # [ 71.537298] nix-grpc-daemon[798]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'...4809worker2 # [ 71.549363] nix-grpc-daemon[798]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'...4810client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.20 seconds)4811client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top4812client # finding garbage collector roots...4813client # removing stale temporary roots file "/nix/var/nix/temproots/863"4814client # removing stale temporary roots file "/nix/var/nix/temproots/884"4815client # removing stale temporary roots file "/nix/var/nix/temproots/807"4816client # removing stale temporary roots file "/nix/var/nix/temproots/855"4817client # removing stale temporary roots file "/nix/var/nix/temproots/876"4818client # removing stale temporary roots file "/nix/var/nix/temproots/822"4819client # removing stale temporary roots file "/nix/var/nix/temproots/843"4820client # removing stale temporary roots file "/nix/var/nix/temproots/899"4821client # deleting specified paths...4822client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top'4823client # deleting unused links...4824client # note: hard linking is currently saving 0.0 KiB4825worker1 # [ 71.828169] nix-grpc-daemon[512]: ts=2026-09-24T12:26:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:532324826worker2 # [ 71.836382] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523324827worker2 # [ 71.846903] nix-grpc-daemon[868]: time=2026-09-24T12:26:31.015Z level=INFO msg="All 1 paths already cached"4828worker2 # [ 71.853440] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:523324829worker1 # [ 71.855565] nix-grpc-daemon[512]: ts=2026-09-24T12:26:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:532324830client # copying 3 paths...4831worker2 # [ 71.870897] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:523324832client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'...4833worker2 # [ 71.887260] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:523324834worker2 # [ 71.893114] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_out=2324835worker2 # [ 71.900213] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:523324836worker2 # [ 71.903880] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_out=1764837worker2 # [ 71.909484] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:523324838client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'...4839worker2 # [ 71.913255] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_out=1284840client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'...4841client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.36 seconds)4842(finished: subtest: outputs read back through any worker carry the cache signature, in 4.73 seconds)4843subtest: two clients wanting the same drv build it once4844client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup4845client # [ 71.956616] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup.4846client # Running as unit: dedup1.service; invocation ID: b8b4c6e8d0fc4da796a5a31444877b764847client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds)4848client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup4849worker2 # [ 72.100358] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523324850client # [ 72.094916] nix[952]: don't know how to build these paths:4851client # [ 72.095857] nix[952]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4852worker1 # [ 72.109655] nix-grpc-daemon[512]: ts=2026-09-24T12:26:30Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04853worker2 # [ 72.117270] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523324854worker1 # [ 72.113882] nix-grpc-daemon[512]: ts=2026-09-24T12:26:30Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14855worker2 # [ 72.129153] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523324856client # [ 72.127087] nix[952]: copying 1 paths to 'lb:50051'...4857client # [ 72.127931] nix[952]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4858worker2 # [ 72.140081] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523324859worker2 # [ 72.151139] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4860worker2 # [ 72.259129] nix-daemon[856]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)4861worker2 # [ 72.274640] nix-daemon[856]: reaped child process 1029, status = succeeded4862lb # [ 72.263308] niks3-server[987]: 2026/09/24 12:26:30 INFO Received push request method=POST path=/api/pushes4863worker2 # [ 72.287602] nix-grpc-daemon[868]: time=2026-09-24T12:26:31.456Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4864worker2 # [ 72.288965] nix-grpc-daemon[868]: time=2026-09-24T12:26:31.456Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4865lb # [ 72.291350] niks3-server[987]: 2026/09/24 12:26:30 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign4866lb # [ 72.298721] niks3-server[987]: 2026/09/24 12:26:30 INFO Signed narinfos id=15 count=14867worker2 # [ 72.317988] nix-grpc-daemon[868]: time=2026-09-24T12:26:31.487Z level=INFO msg="Uploading 1 narinfos"4868lb # [ 72.304767] niks3-server[987]: 2026/09/24 12:26:30 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4869lb # [ 72.316043] niks3-server[987]: 2026/09/24 12:26:30 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4870lb # [ 72.325862] niks3-server[987]: 2026/09/24 12:26:30 INFO Received complete push request method=POST path=/api/pushes/15/complete4871lb # [ 72.335702] niks3-server[987]: 2026/09/24 12:26:30 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4872worker2 # [ 72.355836] nix-grpc-daemon[868]: time=2026-09-24T12:26:31.524Z level=INFO msg="Upload complete. (192ms)"4873worker2 # [ 72.360707] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=4324874worker2 # [ 72.367411] nix-grpc-daemon[798]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523324875worker2 # [ 72.377480] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4876worker2 # [ 72.386667] nix-daemon[856]: reaped child process 1024, status = succeeded4877worker2 # [ 72.392596] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4878client # [ 72.380302] nix[952]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4879client # [ 73.012717] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup.4880client # Running as unit: dedup2.service; invocation ID: de0571c07fb9455d94fb0dc4fbe0925b4881client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.07 seconds)4882client # [ 73.176796] nix[968]: don't know how to build these paths:4883client # [ 73.177667] nix[968]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4884worker1 # [ 73.182115] nix-grpc-daemon[512]: ts=2026-09-24T12:26:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:532324885worker1 # [ 73.193118] nix-grpc-daemon[512]: ts=2026-09-24T12:26:31Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04886worker2 # [ 73.203800] nix-grpc-daemon[798]: ts=2026-09-24T12:26:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523324887client # [ 73.194871] nix[968]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4888client: must succeed: sleep 24889client: (finished: must succeed: sleep 2, in 2.04 seconds)4890lb # [ 76.350676] envoy[907]: conn peer=[2001:db8:1::1]:59234 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4178 tx=1878 ms=15474891lb # [ 76.354539] envoy[907]: conn peer=[2001:db8:1::1]:59246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9451 tx=4333 ms=37564892lb # [ 76.358265] envoy[907]: conn peer=[2001:db8:1::1]:59252 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1034 tx=2870 ms=1014893lb # [ 76.361739] envoy[907]: conn peer=[2001:db8:1::1]:59266 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=384 tx=410 ms=464894lb # [ 76.365227] envoy[907]: conn peer=[2001:db8:1::1]:59292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=329 ms=334895client: waiting for success: ! systemctl is-active dedup1 dedup24896lb # [ 76.369254] envoy[907]: conn peer=[2001:db8:1::1]:59280 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=376 ms=394897worker2 # [ 76.408363] nix-daemon[856]: reaped child process 1033, status = succeeded4898worker2 # [ 76.483892] nix-daemon[856]: accepted connection from pid 1063, user nix-grpc-daemon (trusted)4899worker2 # [ 76.497980] nix-daemon[856]: reaped child process 1066, status = succeeded4900lb # [ 76.488111] niks3-server[987]: 2026/09/24 12:26:34 INFO Received push request method=POST path=/api/pushes4901worker2 # [ 76.511769] nix-grpc-daemon[868]: time=2026-09-24T12:26:35.680Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4902worker2 # [ 76.513448] nix-grpc-daemon[868]: time=2026-09-24T12:26:35.682Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4903lb # [ 76.528987] niks3-server[987]: 2026/09/24 12:26:34 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4904lb # [ 76.532408] niks3-server[987]: 2026/09/24 12:26:34 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4905lb # [ 76.541358] niks3-server[987]: 2026/09/24 12:26:34 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign4906worker2 # [ 76.561610] nix-grpc-daemon[868]: time=2026-09-24T12:26:35.730Z level=INFO msg="Uploading 1 narinfos"4907lb # [ 76.546140] niks3-server[987]: 2026/09/24 12:26:34 INFO Signed narinfos id=16 count=14908lb # [ 76.552544] niks3-server[987]: 2026/09/24 12:26:34 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4909lb # [ 76.562266] niks3-server[987]: 2026/09/24 12:26:34 INFO Received complete push request method=POST path=/api/pushes/16/complete4910lb # [ 76.566213] niks3-server[987]: 2026/09/24 12:26:34 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4911worker2 # [ 76.581584] nix-grpc-daemon[868]: time=2026-09-24T12:26:35.750Z level=INFO msg="Upload complete. (179ms)"4912worker2 # [ 76.589273] nix-grpc-daemon[798]: ts=2026-09-24T12:26:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04913worker2 # [ 76.596267] nix-grpc-daemon[798]: ts=2026-09-24T12:26:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04914worker2 # [ 76.608117] nix-daemon[856]: reaped child process 1031, status = succeeded4915client # [ 76.621130] systemd[1]: dedup2.service: Deactivated successfully.4916client # [ 76.624739] systemd[1]: dedup2.service: Consumed 141ms CPU time over 3.611s wall clock time, 35.4M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic.4917client # [ 76.629562] systemd[1]: dedup1.service: Deactivated successfully.4918client # [ 76.632765] systemd[1]: dedup1.service: Consumed 119ms CPU time over 4.675s wall clock time, 41.5M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.4919client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds)4920client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4921client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4922worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4923worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4924worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4925worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4926worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4927worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4928worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4929worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4930(finished: subtest: two clients wanting the same drv build it once, in 5.74 seconds)4931subtest: --timeout and --max-silent-time reach the builder4932worker2 # [ 77.839344] nix-grpc-daemon[798]: ts=2026-09-24T12:26:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523324933worker1 # [ 77.849723] nix-grpc-daemon[512]: ts=2026-09-24T12:26:36Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=04934worker1 # [ 77.855855] nix-grpc-daemon[512]: ts=2026-09-24T12:26:36Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.3:50051 clients=14935worker1 # [ 77.860602] nix-grpc-daemon[512]: ts=2026-09-24T12:26:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532324936worker1 # [ 77.871494] nix-grpc-daemon[512]: ts=2026-09-24T12:26:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532324937worker1 # [ 77.882424] nix-grpc-daemon[512]: ts=2026-09-24T12:26:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532324938worker1 # [ 77.893326] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4939worker1 # [ 77.994970] nix-daemon[866]: accepted connection from pid 1059, user nix-grpc-daemon (trusted)4940worker1 # [ 78.008683] nix-daemon[866]: reaped child process 1062, status = succeeded4941lb # [ 78.007658] niks3-server[987]: 2026/09/24 12:26:36 INFO Received push request method=POST path=/api/pushes4942worker1 # [ 78.024779] nix-grpc-daemon[925]: time=2026-09-24T12:26:36.313Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4943worker1 # [ 78.026759] nix-grpc-daemon[925]: time=2026-09-24T12:26:36.315Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)"4944lb # [ 78.036383] niks3-server[987]: 2026/09/24 12:26:36 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign4945lb # [ 78.040462] niks3-server[987]: 2026/09/24 12:26:36 INFO Signed narinfos id=17 count=14946worker1 # [ 78.054920] nix-grpc-daemon[925]: time=2026-09-24T12:26:36.343Z level=INFO msg="Uploading 1 narinfos"4947lb # [ 78.051787] niks3-server[987]: 2026/09/24 12:26:36 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls4948lb # [ 78.057160] niks3-server[987]: 2026/09/24 12:26:36 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst4949lb # [ 78.068168] niks3-server[987]: 2026/09/24 12:26:36 INFO Received complete push request method=POST path=/api/pushes/17/complete4950lb # [ 78.074725] niks3-server[987]: 2026/09/24 12:26:36 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo4951worker1 # [ 78.091252] nix-grpc-daemon[925]: time=2026-09-24T12:26:36.380Z level=INFO msg="Upload complete. (186ms)"4952worker1 # [ 78.095817] nix-grpc-daemon[512]: ts=2026-09-24T12:26:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 paths=1 nar_bytes_in=4244953worker1 # [ 78.102422] nix-grpc-daemon[512]: ts=2026-09-24T12:26:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532324954worker1 # [ 78.112524] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4955worker1 # [ 78.121967] nix-daemon[866]: reaped child process 1057, status = succeeded4956worker1 # [ 78.127385] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)4957worker1 # [ 84.138421] nix-grpc-daemon[512]: ts=2026-09-24T12:26:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=6 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04958worker1 # [ 84.150607] nix-daemon[866]: reaped child process 1064, status = succeeded4959worker1 # [ 84.151600] nix-daemon[866]: reaped child process 1066, status = succeeded4960worker2 # [ 84.305073] nix-grpc-daemon[798]: ts=2026-09-24T12:26:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523324961worker1 # [ 84.308910] nix-grpc-daemon[512]: ts=2026-09-24T12:26:42Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=04962worker2 # [ 84.316707] nix-grpc-daemon[798]: ts=2026-09-24T12:26:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523324963worker1 # [ 84.313467] nix-grpc-daemon[512]: ts=2026-09-24T12:26:42Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.4:50051 clients=14964worker2 # [ 84.329917] nix-grpc-daemon[798]: ts=2026-09-24T12:26:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523324965worker2 # [ 84.341132] nix-grpc-daemon[798]: ts=2026-09-24T12:26:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523324966worker2 # [ 84.351762] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4967worker2 # [ 84.453182] nix-daemon[856]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)4968worker2 # [ 84.465899] nix-daemon[856]: reaped child process 1082, status = succeeded4969lb # [ 84.457200] niks3-server[987]: 2026/09/24 12:26:42 INFO Received push request method=POST path=/api/pushes4970worker2 # [ 84.481145] nix-grpc-daemon[868]: time=2026-09-24T12:26:43.650Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4971worker2 # [ 84.483165] nix-grpc-daemon[868]: time=2026-09-24T12:26:43.651Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)"4972lb # [ 84.494247] niks3-server[987]: 2026/09/24 12:26:42 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign4973worker2 # [ 84.515346] nix-grpc-daemon[868]: time=2026-09-24T12:26:43.684Z level=INFO msg="Uploading 1 narinfos"4974lb # [ 84.500165] niks3-server[987]: 2026/09/24 12:26:42 INFO Signed narinfos id=18 count=14975lb # [ 84.507942] niks3-server[987]: 2026/09/24 12:26:42 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls4976lb # [ 84.514735] niks3-server[987]: 2026/09/24 12:26:42 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst4977lb # [ 84.527905] niks3-server[987]: 2026/09/24 12:26:42 INFO Received complete push request method=POST path=/api/pushes/18/complete4978lb # [ 84.536337] niks3-server[987]: 2026/09/24 12:26:42 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo4979worker2 # [ 84.555757] nix-grpc-daemon[868]: time=2026-09-24T12:26:43.724Z level=INFO msg="Upload complete. (192ms)"4980worker2 # [ 84.560689] nix-grpc-daemon[798]: ts=2026-09-24T12:26:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=4244981worker2 # [ 84.567346] nix-grpc-daemon[798]: ts=2026-09-24T12:26:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523324982worker2 # [ 84.576473] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4983worker2 # [ 84.587143] nix-daemon[856]: reaped child process 1077, status = succeeded4984worker2 # [ 84.590422] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4985lb # [ 86.350303] envoy[907]: conn peer=[2001:db8:1::1]:47146 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1197 ms=34194986lb # [ 86.354196] envoy[907]: conn peer=[2001:db8:1::1]:59306 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2994 tx=1521 ms=45044987lb # [ 86.357698] envoy[907]: conn peer=[2001:db8:1::1]:47148 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=957 ms=63194988worker2 # [ 90.603882] nix-grpc-daemon[798]: ts=2026-09-24T12:26:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=6 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04989worker2 # [ 90.630944] nix-daemon[856]: reaped child process 1084, status = succeeded4990worker2 # [ 90.633929] nix-daemon[856]: reaped child process 1086, status = succeeded4991(finished: subtest: --timeout and --max-silent-time reach the builder, in 13.04 seconds)4992subtest: the first client leaving does not fail the second4993client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share4994client # [ 90.766866] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share.4995client # Running as unit: share1.service; invocation ID: 94b01afb7e5d420c9c37340c44e39ff44996client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds)4997client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share4998client # [ 90.911193] nix[1042]: don't know how to build these paths:4999client # [ 90.912087] nix[1042]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5000worker2 # [ 90.921672] nix-grpc-daemon[798]: ts=2026-09-24T12:26:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523325001worker1 # [ 90.925853] nix-grpc-daemon[512]: ts=2026-09-24T12:26:49Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=05002worker1 # [ 90.931485] nix-grpc-daemon[512]: ts=2026-09-24T12:26:49Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.3:50051 clients=15003worker1 # [ 90.938274] nix-grpc-daemon[512]: ts=2026-09-24T12:26:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532325004worker1 # [ 90.949135] nix-grpc-daemon[512]: ts=2026-09-24T12:26:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532325005client # [ 90.952079] nix[1042]: copying 1 paths to 'lb:50051'...5006client # [ 90.952923] nix[1042]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'...5007worker1 # [ 90.959727] nix-grpc-daemon[512]: ts=2026-09-24T12:26:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532325008worker1 # [ 90.970723] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5009worker1 # [ 91.070920] nix-daemon[866]: accepted connection from pid 1093, user nix-grpc-daemon (trusted)5010worker1 # [ 91.084981] nix-daemon[866]: reaped child process 1096, status = succeeded5011lb # [ 91.079709] niks3-server[987]: 2026/09/24 12:26:49 INFO Received push request method=POST path=/api/pushes5012worker1 # [ 91.099387] nix-grpc-daemon[925]: time=2026-09-24T12:26:49.387Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5013worker1 # [ 91.100744] nix-grpc-daemon[925]: time=2026-09-24T12:26:49.387Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)"5014lb # [ 91.111816] niks3-server[987]: 2026/09/24 12:26:49 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign5015worker1 # [ 91.130699] nix-grpc-daemon[925]: time=2026-09-24T12:26:49.419Z level=INFO msg="Uploading 1 narinfos"5016lb # [ 91.119949] niks3-server[987]: 2026/09/24 12:26:49 INFO Signed narinfos id=19 count=15017lb # [ 91.129756] niks3-server[987]: 2026/09/24 12:26:49 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls5018lb # [ 91.135918] niks3-server[987]: 2026/09/24 12:26:49 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst5019lb # [ 91.151107] niks3-server[987]: 2026/09/24 12:26:49 INFO Received complete push request method=POST path=/api/pushes/19/complete5020lb # [ 91.161515] niks3-server[987]: 2026/09/24 12:26:49 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo5021worker1 # [ 91.171705] nix-grpc-daemon[925]: time=2026-09-24T12:26:49.460Z level=INFO msg="Upload complete. (189ms)"5022worker1 # [ 91.176540] nix-grpc-daemon[512]: ts=2026-09-24T12:26:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 paths=1 nar_bytes_in=4325023worker1 # [ 91.183522] nix-grpc-daemon[512]: ts=2026-09-24T12:26:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532325024worker1 # [ 91.193577] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5025worker1 # [ 91.203738] nix-daemon[866]: reaped child process 1091, status = succeeded5026worker1 # [ 91.211427] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5027client # [ 91.203904] nix[1042]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051...5028client # [ 91.837173] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share.5029client # Running as unit: share2.service; invocation ID: 70b338f22bbe4efd8f850181cec8cf945030client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds)5031client # [ 91.979280] nix[1058]: don't know how to build these paths:5032client # [ 91.980228] nix[1058]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5033worker2 # [ 91.989894] nix-grpc-daemon[798]: ts=2026-09-24T12:26:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:523325034worker1 # [ 91.992244] nix-grpc-daemon[512]: ts=2026-09-24T12:26:50Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=05035worker1 # [ 91.996464] nix-grpc-daemon[512]: ts=2026-09-24T12:26:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532325036client # [ 91.992631] nix[1058]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051...5037client: must succeed: sleep 2; systemctl kill -s INT share15038client # [ 95.084636] systemd[1]: share1.service: Sent signal SIGINT to main process 1042 (nix) on client request.5039client # [ 95.091137] nix[1042]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5040client # [ 95.096815] nix[1042]: error: interrupted by the user5041client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds)5042client: waiting for success: ! systemctl is-active share15043client # [ 95.139320] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE5044client # [ 95.140819] systemd[1]: share1.service: Failed with result 'exit-code'.5045client # [ 95.142816] systemd[1]: share1.service: Consumed 116ms CPU time over 4.375s wall clock time, 43.4M memory peak, 6K incoming IP traffic, 8.1K outgoing IP traffic.5046client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds)5047client: waiting for success: ! systemctl is-active share25048lb # [ 96.351469] envoy[907]: conn peer=[2001:db8:1::1]:42678 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=935 ms=63125049lb # [ 96.355234] envoy[907]: conn peer=[2001:db8:1::1]:42694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=794 ms=41985050worker1 # [ 96.454270] nix-daemon[866]: reaped child process 1100, status = succeeded5051worker1 # [ 96.530436] nix-daemon[866]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)5052worker1 # [ 96.543123] nix-daemon[866]: reaped child process 1139, status = succeeded5053lb # [ 96.540524] niks3-server[987]: 2026/09/24 12:26:54 INFO Received push request method=POST path=/api/pushes5054worker1 # [ 96.559824] nix-grpc-daemon[925]: time=2026-09-24T12:26:54.848Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5055worker1 # [ 96.561382] nix-grpc-daemon[925]: time=2026-09-24T12:26:54.850Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)"5056lb # [ 96.584337] niks3-server[987]: 2026/09/24 12:26:54 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5057lb # [ 96.589471] niks3-server[987]: 2026/09/24 12:26:54 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls5058lb # [ 96.594754] niks3-server[987]: 2026/09/24 12:26:54 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign5059lb # [ 96.599948] niks3-server[987]: 2026/09/24 12:26:54 INFO Signed narinfos id=20 count=15060worker1 # [ 96.613964] nix-grpc-daemon[925]: time=2026-09-24T12:26:54.902Z level=INFO msg="Uploading 1 narinfos"5061lb # [ 96.608942] niks3-server[987]: 2026/09/24 12:26:54 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst5062lb # [ 96.618414] niks3-server[987]: 2026/09/24 12:26:54 INFO Received complete push request method=POST path=/api/pushes/20/complete5063worker1 # [ 96.638270] nix-grpc-daemon[925]: time=2026-09-24T12:26:54.927Z level=INFO msg="Upload complete. (215ms)"5064lb # [ 96.631288] niks3-server[987]: 2026/09/24 12:26:54 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo5065worker1 # [ 96.645861] nix-grpc-daemon[512]: ts=2026-09-24T12:26:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05066worker1 # [ 96.653564] nix-grpc-daemon[512]: ts=2026-09-24T12:26:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05067worker1 # [ 96.667955] nix-daemon[866]: reaped child process 1098, status = succeeded5068client # [ 96.678327] systemd[1]: share2.service: Deactivated successfully.5069client # [ 96.682432] systemd[1]: share2.service: Consumed 120ms CPU time over 4.840s wall clock time, 35.4M memory peak, 5.9K incoming IP traffic, 5.7K outgoing IP traffic.5070client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds)5071client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }5072client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds)5073(finished: subtest: the first client leaving does not fail the second, in 6.75 seconds)5074subtest: build hook: nix-daemon with builders = grpc://lb5075client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log5076client # [ 97.558131] systemd[1]: Started Nix Daemon.5077client # [ 97.648098] nix-daemon[1109]: accepted connection from pid 1106, user root (trusted)5078worker1 # [ 97.771997] nix-grpc-daemon[512]: ts=2026-09-24T12:26:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:532325079worker1 # [ 97.777881] nix-grpc-daemon[512]: ts=2026-09-24T12:26:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532325080worker1 # [ 97.788157] nix-grpc-daemon[512]: ts=2026-09-24T12:26:56Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=05081worker1 # [ 97.793125] nix-grpc-daemon[512]: ts=2026-09-24T12:26:56Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=15082worker2 # [ 97.801208] nix-grpc-daemon[798]: ts=2026-09-24T12:26:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325083worker2 # [ 97.813734] nix-grpc-daemon[798]: ts=2026-09-24T12:26:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325084worker2 # [ 97.824859] nix-grpc-daemon[798]: ts=2026-09-24T12:26:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523325085worker2 # [ 97.835442] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5086worker2 # [ 97.938509] nix-daemon[856]: accepted connection from pid 1125, user nix-grpc-daemon (trusted)5087worker2 # [ 97.952102] nix-daemon[856]: reaped child process 1128, status = succeeded5088lb # [ 97.941834] niks3-server[987]: 2026/09/24 12:26:56 INFO Received push request method=POST path=/api/pushes5089worker2 # [ 97.965957] nix-grpc-daemon[868]: time=2026-09-24T12:26:57.135Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5090worker2 # [ 97.967916] nix-grpc-daemon[868]: time=2026-09-24T12:26:57.136Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"5091lb # [ 97.978591] niks3-server[987]: 2026/09/24 12:26:56 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls5092lb # [ 97.986621] niks3-server[987]: 2026/09/24 12:26:56 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign5093worker2 # [ 98.008354] nix-grpc-daemon[868]: time=2026-09-24T12:26:57.177Z level=INFO msg="Uploading 1 narinfos"5094lb # [ 97.992828] niks3-server[987]: 2026/09/24 12:26:56 INFO Signed narinfos id=21 count=15095lb # [ 98.000955] niks3-server[987]: 2026/09/24 12:26:56 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst5096lb # [ 98.012423] niks3-server[987]: 2026/09/24 12:26:56 INFO Received complete push request method=POST path=/api/pushes/21/complete5097lb # [ 98.021114] niks3-server[987]: 2026/09/24 12:26:56 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo5098worker2 # [ 98.036004] nix-grpc-daemon[868]: time=2026-09-24T12:26:57.205Z level=INFO msg="Upload complete. (188ms)"5099worker2 # [ 98.040922] nix-grpc-daemon[798]: ts=2026-09-24T12:26:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=5125100worker2 # [ 98.046802] nix-grpc-daemon[798]: ts=2026-09-24T12:26:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325101worker2 # [ 98.057546] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5102worker2 # [ 98.070943] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5103worker2 # [ 98.073201] nix-daemon[856]: reaped child process 1123, status = succeeded5104worker2 # [ 98.696819] nix-daemon[856]: reaped child process 1132, status = succeeded5105worker2 # [ 98.774299] nix-daemon[856]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)5106worker2 # [ 98.787254] nix-daemon[856]: reaped child process 1151, status = succeeded5107lb # [ 98.777878] niks3-server[987]: 2026/09/24 12:26:57 INFO Received push request method=POST path=/api/pushes5108worker2 # [ 98.801578] nix-grpc-daemon[868]: time=2026-09-24T12:26:57.970Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5109worker2 # [ 98.803069] nix-grpc-daemon[868]: time=2026-09-24T12:26:57.972Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"5110lb # [ 98.820655] niks3-server[987]: 2026/09/24 12:26:57 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv5111lb # [ 98.825883] niks3-server[987]: 2026/09/24 12:26:57 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls5112lb # [ 98.835520] niks3-server[987]: 2026/09/24 12:26:57 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign5113lb # [ 98.840071] niks3-server[987]: 2026/09/24 12:26:57 INFO Signed narinfos id=22 count=15114worker2 # [ 98.858933] nix-grpc-daemon[868]: time=2026-09-24T12:26:58.028Z level=INFO msg="Uploading 1 narinfos"5115lb # [ 98.844437] niks3-server[987]: 2026/09/24 12:26:57 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst5116lb # [ 98.857896] niks3-server[987]: 2026/09/24 12:26:57 INFO Received complete push request method=POST path=/api/pushes/22/complete5117lb # [ 98.866387] niks3-server[987]: 2026/09/24 12:26:57 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo5118worker2 # [ 98.881479] nix-grpc-daemon[868]: time=2026-09-24T12:26:58.050Z level=INFO msg="Upload complete. (203ms)"5119worker2 # [ 98.887565] nix-grpc-daemon[798]: ts=2026-09-24T12:26:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05120worker1 # [ 98.887303] nix-grpc-daemon[512]: ts=2026-09-24T12:26:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:532325121worker1 # [ 98.896553] nix-grpc-daemon[512]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...5122worker2 # [ 98.903862] nix-daemon[856]: reaped child process 1130, status = succeeded5123worker2 # [ 98.931213] nix-grpc-daemon[798]: ts=2026-09-24T12:26:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:523325124worker2 # [ 98.936508] nix-grpc-daemon[798]: ts=2026-09-24T12:26:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_out=1285125worker1 # [ 99.101919] nix-grpc-daemon[512]: ts=2026-09-24T12:26:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:532325126worker2 # [ 99.115362] nix-grpc-daemon[798]: ts=2026-09-24T12:26:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325127worker2 # [ 99.125135] nix-grpc-daemon[868]: time=2026-09-24T12:26:58.293Z level=INFO msg="All 1 paths already cached"5128worker1 # [ 99.134630] nix-grpc-daemon[512]: ts=2026-09-24T12:26:57Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=05129worker2 # [ 99.142424] nix-grpc-daemon[798]: ts=2026-09-24T12:26:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325130worker1 # [ 99.138988] nix-grpc-daemon[512]: ts=2026-09-24T12:26:57Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=15131worker2 # [ 99.153909] nix-grpc-daemon[798]: ts=2026-09-24T12:26:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325132worker2 # [ 99.166342] nix-grpc-daemon[868]: time=2026-09-24T12:26:58.335Z level=INFO msg="All 1 paths already cached"5133worker2 # [ 99.173293] nix-grpc-daemon[798]: ts=2026-09-24T12:26:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523325134worker2 # [ 99.183167] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5135worker2 # [ 99.281167] nix-daemon[856]: accepted connection from pid 1155, user nix-grpc-daemon (trusted)5136worker2 # [ 99.293832] nix-daemon[856]: reaped child process 1158, status = succeeded5137lb # [ 99.287720] niks3-server[987]: 2026/09/24 12:26:57 INFO Received push request method=POST path=/api/pushes5138worker2 # [ 99.309147] nix-grpc-daemon[868]: time=2026-09-24T12:26:58.478Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5139worker2 # [ 99.310525] nix-grpc-daemon[868]: time=2026-09-24T12:26:58.479Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"5140lb # [ 99.314295] niks3-server[987]: 2026/09/24 12:26:57 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign5141worker2 # [ 99.334748] nix-grpc-daemon[868]: time=2026-09-24T12:26:58.503Z level=INFO msg="Uploading 1 narinfos"5142lb # [ 99.319184] niks3-server[987]: 2026/09/24 12:26:57 INFO Signed narinfos id=23 count=15143lb # [ 99.328660] niks3-server[987]: 2026/09/24 12:26:57 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls5144lb # [ 99.336291] niks3-server[987]: 2026/09/24 12:26:57 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst5145lb # [ 99.346196] niks3-server[987]: 2026/09/24 12:26:57 INFO Received complete push request method=POST path=/api/pushes/23/complete5146worker2 # [ 99.369791] nix-grpc-daemon[868]: time=2026-09-24T12:26:58.538Z level=INFO msg="Upload complete. (174ms)"5147lb # [ 99.355652] niks3-server[987]: 2026/09/24 12:26:57 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo5148worker2 # [ 99.373524] nix-grpc-daemon[798]: ts=2026-09-24T12:26:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=6245149worker2 # [ 99.378385] nix-grpc-daemon[798]: ts=2026-09-24T12:26:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325150worker2 # [ 99.388992] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5151worker2 # [ 99.393892] nix-daemon[856]: reaped child process 1153, status = succeeded5152worker2 # [ 99.398612] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5153worker2 # [ 100.412910] nix-daemon[856]: reaped child process 1162, status = succeeded5154worker2 # [ 100.487464] nix-daemon[856]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)5155worker2 # [ 100.499787] nix-daemon[856]: reaped child process 1181, status = succeeded5156lb # [ 100.492304] niks3-server[987]: 2026/09/24 12:26:58 INFO Received push request method=POST path=/api/pushes5157worker2 # [ 100.516343] nix-grpc-daemon[868]: time=2026-09-24T12:26:59.685Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5158worker2 # [ 100.518049] nix-grpc-daemon[868]: time=2026-09-24T12:26:59.687Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"5159lb # [ 100.539911] niks3-server[987]: 2026/09/24 12:26:58 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst5160lb # [ 100.551425] niks3-server[987]: 2026/09/24 12:26:58 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign5161lb # [ 100.556570] niks3-server[987]: 2026/09/24 12:26:58 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv5162lb # [ 100.560867] niks3-server[987]: 2026/09/24 12:26:58 INFO Signed narinfos id=24 count=15163worker2 # [ 100.576922] nix-grpc-daemon[868]: time=2026-09-24T12:26:59.745Z level=INFO msg="Uploading 1 narinfos"5164lb # [ 100.565110] niks3-server[987]: 2026/09/24 12:26:58 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls5165lb # [ 100.573283] niks3-server[987]: 2026/09/24 12:26:58 INFO Received complete push request method=POST path=/api/pushes/24/complete5166lb # [ 100.578738] niks3-server[987]: 2026/09/24 12:26:58 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo5167worker2 # [ 100.594127] nix-grpc-daemon[868]: time=2026-09-24T12:26:59.763Z level=INFO msg="Upload complete. (187ms)"5168worker2 # [ 100.599880] nix-grpc-daemon[798]: ts=2026-09-24T12:26:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05169worker1 # [ 100.600272] nix-grpc-daemon[512]: ts=2026-09-24T12:26:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:532325170worker2 # [ 100.614876] nix-daemon[856]: reaped child process 1160, status = succeeded5171worker1 # [ 100.609277] nix-grpc-daemon[512]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...5172worker2 # [ 100.637112] nix-grpc-daemon[798]: ts=2026-09-24T12:26:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:523325173worker2 # [ 100.642369] nix-grpc-daemon[798]: ts=2026-09-24T12:26:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_out=1765174worker1 # [ 100.804749] nix-grpc-daemon[512]: ts=2026-09-24T12:26:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:532325175worker2 # [ 100.818090] nix-grpc-daemon[798]: ts=2026-09-24T12:26:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325176worker2 # [ 100.827368] nix-grpc-daemon[868]: time=2026-09-24T12:26:59.996Z level=INFO msg="All 2 paths already cached"5177worker1 # [ 100.837639] nix-grpc-daemon[512]: ts=2026-09-24T12:26:59Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=05178worker2 # [ 100.845396] nix-grpc-daemon[798]: ts=2026-09-24T12:27:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325179worker1 # [ 100.842195] nix-grpc-daemon[512]: ts=2026-09-24T12:26:59Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=15180worker2 # [ 100.857389] nix-grpc-daemon[798]: ts=2026-09-24T12:27:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325181worker2 # [ 100.870606] nix-grpc-daemon[868]: time=2026-09-24T12:27:00.039Z level=INFO msg="All 2 paths already cached"5182worker2 # [ 100.878688] nix-grpc-daemon[798]: ts=2026-09-24T12:27:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523325183worker2 # [ 100.888166] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5184worker2 # [ 100.989041] nix-daemon[856]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)5185worker2 # [ 101.003770] nix-daemon[856]: reaped child process 1188, status = succeeded5186lb # [ 100.993440] niks3-server[987]: 2026/09/24 12:26:59 INFO Received push request method=POST path=/api/pushes5187worker2 # [ 101.016867] nix-grpc-daemon[868]: time=2026-09-24T12:27:00.186Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5188worker2 # [ 101.018885] nix-grpc-daemon[868]: time=2026-09-24T12:27:00.188Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"5189lb # [ 101.029534] niks3-server[987]: 2026/09/24 12:26:59 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign5190lb # [ 101.034440] niks3-server[987]: 2026/09/24 12:26:59 INFO Signed narinfos id=25 count=15191worker2 # [ 101.054157] nix-grpc-daemon[868]: time=2026-09-24T12:27:00.223Z level=INFO msg="Uploading 1 narinfos"5192lb # [ 101.039713] niks3-server[987]: 2026/09/24 12:26:59 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst5193lb # [ 101.047516] niks3-server[987]: 2026/09/24 12:26:59 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls5194lb # [ 101.058909] niks3-server[987]: 2026/09/24 12:26:59 INFO Received complete push request method=POST path=/api/pushes/25/complete5195worker2 # [ 101.082582] nix-grpc-daemon[868]: time=2026-09-24T12:27:00.251Z level=INFO msg="Upload complete. (181ms)"5196lb # [ 101.069751] niks3-server[987]: 2026/09/24 12:26:59 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo5197worker2 # [ 101.087305] nix-grpc-daemon[798]: ts=2026-09-24T12:27:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=7525198worker2 # [ 101.092466] nix-grpc-daemon[798]: ts=2026-09-24T12:27:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325199worker2 # [ 101.101870] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5200worker2 # [ 101.109356] nix-daemon[856]: reaped child process 1183, status = succeeded5201worker2 # [ 101.112551] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5202worker2 # [ 102.129155] nix-daemon[856]: reaped child process 1192, status = succeeded5203worker2 # [ 102.214280] nix-daemon[856]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5204worker2 # [ 102.229559] nix-daemon[856]: reaped child process 1211, status = succeeded5205lb # [ 102.221772] niks3-server[987]: 2026/09/24 12:27:00 INFO Received push request method=POST path=/api/pushes5206worker2 # [ 102.246249] nix-grpc-daemon[868]: time=2026-09-24T12:27:01.415Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5207worker2 # [ 102.247762] nix-grpc-daemon[868]: time=2026-09-24T12:27:01.417Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"5208lb # [ 102.264686] niks3-server[987]: 2026/09/24 12:27:00 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls5209lb # [ 102.270201] niks3-server[987]: 2026/09/24 12:27:00 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign5210lb # [ 102.280428] niks3-server[987]: 2026/09/24 12:27:00 INFO Signed narinfos id=26 count=15211worker2 # [ 102.301064] nix-grpc-daemon[868]: time=2026-09-24T12:27:01.469Z level=INFO msg="Uploading 1 narinfos"5212lb # [ 102.285510] niks3-server[987]: 2026/09/24 12:27:00 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv5213lb # [ 102.292310] niks3-server[987]: 2026/09/24 12:27:00 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst5214lb # [ 102.303446] niks3-server[987]: 2026/09/24 12:27:00 INFO Received complete push request method=POST path=/api/pushes/26/complete5215lb # [ 102.307501] niks3-server[987]: 2026/09/24 12:27:00 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo5216worker2 # [ 102.327337] nix-grpc-daemon[868]: time=2026-09-24T12:27:01.496Z level=INFO msg="Upload complete. (205ms)"5217worker2 # [ 102.333485] nix-grpc-daemon[798]: ts=2026-09-24T12:27:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=05218worker2 # [ 102.342534] nix-grpc-daemon[798]: ts=2026-09-24T12:27:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:523325219worker2 # [ 102.355425] nix-grpc-daemon[798]: ts=2026-09-24T12:27:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:523325220worker2 # [ 102.358692] nix-daemon[856]: reaped child process 1190, status = succeeded5221worker2 # [ 102.361634] nix-grpc-daemon[798]: ts=2026-09-24T12:27:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_out=2325222client # [ 102.419628] nix-daemon[1109]: reaped child process 1111, status = succeeded5223client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 4.96 seconds)5224client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top5225client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)5226client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5227client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds)5228client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5229client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds)5230(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.02 seconds)5231subtest: an input only one worker has still reaches the builder5232client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only5233client # this derivation will be built:5234client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv5235client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...5236client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.24 seconds)5237client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure5238client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.10 seconds)5239worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5240worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds)5241worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only5242worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)5243client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&25244client # [ 103.088730] nix-daemon[1109]: accepted connection from pid 1190, user root (trusted)5245client # this derivation will be built:5246client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5247worker2 # [ 103.222184] nix-grpc-daemon[798]: ts=2026-09-24T12:27:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:523325248client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5249worker2 # [ 103.227872] nix-grpc-daemon[798]: ts=2026-09-24T12:27:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325250client # copying 1 paths...5251client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...5252worker1 # [ 103.236606] nix-grpc-daemon[512]: ts=2026-09-24T12:27:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532325253worker1 # [ 103.247569] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5254worker1 # [ 103.351399] nix-daemon[866]: accepted connection from pid 1156, user nix-grpc-daemon (trusted)5255worker1 # [ 103.364082] nix-daemon[866]: reaped child process 1159, status = succeeded5256lb # [ 103.361838] niks3-server[987]: 2026/09/24 12:27:01 INFO Received push request method=POST path=/api/pushes5257worker1 # [ 103.381243] nix-grpc-daemon[925]: time=2026-09-24T12:27:01.670Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5258worker1 # [ 103.382989] nix-grpc-daemon[925]: time=2026-09-24T12:27:01.671Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5259lb # [ 103.394887] niks3-server[987]: 2026/09/24 12:27:01 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5260lb # [ 103.400353] niks3-server[987]: 2026/09/24 12:27:01 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign5261lb # [ 103.405983] niks3-server[987]: 2026/09/24 12:27:01 INFO Signed narinfos id=27 count=15262worker1 # [ 103.419452] nix-grpc-daemon[925]: time=2026-09-24T12:27:01.708Z level=INFO msg="Uploading 1 narinfos"5263lb # [ 103.414257] niks3-server[987]: 2026/09/24 12:27:01 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5264lb # [ 103.423162] niks3-server[987]: 2026/09/24 12:27:01 INFO Received complete push request method=POST path=/api/pushes/27/complete5265lb # [ 103.428606] niks3-server[987]: 2026/09/24 12:27:01 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5266worker1 # [ 103.438195] nix-grpc-daemon[925]: time=2026-09-24T12:27:01.727Z level=INFO msg="Upload complete. (180ms)"5267worker1 # [ 103.442659] nix-grpc-daemon[512]: ts=2026-09-24T12:27:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 paths=1 nar_bytes_in=1205268worker1 # [ 103.455604] nix-daemon[866]: reaped child process 1154, status = succeeded5269worker1 # [ 103.458643] nix-grpc-daemon[512]: ts=2026-09-24T12:27:01Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05270worker1 # [ 103.461467] nix-grpc-daemon[512]: ts=2026-09-24T12:27:01Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=15271worker1 # [ 103.463814] nix-grpc-daemon[512]: ts=2026-09-24T12:27:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532325272worker1 # [ 103.470150] nix-grpc-daemon[512]: ts=2026-09-24T12:27:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532325273client # copying 2 paths to 'lb:50051'...5274worker1 # [ 103.478330] nix-grpc-daemon[512]: ts=2026-09-24T12:27:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532325275client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5276client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5277worker1 # [ 103.484861] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5278worker1 # [ 103.571069] nix-daemon[866]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5279worker1 # [ 103.583469] nix-daemon[866]: reaped child process 1168, status = succeeded5280lb # [ 103.580837] niks3-server[987]: 2026/09/24 12:27:01 INFO Received push request method=POST path=/api/pushes5281worker1 # [ 103.601220] nix-grpc-daemon[925]: time=2026-09-24T12:27:01.890Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5282worker1 # [ 103.603423] nix-grpc-daemon[925]: time=2026-09-24T12:27:01.891Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5283worker1 # [ 103.605048] nix-grpc-daemon[925]: time=2026-09-24T12:27:01.891Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5284lb # [ 103.623968] niks3-server[987]: 2026/09/24 12:27:01 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5285lb # [ 103.626886] niks3-server[987]: 2026/09/24 12:27:01 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign5286worker1 # [ 103.640328] nix-grpc-daemon[925]: time=2026-09-24T12:27:01.929Z level=INFO msg="Uploading 2 narinfos"5287lb # [ 103.630189] niks3-server[987]: 2026/09/24 12:27:01 INFO Signed narinfos id=28 count=25288lb # [ 103.631893] niks3-server[987]: 2026/09/24 12:27:01 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5289lb # [ 103.636862] niks3-server[987]: 2026/09/24 12:27:01 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5290lb # [ 103.639508] niks3-server[987]: 2026/09/24 12:27:01 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5291lb # [ 103.647268] niks3-server[987]: 2026/09/24 12:27:01 INFO Received complete push request method=POST path=/api/pushes/28/complete5292worker1 # [ 103.661309] nix-grpc-daemon[925]: time=2026-09-24T12:27:01.950Z level=INFO msg="Upload complete. (170ms)"5293lb # [ 103.653809] niks3-server[987]: 2026/09/24 12:27:01 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5294worker1 # [ 103.664440] nix-grpc-daemon[512]: ts=2026-09-24T12:27:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 paths=2 nar_bytes_in=9765295lb # [ 103.656923] niks3-server[987]: 2026/09/24 12:27:01 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5296worker1 # [ 103.669822] nix-grpc-daemon[512]: ts=2026-09-24T12:27:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532325297worker1 # [ 103.677840] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5298worker1 # [ 103.679239] nix-daemon[866]: reaped child process 1163, status = succeeded5299worker1 # [ 103.684331] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5300client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5301client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5302client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds5303worker1 # [ 104.518930] nix-daemon[866]: reaped child process 1172, status = succeeded5304worker1 # [ 104.604141] nix-daemon[866]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5305worker1 # [ 104.617406] nix-daemon[866]: reaped child process 1191, status = succeeded5306lb # [ 104.614387] niks3-server[987]: 2026/09/24 12:27:02 INFO Received push request method=POST path=/api/pushes5307worker1 # [ 104.635323] nix-grpc-daemon[925]: time=2026-09-24T12:27:02.924Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5308lb # [ 104.646571] niks3-server[987]: 2026/09/24 12:27:02 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5309lb # [ 104.655457] niks3-server[987]: 2026/09/24 12:27:02 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign5310lb # [ 104.663874] niks3-server[987]: 2026/09/24 12:27:02 INFO Signed narinfos id=29 count=15311worker1 # [ 104.677645] nix-grpc-daemon[925]: time=2026-09-24T12:27:02.966Z level=INFO msg="Uploading 1 narinfos"5312lb # [ 104.671434] niks3-server[987]: 2026/09/24 12:27:02 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5313lb # [ 104.683443] niks3-server[987]: 2026/09/24 12:27:03 INFO Received complete push request method=POST path=/api/pushes/29/complete5314lb # [ 104.693273] niks3-server[987]: 2026/09/24 12:27:03 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5315worker1 # [ 104.707266] nix-grpc-daemon[925]: time=2026-09-24T12:27:02.996Z level=INFO msg="Upload complete. (214ms)"5316worker1 # [ 104.713573] nix-grpc-daemon[512]: ts=2026-09-24T12:27:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05317client # copying 1 paths...5318worker2 # [ 104.730282] nix-grpc-daemon[798]: ts=2026-09-24T12:27:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:523325319worker1 # [ 104.729908] nix-daemon[866]: reaped child process 1170, status = succeeded5320worker2 # [ 104.739333] nix-grpc-daemon[798]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5321client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5322worker2 # [ 104.768884] nix-grpc-daemon[798]: ts=2026-09-24T12:27:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:523325323worker2 # [ 104.774459] nix-grpc-daemon[798]: ts=2026-09-24T12:27:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_out=1205324client # [ 104.833060] nix-daemon[1109]: reaped child process 1193, status = succeeded5325client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 1.86 seconds)5326client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&25327client # [ 104.933846] nix-daemon[1109]: accepted connection from pid 1212, user root (trusted)5328client # this derivation will be built:5329client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5330worker1 # [ 105.058764] nix-grpc-daemon[512]: ts=2026-09-24T12:27:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:532325331client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5332worker2 # [ 105.067730] nix-grpc-daemon[798]: ts=2026-09-24T12:27:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325333worker1 # [ 105.084665] nix-grpc-daemon[512]: ts=2026-09-24T12:27:03Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05334worker1 # [ 105.089548] nix-grpc-daemon[512]: ts=2026-09-24T12:27:03Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15335worker2 # [ 105.097273] nix-grpc-daemon[798]: ts=2026-09-24T12:27:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325336worker2 # [ 105.108934] nix-grpc-daemon[798]: ts=2026-09-24T12:27:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325337client # copying 1 paths to 'lb:50051'...5338client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5339worker2 # [ 105.125567] nix-grpc-daemon[798]: ts=2026-09-24T12:27:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:523325340worker2 # [ 105.137578] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5341worker2 # [ 105.153905] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5)5342worker2 # [ 105.211549] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 142 ms (attempt 2/5)5343worker2 # [ 105.355915] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 211 ms (attempt 3/5)5344worker2 # [ 105.568908] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 4/5)5345worker2 # [ 105.661819] nix-grpc-daemon[798]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5346worker2 # [ 105.665349] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5347worker2 # [ 105.671166] nix-grpc-daemon[798]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5348worker2 # [ 105.792867] nix-daemon[856]: accepted connection from pid 1225, user nix-grpc-daemon (trusted)5349worker2 # [ 105.809429] nix-daemon[856]: reaped child process 1228, status = succeeded5350lb # [ 105.801603] niks3-server[987]: 2026/09/24 12:27:04 INFO Received push request method=POST path=/api/pushes5351worker2 # [ 105.827260] nix-grpc-daemon[868]: time=2026-09-24T12:27:04.996Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5352worker2 # [ 105.828757] nix-grpc-daemon[868]: time=2026-09-24T12:27:04.998Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5353lb # [ 105.833565] niks3-server[987]: 2026/09/24 12:27:04 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign5354lb # [ 105.838506] niks3-server[987]: 2026/09/24 12:27:04 INFO Signed narinfos id=30 count=15355worker2 # [ 105.857708] nix-grpc-daemon[868]: time=2026-09-24T12:27:05.026Z level=INFO msg="Uploading 1 narinfos"5356lb # [ 105.850272] niks3-server[987]: 2026/09/24 12:27:04 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5357lb # [ 105.861827] niks3-server[987]: 2026/09/24 12:27:04 INFO Received complete push request method=POST path=/api/pushes/30/complete5358lb # [ 105.867292] niks3-server[987]: 2026/09/24 12:27:04 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5359lb # [ 105.876332] niks3-server[987]: 2026/09/24 12:27:04 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5360worker2 # [ 105.891427] nix-grpc-daemon[868]: time=2026-09-24T12:27:05.060Z level=INFO msg="Upload complete. (202ms)"5361worker2 # [ 105.896782] nix-grpc-daemon[798]: ts=2026-09-24T12:27:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_in=5605362worker2 # [ 105.903493] nix-grpc-daemon[798]: ts=2026-09-24T12:27:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:523325363worker2 # [ 105.914166] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5364worker2 # [ 105.925172] nix-daemon[856]: reaped child process 1218, status = succeeded5365worker2 # [ 105.927066] nix-grpc-daemon[798]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5366worker2 # [ 105.936462] nix-daemon[856]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5367client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5368client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5369lb # [ 106.351450] envoy[907]: conn peer=[2001:db8:1::1]:42696 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1197 ms=46795370lb # [ 106.355239] envoy[907]: conn peer=[2001:db8:1::1]:47464 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=305371lb # [ 106.358837] envoy[907]: conn peer=[2001:db8:1::1]:47450 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3406 tx=1925 ms=11815372lb # [ 106.362330] envoy[907]: conn peer=[2001:db8:1::1]:47466 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3820 tx=2122 ms=15465373lb # [ 106.366146] envoy[907]: conn peer=[2001:db8:1::1]:47480 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=378 ms=165374lb # [ 106.369828] envoy[907]: conn peer=[2001:db8:1::1]:47494 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4324 tx=2394 ms=15625375lb # [ 106.373859] envoy[907]: conn peer=[2001:db8:1::1]:47506 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=185376lb # [ 106.377348] envoy[907]: conn peer=[2001:db8:1::1]:35848 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4217 tx=2027 ms=15655377lb # [ 106.381087] envoy[907]: conn peer=[2001:db8:1::1]:35856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=175378client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5379worker2 # [ 107.154868] nix-daemon[856]: reaped child process 1233, status = succeeded5380worker2 # [ 107.241611] nix-daemon[856]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5381worker2 # [ 107.256373] nix-daemon[856]: reaped child process 1252, status = succeeded5382lb # [ 107.249606] niks3-server[987]: 2026/09/24 12:27:05 INFO Received push request method=POST path=/api/pushes5383worker2 # [ 107.273115] nix-grpc-daemon[868]: time=2026-09-24T12:27:06.442Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5384lb # [ 107.276229] niks3-server[987]: 2026/09/24 12:27:05 INFO Received sign narinfos request method=POST path=/api/pushes/31/sign5385lb # [ 107.281104] niks3-server[987]: 2026/09/24 12:27:05 INFO Signed narinfos id=31 count=15386worker2 # [ 107.299939] nix-grpc-daemon[868]: time=2026-09-24T12:27:06.469Z level=INFO msg="Uploading 1 narinfos"5387lb # [ 107.291067] niks3-server[987]: 2026/09/24 12:27:05 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5388lb # [ 107.303374] niks3-server[987]: 2026/09/24 12:27:05 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5389lb # [ 107.311650] niks3-server[987]: 2026/09/24 12:27:05 INFO Received complete push request method=POST path=/api/pushes/31/complete5390lb # [ 107.318109] niks3-server[987]: 2026/09/24 12:27:05 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5391worker2 # [ 107.338316] nix-grpc-daemon[868]: time=2026-09-24T12:27:06.507Z level=INFO msg="Upload complete. (193ms)"5392client # copying 1 paths...5393worker2 # [ 107.343571] nix-grpc-daemon[798]: ts=2026-09-24T12:27:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 inputs=1 inputs_fetched=1 input_bytes=120 input_s=05394worker1 # [ 107.345275] nix-grpc-daemon[512]: ts=2026-09-24T12:27:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:532325395worker2 # [ 107.357893] nix-daemon[856]: reaped child process 1230, status = succeeded5396worker1 # [ 107.355381] nix-grpc-daemon[512]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5397client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5398worker1 # [ 107.383518] nix-grpc-daemon[512]: ts=2026-09-24T12:27:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:532325399worker1 # [ 107.389086] nix-grpc-daemon[512]: ts=2026-09-24T12:27:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 paths=1 nar_bytes_out=1205400client # [ 107.451660] nix-daemon[1109]: reaped child process 1215, status = succeeded5401client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.62 seconds)5402client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&25403client # [ 107.551986] nix-daemon[1109]: accepted connection from pid 1234, user root (trusted)5404client # this derivation will be built:5405client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5406worker2 # [ 107.681880] nix-grpc-daemon[798]: ts=2026-09-24T12:27:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:523325407client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5408worker2 # [ 107.687940] nix-grpc-daemon[798]: ts=2026-09-24T12:27:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:523325409worker2 # [ 107.693069] nix-grpc-daemon[868]: time=2026-09-24T12:27:06.861Z level=INFO msg="All 1 paths already cached"5410worker1 # [ 107.698391] nix-grpc-daemon[512]: ts=2026-09-24T12:27:05Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05411worker1 # [ 107.704192] nix-grpc-daemon[512]: ts=2026-09-24T12:27:05Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15412worker1 # [ 107.710133] nix-grpc-daemon[512]: ts=2026-09-24T12:27:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532325413worker1 # [ 107.722069] nix-grpc-daemon[512]: ts=2026-09-24T12:27:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:532325414worker1 # [ 107.734948] nix-grpc-daemon[925]: time=2026-09-24T12:27:06.023Z level=INFO msg="All 1 paths already cached"5415client # copying 1 paths to 'lb:50051'...5416client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5417worker1 # [ 107.743089] nix-grpc-daemon[512]: ts=2026-09-24T12:27:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:532325418worker1 # [ 107.754448] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5419worker1 # [ 107.851312] nix-daemon[866]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)5420worker1 # [ 107.864406] nix-daemon[866]: reaped child process 1203, status = succeeded5421lb # [ 107.860708] niks3-server[987]: 2026/09/24 12:27:06 INFO Received push request method=POST path=/api/pushes5422worker1 # [ 107.879617] nix-grpc-daemon[925]: time=2026-09-24T12:27:06.168Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5423worker1 # [ 107.881396] nix-grpc-daemon[925]: time=2026-09-24T12:27:06.170Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5424lb # [ 107.893146] niks3-server[987]: 2026/09/24 12:27:06 INFO Received sign narinfos request method=POST path=/api/pushes/32/sign5425lb # [ 107.898836] niks3-server[987]: 2026/09/24 12:27:06 INFO Signed narinfos id=32 count=15426worker1 # [ 107.912668] nix-grpc-daemon[925]: time=2026-09-24T12:27:06.201Z level=INFO msg="Uploading 1 narinfos"5427lb # [ 107.907449] niks3-server[987]: 2026/09/24 12:27:06 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5428lb # [ 107.912550] niks3-server[987]: 2026/09/24 12:27:06 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5429lb # [ 107.926243] niks3-server[987]: 2026/09/24 12:27:06 INFO Received complete push request method=POST path=/api/pushes/32/complete5430lb # [ 107.933603] niks3-server[987]: 2026/09/24 12:27:06 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5431worker1 # [ 107.950084] nix-grpc-daemon[925]: time=2026-09-24T12:27:06.238Z level=INFO msg="Upload complete. (184ms)"5432worker1 # [ 107.955442] nix-grpc-daemon[512]: ts=2026-09-24T12:27:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=0 paths=1 nar_bytes_in=5605433worker1 # [ 107.961350] nix-grpc-daemon[512]: ts=2026-09-24T12:27:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:532325434worker1 # [ 107.972137] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5435worker1 # [ 107.984179] nix-daemon[866]: accepted connection from pid 512, user nix-grpc-daemon (trusted)5436client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5437worker1 # [ 107.986284] nix-daemon[866]: reaped child process 1198, status = succeeded5438client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5439client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5440worker1 # [ 109.418777] nix-daemon[866]: reaped child process 1207, status = succeeded5441worker1 # [ 109.507482] nix-daemon[866]: accepted connection from pid 1223, user nix-grpc-daemon (trusted)5442worker1 # [ 109.518349] nix-daemon[866]: reaped child process 1226, status = succeeded5443lb # [ 109.518269] niks3-server[987]: 2026/09/24 12:27:07 INFO Received push request method=POST path=/api/pushes5444worker1 # [ 109.535510] nix-grpc-daemon[925]: time=2026-09-24T12:27:07.824Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5445lb # [ 109.548831] niks3-server[987]: 2026/09/24 12:27:07 INFO Received sign narinfos request method=POST path=/api/pushes/33/sign5446worker1 # [ 109.564603] nix-grpc-daemon[925]: time=2026-09-24T12:27:07.853Z level=INFO msg="Uploading 1 narinfos"5447lb # [ 109.554289] niks3-server[987]: 2026/09/24 12:27:07 INFO Signed narinfos id=33 count=15448lb # [ 109.559625] niks3-server[987]: 2026/09/24 12:27:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5449lb # [ 109.573740] niks3-server[987]: 2026/09/24 12:27:07 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5450lb # [ 109.579135] niks3-server[987]: 2026/09/24 12:27:07 INFO Received complete push request method=POST path=/api/pushes/33/complete5451worker1 # [ 109.600526] nix-grpc-daemon[925]: time=2026-09-24T12:27:07.889Z level=INFO msg="Upload complete. (207ms)"5452lb # [ 109.591832] niks3-server[987]: 2026/09/24 12:27:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5453worker1 # [ 109.607431] nix-grpc-daemon[512]: ts=2026-09-24T12:27:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53232 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05454client # copying 1 paths...5455worker1 # [ 109.622841] nix-daemon[866]: reaped child process 1205, status = succeeded5456worker2 # [ 109.626224] nix-grpc-daemon[798]: ts=2026-09-24T12:27:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:523325457worker2 # [ 109.637455] nix-grpc-daemon[798]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5458client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5459worker2 # [ 109.667801] nix-grpc-daemon[798]: ts=2026-09-24T12:27:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:523325460worker2 # [ 109.673211] nix-grpc-daemon[798]: ts=2026-09-24T12:27:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52332 duration_s=0 paths=1 nar_bytes_out=1205461client # [ 109.731101] nix-daemon[1109]: reaped child process 1237, status = succeeded5462client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.28 seconds)5463(finished: subtest: an input only one worker has still reaches the builder, in 7.25 seconds)5464subtest: upload whose reference the worker lacks is completed from the cache5465client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache5466client # this derivation will be built:5467client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5468client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5469client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.24 seconds)5470client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache5471client # this derivation will be built:5472client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5473client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5474client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.24 seconds)5475client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5476client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.10 seconds)5477worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5478worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds)5479worker2 # [ 110.499971] systemd[1]: Stopping Nix worker-protocol over gRPC...5480worker2 # [ 111.004398] nix-grpc-daemon[798]: ts=2026-09-24T12:27:10Z level=info event=signal_exit5481worker1 # [ 112.985673] nix-grpc-daemon[512]: ts=2026-09-24T12:27:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:378145482worker1 # [ 112.992336] nix-grpc-daemon[512]: ts=2026-09-24T12:27:11Z level=info event=worker_gone addr=192.168.1.4:500515483worker2 # [ 112.996437] nix-grpc-daemon[798]: ts=2026-09-24T12:27:12Z level=info event=scheduler_restarting5484worker2 # [ 113.010930] nix-grpc-daemon[798]: ts=2026-09-24T12:27:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5485worker2 # [ 113.031688] nix-daemon[856]: reaped child process 858, status = succeeded5486worker2 # [ 113.757304] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5487worker2 # [ 113.760814] systemd[1]: Stopped Nix worker-protocol over gRPC.5488worker2 # [ 113.765835] systemd[1]: nix-grpc-daemon.service: Consumed 2.376s CPU time over 1min 21.920s wall clock time, 62M memory peak, 186.5K incoming IP traffic, 285.9K outgoing IP traffic.5489lb: waiting until exactly ['worker1'] are healthy members of x86_64-linux5490lb: must succeed: curl -sf localhost:9901/clusters5491lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5492lb: (finished: waiting until exactly ['worker1'] are healthy members of x86_64-linux, in 0.06 seconds)5493client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25494worker1 # [ 113.977925] nix-grpc-daemon[512]: ts=2026-09-24T12:27:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:532325495client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5496worker1 # [ 113.983638] nix-grpc-daemon[512]: ts=2026-09-24T12:27:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:532325497client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds)5498worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5499worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5500worker2 # [ 114.076220] systemd[1]: Starting scheduler-token.service...5501worker2 # [ 114.120474] systemd[1]: scheduler-token.service: Deactivated successfully.5502worker2 # [ 114.122108] systemd[1]: Finished scheduler-token.service.5503worker2 # [ 114.123638] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 46ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5504worker2 # [ 114.128176] systemd[1]: Starting Nix worker-protocol over gRPC...5505worker2 # [ 114.214974] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:13Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5506worker2 # [ 114.219517] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5507worker2 # [ 114.223213] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15508worker2 # [ 114.227059] nix-grpc-daemon[1277]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5509worker2 # [ 114.230948] nix-grpc-daemon[1277]: E0000 00:00:1790252833.392193 1277 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5510worker2 # [ 114.235376] nix-grpc-daemon[1277]: E0000 00:00:1790252833.395745 1277 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5511worker2 # [ 114.239263] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:13Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket5512worker2 # [ 114.241681] systemd[1]: Started Nix worker-protocol over gRPC.5513worker2 # [ 114.244148] nix-grpc-daemon[1277]: E0000 00:00:1790252833.412198 1319 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5514worker2 # [ 114.256689] nix-grpc-daemon[1277]: E0000 00:00:1790252833.425755 1319 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5515worker2 # [ 114.260145] nix-grpc-daemon[1277]: E0000 00:00:1790252833.428274 1319 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5516worker2 # [ 114.271616] nix-grpc-daemon[1277]: E0000 00:00:1790252833.440836 1319 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5517worker2 # [ 114.281157] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:13Z level=info event=scheduler_connected addr=lb:500515518worker1 # [ 114.284428] nix-grpc-daemon[512]: ts=2026-09-24T12:27:12Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:378145519worker1 # [ 114.289568] nix-grpc-daemon[512]: ts=2026-09-24T12:27:12Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05520worker1 # [ 114.315126] systemd[1]: Stopping Nix worker-protocol over gRPC...5521worker1 # [ 114.799746] nix-grpc-daemon[512]: ts=2026-09-24T12:27:13Z level=info event=signal_exit5522lb # [ 115.773875] niks3-server[987]: 2026/09/24 12:27:14 INFO lead: released remote=192.168.1.3:523985523lb # [ 116.352144] envoy[907]: conn peer=[2001:db8:1::1]:35876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=175524lb # [ 116.356231] envoy[907]: conn peer=[2001:db8:1::1]:35862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3728 tx=2103 ms=23415525lb # [ 116.360215] envoy[907]: conn peer=[2001:db8:1::1]:35888 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3725 tx=2106 ms=20035526lb # [ 116.364325] envoy[907]: conn peer=[2001:db8:1::1]:35900 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=185527lb # [ 116.368306] envoy[907]: conn peer=[2001:db8:1::4]:57782 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4831 tx=1222 ms=809885528lb # [ 116.372389] envoy[907]: conn peer=[2001:db8:1::1]:47264 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=165529worker1 # [ 116.784339] nix-grpc-daemon[512]: ts=2026-09-24T12:27:15Z level=info event=scheduler_restarting5530lb # [ 116.773211] envoy[907]: [2026-09-24 12:27:15.092][907][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream}5531worker1 # [ 116.793552] nix-grpc-daemon[512]: ts=2026-09-24T12:27:15Z level=info event=scheduler_restarting addr=lb:500515532worker2 # [ 116.799327] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:15Z level=info event=scheduler_restarting addr=lb:500515533worker1 # [ 116.800335] nix-grpc-daemon[512]: ts=2026-09-24T12:27:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:378145534worker1 # [ 116.804152] nix-grpc-daemon[512]: ts=2026-09-24T12:27:15Z level=info event=worker_gone addr=192.168.1.4:500515535worker1 # [ 116.807676] nix-grpc-daemon[512]: ts=2026-09-24T12:27:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:378145536worker1 # [ 116.811186] nix-grpc-daemon[512]: ts=2026-09-24T12:27:15Z level=info event=worker_gone addr=192.168.1.3:500515537worker1 # [ 116.831528] nix-daemon[866]: reaped child process 868, status = succeeded5538worker2 # [ 117.000366] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_connected addr=lb:500515539worker2 # [ 117.004710] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5540worker1 # [ 117.008472] nix-grpc-daemon[512]: ts=2026-09-24T12:27:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5541worker2 # [ 117.205907] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_connected addr=lb:500515542worker2 # [ 117.210125] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5543worker2 # [ 117.411649] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_connected addr=lb:500515544worker2 # [ 117.415812] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5545worker2 # [ 117.617185] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_connected addr=lb:500515546worker2 # [ 117.621342] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5547worker1 # [ 117.698462] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5548worker1 # [ 117.702419] systemd[1]: Stopped Nix worker-protocol over gRPC.5549worker1 # [ 117.706803] systemd[1]: nix-grpc-daemon.service: Consumed 2.123s CPU time over 1min 49.195s wall clock time, 64.8M memory peak, 426.3K incoming IP traffic, 297.1K outgoing IP traffic.5550lb: waiting until exactly ['worker2'] are healthy members of x86_64-linux5551lb: must succeed: curl -sf localhost:9901/clusters5552lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5553lb: (finished: waiting until exactly ['worker2'] are healthy members of x86_64-linux, in 0.05 seconds)5554client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25555worker2 # [ 117.823875] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_connected addr=lb:500515556worker2 # [ 117.827742] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5557worker2 # [ 117.922151] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:334225558worker2 # [ 117.934739] nix-daemon[856]: accepted connection from pid 1277, user nix-grpc-daemon (trusted)5559worker2 # [ 117.952378] nix-grpc-daemon[1277]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5)5560worker2 # [ 118.029365] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=info event=scheduler_connected addr=lb:500515561worker2 # [ 118.034216] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5562worker2 # [ 118.039730] nix-grpc-daemon[1277]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 2/5)5563worker2 # [ 118.123624] nix-grpc-daemon[1277]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 348 ms (attempt 3/5)5564worker2 # [ 118.234594] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=info event=scheduler_connected addr=lb:500515565worker2 # [ 118.238677] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5566worker2 # [ 118.440185] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=info event=scheduler_connected addr=lb:500515567worker2 # [ 118.444311] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5568worker2 # [ 118.479564] nix-grpc-daemon[1277]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 321 ms (attempt 4/5)5569worker2 # [ 118.645463] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=info event=scheduler_connected addr=lb:500515570worker2 # [ 118.649486] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5571worker2 # [ 118.803289] nix-grpc-daemon[1277]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5572worker2 # [ 118.806546] nix-grpc-daemon[1277]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5573client # copying 2 paths...5574client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5575worker2 # [ 118.830579] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:334225576client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5577worker2 # [ 118.842172] nix-daemon[856]: accepted connection from pid 1277, user nix-grpc-daemon (trusted)5578worker2 # [ 118.850929] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_connected addr=lb:500515579worker2 # [ 118.854900] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5580worker2 # [ 118.873318] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=niks3_push_started pid=13375581worker2 # [ 118.983877] nix-grpc-daemon[1337]: time=2026-09-24T12:27:18.152Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""5582worker2 # [ 119.056837] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_connected addr=lb:500515583worker2 # [ 119.061203] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5584worker2 # [ 119.085837] nix-daemon[856]: accepted connection from pid 1350, user nix-grpc-daemon (trusted)5585worker2 # [ 119.099441] nix-daemon[856]: reaped child process 1353, status = succeeded5586lb # [ 119.092504] niks3-server[987]: 2026/09/24 12:27:17 INFO Received push request method=POST path=/api/pushes5587worker2 # [ 119.116669] nix-grpc-daemon[1337]: time=2026-09-24T12:27:18.285Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5588worker2 # [ 119.118176] nix-grpc-daemon[1337]: time=2026-09-24T12:27:18.287Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5589worker2 # [ 119.119975] nix-grpc-daemon[1337]: time=2026-09-24T12:27:18.289Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5590lb # [ 119.149669] niks3-server[987]: 2026/09/24 12:27:17 INFO Received sign narinfos request method=POST path=/api/pushes/34/sign5591lb # [ 119.154461] niks3-server[987]: 2026/09/24 12:27:17 INFO Signed narinfos id=34 count=25592worker2 # [ 119.174087] nix-grpc-daemon[1337]: time=2026-09-24T12:27:18.342Z level=INFO msg="Uploading 2 narinfos"5593lb # [ 119.166847] niks3-server[987]: 2026/09/24 12:27:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5594lb # [ 119.172426] niks3-server[987]: 2026/09/24 12:27:17 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5595lb # [ 119.176929] niks3-server[987]: 2026/09/24 12:27:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5596lb # [ 119.187778] niks3-server[987]: 2026/09/24 12:27:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5597lb # [ 119.190986] niks3-server[987]: 2026/09/24 12:27:17 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5598lb # [ 119.194237] niks3-server[987]: 2026/09/24 12:27:17 INFO Received complete push request method=POST path=/api/pushes/34/complete5599lb # [ 119.201128] niks3-server[987]: 2026/09/24 12:27:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5600worker2 # [ 119.216591] nix-grpc-daemon[1337]: time=2026-09-24T12:27:18.385Z level=INFO msg="Upload complete. (229ms)"5601worker2 # [ 119.222890] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33422 duration_s=0 paths=2 nar_bytes_in=3125602worker2 # [ 119.238319] nix-daemon[856]: reaped child process 1335, status = succeeded5603lb # [ 119.224335] niks3-server[987]: 2026/09/24 12:27:17 INFO lead: acquired remote=192.168.1.4:466025604worker2 # [ 119.241754] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_take_over5605client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.47 seconds)5606worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5607worker2 # [ 119.260630] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_connected addr=lb:500515608worker2 # [ 119.263985] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5609worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5610worker1 # [ 119.319607] systemd[1]: Starting Nix worker-protocol over gRPC...5611worker1 # [ 119.408340] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5612worker1 # [ 119.410376] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5613worker1 # [ 119.413485] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15614worker1 # [ 119.417714] nix-grpc-daemon[1249]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5615worker1 # [ 119.420164] nix-grpc-daemon[1249]: E0000 00:00:1790252837.706713 1249 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5616worker1 # [ 119.423212] nix-grpc-daemon[1249]: E0000 00:00:1790252837.712229 1249 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5617worker1 # [ 119.427789] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:17Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket5618worker1 # [ 119.431118] systemd[1]: Started Nix worker-protocol over gRPC.5619worker1 # [ 119.436108] nix-grpc-daemon[1249]: E0000 00:00:1790252837.724025 1292 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5620lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux5621lb: must succeed: curl -sf localhost:9901/clusters5622worker1 # [ 119.447983] nix-grpc-daemon[1249]: E0000 00:00:1790252837.737020 1292 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5623worker1 # [ 119.452133] nix-grpc-daemon[1249]: E0000 00:00:1790252837.737218 1292 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5624worker2 # [ 119.465287] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_connected addr=lb:500515625worker1 # [ 119.462443] nix-grpc-daemon[1249]: E0000 00:00:1790252837.751532 1292 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5626worker2 # [ 119.469354] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5627worker1 # [ 119.474367] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:17Z level=info event=scheduler_connected addr=lb:500515628worker1 # [ 119.475996] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5629lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5630worker2 # [ 119.670663] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=scheduler_connected addr=lb:500515631worker1 # [ 119.677237] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:17Z level=info event=scheduler_connected addr=lb:500515632worker2 # [ 119.684240] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:334285633worker2 # [ 119.687943] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05634worker2 # [ 119.699147] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=oidc_jwks provider=mock keys=15635worker2 # [ 119.702726] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:334285636worker2 # [ 119.706691] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:18Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05637lb: must succeed: curl -sf localhost:9901/clusters5638lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5639lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 1.10 seconds)5640(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.80 seconds)5641subtest: a niks3 restart does not cost the leader its role5642lb: must succeed: curl -sf localhost:9901/clusters5643lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5644lb: must succeed: curl -sf localhost:9901/clusters5645lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5646lb # [ 120.601921] systemd[1]: Stopping niks3 server...5647lb # [ 120.603707] niks3-server[987]: 2026/09/24 12:27:18 INFO Shutdown signal received, draining in-flight requests timeout=10s5648lb # [ 120.608051] niks3-server[987]: 2026/09/24 12:27:18 INFO lead: released remote=192.168.1.4:466025649worker2 # [ 120.623844] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:19Z level=info event=scheduler_lock_lost status=2005650worker1 # [ 120.619957] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:18Z level=info event=scheduler_lock_lost status=2005651lb # [ 120.618597] systemd[1]: niks3.service: Deactivated successfully.5652lb # [ 120.620872] systemd[1]: Stopped niks3 server.5653lb # [ 120.621593] systemd[1]: niks3.service: Consumed 769ms CPU time over 1min 39.107s wall clock time, 28.9M memory peak, 97.4K incoming IP traffic, 139.9K outgoing IP traffic.5654lb # [ 120.628350] systemd[1]: Starting niks3 server...5655lb # [ 120.677537] niks3-server[1195]: 2026/09/24 12:27:18 goose: no migrations to run. current version: 202609231200005656lb # [ 120.685200] niks3-server[1195]: 2026/09/24 12:27:19 OK 1_commit_pending_closure.sql (5.79ms)5657lb # [ 120.688353] niks3-server[1195]: 2026/09/24 12:27:19 OK 2_object_stats_trigger.sql (3.14ms)5658lb # [ 120.691811] niks3-server[1195]: 2026/09/24 12:27:19 OK 3_commit_push.sql (3.09ms)5659lb # [ 120.692829] niks3-server[1195]: 2026/09/24 12:27:19 goose: up to current file version: 35660lb # [ 120.694055] niks3-server[1195]: 2026/09/24 12:27:19 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key5661lb # [ 120.704338] niks3-server[1195]: 2026/09/24 12:27:19 INFO Read proxy enabled — serving cache objects from S35662lb # [ 120.705920] niks3-server[1195]: 2026/09/24 12:27:19 INFO Using socket-activated listener address=0.0.0.0:57515663lb # [ 120.707628] systemd[1]: Started niks3 server.5664lb # [ 120.709631] niks3-server[1195]: 2026/09/24 12:27:19 INFO Starting HTTP server address=0.0.0.0:57515665lb # [ 120.712371] niks3-server[1195]: 2026/09/24 12:27:19 INFO systemd watchdog enabled interval=15s5666lb: waiting for unit niks3.service5667lb: (finished: waiting for unit niks3.service, in 0.02 seconds)5668lb: must succeed: curl -sf localhost:9901/clusters5669lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5670worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5671worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5672lb: must succeed: curl -sf localhost:9901/clusters5673lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5674lb: must succeed: curl -sf localhost:9901/clusters5675lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5676worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5677worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.04 seconds)5678client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&25679worker2 # [ 121.043619] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:334225680client # don't know how to build these paths:5681client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv5682worker2 # [ 121.053140] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:334225683worker2 # [ 121.079640] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:20Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=05684worker2 # [ 121.084346] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:20Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.3:50051 clients=15685worker1 # [ 121.085099] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525686worker1 # [ 121.096746] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5687worker1 # [ 121.113419] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5)5688worker1 # [ 121.176224] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 200 ms (attempt 2/5)5689worker1 # [ 121.383150] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 310 ms (attempt 3/5)5690lb # [ 121.612987] niks3-server[1195]: 2026/09/24 12:27:19 INFO lead: acquired remote=192.168.1.4:467005691worker1 # [ 121.695889] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 781 ms (attempt 4/5)5692worker1 # [ 122.478466] nix-grpc-daemon[1249]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5693worker1 # [ 122.482132] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5694worker1 # [ 122.499320] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482525695client # copying 1 paths to 'lb:50051'...5696client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'...5697worker1 # [ 122.513438] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482525698worker1 # [ 122.525170] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5699worker1 # [ 122.544068] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:20Z level=info event=niks3_push_started pid=13115700worker1 # [ 122.648870] nix-grpc-daemon[1311]: time=2026-09-24T12:27:20.937Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""5701worker2 # [ 122.731431] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:21Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:334345702worker1 # [ 122.746139] nix-daemon[866]: accepted connection from pid 1324, user nix-grpc-daemon (trusted)5703worker1 # [ 122.758188] nix-daemon[866]: reaped child process 1327, status = succeeded5704lb # [ 122.755893] niks3-server[1195]: 2026/09/24 12:27:21 INFO Received push request method=POST path=/api/pushes5705worker1 # [ 122.779980] nix-grpc-daemon[1311]: time=2026-09-24T12:27:21.069Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5706worker1 # [ 122.781597] nix-grpc-daemon[1311]: time=2026-09-24T12:27:21.070Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)"5707lb # [ 122.797612] niks3-server[1195]: 2026/09/24 12:27:21 INFO Received sign narinfos request method=POST path=/api/pushes/35/sign5708lb # [ 122.822701] niks3-server[1195]: 2026/09/24 12:27:21 INFO Signed narinfos id=35 count=15709worker1 # [ 122.837084] nix-grpc-daemon[1311]: time=2026-09-24T12:27:21.125Z level=INFO msg="Uploading 1 narinfos"5710lb # [ 122.835985] niks3-server[1195]: 2026/09/24 12:27:21 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls5711lb # [ 122.841048] niks3-server[1195]: 2026/09/24 12:27:21 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst5712lb # [ 122.843353] niks3-server[1195]: 2026/09/24 12:27:21 INFO Received complete push request method=POST path=/api/pushes/35/complete5713lb # [ 122.852106] niks3-server[1195]: 2026/09/24 12:27:21 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo5714worker1 # [ 122.866882] nix-grpc-daemon[1311]: time=2026-09-24T12:27:21.155Z level=INFO msg="Upload complete. (214ms)"5715worker1 # [ 122.872554] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=0 paths=1 nar_bytes_in=5365716worker1 # [ 122.879355] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525717worker1 # [ 122.892168] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5718worker1 # [ 122.898680] nix-daemon[866]: reaped child process 1309, status = succeeded5719worker1 # [ 122.906891] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5720client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051...5721client # farm-a> node-a: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv5722client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5723client # farm-a> LOG-farm-a-after-niks3-restart5724worker1 # [ 124.140861] nix-daemon[866]: reaped child process 1331, status = succeeded5725worker1 # [ 124.228277] nix-daemon[866]: accepted connection from pid 1347, user nix-grpc-daemon (trusted)5726worker1 # [ 124.240081] nix-daemon[866]: reaped child process 1350, status = succeeded5727lb # [ 124.237263] niks3-server[1195]: 2026/09/24 12:27:22 INFO Received push request method=POST path=/api/pushes5728worker1 # [ 124.258339] nix-grpc-daemon[1311]: time=2026-09-24T12:27:22.547Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5729worker1 # [ 124.261061] nix-grpc-daemon[1311]: time=2026-09-24T12:27:22.548Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)"5730lb # [ 124.277622] niks3-server[1195]: 2026/09/24 12:27:22 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv5731lb # [ 124.287988] niks3-server[1195]: 2026/09/24 12:27:22 INFO Received sign narinfos request method=POST path=/api/pushes/36/sign5732worker1 # [ 124.307698] nix-grpc-daemon[1311]: time=2026-09-24T12:27:22.596Z level=INFO msg="Uploading 1 narinfos"5733lb # [ 124.296759] niks3-server[1195]: 2026/09/24 12:27:22 INFO Signed narinfos id=36 count=15734lb # [ 124.304653] niks3-server[1195]: 2026/09/24 12:27:22 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5735lb # [ 124.311350] niks3-server[1195]: 2026/09/24 12:27:22 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls5736lb # [ 124.318887] niks3-server[1195]: 2026/09/24 12:27:22 INFO Received complete push request method=POST path=/api/pushes/36/complete5737lb # [ 124.325377] niks3-server[1195]: 2026/09/24 12:27:22 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo5738worker1 # [ 124.339333] nix-grpc-daemon[1311]: time=2026-09-24T12:27:22.628Z level=INFO msg="Upload complete. (224ms)"5739worker1 # [ 124.345702] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05740worker2 # [ 124.359984] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:23Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=05741worker1 # [ 124.357215] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525742worker2 # [ 124.364349] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:23Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.3:50051 clients=15743worker1 # [ 124.369808] nix-daemon[866]: reaped child process 1329, status = succeeded5744worker1 # [ 124.372692] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482525745worker1 # [ 124.380880] nix-grpc-daemon[1311]: time=2026-09-24T12:27:22.669Z level=INFO msg="All 1 paths already cached"5746client # copying 1 paths to 'lb:50051'...5747client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'...5748worker1 # [ 124.387754] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482525749worker1 # [ 124.395252] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5750worker1 # [ 124.480697] nix-daemon[866]: accepted connection from pid 1354, user nix-grpc-daemon (trusted)5751worker1 # [ 124.494354] nix-daemon[866]: reaped child process 1357, status = succeeded5752lb # [ 124.490098] niks3-server[1195]: 2026/09/24 12:27:22 INFO Received push request method=POST path=/api/pushes5753worker1 # [ 124.510736] nix-grpc-daemon[1311]: time=2026-09-24T12:27:22.799Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5754worker1 # [ 124.512252] nix-grpc-daemon[1311]: time=2026-09-24T12:27:22.801Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)"5755lb # [ 124.521559] niks3-server[1195]: 2026/09/24 12:27:22 INFO Received sign narinfos request method=POST path=/api/pushes/37/sign5756worker1 # [ 124.541749] nix-grpc-daemon[1311]: time=2026-09-24T12:27:22.830Z level=INFO msg="Uploading 1 narinfos"5757lb # [ 124.531918] niks3-server[1195]: 2026/09/24 12:27:22 INFO Signed narinfos id=37 count=15758lb # [ 124.537858] niks3-server[1195]: 2026/09/24 12:27:22 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls5759lb # [ 124.542904] niks3-server[1195]: 2026/09/24 12:27:22 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst5760lb # [ 124.554858] niks3-server[1195]: 2026/09/24 12:27:22 INFO Received complete push request method=POST path=/api/pushes/37/complete5761worker1 # [ 124.573250] nix-grpc-daemon[1311]: time=2026-09-24T12:27:22.862Z level=INFO msg="Upload complete. (173ms)"5762lb # [ 124.563518] niks3-server[1195]: 2026/09/24 12:27:22 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo5763worker1 # [ 124.576810] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=0 paths=1 nar_bytes_in=6565764worker1 # [ 124.582660] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525765worker1 # [ 124.592531] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5766worker1 # [ 124.598711] nix-daemon[866]: reaped child process 1352, status = succeeded5767worker1 # [ 124.602707] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5768client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051...5769client # farm-b> node-a: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv5770client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5771client # farm-b> LOG-farm-b-after-niks3-restart5772worker1 # [ 125.838742] nix-daemon[866]: reaped child process 1361, status = succeeded5773worker1 # [ 125.915440] nix-daemon[866]: accepted connection from pid 1377, user nix-grpc-daemon (trusted)5774worker1 # [ 125.928711] nix-daemon[866]: reaped child process 1380, status = succeeded5775lb # [ 125.925332] niks3-server[1195]: 2026/09/24 12:27:24 INFO Received push request method=POST path=/api/pushes5776worker1 # [ 125.944687] nix-grpc-daemon[1311]: time=2026-09-24T12:27:24.233Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5777worker1 # [ 125.946245] nix-grpc-daemon[1311]: time=2026-09-24T12:27:24.235Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)"5778lb # [ 125.972742] niks3-server[1195]: 2026/09/24 12:27:24 INFO Received sign narinfos request method=POST path=/api/pushes/38/sign5779worker1 # [ 125.988950] nix-grpc-daemon[1311]: time=2026-09-24T12:27:24.277Z level=INFO msg="Uploading 1 narinfos"5780lb # [ 125.978146] niks3-server[1195]: 2026/09/24 12:27:24 INFO Signed narinfos id=38 count=15781lb # [ 125.989761] niks3-server[1195]: 2026/09/24 12:27:24 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls5782lb # [ 125.995413] niks3-server[1195]: 2026/09/24 12:27:24 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv5783lb # [ 126.001279] niks3-server[1195]: 2026/09/24 12:27:24 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst5784lb # [ 126.009572] niks3-server[1195]: 2026/09/24 12:27:24 INFO Received complete push request method=POST path=/api/pushes/38/complete5785lb # [ 126.015235] niks3-server[1195]: 2026/09/24 12:27:24 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo5786worker1 # [ 126.025106] nix-grpc-daemon[1311]: time=2026-09-24T12:27:24.314Z level=INFO msg="Upload complete. (214ms)"5787worker1 # [ 126.031706] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05788worker2 # [ 126.045320] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:25Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=05789worker1 # [ 126.042221] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525790worker2 # [ 126.049692] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:25Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.3:50051 clients=15791worker1 # [ 126.053712] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482525792worker1 # [ 126.060420] nix-daemon[866]: reaped child process 1359, status = succeeded5793worker1 # [ 126.066420] nix-grpc-daemon[1311]: time=2026-09-24T12:27:24.355Z level=INFO msg="All 2 paths already cached"5794client # copying 1 paths to 'lb:50051'...5795worker1 # [ 126.074375] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482525796client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'...5797worker1 # [ 126.080840] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5798worker1 # [ 126.166473] nix-daemon[866]: accepted connection from pid 1384, user nix-grpc-daemon (trusted)5799worker1 # [ 126.179363] nix-daemon[866]: reaped child process 1387, status = succeeded5800lb # [ 126.176808] niks3-server[1195]: 2026/09/24 12:27:24 INFO Received push request method=POST path=/api/pushes5801worker1 # [ 126.196068] nix-grpc-daemon[1311]: time=2026-09-24T12:27:24.485Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5802worker1 # [ 126.197856] nix-grpc-daemon[1311]: time=2026-09-24T12:27:24.486Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)"5803lb # [ 126.208576] niks3-server[1195]: 2026/09/24 12:27:24 INFO Received sign narinfos request method=POST path=/api/pushes/39/sign5804lb # [ 126.217059] niks3-server[1195]: 2026/09/24 12:27:24 INFO Signed narinfos id=39 count=15805worker1 # [ 126.230879] nix-grpc-daemon[1311]: time=2026-09-24T12:27:24.519Z level=INFO msg="Uploading 1 narinfos"5806lb # [ 126.220174] niks3-server[1195]: 2026/09/24 12:27:24 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst5807lb # [ 126.229095] niks3-server[1195]: 2026/09/24 12:27:24 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls5808lb # [ 126.238360] niks3-server[1195]: 2026/09/24 12:27:24 INFO Received complete push request method=POST path=/api/pushes/39/complete5809worker1 # [ 126.253090] nix-grpc-daemon[1311]: time=2026-09-24T12:27:24.542Z level=INFO msg="Upload complete. (166ms)"5810lb # [ 126.243947] niks3-server[1195]: 2026/09/24 12:27:24 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo5811worker1 # [ 126.257173] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=0 paths=1 nar_bytes_in=7845812worker1 # [ 126.262087] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525813worker1 # [ 126.272063] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5814worker1 # [ 126.276713] nix-daemon[866]: reaped child process 1382, status = succeeded5815worker1 # [ 126.280664] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5816client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051...5817client # farm-top> node-a: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv5818lb # [ 126.353832] envoy[907]: conn peer=[2001:db8:1::3]:53126 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2110 tx=986 ms=840525819lb # [ 126.357968] envoy[907]: conn peer=[2001:db8:1::1]:47280 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=305 ms=13175820client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5821client # farm-top> LOG-farm-top-after-niks3-restart5822worker1 # [ 127.720922] nix-daemon[866]: reaped child process 1391, status = succeeded5823worker1 # [ 127.796480] nix-daemon[866]: accepted connection from pid 1407, user nix-grpc-daemon (trusted)5824worker1 # [ 127.809762] nix-daemon[866]: reaped child process 1410, status = succeeded5825lb # [ 127.806937] niks3-server[1195]: 2026/09/24 12:27:26 INFO Received push request method=POST path=/api/pushes5826worker1 # [ 127.826077] nix-grpc-daemon[1311]: time=2026-09-24T12:27:26.114Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5827worker1 # [ 127.827645] nix-grpc-daemon[1311]: time=2026-09-24T12:27:26.116Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)"5828lb # [ 127.849261] niks3-server[1195]: 2026/09/24 12:27:26 INFO Received sign narinfos request method=POST path=/api/pushes/40/sign5829lb # [ 127.862267] niks3-server[1195]: 2026/09/24 12:27:26 INFO Signed narinfos id=40 count=15830worker1 # [ 127.875622] nix-grpc-daemon[1311]: time=2026-09-24T12:27:26.164Z level=INFO msg="Uploading 1 narinfos"5831lb # [ 127.865365] niks3-server[1195]: 2026/09/24 12:27:26 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst5832lb # [ 127.874566] niks3-server[1195]: 2026/09/24 12:27:26 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls5833lb # [ 127.882268] niks3-server[1195]: 2026/09/24 12:27:26 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv5834lb # [ 127.889264] niks3-server[1195]: 2026/09/24 12:27:26 INFO Received complete push request method=POST path=/api/pushes/40/complete5835lb # [ 127.895399] niks3-server[1195]: 2026/09/24 12:27:26 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo5836worker1 # [ 127.909599] nix-grpc-daemon[1311]: time=2026-09-24T12:27:26.198Z level=INFO msg="Upload complete. (220ms)"5837worker1 # [ 127.915735] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=05838worker1 # [ 127.931778] nix-daemon[866]: reaped child process 1389, status = succeeded5839client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 7.05 seconds)5840client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath5841client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.12 seconds)5842(finished: subtest: a niks3 restart does not cost the leader its role, in 7.53 seconds)5843subtest: scheduler down: the other node takes the lock and keeps it5844lb: must succeed: curl -sf localhost:9901/clusters5845lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5846lb: must succeed: curl -sf localhost:9901/clusters5847lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5848lb: must succeed: curl -sf localhost:9901/clusters5849lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5850lb: must succeed: curl -sf localhost:9901/clusters5851lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5852worker2 # [ 128.238556] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:27Z level=info event=signal_exit5853worker2 # [ 128.241657] systemd[1]: Stopping Nix worker-protocol over gRPC...5854lb # [ 128.618264] niks3-server[1195]: 2026/09/24 12:27:26 INFO lead: released remote=192.168.1.4:467005855worker1 # [ 129.631511] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:27Z level=info event=scheduler_restarting addr=lb:500515856worker2 # [ 129.637445] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:28Z level=info event=scheduler_restarting5857lb # [ 129.619212] envoy[907]: [2026-09-24 12:27:27.937][907][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream}5858worker2 # [ 129.640681] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:28Z level=info event=scheduler_restarting addr=lb:500515859worker2 # [ 129.647808] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:334285860worker2 # [ 129.652304] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:28Z level=info event=worker_gone addr=192.168.1.3:500515861worker2 # [ 129.655903] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:334285862worker2 # [ 129.659705] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:28Z level=info event=worker_gone addr=192.168.1.4:500515863worker2 # [ 129.684319] nix-daemon[856]: reaped child process 1329, status = succeeded5864worker1 # [ 129.831572] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_connected addr=lb:500515865worker1 # [ 129.835858] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5866worker2 # [ 129.850623] nix-grpc-daemon[1277]: ts=2026-09-24T12:27:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5867worker1 # [ 130.036704] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_connected addr=lb:500515868worker1 # [ 130.040804] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5869worker1 # [ 130.241785] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_connected addr=lb:500515870worker1 # [ 130.245886] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5871worker1 # [ 130.446710] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_connected addr=lb:500515872worker1 # [ 130.450685] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5873worker1 # [ 130.652741] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_connected addr=lb:500515874worker1 # [ 130.655985] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5875worker2 # [ 130.854818] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5876worker2 # [ 130.858356] systemd[1]: Stopped Nix worker-protocol over gRPC.5877worker1 # [ 130.856709] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_connected addr=lb:500515878worker2 # [ 130.862175] systemd[1]: nix-grpc-daemon.service: Consumed 504ms CPU time over 16.725s wall clock time, 35M memory peak, 166.7K incoming IP traffic, 75.4K outgoing IP traffic.5879worker1 # [ 130.860508] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5880worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5881worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.05 seconds)5882worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5883worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds)5884worker1 # [ 131.061417] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_connected addr=lb:500515885worker1 # [ 131.065419] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5886worker1 # [ 131.266261] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_connected addr=lb:500515887worker1 # [ 131.270239] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5888worker1 # [ 131.471129] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_connected addr=lb:500515889worker1 # [ 131.475290] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5890worker1 # [ 131.630386] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_take_over5891lb # [ 131.619803] niks3-server[1195]: 2026/09/24 12:27:29 INFO lead: acquired remote=192.168.1.3:417665892worker1 # [ 131.677225] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_connected addr=lb:500515893worker1 # [ 131.681099] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5894worker1 # [ 131.882290] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:30Z level=info event=scheduler_connected addr=lb:500515895worker1 # [ 131.886410] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5896worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5897worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5898worker1 # [ 132.086912] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:30Z level=info event=scheduler_connected addr=lb:500515899worker1 # [ 132.090877] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5900worker1 # [ 132.291740] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:30Z level=info event=scheduler_connected addr=lb:500515901worker1 # [ 132.295744] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5902worker1 # [ 132.496651] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:30Z level=info event=scheduler_connected addr=lb:500515903worker1 # [ 132.500638] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5904worker1 # [ 132.703326] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:30Z level=info event=scheduler_connected addr=lb:500515905worker1 # [ 132.715177] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:495985906worker1 # [ 132.718845] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05907worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5908worker1 # [ 132.999937] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:413345909worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5910client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&25911worker1 # [ 133.187196] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:482525912client # don't know how to build these paths:5913client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5914worker1 # [ 133.196142] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482525915worker1 # [ 133.218955] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05916worker1 # [ 133.223924] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15917worker1 # [ 133.229723] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525918worker1 # [ 133.240727] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482525919client # copying 1 paths to 'lb:50051'...5920client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5921worker1 # [ 133.252071] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482525922worker1 # [ 133.263280] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5923worker1 # [ 133.359258] nix-daemon[866]: accepted connection from pid 1431, user nix-grpc-daemon (trusted)5924worker1 # [ 133.372386] nix-daemon[866]: reaped child process 1434, status = succeeded5925lb # [ 133.369685] niks3-server[1195]: 2026/09/24 12:27:31 INFO Received push request method=POST path=/api/pushes5926worker1 # [ 133.388560] nix-grpc-daemon[1311]: time=2026-09-24T12:27:31.677Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5927worker1 # [ 133.390482] nix-grpc-daemon[1311]: time=2026-09-24T12:27:31.679Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5928lb # [ 133.406067] niks3-server[1195]: 2026/09/24 12:27:31 INFO Received sign narinfos request method=POST path=/api/pushes/41/sign5929lb # [ 133.413936] niks3-server[1195]: 2026/09/24 12:27:31 INFO Signed narinfos id=41 count=15930worker1 # [ 133.427692] nix-grpc-daemon[1311]: time=2026-09-24T12:27:31.716Z level=INFO msg="Uploading 1 narinfos"5931lb # [ 133.423510] niks3-server[1195]: 2026/09/24 12:27:31 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5932lb # [ 133.430497] niks3-server[1195]: 2026/09/24 12:27:31 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5933lb # [ 133.439883] niks3-server[1195]: 2026/09/24 12:27:31 INFO Received complete push request method=POST path=/api/pushes/41/complete5934worker1 # [ 133.456819] nix-grpc-daemon[1311]: time=2026-09-24T12:27:31.745Z level=INFO msg="Upload complete. (184ms)"5935lb # [ 133.447307] niks3-server[1195]: 2026/09/24 12:27:31 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5936worker1 # [ 133.461549] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=0 paths=1 nar_bytes_in=5205937worker1 # [ 133.468244] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525938worker1 # [ 133.477123] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5939worker1 # [ 133.487064] nix-daemon[866]: reaped child process 1429, status = succeeded5940worker1 # [ 133.491732] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5941client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5942client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5943client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5944client # farm-a> LOG-farm-a-on-standby5945worker1 # [ 134.732847] nix-daemon[866]: reaped child process 1438, status = succeeded5946worker1 # [ 134.812553] nix-daemon[866]: accepted connection from pid 1454, user nix-grpc-daemon (trusted)5947worker1 # [ 134.824937] nix-daemon[866]: reaped child process 1457, status = succeeded5948lb # [ 134.824755] niks3-server[1195]: 2026/09/24 12:27:33 INFO Received push request method=POST path=/api/pushes5949worker1 # [ 134.841837] nix-grpc-daemon[1311]: time=2026-09-24T12:27:33.130Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5950worker1 # [ 134.843231] nix-grpc-daemon[1311]: time=2026-09-24T12:27:33.132Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5951lb # [ 134.861950] niks3-server[1195]: 2026/09/24 12:27:33 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5952lb # [ 134.876478] niks3-server[1195]: 2026/09/24 12:27:33 INFO Received sign narinfos request method=POST path=/api/pushes/42/sign5953worker1 # [ 134.894387] nix-grpc-daemon[1311]: time=2026-09-24T12:27:33.183Z level=INFO msg="Uploading 1 narinfos"5954lb # [ 134.883506] niks3-server[1195]: 2026/09/24 12:27:33 INFO Signed narinfos id=42 count=15955lb # [ 134.890209] niks3-server[1195]: 2026/09/24 12:27:33 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5956lb # [ 134.895666] niks3-server[1195]: 2026/09/24 12:27:33 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5957lb # [ 134.904068] niks3-server[1195]: 2026/09/24 12:27:33 INFO Received complete push request method=POST path=/api/pushes/42/complete5958lb # [ 134.911531] niks3-server[1195]: 2026/09/24 12:27:33 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5959worker1 # [ 134.921422] nix-grpc-daemon[1311]: time=2026-09-24T12:27:33.210Z level=INFO msg="Upload complete. (222ms)"5960worker1 # [ 134.932341] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05961worker1 # [ 134.943579] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:33Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05962worker1 # [ 134.947893] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:33Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15963worker1 # [ 134.952228] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525964worker1 # [ 134.961305] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482525965worker1 # [ 134.964053] nix-daemon[866]: reaped child process 1436, status = succeeded5966worker1 # [ 134.969436] nix-grpc-daemon[1311]: time=2026-09-24T12:27:33.258Z level=INFO msg="All 1 paths already cached"5967client # copying 1 paths to 'lb:50051'...5968worker1 # [ 134.975081] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482525969client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5970worker1 # [ 134.980972] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5971worker1 # [ 135.066147] nix-daemon[866]: accepted connection from pid 1463, user nix-grpc-daemon (trusted)5972worker1 # [ 135.080151] nix-daemon[866]: reaped child process 1466, status = succeeded5973lb # [ 135.075178] niks3-server[1195]: 2026/09/24 12:27:33 INFO Received push request method=POST path=/api/pushes5974worker1 # [ 135.094368] nix-grpc-daemon[1311]: time=2026-09-24T12:27:33.383Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5975worker1 # [ 135.096340] nix-grpc-daemon[1311]: time=2026-09-24T12:27:33.384Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5976lb # [ 135.106398] niks3-server[1195]: 2026/09/24 12:27:33 INFO Received sign narinfos request method=POST path=/api/pushes/43/sign5977worker1 # [ 135.122542] nix-grpc-daemon[1311]: time=2026-09-24T12:27:33.411Z level=INFO msg="Uploading 1 narinfos"5978lb # [ 135.111245] niks3-server[1195]: 2026/09/24 12:27:33 INFO Signed narinfos id=43 count=15979lb # [ 135.119280] niks3-server[1195]: 2026/09/24 12:27:33 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5980lb # [ 135.127193] niks3-server[1195]: 2026/09/24 12:27:33 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5981lb # [ 135.136248] niks3-server[1195]: 2026/09/24 12:27:33 INFO Received complete push request method=POST path=/api/pushes/43/complete5982lb # [ 135.143628] niks3-server[1195]: 2026/09/24 12:27:33 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5983worker1 # [ 135.157870] nix-grpc-daemon[1311]: time=2026-09-24T12:27:33.446Z level=INFO msg="Upload complete. (172ms)"5984worker1 # [ 135.162521] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=0 paths=1 nar_bytes_in=6405985worker1 # [ 135.167896] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482525986worker1 # [ 135.177494] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5987worker1 # [ 135.185116] nix-daemon[866]: reaped child process 1461, status = succeeded5988worker1 # [ 135.189876] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5989client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5990client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5991client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5992client # farm-b> LOG-farm-b-on-standby5993worker1 # [ 135.819433] nix-daemon[866]: reaped child process 1470, status = succeeded5994worker1 # [ 135.890329] nix-daemon[866]: accepted connection from pid 1486, user nix-grpc-daemon (trusted)5995worker1 # [ 135.903837] nix-daemon[866]: reaped child process 1489, status = succeeded5996lb # [ 135.899715] niks3-server[1195]: 2026/09/24 12:27:34 INFO Received push request method=POST path=/api/pushes5997worker1 # [ 135.918683] nix-grpc-daemon[1311]: time=2026-09-24T12:27:34.207Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5998worker1 # [ 135.920364] nix-grpc-daemon[1311]: time=2026-09-24T12:27:34.209Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5999lb # [ 135.943140] niks3-server[1195]: 2026/09/24 12:27:34 INFO Received sign narinfos request method=POST path=/api/pushes/44/sign6000worker1 # [ 135.959691] nix-grpc-daemon[1311]: time=2026-09-24T12:27:34.248Z level=INFO msg="Uploading 1 narinfos"6001lb # [ 135.949311] niks3-server[1195]: 2026/09/24 12:27:34 INFO Signed narinfos id=44 count=16002lb # [ 135.959938] niks3-server[1195]: 2026/09/24 12:27:34 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls6003lb # [ 135.965791] niks3-server[1195]: 2026/09/24 12:27:34 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv6004lb # [ 135.980439] niks3-server[1195]: 2026/09/24 12:27:34 INFO Received complete push request method=POST path=/api/pushes/44/complete6005lb # [ 135.985057] niks3-server[1195]: 2026/09/24 12:27:34 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo6006lb # [ 135.988693] niks3-server[1195]: 2026/09/24 12:27:34 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst6007worker1 # [ 136.002685] nix-grpc-daemon[1311]: time=2026-09-24T12:27:34.291Z level=INFO msg="Upload complete. (206ms)"6008worker1 # [ 136.014213] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=0 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=06009worker1 # [ 136.023942] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:34Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=06010worker1 # [ 136.028081] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:34Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=16011worker1 # [ 136.032086] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482526012worker1 # [ 136.042517] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482526013worker1 # [ 136.046094] nix-daemon[866]: reaped child process 1468, status = succeeded6014worker1 # [ 136.050794] nix-grpc-daemon[1311]: time=2026-09-24T12:27:34.339Z level=INFO msg="All 2 paths already cached"6015client # copying 1 paths to 'lb:50051'...6016worker1 # [ 136.056447] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482526017client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...6018worker1 # [ 136.061507] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)6019worker1 # [ 136.147550] nix-daemon[866]: accepted connection from pid 1495, user nix-grpc-daemon (trusted)6020worker1 # [ 136.160562] nix-daemon[866]: reaped child process 1498, status = succeeded6021lb # [ 136.157808] niks3-server[1195]: 2026/09/24 12:27:34 INFO Received push request method=POST path=/api/pushes6022worker1 # [ 136.176042] nix-grpc-daemon[1311]: time=2026-09-24T12:27:34.465Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6023worker1 # [ 136.178033] nix-grpc-daemon[1311]: time=2026-09-24T12:27:34.466Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"6024lb # [ 136.189798] niks3-server[1195]: 2026/09/24 12:27:34 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst6025lb # [ 136.197127] niks3-server[1195]: 2026/09/24 12:27:34 INFO Received sign narinfos request method=POST path=/api/pushes/45/sign6026lb # [ 136.202879] niks3-server[1195]: 2026/09/24 12:27:34 INFO Signed narinfos id=45 count=16027worker1 # [ 136.216649] nix-grpc-daemon[1311]: time=2026-09-24T12:27:34.505Z level=INFO msg="Uploading 1 narinfos"6028lb # [ 136.209830] niks3-server[1195]: 2026/09/24 12:27:34 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls6029lb # [ 136.221621] niks3-server[1195]: 2026/09/24 12:27:34 INFO Received complete push request method=POST path=/api/pushes/45/complete6030worker1 # [ 136.242838] nix-grpc-daemon[1311]: time=2026-09-24T12:27:34.531Z level=INFO msg="Upload complete. (175ms)"6031lb # [ 136.233276] niks3-server[1195]: 2026/09/24 12:27:34 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo6032worker1 # [ 136.246740] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=0 paths=1 nar_bytes_in=7686033worker1 # [ 136.251613] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482526034worker1 # [ 136.261286] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)6035worker1 # [ 136.269080] nix-daemon[866]: reaped child process 1493, status = succeeded6036worker1 # [ 136.273652] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)6037client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...6038client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6039lb # [ 136.352899] envoy[907]: conn peer=[2001:db8:1::1]:47286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9752 tx=4439 ms=68916040lb # [ 136.356602] envoy[907]: conn peer=[2001:db8:1::4]:57524 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=12827 tx=736 ms=155626041client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6042client # farm-top> LOG-farm-top-on-standby6043worker1 # [ 137.086675] nix-daemon[866]: reaped child process 1502, status = succeeded6044worker1 # [ 137.163086] nix-daemon[866]: accepted connection from pid 1518, user nix-grpc-daemon (trusted)6045worker1 # [ 137.175377] nix-daemon[866]: reaped child process 1521, status = succeeded6046lb # [ 137.173688] niks3-server[1195]: 2026/09/24 12:27:35 INFO Received push request method=POST path=/api/pushes6047worker1 # [ 137.195441] nix-grpc-daemon[1311]: time=2026-09-24T12:27:35.484Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6048worker1 # [ 137.196906] nix-grpc-daemon[1311]: time=2026-09-24T12:27:35.486Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"6049lb # [ 137.219366] niks3-server[1195]: 2026/09/24 12:27:35 INFO Received sign narinfos request method=POST path=/api/pushes/46/sign6050lb # [ 137.222314] niks3-server[1195]: 2026/09/24 12:27:35 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6051lb # [ 137.230534] niks3-server[1195]: 2026/09/24 12:27:35 INFO Signed narinfos id=46 count=16052worker1 # [ 137.244090] nix-grpc-daemon[1311]: time=2026-09-24T12:27:35.532Z level=INFO msg="Uploading 1 narinfos"6053lb # [ 137.236153] niks3-server[1195]: 2026/09/24 12:27:35 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls6054lb # [ 137.241331] niks3-server[1195]: 2026/09/24 12:27:35 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst6055lb # [ 137.250668] niks3-server[1195]: 2026/09/24 12:27:35 INFO Received complete push request method=POST path=/api/pushes/46/complete6056lb # [ 137.257453] niks3-server[1195]: 2026/09/24 12:27:35 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo6057worker1 # [ 137.272154] nix-grpc-daemon[1311]: time=2026-09-24T12:27:35.561Z level=INFO msg="Upload complete. (192ms)"6058worker1 # [ 137.279294] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=06059worker1 # [ 137.295238] nix-daemon[866]: reaped child process 1500, status = succeeded6060client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 4.27 seconds)6061client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath6062client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.11 seconds)6063worker2 # [ 137.485765] systemd[1]: Starting scheduler-token.service...6064worker2 # [ 137.534349] systemd[1]: scheduler-token.service: Deactivated successfully.6065worker2 # [ 137.536070] systemd[1]: Finished scheduler-token.service.6066worker2 # [ 137.537258] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 50ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6067worker2 # [ 137.542574] systemd[1]: Starting Nix worker-protocol over gRPC...6068worker2 # [ 137.628312] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:36Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6069worker2 # [ 137.633091] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6070worker2 # [ 137.634987] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16071worker2 # [ 137.639133] nix-grpc-daemon[1393]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6072worker2 # [ 137.640493] nix-grpc-daemon[1393]: E0000 00:00:1790252856.807660 1393 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6073worker2 # [ 137.643869] nix-grpc-daemon[1393]: E0000 00:00:1790252856.812881 1393 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6074worker2 # [ 137.649467] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:36Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket6075worker2 # [ 137.654254] systemd[1]: Started Nix worker-protocol over gRPC.6076worker2 # [ 137.658081] nix-grpc-daemon[1393]: E0000 00:00:1790252856.825429 1435 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6077worker2 # [ 137.669347] nix-grpc-daemon[1393]: E0000 00:00:1790252856.838604 1435 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6078worker2 # [ 137.674067] nix-grpc-daemon[1393]: E0000 00:00:1790252856.840891 1435 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6079lb: must succeed: curl -sf localhost:9901/clusters6080worker2 # [ 137.684591] nix-grpc-daemon[1393]: E0000 00:00:1790252856.853864 1435 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6081worker2 # [ 137.695817] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:36Z level=info event=scheduler_connected addr=lb:500516082worker1 # [ 137.699175] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:35Z level=info event=oidc_jwks provider=mock keys=16083worker1 # [ 137.703093] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:35Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:495986084worker1 # [ 137.709796] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06085lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6086worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6087worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6088lb: must succeed: curl -sf localhost:9901/clusters6089lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6090lb: must succeed: curl -sf localhost:9901/clusters6091lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6092worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6093worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6094(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 9.81 seconds)6095subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise6096client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs6097client # [ 137.913743] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs.6098client # Running as unit: rs.service; invocation ID: 4a7cae31c3494ec8aaaa499ec42730de6099client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds)6100worker1 # [ 138.055931] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:482526101client # [ 138.056666] nix[1361]: don't know how to build these paths:6102client # [ 138.057604] nix[1361]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv6103worker1 # [ 138.070163] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:36Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=06104worker1 # [ 138.075669] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:36Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=16105worker1 # [ 138.081489] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482526106worker1 # [ 138.092782] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482526107client # [ 138.097087] nix[1361]: copying 1 paths to 'lb:50051'...6108client # [ 138.097899] nix[1361]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...6109worker1 # [ 138.104557] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482526110worker1 # [ 138.115940] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)6111worker1 # [ 138.211850] nix-daemon[866]: accepted connection from pid 1534, user nix-grpc-daemon (trusted)6112worker1 # [ 138.224648] nix-daemon[866]: reaped child process 1537, status = succeeded6113lb # [ 138.221832] niks3-server[1195]: 2026/09/24 12:27:36 INFO Received push request method=POST path=/api/pushes6114worker1 # [ 138.240676] nix-grpc-daemon[1311]: time=2026-09-24T12:27:36.529Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6115worker1 # [ 138.242634] nix-grpc-daemon[1311]: time=2026-09-24T12:27:36.531Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"6116lb # [ 138.251582] niks3-server[1195]: 2026/09/24 12:27:36 INFO Received sign narinfos request method=POST path=/api/pushes/47/sign6117lb # [ 138.258056] niks3-server[1195]: 2026/09/24 12:27:36 INFO Signed narinfos id=47 count=16118worker1 # [ 138.271914] nix-grpc-daemon[1311]: time=2026-09-24T12:27:36.560Z level=INFO msg="Uploading 1 narinfos"6119lb # [ 138.269417] niks3-server[1195]: 2026/09/24 12:27:36 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls6120lb # [ 138.273772] niks3-server[1195]: 2026/09/24 12:27:36 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst6121lb # [ 138.282319] niks3-server[1195]: 2026/09/24 12:27:36 INFO Received complete push request method=POST path=/api/pushes/47/complete6122worker1 # [ 138.301556] nix-grpc-daemon[1311]: time=2026-09-24T12:27:36.590Z level=INFO msg="Upload complete. (174ms)"6123lb # [ 138.292325] niks3-server[1195]: 2026/09/24 12:27:36 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo6124worker1 # [ 138.307186] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=0 paths=1 nar_bytes_in=4166125worker1 # [ 138.311862] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482526126worker1 # [ 138.323608] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)6127worker1 # [ 138.326824] nix-daemon[866]: reaped child process 1532, status = succeeded6128worker1 # [ 138.330724] nix-daemon[866]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)6129client # [ 138.324272] nix[1361]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...6130lb: must succeed: curl -sf localhost:9901/clusters6131lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6132lb: must succeed: curl -sf localhost:9901/clusters6133lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6134lb: must succeed: curl -sf localhost:9901/clusters6135lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6136lb: must succeed: curl -sf localhost:9901/clusters6137lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6138worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true6139worker2 # [ 140.596881] systemd-journald[284]: Received client request to rotate journal, rotating.6140worker2 # [ 140.616525] systemd-journald[284]: Vacuuming done, freed 0B of archived journals from /var/log/journal/837ef6be7a41459384e842303129edd3.6141worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds)6142worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service6143worker1 # [ 140.521291] systemd[1]: Stopping Nix worker-protocol over gRPC...6144worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds)6145client: must succeed: sleep 5.06146worker1 # [ 141.433886] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:39Z level=info event=draining6147client: (finished: must succeed: sleep 5.0, in 5.03 seconds)6148worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='6149worker1 # [ 145.752158] nix-daemon[866]: reaped child process 1541, status = succeeded6150worker1 # [ 145.828034] nix-daemon[866]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)6151worker1 # [ 145.839707] nix-daemon[866]: reaped child process 1585, status = succeeded6152lb # [ 145.836760] niks3-server[1195]: 2026/09/24 12:27:44 INFO Received push request method=POST path=/api/pushes6153worker1 # [ 145.857748] nix-grpc-daemon[1311]: time=2026-09-24T12:27:44.146Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6154worker1 # [ 145.859252] nix-grpc-daemon[1311]: time=2026-09-24T12:27:44.148Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"6155lb # [ 145.888362] niks3-server[1195]: 2026/09/24 12:27:44 INFO Received sign narinfos request method=POST path=/api/pushes/48/sign6156worker1 # [ 145.903780] nix-grpc-daemon[1311]: time=2026-09-24T12:27:44.192Z level=INFO msg="Uploading 1 narinfos"6157lb # [ 145.893758] niks3-server[1195]: 2026/09/24 12:27:44 INFO Signed narinfos id=48 count=16158lb # [ 145.901190] niks3-server[1195]: 2026/09/24 12:27:44 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv6159lb # [ 145.905584] niks3-server[1195]: 2026/09/24 12:27:44 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls6160lb # [ 145.915245] niks3-server[1195]: 2026/09/24 12:27:44 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst6161lb # [ 145.924312] niks3-server[1195]: 2026/09/24 12:27:44 INFO Received complete push request method=POST path=/api/pushes/48/complete6162worker1 # [ 145.938261] nix-grpc-daemon[1311]: time=2026-09-24T12:27:44.227Z level=INFO msg="Upload complete. (194ms)"6163lb # [ 145.929252] niks3-server[1195]: 2026/09/24 12:27:44 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo6164worker1 # [ 145.945751] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48252 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06165worker1 # [ 145.961298] nix-daemon[866]: reaped child process 1539, status = succeeded6166client # [ 145.968720] systemd[1]: rs.service: Deactivated successfully.6167client # [ 145.972444] systemd[1]: rs.service: Consumed 124ms CPU time over 8.058s wall clock time, 41.4M memory peak, 7.1K incoming IP traffic, 8.3K outgoing IP traffic.6168lb # [ 146.353426] envoy[907]: conn peer=[2001:db8:1::1]:49206 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9530 tx=4358 ms=41086169lb # [ 146.358069] envoy[907]: conn peer=[2001:db8:1::1]:49220 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2956 tx=1498 ms=78986170worker1 # [ 146.436544] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:44Z level=info event=signal_exit6171lb # [ 146.620358] niks3-server[1195]: 2026/09/24 12:27:44 INFO lead: released remote=192.168.1.3:417666172worker1 # [ 147.632783] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:45Z level=info event=scheduler_restarting6173lb # [ 147.621156] envoy[907]: [2026-09-24 12:27:45.940][907][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream}6174worker2 # [ 147.645813] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:46Z level=info event=scheduler_restarting addr=lb:500516175worker1 # [ 147.640683] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:495986176worker1 # [ 147.644650] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:45Z level=info event=worker_gone addr=192.168.1.4:500516177worker1 # [ 147.649834] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:45Z level=info event=scheduler_restarting addr=lb:500516178lb # [ 147.640784] niks3-server[1195]: 2026/09/24 12:27:45 INFO lead: acquired remote=192.168.1.4:540186179worker1 # [ 147.653340] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:495986180worker2 # [ 147.659701] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:46Z level=info event=scheduler_take_over6181worker1 # [ 147.657209] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:45Z level=info event=worker_gone addr=192.168.1.3:500516182worker1 # [ 147.681725] nix-daemon[866]: reaped child process 1301, status = succeeded6183worker2 # [ 147.845951] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:47Z level=info event=scheduler_connected addr=lb:500516184worker2 # [ 147.860669] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:47Z level=info event=oidc_jwks provider=mock keys=16185worker2 # [ 147.863309] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:366326186worker1 # [ 147.858769] nix-grpc-daemon[1249]: ts=2026-09-24T12:27:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6187worker2 # [ 147.866618] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06188worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.14 seconds)6189client: waiting for success: ! systemctl is-active rs6190client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds)6191client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }6192client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)6193client: must fail: journalctl -u rs | grep -q 'reconnecting'6194client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds)6195lb: must succeed: curl -sf localhost:9901/clusters6196worker2 # [ 147.973525] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:47Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:366406197lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6198worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6199worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6200lb: must succeed: curl -sf localhost:9901/clusters6201lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6202worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6203worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6204worker1 # [ 149.807210] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6205worker1 # [ 149.810213] systemd[1]: Stopped Nix worker-protocol over gRPC.6206worker1 # [ 149.813538] systemd[1]: nix-grpc-daemon.service: Consumed 1.557s CPU time over 30.488s wall clock time, 45.1M memory peak, 364K incoming IP traffic, 227.9K outgoing IP traffic.6207worker1 # [ 149.827537] systemd[1]: Starting Nix worker-protocol over gRPC...6208worker1 # [ 149.919094] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6209worker1 # [ 149.921105] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6210worker1 # [ 149.924360] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16211worker1 # [ 149.928642] nix-grpc-daemon[1593]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6212worker1 # [ 149.931164] nix-grpc-daemon[1593]: E0000 00:00:1790252868.217540 1593 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6213worker1 # [ 149.933905] nix-grpc-daemon[1593]: E0000 00:00:1790252868.222918 1593 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6214worker1 # [ 149.936798] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:48Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket6215worker1 # [ 149.940544] systemd[1]: Started Nix worker-protocol over gRPC.6216worker1 # [ 149.944058] nix-grpc-daemon[1593]: E0000 00:00:1790252868.233030 1635 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6217worker1 # [ 149.956025] nix-grpc-daemon[1593]: E0000 00:00:1790252868.245039 1635 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6218worker1 # [ 149.959195] nix-grpc-daemon[1593]: E0000 00:00:1790252868.245208 1635 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6219worker1 # [ 149.971190] nix-grpc-daemon[1593]: E0000 00:00:1790252868.260235 1635 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6220worker1 # [ 149.980512] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:48Z level=info event=scheduler_connected addr=lb:500516221worker2 # [ 149.988628] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:49Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:366326222worker2 # [ 149.993406] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06223lb: must succeed: curl -sf localhost:9901/clusters6224lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6225worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6226worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6227(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.37 seconds)6228subtest: scheduler restart mid-build: build finishes, no double build6229client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid6230client # [ 150.281989] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid.6231client # Running as unit: mid.service; invocation ID: 0f8c446b40ba47309cbf125ad5007cf86232client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds)6233worker2 # [ 150.437778] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:366566234worker2 # [ 150.449717] nix-daemon[856]: accepted connection from pid 1393, user nix-grpc-daemon (trusted)6235client # [ 150.449183] nix[1397]: don't know how to build these paths:6236client # [ 150.450205] nix[1397]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6237worker2 # [ 150.467230] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:49Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=06238worker2 # [ 150.471113] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:49Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=16239worker2 # [ 150.476369] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366566240worker2 # [ 150.483599] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5)6241worker2 # [ 150.564209] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 2/5)6242worker2 # [ 150.623318] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 248 ms (attempt 3/5)6243worker2 # [ 150.879275] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 4/5)6244worker2 # [ 150.910145] nix-grpc-daemon[1393]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6245worker2 # [ 150.913389] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6246worker2 # [ 150.931263] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366566247client # [ 150.930435] nix[1397]: copying 1 paths to 'lb:50051'...6248client # [ 150.934151] nix[1397]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...6249worker2 # [ 150.946434] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366566250worker2 # [ 150.954940] nix-daemon[856]: accepted connection from pid 1393, user nix-grpc-daemon (trusted)6251worker2 # [ 150.978333] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:50Z level=info event=niks3_push_started pid=15186252worker2 # [ 151.090464] nix-grpc-daemon[1518]: time=2026-09-24T12:27:50.258Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""6253worker2 # [ 151.187653] nix-daemon[856]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)6254worker2 # [ 151.201386] nix-daemon[856]: reaped child process 1533, status = succeeded6255lb # [ 151.193501] niks3-server[1195]: 2026/09/24 12:27:49 INFO Received push request method=POST path=/api/pushes6256worker2 # [ 151.218909] nix-grpc-daemon[1518]: time=2026-09-24T12:27:50.388Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6257worker2 # [ 151.220549] nix-grpc-daemon[1518]: time=2026-09-24T12:27:50.389Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"6258lb # [ 151.233412] niks3-server[1195]: 2026/09/24 12:27:49 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls6259lb # [ 151.238720] niks3-server[1195]: 2026/09/24 12:27:49 INFO Received sign narinfos request method=POST path=/api/pushes/49/sign6260worker2 # [ 151.260822] nix-grpc-daemon[1518]: time=2026-09-24T12:27:50.430Z level=INFO msg="Uploading 1 narinfos"6261lb # [ 151.245273] niks3-server[1195]: 2026/09/24 12:27:49 INFO Signed narinfos id=49 count=16262lb # [ 151.259861] niks3-server[1195]: 2026/09/24 12:27:49 INFO Received complete push request method=POST path=/api/pushes/49/complete6263worker2 # [ 151.289371] nix-grpc-daemon[1518]: time=2026-09-24T12:27:50.458Z level=INFO msg="Upload complete. (196ms)"6264lb # [ 151.274869] niks3-server[1195]: 2026/09/24 12:27:49 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo6265worker2 # [ 151.292309] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36656 duration_s=0 paths=1 nar_bytes_in=4246266worker2 # [ 151.295590] nix-grpc-daemon[1393]: ts=2026-09-24T12:27:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366566267lb # [ 151.281980] niks3-server[1195]: 2026/09/24 12:27:49 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst6268worker2 # [ 151.301549] nix-daemon[856]: accepted connection from pid 1393, user nix-grpc-daemon (trusted)6269worker2 # [ 151.307779] nix-daemon[856]: reaped child process 1516, status = succeeded6270worker2 # [ 151.313112] nix-daemon[856]: accepted connection from pid 1393, user nix-grpc-daemon (trusted)6271client # [ 151.300340] nix[1397]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...6272lb: must succeed: curl -sf localhost:9901/clusters6273lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6274lb: must succeed: curl -sf localhost:9901/clusters6275lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6276worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6277worker2 # [ 152.788961] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1393 (nix-grpc-daemon) on client request.6278worker2 # [ 152.793380] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6279lb # [ 152.783469] niks3-server[1195]: 2026/09/24 12:27:51 INFO lead: released remote=192.168.1.4:540186280lb # [ 152.786108] envoy[907]: [2026-09-24 12:27:51.104][907][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 13, upstream_reset_after_response_started{connection_termination}6281client # [ 152.791879] nix[1397]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again6282worker1 # [ 152.798227] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"6283worker2 # [ 152.807766] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6284worker2 # [ 152.809725] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6285client # [ 152.796792] nix[1397]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6286worker2 # [ 152.810963] systemd[1]: nix-grpc-daemon.service: Consumed 413ms CPU time over 15.262s wall clock time, 35.9M memory peak, 217.6K incoming IP traffic, 60.9K outgoing IP traffic.6287worker2 # [ 152.821281] systemd[1]: Starting scheduler-token.service...6288worker2 # [ 152.840170] nix-daemon[856]: reaped child process 1508, status = succeeded6289worker2 # [ 152.844175] nix-daemon[856]: reaped child process 1535, status = succeeded6290worker2 # [ 152.852880] nix-daemon[1537]: unexpected Nix daemon error: error: interrupted by the user6291worker2 # [ 152.859672] nix-daemon[856]: reaped child process 1537, status = failed with exit code 16292worker2 # [ 152.878744] systemd[1]: scheduler-token.service: Deactivated successfully.6293worker2 # [ 152.880535] systemd[1]: Finished scheduler-token.service.6294worker2 # [ 152.882578] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 59ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6295worker2 # [ 152.884774] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6296worker2 # [ 152.888493] systemd[1]: Starting scheduler-token.service...6297worker2 # [ 152.924782] systemd[1]: scheduler-token.service: Deactivated successfully.6298worker2 # [ 152.926416] systemd[1]: Finished scheduler-token.service.6299worker2 # [ 152.927682] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 37ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6300worker2 # [ 152.932290] systemd[1]: Starting Nix worker-protocol over gRPC...6301worker1 # [ 152.998543] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:51Z level=info event=scheduler_connected addr=lb:500516302worker2 # [ 153.011342] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6303worker2 # [ 153.013317] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6304worker2 # [ 153.016867] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16305worker2 # [ 153.021052] nix-grpc-daemon[1580]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6306worker2 # [ 153.022659] nix-grpc-daemon[1580]: E0000 00:00:1790252872.190250 1580 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6307worker2 # [ 153.026442] nix-grpc-daemon[1580]: E0000 00:00:1790252872.195643 1580 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6308worker2 # [ 153.030724] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket6309worker2 # [ 153.034159] systemd[1]: Started Nix worker-protocol over gRPC.6310worker2 # [ 153.038097] nix-grpc-daemon[1580]: E0000 00:00:1790252872.207035 1622 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6311lb # [ 153.023597] niks3-server[1195]: 2026/09/24 12:27:51 INFO lead: acquired remote=192.168.1.4:589926312worker2 # [ 153.043175] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=scheduler_take_over6313worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.29 seconds)6314client: must succeed: sleep 5.06315worker2 # [ 153.051454] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:585846316worker2 # [ 153.055061] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06317worker2 # [ 153.059558] nix-grpc-daemon[1580]: E0000 00:00:1790252872.228787 1622 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6318worker2 # [ 153.064055] nix-grpc-daemon[1580]: E0000 00:00:1790252872.231052 1622 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6319worker2 # [ 153.073593] nix-grpc-daemon[1580]: E0000 00:00:1790252872.242828 1622 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6320worker2 # [ 153.083854] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=scheduler_connected addr=lb:500516321worker2 # [ 153.089060] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=oidc_jwks provider=mock keys=16322worker2 # [ 153.090700] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:585846323worker2 # [ 153.092337] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06324worker2 # [ 153.317996] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=06325worker2 # [ 153.322865] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=16326worker1 # [ 153.323838] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348306327worker1 # [ 153.335332] nix-daemon[866]: accepted connection from pid 1593, user nix-grpc-daemon (trusted)6328worker1 # [ 153.351906] nix-grpc-daemon[1593]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 1/5)6329worker1 # [ 153.393512] nix-grpc-daemon[1593]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 2/5)6330worker1 # [ 153.531747] nix-grpc-daemon[1593]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 139 ms (attempt 3/5)6331worker1 # [ 153.673143] nix-grpc-daemon[1593]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 4/5)6332worker2 # [ 153.705517] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:52Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:585986333worker1 # [ 153.759305] nix-grpc-daemon[1593]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6334worker1 # [ 153.763191] nix-grpc-daemon[1593]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6335worker1 # [ 153.778175] nix-grpc-daemon[1593]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...6336worker1 # [ 153.802136] nix-daemon[866]: accepted connection from pid 1593, user nix-grpc-daemon (trusted)6337client # [ 153.808830] nix[1397]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...6338worker1 # [ 153.816128] nix-daemon[866]: accepted connection from pid 1593, user nix-grpc-daemon (trusted)6339lb # [ 156.353645] envoy[907]: conn peer=[2001:db8:1::3]:41974 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5192 tx=1434 ms=283796340lb # [ 156.357548] envoy[907]: conn peer=[2001:db8:1::4]:41846 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2089 tx=328 ms=151136341client: (finished: must succeed: sleep 5.0, in 5.03 seconds)6342worker1 # [ 158.235516] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:56Z level=info event=niks3_push_started pid=16956343worker1 # [ 158.250671] nix-daemon[866]: reaped child process 1670, status = succeeded6344client: waiting for success: ! systemctl is-active mid6345worker1 # [ 158.332468] nix-grpc-daemon[1695]: time=2026-09-24T12:27:56.619Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""6346worker1 # [ 158.416848] nix-daemon[866]: accepted connection from pid 1708, user nix-grpc-daemon (trusted)6347worker1 # [ 158.429992] nix-daemon[866]: reaped child process 1711, status = succeeded6348lb # [ 158.427576] niks3-server[1195]: 2026/09/24 12:27:56 INFO Received push request method=POST path=/api/pushes6349worker1 # [ 158.449509] nix-grpc-daemon[1695]: time=2026-09-24T12:27:56.738Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6350worker1 # [ 158.451035] nix-grpc-daemon[1695]: time=2026-09-24T12:27:56.740Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"6351lb # [ 158.485734] niks3-server[1195]: 2026/09/24 12:27:56 INFO Received sign narinfos request method=POST path=/api/pushes/50/sign6352worker1 # [ 158.507112] nix-grpc-daemon[1695]: time=2026-09-24T12:27:56.796Z level=INFO msg="Uploading 1 narinfos"6353lb # [ 158.498166] niks3-server[1195]: 2026/09/24 12:27:56 INFO Signed narinfos id=50 count=16354lb # [ 158.500292] niks3-server[1195]: 2026/09/24 12:27:56 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6355lb # [ 158.517343] niks3-server[1195]: 2026/09/24 12:27:56 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6356lb # [ 158.521134] niks3-server[1195]: 2026/09/24 12:27:56 INFO Received complete push request method=POST path=/api/pushes/50/complete6357lb # [ 158.523071] niks3-server[1195]: 2026/09/24 12:27:56 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls6358lb # [ 158.530607] niks3-server[1195]: 2026/09/24 12:27:56 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo6359worker1 # [ 158.540515] nix-grpc-daemon[1695]: time=2026-09-24T12:27:56.829Z level=INFO msg="Upload complete. (208ms)"6360worker1 # [ 158.546733] nix-grpc-daemon[1593]: ts=2026-09-24T12:27:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34830 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06361worker1 # [ 158.562385] nix-daemon[866]: reaped child process 1668, status = succeeded6362client # [ 158.573551] systemd[1]: mid.service: Deactivated successfully.6363client # [ 158.577894] systemd[1]: mid.service: Consumed 143ms CPU time over 8.295s wall clock time, 43.4M memory peak, 8.6K incoming IP traffic, 10.2K outgoing IP traffic.6364client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds)6365client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6366client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)6367(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.12 seconds)6368subtest: interrupting the client stops the build on the worker6369client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr6370client # [ 159.378808] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr.6371client # Running as unit: intr.service; invocation ID: 51fa31a4add642f39747634cadfeb6d36372client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds)6373worker2 # [ 159.512377] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:586186374worker2 # [ 159.524127] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6375client # [ 159.522821] nix[1433]: don't know how to build these paths:6376client # [ 159.523722] nix[1433]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6377worker2 # [ 159.542162] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:58Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=06378worker2 # [ 159.546161] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:58Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=16379worker2 # [ 159.551317] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186380worker2 # [ 159.558764] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5)6381worker2 # [ 159.565896] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 2/5)6382worker2 # [ 159.615914] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 3/5)6383worker2 # [ 159.814913] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 267 ms (attempt 4/5)6384worker2 # [ 160.084338] nix-grpc-daemon[1580]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6385worker2 # [ 160.087291] nix-grpc-daemon[1580]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6386worker2 # [ 160.104721] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586186387client # [ 160.104196] nix[1433]: copying 1 paths to 'lb:50051'...6388worker2 # [ 160.117202] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:586186389client # [ 160.107989] nix[1433]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...6390worker2 # [ 160.125498] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6391worker2 # [ 160.147104] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:59Z level=info event=niks3_push_started pid=16566392worker2 # [ 160.254380] nix-grpc-daemon[1656]: time=2026-09-24T12:27:59.423Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""6393worker2 # [ 160.344094] nix-daemon[856]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6394worker2 # [ 160.356352] nix-daemon[856]: reaped child process 1672, status = succeeded6395lb # [ 160.348377] niks3-server[1195]: 2026/09/24 12:27:58 INFO Received push request method=POST path=/api/pushes6396worker2 # [ 160.374974] nix-grpc-daemon[1656]: time=2026-09-24T12:27:59.544Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6397worker2 # [ 160.376548] nix-grpc-daemon[1656]: time=2026-09-24T12:27:59.545Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6398lb # [ 160.387391] niks3-server[1195]: 2026/09/24 12:27:58 INFO Received sign narinfos request method=POST path=/api/pushes/51/sign6399lb # [ 160.392960] niks3-server[1195]: 2026/09/24 12:27:58 INFO Signed narinfos id=51 count=16400worker2 # [ 160.412641] nix-grpc-daemon[1656]: time=2026-09-24T12:27:59.581Z level=INFO msg="Uploading 1 narinfos"6401lb # [ 160.396633] niks3-server[1195]: 2026/09/24 12:27:58 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6402lb # [ 160.411855] niks3-server[1195]: 2026/09/24 12:27:58 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6403lb # [ 160.418702] niks3-server[1195]: 2026/09/24 12:27:58 INFO Received complete push request method=POST path=/api/pushes/51/complete6404worker2 # [ 160.441929] nix-grpc-daemon[1656]: time=2026-09-24T12:27:59.611Z level=INFO msg="Upload complete. (184ms)"6405lb # [ 160.427248] niks3-server[1195]: 2026/09/24 12:27:58 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6406worker2 # [ 160.444181] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=0 paths=1 nar_bytes_in=4246407worker2 # [ 160.447769] nix-grpc-daemon[1580]: ts=2026-09-24T12:27:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186408worker2 # [ 160.454750] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6409worker2 # [ 160.457120] nix-daemon[856]: reaped child process 1654, status = succeeded6410worker2 # [ 160.462149] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6411client # [ 160.450291] nix[1433]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6412client: must succeed: systemctl kill -s INT intr6413client # [ 161.699876] systemd[1]: intr.service: Sent signal SIGINT to main process 1433 (nix) on client request.6414worker2 # [ 161.714120] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:00Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6415client # [ 161.707292] nix[1433]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6416client # [ 161.712871] nix[1433]: error: interrupted by the user6417client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)6418client # [ 161.742756] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6419client # [ 161.745495] systemd[1]: intr.service: Failed with result 'exit-code'.6420client # [ 161.749547] systemd[1]: intr.service: Consumed 116ms CPU time over 2.369s wall clock time, 43.4M memory peak, 6.3K incoming IP traffic, 8K outgoing IP traffic.6421worker2 # [ 161.879287] nix-daemon[1676]: unexpected Nix daemon error: error: interrupted by the user6422worker2 # [ 161.881406] nix-daemon[856]: reaped child process 1674, status = succeeded6423worker2 # [ 161.885413] nix-daemon[856]: reaped child process 1676, status = failed with exit code 16424(finished: subtest: interrupting the client stops the build on the worker, in 3.52 seconds)6425subtest: a deploy mid-build drains: the build finishes, the new generation takes over6426client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw6427client # [ 162.919707] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw.6428client # Running as unit: sw.service; invocation ID: f3da9d023e9f43639a822e6070df97736429client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.06 seconds)6430client # [ 163.058752] nix[1453]: don't know how to build these paths:6431client # [ 163.059620] nix[1453]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6432worker2 # [ 163.069544] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:586186433worker2 # [ 163.081158] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:02Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06434worker2 # [ 163.085394] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:02Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=16435worker1 # [ 163.088352] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348306436worker1 # [ 163.096129] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348306437client # [ 163.096155] nix[1453]: copying 1 paths to 'lb:50051'...6438client # [ 163.096945] nix[1453]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6439worker1 # [ 163.103280] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348306440worker1 # [ 163.108992] nix-daemon[866]: accepted connection from pid 1593, user nix-grpc-daemon (trusted)6441worker1 # [ 163.196297] nix-daemon[866]: accepted connection from pid 1739, user nix-grpc-daemon (trusted)6442worker1 # [ 163.208639] nix-daemon[866]: reaped child process 1742, status = succeeded6443lb # [ 163.208699] niks3-server[1195]: 2026/09/24 12:28:01 INFO Received push request method=POST path=/api/pushes6444worker1 # [ 163.226658] nix-grpc-daemon[1695]: time=2026-09-24T12:28:01.515Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6445worker1 # [ 163.229088] nix-grpc-daemon[1695]: time=2026-09-24T12:28:01.517Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6446lb # [ 163.238586] niks3-server[1195]: 2026/09/24 12:28:01 INFO Received sign narinfos request method=POST path=/api/pushes/52/sign6447worker1 # [ 163.258639] nix-grpc-daemon[1695]: time=2026-09-24T12:28:01.547Z level=INFO msg="Uploading 1 narinfos"6448lb # [ 163.247671] niks3-server[1195]: 2026/09/24 12:28:01 INFO Signed narinfos id=52 count=16449lb # [ 163.256283] niks3-server[1195]: 2026/09/24 12:28:01 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6450lb # [ 163.261386] niks3-server[1195]: 2026/09/24 12:28:01 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6451lb # [ 163.273152] niks3-server[1195]: 2026/09/24 12:28:01 INFO Received complete push request method=POST path=/api/pushes/52/complete6452worker1 # [ 163.294214] nix-grpc-daemon[1695]: time=2026-09-24T12:28:01.583Z level=INFO msg="Upload complete. (180ms)"6453lb # [ 163.284394] niks3-server[1195]: 2026/09/24 12:28:01 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6454worker1 # [ 163.296596] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34830 duration_s=0 paths=1 nar_bytes_in=4166455worker1 # [ 163.299254] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348306456worker1 # [ 163.306976] nix-daemon[866]: accepted connection from pid 1593, user nix-grpc-daemon (trusted)6457worker1 # [ 163.309360] nix-daemon[866]: reaped child process 1737, status = succeeded6458worker1 # [ 163.314732] nix-daemon[866]: accepted connection from pid 1593, user nix-grpc-daemon (trusted)6459client # [ 163.307846] nix[1453]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6460worker1: must succeed: systemctl reload nix-grpc-daemon.service6461worker1 # [ 165.298311] systemd[1]: Reloading Nix worker-protocol over gRPC...6462worker1 # [ 165.325244] systemd[1]: Reloaded Nix worker-protocol over gRPC.6463worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.06 seconds)6464worker1: must succeed: pgrep -f 'read -t [9]0 x'6465worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.03 seconds)6466client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&26467worker2 # [ 165.510668] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:586186468client # don't know how to build these paths:6469client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6470worker2 # [ 165.518601] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586186471worker2 # [ 165.542250] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:04Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06472worker2 # [ 165.547546] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:04Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=16473worker2 # [ 165.552984] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186474worker2 # [ 165.564361] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586186475client # copying 1 paths to 'lb:50051'...6476worker2 # [ 165.575541] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:586186477client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6478worker2 # [ 165.592856] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6479worker2 # [ 165.691576] nix-daemon[856]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6480worker2 # [ 165.704386] nix-daemon[856]: reaped child process 1734, status = succeeded6481lb # [ 165.697736] niks3-server[1195]: 2026/09/24 12:28:04 INFO Received push request method=POST path=/api/pushes6482worker2 # [ 165.723107] nix-grpc-daemon[1656]: time=2026-09-24T12:28:04.892Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6483worker2 # [ 165.725381] nix-grpc-daemon[1656]: time=2026-09-24T12:28:04.893Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6484lb # [ 165.735355] niks3-server[1195]: 2026/09/24 12:28:04 INFO Received sign narinfos request method=POST path=/api/pushes/53/sign6485lb # [ 165.737738] niks3-server[1195]: 2026/09/24 12:28:04 INFO Signed narinfos id=53 count=16486worker2 # [ 165.754022] nix-grpc-daemon[1656]: time=2026-09-24T12:28:04.922Z level=INFO msg="Uploading 1 narinfos"6487lb # [ 165.741808] niks3-server[1195]: 2026/09/24 12:28:04 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6488lb # [ 165.744995] niks3-server[1195]: 2026/09/24 12:28:04 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6489lb # [ 165.748899] niks3-server[1195]: 2026/09/24 12:28:04 INFO Received complete push request method=POST path=/api/pushes/53/complete6490lb # [ 165.755335] niks3-server[1195]: 2026/09/24 12:28:04 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6491worker2 # [ 165.774202] nix-grpc-daemon[1656]: time=2026-09-24T12:28:04.943Z level=INFO msg="Upload complete. (170ms)"6492worker2 # [ 165.776465] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=0 paths=1 nar_bytes_in=5286493worker2 # [ 165.781235] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186494worker2 # [ 165.788771] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6495worker2 # [ 165.791441] nix-daemon[856]: reaped child process 1729, status = succeeded6496worker2 # [ 165.796205] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6497client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6498client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6499worker1 # [ 165.944768] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:04Z level=info event=draining6500lb # [ 166.354179] envoy[907]: conn peer=[2001:db8:1::1]:56058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3891 tx=1926 ms=81356501lb # [ 166.357948] envoy[907]: conn peer=[2001:db8:1::1]:59232 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=812 ms=22286502client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6503client # farm-a> LOG-farm-a-during-drain6504worker2 # [ 167.034553] nix-daemon[856]: reaped child process 1738, status = succeeded6505worker2 # [ 167.112628] nix-daemon[856]: accepted connection from pid 1754, user nix-grpc-daemon (trusted)6506worker2 # [ 167.125283] nix-daemon[856]: reaped child process 1757, status = succeeded6507lb # [ 167.117740] niks3-server[1195]: 2026/09/24 12:28:05 INFO Received push request method=POST path=/api/pushes6508worker2 # [ 167.143967] nix-grpc-daemon[1656]: time=2026-09-24T12:28:06.313Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6509worker2 # [ 167.145507] nix-grpc-daemon[1656]: time=2026-09-24T12:28:06.314Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6510lb # [ 167.155219] niks3-server[1195]: 2026/09/24 12:28:05 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6511lb # [ 167.172111] niks3-server[1195]: 2026/09/24 12:28:05 INFO Received sign narinfos request method=POST path=/api/pushes/54/sign6512lb # [ 167.176246] niks3-server[1195]: 2026/09/24 12:28:05 INFO Signed narinfos id=54 count=16513worker2 # [ 167.194741] nix-grpc-daemon[1656]: time=2026-09-24T12:28:06.363Z level=INFO msg="Uploading 1 narinfos"6514lb # [ 167.179414] niks3-server[1195]: 2026/09/24 12:28:05 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6515lb # [ 167.191244] niks3-server[1195]: 2026/09/24 12:28:05 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6516lb # [ 167.195358] niks3-server[1195]: 2026/09/24 12:28:05 INFO Received complete push request method=POST path=/api/pushes/54/complete6517lb # [ 167.200373] niks3-server[1195]: 2026/09/24 12:28:05 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6518worker2 # [ 167.214933] nix-grpc-daemon[1656]: time=2026-09-24T12:28:06.384Z level=INFO msg="Upload complete. (210ms)"6519worker2 # [ 167.225991] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06520worker2 # [ 167.232560] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:06Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06521worker2 # [ 167.237182] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:06Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16522worker2 # [ 167.242286] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186523worker2 # [ 167.251114] nix-daemon[856]: reaped child process 1736, status = succeeded6524worker2 # [ 167.252697] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586186525worker2 # [ 167.259560] nix-grpc-daemon[1656]: time=2026-09-24T12:28:06.428Z level=INFO msg="All 1 paths already cached"6526client # copying 1 paths to 'lb:50051'...6527worker2 # [ 167.265163] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:586186528client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6529worker2 # [ 167.281790] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6530worker2 # [ 167.368792] nix-daemon[856]: accepted connection from pid 1763, user nix-grpc-daemon (trusted)6531worker2 # [ 167.382273] nix-daemon[856]: reaped child process 1766, status = succeeded6532lb # [ 167.372714] niks3-server[1195]: 2026/09/24 12:28:05 INFO Received push request method=POST path=/api/pushes6533worker2 # [ 167.396036] nix-grpc-daemon[1656]: time=2026-09-24T12:28:06.565Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6534worker2 # [ 167.397577] nix-grpc-daemon[1656]: time=2026-09-24T12:28:06.566Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6535lb # [ 167.403856] niks3-server[1195]: 2026/09/24 12:28:05 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6536lb # [ 167.410453] niks3-server[1195]: 2026/09/24 12:28:05 INFO Received sign narinfos request method=POST path=/api/pushes/55/sign6537lb # [ 167.417248] niks3-server[1195]: 2026/09/24 12:28:05 INFO Signed narinfos id=55 count=16538worker2 # [ 167.436396] nix-grpc-daemon[1656]: time=2026-09-24T12:28:06.605Z level=INFO msg="Uploading 1 narinfos"6539lb # [ 167.426237] niks3-server[1195]: 2026/09/24 12:28:05 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6540lb # [ 167.437446] niks3-server[1195]: 2026/09/24 12:28:05 INFO Received complete push request method=POST path=/api/pushes/55/complete6541lb # [ 167.449217] niks3-server[1195]: 2026/09/24 12:28:05 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6542worker2 # [ 167.462932] nix-grpc-daemon[1656]: time=2026-09-24T12:28:06.632Z level=INFO msg="Upload complete. (175ms)"6543worker2 # [ 167.467063] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=0 paths=1 nar_bytes_in=6406544worker2 # [ 167.471793] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186545worker2 # [ 167.485103] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6546worker2 # [ 167.487518] nix-daemon[856]: reaped child process 1761, status = succeeded6547worker2 # [ 167.492757] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6548client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6549client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6550client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6551client # farm-b> LOG-farm-b-during-drain6552worker2 # [ 168.525908] nix-daemon[856]: reaped child process 1770, status = succeeded6553worker2 # [ 168.611797] nix-daemon[856]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)6554worker2 # [ 168.624612] nix-daemon[856]: reaped child process 1789, status = succeeded6555lb # [ 168.617475] niks3-server[1195]: 2026/09/24 12:28:06 INFO Received push request method=POST path=/api/pushes6556worker2 # [ 168.641836] nix-grpc-daemon[1656]: time=2026-09-24T12:28:07.810Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6557worker2 # [ 168.644159] nix-grpc-daemon[1656]: time=2026-09-24T12:28:07.812Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6558lb # [ 168.657087] niks3-server[1195]: 2026/09/24 12:28:06 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6559lb # [ 168.666827] niks3-server[1195]: 2026/09/24 12:28:06 INFO Received sign narinfos request method=POST path=/api/pushes/56/sign6560lb # [ 168.671787] niks3-server[1195]: 2026/09/24 12:28:06 INFO Signed narinfos id=56 count=16561worker2 # [ 168.690763] nix-grpc-daemon[1656]: time=2026-09-24T12:28:07.859Z level=INFO msg="Uploading 1 narinfos"6562lb # [ 168.676354] niks3-server[1195]: 2026/09/24 12:28:06 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6563lb # [ 168.688090] niks3-server[1195]: 2026/09/24 12:28:07 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6564lb # [ 168.696367] niks3-server[1195]: 2026/09/24 12:28:07 INFO Received complete push request method=POST path=/api/pushes/56/complete6565lb # [ 168.706375] niks3-server[1195]: 2026/09/24 12:28:07 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6566worker2 # [ 168.721153] nix-grpc-daemon[1656]: time=2026-09-24T12:28:07.890Z level=INFO msg="Upload complete. (218ms)"6567worker2 # [ 168.727733] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=06568worker2 # [ 168.740779] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:07Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06569worker2 # [ 168.746268] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:07Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16570worker2 # [ 168.750464] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186571worker2 # [ 168.761990] nix-daemon[856]: reaped child process 1768, status = succeeded6572worker2 # [ 168.768224] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586186573worker2 # [ 168.776892] nix-grpc-daemon[1656]: time=2026-09-24T12:28:07.946Z level=INFO msg="All 2 paths already cached"6574client # copying 1 paths to 'lb:50051'...6575worker2 # [ 168.785247] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:586186576client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6577worker2 # [ 168.804252] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6578worker2 # [ 168.898026] nix-daemon[856]: accepted connection from pid 1795, user nix-grpc-daemon (trusted)6579worker2 # [ 168.911845] nix-daemon[856]: reaped child process 1798, status = succeeded6580lb # [ 168.901924] niks3-server[1195]: 2026/09/24 12:28:07 INFO Received push request method=POST path=/api/pushes6581worker2 # [ 168.925630] nix-grpc-daemon[1656]: time=2026-09-24T12:28:08.094Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6582worker2 # [ 168.927152] nix-grpc-daemon[1656]: time=2026-09-24T12:28:08.096Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6583lb # [ 168.931912] niks3-server[1195]: 2026/09/24 12:28:07 INFO Received sign narinfos request method=POST path=/api/pushes/57/sign6584lb # [ 168.938133] niks3-server[1195]: 2026/09/24 12:28:07 INFO Signed narinfos id=57 count=16585worker2 # [ 168.957076] nix-grpc-daemon[1656]: time=2026-09-24T12:28:08.126Z level=INFO msg="Uploading 1 narinfos"6586lb # [ 168.945387] niks3-server[1195]: 2026/09/24 12:28:07 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6587lb # [ 168.960356] niks3-server[1195]: 2026/09/24 12:28:07 INFO Received complete push request method=POST path=/api/pushes/57/complete6588worker2 # [ 168.984655] nix-grpc-daemon[1656]: time=2026-09-24T12:28:08.153Z level=INFO msg="Upload complete. (170ms)"6589lb # [ 168.970425] niks3-server[1195]: 2026/09/24 12:28:07 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6590lb # [ 168.973863] niks3-server[1195]: 2026/09/24 12:28:07 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6591worker2 # [ 168.988698] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=0 paths=1 nar_bytes_in=7686592worker2 # [ 168.994276] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186593worker2 # [ 169.003265] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6594worker2 # [ 169.008983] nix-daemon[856]: reaped child process 1793, status = succeeded6595worker2 # [ 169.013106] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6596client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6597client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6598client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6599client # farm-top> LOG-farm-top-during-drain6600worker2 # [ 170.449271] nix-daemon[856]: reaped child process 1802, status = succeeded6601worker2 # [ 170.533414] nix-daemon[856]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)6602worker2 # [ 170.547775] nix-daemon[856]: reaped child process 1821, status = succeeded6603lb # [ 170.539723] niks3-server[1195]: 2026/09/24 12:28:08 INFO Received push request method=POST path=/api/pushes6604worker2 # [ 170.566386] nix-grpc-daemon[1656]: time=2026-09-24T12:28:09.735Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6605worker2 # [ 170.567910] nix-grpc-daemon[1656]: time=2026-09-24T12:28:09.737Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6606lb # [ 170.579740] niks3-server[1195]: 2026/09/24 12:28:08 INFO Received sign narinfos request method=POST path=/api/pushes/58/sign6607lb # [ 170.584543] niks3-server[1195]: 2026/09/24 12:28:08 INFO Signed narinfos id=58 count=16608worker2 # [ 170.604204] nix-grpc-daemon[1656]: time=2026-09-24T12:28:09.773Z level=INFO msg="Uploading 1 narinfos"6609lb # [ 170.596270] niks3-server[1195]: 2026/09/24 12:28:08 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6610lb # [ 170.601559] niks3-server[1195]: 2026/09/24 12:28:08 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6611lb # [ 170.605265] niks3-server[1195]: 2026/09/24 12:28:08 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6612lb # [ 170.613663] niks3-server[1195]: 2026/09/24 12:28:08 INFO Received complete push request method=POST path=/api/pushes/58/complete6613worker2 # [ 170.632944] nix-grpc-daemon[1656]: time=2026-09-24T12:28:09.802Z level=INFO msg="Upload complete. (210ms)"6614lb # [ 170.618431] niks3-server[1195]: 2026/09/24 12:28:08 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6615worker2 # [ 170.640618] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=06616worker2 # [ 170.653950] nix-daemon[856]: reaped child process 1800, status = succeeded6617client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 5.31 seconds)6618client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath6619client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.12 seconds)6620worker1: must succeed: pkill -f 'read -t [9]0 x'6621worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds)6622client: waiting for success: ! systemctl is-active sw6623worker1 # [ 170.952275] nix-daemon[866]: reaped child process 1746, status = succeeded6624worker1 # [ 171.023655] nix-daemon[866]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)6625worker1 # [ 171.037195] nix-daemon[866]: reaped child process 1790, status = succeeded6626lb # [ 171.033323] niks3-server[1195]: 2026/09/24 12:28:09 INFO Received push request method=POST path=/api/pushes6627worker1 # [ 171.051517] nix-grpc-daemon[1695]: time=2026-09-24T12:28:09.340Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6628worker1 # [ 171.053104] nix-grpc-daemon[1695]: time=2026-09-24T12:28:09.342Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6629lb # [ 171.073157] niks3-server[1195]: 2026/09/24 12:28:09 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6630lb # [ 171.083532] niks3-server[1195]: 2026/09/24 12:28:09 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6631lb # [ 171.091483] niks3-server[1195]: 2026/09/24 12:28:09 INFO Received sign narinfos request method=POST path=/api/pushes/59/sign6632lb # [ 171.097748] niks3-server[1195]: 2026/09/24 12:28:09 INFO Signed narinfos id=59 count=16633worker1 # [ 171.110826] nix-grpc-daemon[1695]: time=2026-09-24T12:28:09.399Z level=INFO msg="Uploading 1 narinfos"6634lb # [ 171.100590] niks3-server[1195]: 2026/09/24 12:28:09 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6635lb # [ 171.112970] niks3-server[1195]: 2026/09/24 12:28:09 INFO Received complete push request method=POST path=/api/pushes/59/complete6636lb # [ 171.117135] niks3-server[1195]: 2026/09/24 12:28:09 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6637worker1 # [ 171.127184] nix-grpc-daemon[1695]: time=2026-09-24T12:28:09.416Z level=INFO msg="Upload complete. (199ms)"6638worker1 # [ 171.134682] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34830 duration_s=7 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06639worker1 # [ 171.149583] nix-daemon[866]: reaped child process 1744, status = succeeded6640client # [ 171.159586] systemd[1]: sw.service: Deactivated successfully.6641client # [ 171.163985] systemd[1]: sw.service: Consumed 128ms CPU time over 8.243s wall clock time, 41.4M memory peak, 7K incoming IP traffic, 8.2K outgoing IP traffic.6642client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds)6643client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6644client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6645worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6646worker1 # [ 171.949728] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:10Z level=info event=signal_exit6647worker1 # [ 173.948915] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:12Z level=info event=scheduler_restarting6648worker2 # [ 173.963854] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:585846649worker2 # [ 173.970851] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:13Z level=info event=worker_gone addr=192.168.1.3:500516650worker1 # [ 173.969899] nix-grpc-daemon[1593]: ts=2026-09-24T12:28:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6651worker1 # [ 173.989270] nix-daemon[866]: reaped child process 1661, status = succeeded6652worker1 # [ 175.971368] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6653worker1 # [ 175.975421] systemd[1]: nix-grpc-daemon.service: Consumed 562ms CPU time over 26.146s wall clock time, 34.9M memory peak, 48.2K incoming IP traffic, 57.1K outgoing IP traffic.6654worker1 # [ 175.988226] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6655worker1 # [ 175.999111] systemd[1]: Starting Nix worker-protocol over gRPC...6656worker1 # [ 176.086281] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6657worker1 # [ 176.088326] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6658worker1 # [ 176.091529] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16659worker1 # [ 176.095882] nix-grpc-daemon[1805]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6660worker1 # [ 176.097205] nix-grpc-daemon[1805]: E0000 00:00:1790252894.384769 1805 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6661worker1 # [ 176.101153] nix-grpc-daemon[1805]: E0000 00:00:1790252894.390169 1805 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6662worker1 # [ 176.106934] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:14Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket6663worker1 # [ 176.110293] systemd[1]: Started Nix worker-protocol over gRPC.6664worker1 # [ 176.112948] nix-grpc-daemon[1805]: E0000 00:00:1790252894.402040 1848 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6665worker1 # [ 176.128082] nix-grpc-daemon[1805]: E0000 00:00:1790252894.415426 1848 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6666worker1 # [ 176.130284] nix-grpc-daemon[1805]: E0000 00:00:1790252894.415758 1848 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6667worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 4.21 seconds)6668lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux6669lb: must succeed: curl -sf localhost:9901/clusters6670worker1 # [ 176.141066] nix-grpc-daemon[1805]: E0000 00:00:1790252894.430129 1848 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6671worker1 # [ 176.155424] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:14Z level=info event=scheduler_connected addr=lb:500516672worker2 # [ 176.164301] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:585846673worker2 # [ 176.171457] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06674lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6675lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 0.05 seconds)6676lb: must succeed: curl -sf localhost:9901/clusters6677lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6678worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6679worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6680(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.37 seconds)6681subtest: queue gauges show a burst while every build blocks6682lb: must succeed: curl -sf localhost:9901/clusters6683lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6684lb: must succeed: curl -sf localhost:9901/clusters6685lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6686worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6687worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6688client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]'6689lb # [ 176.354198] envoy[907]: conn peer=[2001:db8:1::1]:34358 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9581 tx=4388 ms=51466690lb # [ 176.357905] envoy[907]: conn peer=[2001:db8:1::1]:34352 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2945 tx=1497 ms=80816691lb # [ 176.361314] envoy[907]: conn peer=[2001:db8:1::3]:42636 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1148 tx=482 ms=239866692client # [ 176.389260] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]".6693client # Running as unit: burst.service; invocation ID: 1fb98ab7172d4b11b066a6fa3a3d96e06694client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.06 seconds)6695lb: must succeed: curl -sf localhost:9901/clusters6696lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6697lb: must succeed: curl -sf localhost:9901/clusters6698lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6699worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6700worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6701worker1 # [ 176.549910] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:421386702worker1 # [ 176.560601] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6703client # [ 176.567226] nix[1509]: don't know how to build these paths:6704client # [ 176.568632] nix[1509]: /nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv6705client # [ 176.569772] nix[1509]: /nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv6706client # [ 176.570940] nix[1509]: /nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv6707client # [ 176.571922] nix[1509]: /nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv6708worker2 # [ 176.587262] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=debug event=want client=5 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv cached=06709worker1 # [ 176.589989] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421386710worker2 # [ 176.592324] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=debug event=assigned drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv worker=192.168.1.4:50051 clients=16711worker2 # [ 176.599474] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=debug event=want client=5 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv cached=06712worker2 # [ 176.603374] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=debug event=assigned drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker=192.168.1.3:50051 clients=16713worker1 # [ 176.601137] nix-grpc-daemon[1805]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 1/5)6714worker2 # [ 176.608561] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=debug event=want client=5 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv cached=06715worker2 # [ 176.612477] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=debug event=want client=5 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv cached=06716worker2 # [ 176.616923] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186717worker2 # [ 176.625881] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586186718client # [ 176.624169] nix[1509]: copying 1 paths to 'lb:50051'...6719client # [ 176.626979] nix[1509]: copying path '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' to 'lb:50051'...6720worker2 # [ 176.639696] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:586186721worker2 # [ 176.650354] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6722worker1 # [ 176.702739] nix-grpc-daemon[1805]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 2/5)6723worker2 # [ 176.745241] nix-daemon[856]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6724worker2 # [ 176.758988] nix-daemon[856]: reaped child process 1839, status = succeeded6725worker1 # [ 176.756580] nix-grpc-daemon[1805]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 277 ms (attempt 3/5)6726lb # [ 176.750463] niks3-server[1195]: 2026/09/24 12:28:15 INFO Received push request method=POST path=/api/pushes6727worker2 # [ 176.775516] nix-grpc-daemon[1656]: time=2026-09-24T12:28:15.944Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6728worker2 # [ 176.777520] nix-grpc-daemon[1656]: time=2026-09-24T12:28:15.946Z level=INFO msg="Uploading 2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv (416B)"6729lb # [ 176.784335] niks3-server[1195]: 2026/09/24 12:28:15 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.ls6730lb # [ 176.787159] niks3-server[1195]: 2026/09/24 12:28:15 INFO Received sign narinfos request method=POST path=/api/pushes/60/sign6731worker2 # [ 176.807109] nix-grpc-daemon[1656]: time=2026-09-24T12:28:15.976Z level=INFO msg="Uploading 1 narinfos"6732lb # [ 176.791207] niks3-server[1195]: 2026/09/24 12:28:15 INFO Signed narinfos id=60 count=16733lb # [ 176.800651] niks3-server[1195]: 2026/09/24 12:28:15 INFO Registered completed upload object_key=nar/0raymp7y3ngiv7lj2qq6nkp63sms2510yhhlnr7hnz7ldnl7b3qc.nar.zst6734lb # [ 176.807314] niks3-server[1195]: 2026/09/24 12:28:15 INFO Received complete push request method=POST path=/api/pushes/60/complete6735worker2 # [ 176.828298] nix-grpc-daemon[1656]: time=2026-09-24T12:28:15.997Z level=INFO msg="Upload complete. (169ms)"6736lb # [ 176.815617] niks3-server[1195]: 2026/09/24 12:28:15 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.narinfo6737worker2 # [ 176.830340] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=0 paths=1 nar_bytes_in=4166738worker2 # [ 176.834270] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186739worker2 # [ 176.842860] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6740worker2 # [ 176.847733] nix-daemon[856]: reaped child process 1834, status = succeeded6741worker2 # [ 176.851801] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6742client # [ 176.839994] nix[1509]: building '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' on lb:50051...6743worker1 # [ 177.035943] nix-grpc-daemon[1805]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 398 ms (attempt 4/5)6744worker1 # [ 177.436969] nix-grpc-daemon[1805]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6745worker1 # [ 177.441160] nix-grpc-daemon[1805]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6746worker1 # [ 177.458161] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421386747client # [ 177.464241] nix[1509]: copying 1 paths to 'lb:50051'...6748client # [ 177.468114] nix[1509]: copying path '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' to 'lb:50051'...6749worker1 # [ 177.474581] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421386750worker1 # [ 177.482781] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6751worker1 # [ 177.506291] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:15Z level=info event=niks3_push_started pid=18656752lb: must succeed: curl -sf localhost:9901/clusters6753lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6754lb: must succeed: curl -sf localhost:9901/clusters6755lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6756worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6757worker1 # [ 177.613167] nix-grpc-daemon[1865]: time=2026-09-24T12:28:15.901Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""6758worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6759worker1 # [ 177.716439] nix-daemon[866]: accepted connection from pid 1878, user nix-grpc-daemon (trusted)6760worker1 # [ 177.730821] nix-daemon[866]: reaped child process 1885, status = succeeded6761lb # [ 177.725724] niks3-server[1195]: 2026/09/24 12:28:16 INFO Received push request method=POST path=/api/pushes6762worker1 # [ 177.744854] nix-grpc-daemon[1865]: time=2026-09-24T12:28:16.032Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6763worker1 # [ 177.746265] nix-grpc-daemon[1865]: time=2026-09-24T12:28:16.033Z level=INFO msg="Uploading 885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv (416B)"6764lb # [ 177.762261] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=nar/0mmcg3cvna05ngbx6v5vspkmc5gj8lna2zc48rllhxr0g8i9mg6y.nar.zst6765lb # [ 177.769080] niks3-server[1195]: 2026/09/24 12:28:16 INFO Received sign narinfos request method=POST path=/api/pushes/61/sign6766lb # [ 177.776616] niks3-server[1195]: 2026/09/24 12:28:16 INFO Signed narinfos id=61 count=16767worker1 # [ 177.790281] nix-grpc-daemon[1865]: time=2026-09-24T12:28:16.079Z level=INFO msg="Uploading 1 narinfos"6768lb # [ 177.789147] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.ls6769lb # [ 177.799557] niks3-server[1195]: 2026/09/24 12:28:16 INFO Received complete push request method=POST path=/api/pushes/61/complete6770lb # [ 177.804162] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.narinfo6771worker1 # [ 177.818482] nix-grpc-daemon[1865]: time=2026-09-24T12:28:16.107Z level=INFO msg="Upload complete. (201ms)"6772worker1 # [ 177.823196] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=4166773worker1 # [ 177.829086] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421386774worker1 # [ 177.837106] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6775worker1 # [ 177.844950] nix-daemon[866]: reaped child process 1863, status = succeeded6776worker1 # [ 177.849225] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6777client # [ 177.843353] nix[1509]: building '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' on lb:50051...6778worker2 # [ 177.884346] nix-daemon[856]: reaped child process 1843, status = succeeded6779worker2 # [ 177.953206] nix-daemon[856]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)6780worker2 # [ 177.966042] nix-daemon[856]: reaped child process 1870, status = succeeded6781lb # [ 177.957158] niks3-server[1195]: 2026/09/24 12:28:16 INFO Received push request method=POST path=/api/pushes6782worker2 # [ 177.981193] nix-grpc-daemon[1656]: time=2026-09-24T12:28:17.150Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6783worker2 # [ 177.982764] nix-grpc-daemon[1656]: time=2026-09-24T12:28:17.151Z level=INFO msg="Uploading vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq-slow-q3 (120B)"6784lb # [ 178.004180] niks3-server[1195]: 2026/09/24 12:28:16 INFO Received sign narinfos request method=POST path=/api/pushes/62/sign6785lb # [ 178.011786] niks3-server[1195]: 2026/09/24 12:28:16 INFO Signed narinfos id=62 count=16786worker2 # [ 178.031486] nix-grpc-daemon[1656]: time=2026-09-24T12:28:17.200Z level=INFO msg="Uploading 1 narinfos"6787lb # [ 178.016466] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst6788lb # [ 178.022442] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.ls6789lb # [ 178.027609] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=log/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv6790lb # [ 178.036227] niks3-server[1195]: 2026/09/24 12:28:16 INFO Received complete push request method=POST path=/api/pushes/62/complete6791worker2 # [ 178.056870] nix-grpc-daemon[1656]: time=2026-09-24T12:28:17.226Z level=INFO msg="Upload complete. (198ms)"6792lb # [ 178.042837] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.narinfo6793worker2 # [ 178.065427] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=1 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv assign_id=7 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06794worker2 # [ 178.073310] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:17Z level=debug event=assigned drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker=192.168.1.4:50051 clients=16795worker2 # [ 178.077529] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186796worker2 # [ 178.086819] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586186797worker2 # [ 178.093857] nix-daemon[856]: reaped child process 1841, status = succeeded6798client # [ 178.083299] nix[1509]: copying 1 paths to 'lb:50051'...6799worker2 # [ 178.095354] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:586186800client # [ 178.085483] nix[1509]: copying path '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' to 'lb:50051'...6801worker2 # [ 178.102922] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6802worker2 # [ 178.189764] nix-daemon[856]: accepted connection from pid 1874, user nix-grpc-daemon (trusted)6803worker2 # [ 178.203417] nix-daemon[856]: reaped child process 1877, status = succeeded6804lb # [ 178.193694] niks3-server[1195]: 2026/09/24 12:28:16 INFO Received push request method=POST path=/api/pushes6805worker2 # [ 178.217313] nix-grpc-daemon[1656]: time=2026-09-24T12:28:17.386Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6806worker2 # [ 178.219347] nix-grpc-daemon[1656]: time=2026-09-24T12:28:17.388Z level=INFO msg="Uploading 8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv (416B)"6807lb # [ 178.222865] niks3-server[1195]: 2026/09/24 12:28:16 INFO Received sign narinfos request method=POST path=/api/pushes/63/sign6808worker2 # [ 178.245377] nix-grpc-daemon[1656]: time=2026-09-24T12:28:17.414Z level=INFO msg="Uploading 1 narinfos"6809lb # [ 178.229686] niks3-server[1195]: 2026/09/24 12:28:16 INFO Signed narinfos id=63 count=16810lb # [ 178.236515] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=nar/1xibay372y9by9a678y9h7bfzwahsxi0vq51acgywak31q6q2m87.nar.zst6811lb # [ 178.247762] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.ls6812lb # [ 178.256174] niks3-server[1195]: 2026/09/24 12:28:16 INFO Received complete push request method=POST path=/api/pushes/63/complete6813worker2 # [ 178.279932] nix-grpc-daemon[1656]: time=2026-09-24T12:28:17.449Z level=INFO msg="Upload complete. (171ms)"6814lb # [ 178.265381] niks3-server[1195]: 2026/09/24 12:28:16 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.narinfo6815worker2 # [ 178.284268] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=0 paths=1 nar_bytes_in=4166816worker2 # [ 178.290403] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586186817worker2 # [ 178.301113] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6818worker2 # [ 178.307114] nix-daemon[856]: reaped child process 1872, status = succeeded6819worker2 # [ 178.310348] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)6820client # [ 178.298541] nix[1509]: building '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' on lb:50051...6821worker1 # [ 180.067281] nix-daemon[866]: reaped child process 1889, status = succeeded6822worker1 # [ 180.142658] nix-daemon[866]: accepted connection from pid 1914, user nix-grpc-daemon (trusted)6823worker2 # [ 180.149058] nix-daemon[856]: reaped child process 1881, status = succeeded6824worker1 # [ 180.155577] nix-daemon[866]: reaped child process 1917, status = succeeded6825lb # [ 180.153172] niks3-server[1195]: 2026/09/24 12:28:18 INFO Received push request method=POST path=/api/pushes6826worker1 # [ 180.171618] nix-grpc-daemon[1865]: time=2026-09-24T12:28:18.460Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6827worker1 # [ 180.173144] nix-grpc-daemon[1865]: time=2026-09-24T12:28:18.462Z level=INFO msg="Uploading nv0kp5b571hsjibnd9v06981i024iima-slow-q2 (120B)"6828lb # [ 180.197223] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.ls6829lb # [ 180.201553] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst6830worker2 # [ 180.223886] nix-daemon[856]: accepted connection from pid 1906, user nix-grpc-daemon (trusted)6831lb # [ 180.208289] niks3-server[1195]: 2026/09/24 12:28:18 INFO Received sign narinfos request method=POST path=/api/pushes/64/sign6832worker1 # [ 180.223517] nix-grpc-daemon[1865]: time=2026-09-24T12:28:18.512Z level=INFO msg="Uploading 1 narinfos"6833lb # [ 180.213710] niks3-server[1195]: 2026/09/24 12:28:18 INFO Signed narinfos id=64 count=16834lb # [ 180.218294] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=log/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv6835worker2 # [ 180.236373] nix-daemon[856]: reaped child process 1909, status = succeeded6836lb # [ 180.227291] niks3-server[1195]: 2026/09/24 12:28:18 INFO Received complete push request method=POST path=/api/pushes/64/complete6837lb # [ 180.230524] niks3-server[1195]: 2026/09/24 12:28:18 INFO Received push request method=POST path=/api/pushes6838worker2 # [ 180.250945] nix-grpc-daemon[1656]: time=2026-09-24T12:28:19.419Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6839worker2 # [ 180.252590] nix-grpc-daemon[1656]: time=2026-09-24T12:28:19.421Z level=INFO msg="Uploading wmw8972gq2nf739xhg7is7lylxf8299y-slow-q0 (120B)"6840worker1 # [ 180.247690] nix-grpc-daemon[1865]: time=2026-09-24T12:28:18.536Z level=INFO msg="Upload complete. (189ms)"6841lb # [ 180.239353] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.narinfo6842worker2 # [ 180.258419] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:19Z level=debug event=assigned drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker=192.168.1.3:50051 clients=16843worker1 # [ 180.252844] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=2 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06844worker1 # [ 180.261971] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421386845lb # [ 180.255669] niks3-server[1195]: 2026/09/24 12:28:18 INFO Received sign narinfos request method=POST path=/api/pushes/65/sign6846lb # [ 180.259548] niks3-server[1195]: 2026/09/24 12:28:18 INFO Signed narinfos id=65 count=16847worker2 # [ 180.276871] nix-grpc-daemon[1656]: time=2026-09-24T12:28:19.445Z level=INFO msg="Uploading 1 narinfos"6848worker1 # [ 180.272526] nix-daemon[866]: reaped child process 1887, status = succeeded6849lb # [ 180.264665] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.ls6850lb # [ 180.267193] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst6851lb # [ 180.269351] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=log/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv6852lb # [ 180.273853] niks3-server[1195]: 2026/09/24 12:28:18 INFO Received complete push request method=POST path=/api/pushes/65/complete6853worker2 # [ 180.294242] nix-grpc-daemon[1656]: time=2026-09-24T12:28:19.463Z level=INFO msg="Upload complete. (176ms)"6854worker1 # [ 180.289542] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421386855lb # [ 180.280389] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.narinfo6856worker2 # [ 180.296726] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=2 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv assign_id=9 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06857client # [ 180.290811] nix[1509]: copying 1 paths to 'lb:50051'...6858worker2 # [ 180.304289] nix-daemon[856]: reaped child process 1879, status = succeeded6859worker1 # [ 180.300299] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421386860client # [ 180.294140] nix[1509]: copying path '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' to 'lb:50051'...6861worker1 # [ 180.309132] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6862worker1 # [ 180.400523] nix-daemon[866]: accepted connection from pid 1921, user nix-grpc-daemon (trusted)6863worker1 # [ 180.413340] nix-daemon[866]: reaped child process 1924, status = succeeded6864lb # [ 180.410536] niks3-server[1195]: 2026/09/24 12:28:18 INFO Received push request method=POST path=/api/pushes6865worker1 # [ 180.429023] nix-grpc-daemon[1865]: time=2026-09-24T12:28:18.718Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6866worker1 # [ 180.431074] nix-grpc-daemon[1865]: time=2026-09-24T12:28:18.719Z level=INFO msg="Uploading qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv (416B)"6867lb # [ 180.437917] niks3-server[1195]: 2026/09/24 12:28:18 INFO Received sign narinfos request method=POST path=/api/pushes/66/sign6868lb # [ 180.443635] niks3-server[1195]: 2026/09/24 12:28:18 INFO Signed narinfos id=66 count=16869worker1 # [ 180.458411] nix-grpc-daemon[1865]: time=2026-09-24T12:28:18.747Z level=INFO msg="Uploading 1 narinfos"6870lb # [ 180.452465] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=nar/1spxkiwzvlj9sgbjal4jf4p68h5kbylxymfww73s5va157qxgafi.nar.zst6871lb # [ 180.465828] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.ls6872lb # [ 180.468637] niks3-server[1195]: 2026/09/24 12:28:18 INFO Received complete push request method=POST path=/api/pushes/66/complete6873worker1 # [ 180.485183] nix-grpc-daemon[1865]: time=2026-09-24T12:28:18.774Z level=INFO msg="Upload complete. (166ms)"6874worker1 # [ 180.487502] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=4166875lb # [ 180.478050] niks3-server[1195]: 2026/09/24 12:28:18 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.narinfo6876worker1 # [ 180.490774] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421386877worker1 # [ 180.497584] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6878worker1 # [ 180.500268] nix-daemon[866]: reaped child process 1919, status = succeeded6879worker1 # [ 180.504910] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6880client # [ 180.498305] nix[1509]: building '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' on lb:50051...6881worker1 # [ 182.332944] nix-daemon[866]: reaped child process 1928, status = succeeded6882worker1 # [ 182.410664] nix-daemon[866]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)6883worker1 # [ 182.424227] nix-daemon[866]: reaped child process 1956, status = succeeded6884lb # [ 182.420757] niks3-server[1195]: 2026/09/24 12:28:20 INFO Received push request method=POST path=/api/pushes6885worker1 # [ 182.441281] nix-grpc-daemon[1865]: time=2026-09-24T12:28:20.730Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6886worker1 # [ 182.443073] nix-grpc-daemon[1865]: time=2026-09-24T12:28:20.731Z level=INFO msg="Uploading 106i40yblbkazayvn9ppswrq6kqs26sj-slow-q1 (120B)"6887lb # [ 182.459145] niks3-server[1195]: 2026/09/24 12:28:20 INFO Received sign narinfos request method=POST path=/api/pushes/67/sign6888worker1 # [ 182.482273] nix-grpc-daemon[1865]: time=2026-09-24T12:28:20.771Z level=INFO msg="Uploading 1 narinfos"6889lb # [ 182.471686] niks3-server[1195]: 2026/09/24 12:28:20 INFO Signed narinfos id=67 count=16890lb # [ 182.476625] niks3-server[1195]: 2026/09/24 12:28:20 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.ls6891lb # [ 182.482488] niks3-server[1195]: 2026/09/24 12:28:20 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst6892lb # [ 182.487911] niks3-server[1195]: 2026/09/24 12:28:20 INFO Registered completed upload object_key=log/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv6893lb # [ 182.499480] niks3-server[1195]: 2026/09/24 12:28:20 INFO Received complete push request method=POST path=/api/pushes/67/complete6894lb # [ 182.507097] niks3-server[1195]: 2026/09/24 12:28:20 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.narinfo6895worker1 # [ 182.516885] nix-grpc-daemon[1865]: time=2026-09-24T12:28:20.805Z level=INFO msg="Upload complete. (204ms)"6896worker1 # [ 182.523679] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=2 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv assign_id=10 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06897worker1 # [ 182.539247] nix-daemon[866]: reaped child process 1926, status = succeeded6898client # [ 182.550748] systemd[1]: burst.service: Deactivated successfully.6899client # [ 182.555140] systemd[1]: burst.service: Consumed 175ms CPU time over 6.164s wall clock time, 57.9M memory peak, 13.9K incoming IP traffic, 18.8K outgoing IP traffic.6900client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }6901client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.04 seconds)6902lb: must succeed: curl -sf localhost:9901/clusters6903lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6904lb: must succeed: curl -sf localhost:9901/clusters6905lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6906worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6907worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6908lb: must succeed: curl -sf localhost:9901/clusters6909lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6910lb: must succeed: curl -sf localhost:9901/clusters6911lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6912worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6913worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6914(finished: subtest: queue gauges show a burst while every build blocks, in 7.47 seconds)6915subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6916client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16917worker2 # [ 183.881252] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:586186918worker1 # [ 183.884858] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421386919worker2 # [ 183.927159] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:23Z level=debug event=want client=6 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06920worker2 # [ 183.931136] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:23Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16921worker2 # [ 183.936118] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:23Z level=debug event=want client=6 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06922worker1 # [ 183.933265] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421386923worker2 # [ 183.940325] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:23Z level=debug event=want client=6 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06924worker1 # [ 183.944883] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421386925worker1 # [ 183.956315] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421386926worker1 # [ 183.967374] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6927worker1 # [ 184.068393] nix-daemon[866]: accepted connection from pid 1964, user nix-grpc-daemon (trusted)6928worker1 # [ 184.080950] nix-daemon[866]: reaped child process 1967, status = succeeded6929lb # [ 184.078835] niks3-server[1195]: 2026/09/24 12:28:22 INFO Received push request method=POST path=/api/pushes6930worker1 # [ 184.099843] nix-grpc-daemon[1865]: time=2026-09-24T12:28:22.388Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6931worker1 # [ 184.101915] nix-grpc-daemon[1865]: time=2026-09-24T12:28:22.390Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6932lb # [ 184.112430] niks3-server[1195]: 2026/09/24 12:28:22 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6933lb # [ 184.117832] niks3-server[1195]: 2026/09/24 12:28:22 INFO Received sign narinfos request method=POST path=/api/pushes/68/sign6934lb # [ 184.125630] niks3-server[1195]: 2026/09/24 12:28:22 INFO Signed narinfos id=68 count=16935worker1 # [ 184.139448] nix-grpc-daemon[1865]: time=2026-09-24T12:28:22.428Z level=INFO msg="Uploading 1 narinfos"6936lb # [ 184.133070] niks3-server[1195]: 2026/09/24 12:28:22 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6937lb # [ 184.144187] niks3-server[1195]: 2026/09/24 12:28:22 INFO Received complete push request method=POST path=/api/pushes/68/complete6938worker1 # [ 184.163265] nix-grpc-daemon[1865]: time=2026-09-24T12:28:22.452Z level=INFO msg="Upload complete. (183ms)"6939lb # [ 184.154394] niks3-server[1195]: 2026/09/24 12:28:22 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6940worker1 # [ 184.167498] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=5046941worker1 # [ 184.173451] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421386942worker1 # [ 184.186109] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6943worker1 # [ 184.192995] nix-daemon[866]: reaped child process 1962, status = succeeded6944worker1 # [ 184.197962] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6945worker1 # [ 185.234732] nix-daemon[866]: reaped child process 1971, status = succeeded6946worker1 # [ 185.309690] nix-daemon[866]: accepted connection from pid 1987, user nix-grpc-daemon (trusted)6947worker1 # [ 185.321319] nix-daemon[866]: reaped child process 1990, status = succeeded6948lb # [ 185.318504] niks3-server[1195]: 2026/09/24 12:28:23 INFO Received push request method=POST path=/api/pushes6949worker1 # [ 185.336910] nix-grpc-daemon[1865]: time=2026-09-24T12:28:23.625Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6950worker1 # [ 185.338413] nix-grpc-daemon[1865]: time=2026-09-24T12:28:23.627Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6951lb # [ 185.361787] niks3-server[1195]: 2026/09/24 12:28:23 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6952lb # [ 185.367061] niks3-server[1195]: 2026/09/24 12:28:23 INFO Received sign narinfos request method=POST path=/api/pushes/69/sign6953lb # [ 185.374142] niks3-server[1195]: 2026/09/24 12:28:23 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6954lb # [ 185.380245] niks3-server[1195]: 2026/09/24 12:28:23 INFO Signed narinfos id=69 count=16955worker1 # [ 185.393723] nix-grpc-daemon[1865]: time=2026-09-24T12:28:23.682Z level=INFO msg="Uploading 1 narinfos"6956lb # [ 185.385676] niks3-server[1195]: 2026/09/24 12:28:23 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6957lb # [ 185.396704] niks3-server[1195]: 2026/09/24 12:28:23 INFO Received complete push request method=POST path=/api/pushes/69/complete6958lb # [ 185.401945] niks3-server[1195]: 2026/09/24 12:28:23 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6959worker1 # [ 185.415734] nix-grpc-daemon[1865]: time=2026-09-24T12:28:23.704Z level=INFO msg="Upload complete. (210ms)"6960worker1 # [ 185.421769] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06961worker2 # [ 185.429509] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:24Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16962worker2 # [ 185.437357] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:24Z level=debug event=want client=6 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06963worker1 # [ 185.430934] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421386964worker1 # [ 185.443604] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421386965worker1 # [ 185.451956] nix-daemon[866]: reaped child process 1969, status = succeeded6966worker1 # [ 185.454634] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421386967worker1 # [ 185.462389] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6968worker1 # [ 185.546753] nix-daemon[866]: accepted connection from pid 1994, user nix-grpc-daemon (trusted)6969worker1 # [ 185.559282] nix-daemon[866]: reaped child process 1997, status = succeeded6970lb # [ 185.556265] niks3-server[1195]: 2026/09/24 12:28:23 INFO Received push request method=POST path=/api/pushes6971worker1 # [ 185.574895] nix-grpc-daemon[1865]: time=2026-09-24T12:28:23.863Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6972worker1 # [ 185.576255] nix-grpc-daemon[1865]: time=2026-09-24T12:28:23.863Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6973lb # [ 185.582638] niks3-server[1195]: 2026/09/24 12:28:23 INFO Received sign narinfos request method=POST path=/api/pushes/70/sign6974worker1 # [ 185.598880] nix-grpc-daemon[1865]: time=2026-09-24T12:28:23.887Z level=INFO msg="Uploading 1 narinfos"6975lb # [ 185.588857] niks3-server[1195]: 2026/09/24 12:28:23 INFO Signed narinfos id=70 count=16976lb # [ 185.596373] niks3-server[1195]: 2026/09/24 12:28:23 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6977lb # [ 185.600836] niks3-server[1195]: 2026/09/24 12:28:23 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6978lb # [ 185.612843] niks3-server[1195]: 2026/09/24 12:28:23 INFO Received complete push request method=POST path=/api/pushes/70/complete6979worker1 # [ 185.631300] nix-grpc-daemon[1865]: time=2026-09-24T12:28:23.920Z level=INFO msg="Upload complete. (164ms)"6980lb # [ 185.622190] niks3-server[1195]: 2026/09/24 12:28:23 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6981worker1 # [ 185.633775] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=5046982worker1 # [ 185.638780] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421386983worker1 # [ 185.648824] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6984worker1 # [ 185.654557] nix-daemon[866]: reaped child process 1992, status = succeeded6985worker1 # [ 185.657371] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6986lb # [ 186.354881] envoy[907]: conn peer=[2001:db8:1::1]:52736 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9660 tx=5182 ms=59906987worker1 # [ 186.894308] nix-daemon[866]: reaped child process 2001, status = succeeded6988worker1 # [ 186.971329] nix-daemon[866]: accepted connection from pid 2017, user nix-grpc-daemon (trusted)6989worker1 # [ 186.982633] nix-daemon[866]: reaped child process 2020, status = succeeded6990lb # [ 186.980411] niks3-server[1195]: 2026/09/24 12:28:25 INFO Received push request method=POST path=/api/pushes6991worker1 # [ 186.998583] nix-grpc-daemon[1865]: time=2026-09-24T12:28:25.287Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6992worker1 # [ 187.000353] nix-grpc-daemon[1865]: time=2026-09-24T12:28:25.289Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6993lb # [ 187.025871] niks3-server[1195]: 2026/09/24 12:28:25 INFO Received sign narinfos request method=POST path=/api/pushes/71/sign6994lb # [ 187.029435] niks3-server[1195]: 2026/09/24 12:28:25 INFO Signed narinfos id=71 count=16995worker1 # [ 187.042857] nix-grpc-daemon[1865]: time=2026-09-24T12:28:25.331Z level=INFO msg="Uploading 1 narinfos"6996lb # [ 187.037839] niks3-server[1195]: 2026/09/24 12:28:25 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6997lb # [ 187.044742] niks3-server[1195]: 2026/09/24 12:28:25 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6998lb # [ 187.050645] niks3-server[1195]: 2026/09/24 12:28:25 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6999lb # [ 187.058795] niks3-server[1195]: 2026/09/24 12:28:25 INFO Received complete push request method=POST path=/api/pushes/71/complete7000lb # [ 187.068166] niks3-server[1195]: 2026/09/24 12:28:25 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo7001worker1 # [ 187.077713] nix-grpc-daemon[1865]: time=2026-09-24T12:28:25.366Z level=INFO msg="Upload complete. (212ms)"7002worker1 # [ 187.086167] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=07003worker2 # [ 187.093915] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:26Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=17004worker1 # [ 187.094393] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387005worker2 # [ 187.099631] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:26Z level=debug event=want client=6 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=07006worker1 # [ 187.105614] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421387007worker1 # [ 187.114138] nix-daemon[866]: reaped child process 1999, status = succeeded7008worker1 # [ 187.116728] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421387009worker1 # [ 187.122554] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7010worker1 # [ 187.210047] nix-daemon[866]: accepted connection from pid 2024, user nix-grpc-daemon (trusted)7011worker1 # [ 187.222565] nix-daemon[866]: reaped child process 2027, status = succeeded7012lb # [ 187.219694] niks3-server[1195]: 2026/09/24 12:28:25 INFO Received push request method=POST path=/api/pushes7013worker1 # [ 187.238155] nix-grpc-daemon[1865]: time=2026-09-24T12:28:25.527Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7014worker1 # [ 187.240153] nix-grpc-daemon[1865]: time=2026-09-24T12:28:25.528Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"7015lb # [ 187.245882] niks3-server[1195]: 2026/09/24 12:28:25 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst7016lb # [ 187.260191] niks3-server[1195]: 2026/09/24 12:28:25 INFO Received sign narinfos request method=POST path=/api/pushes/72/sign7017lb # [ 187.265467] niks3-server[1195]: 2026/09/24 12:28:25 INFO Signed narinfos id=72 count=17018worker1 # [ 187.278875] nix-grpc-daemon[1865]: time=2026-09-24T12:28:25.567Z level=INFO msg="Uploading 1 narinfos"7019lb # [ 187.273190] niks3-server[1195]: 2026/09/24 12:28:25 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls7020lb # [ 187.283918] niks3-server[1195]: 2026/09/24 12:28:25 INFO Received complete push request method=POST path=/api/pushes/72/complete7021worker1 # [ 187.299744] nix-grpc-daemon[1865]: time=2026-09-24T12:28:25.588Z level=INFO msg="Upload complete. (171ms)"7022lb # [ 187.290943] niks3-server[1195]: 2026/09/24 12:28:25 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo7023worker1 # [ 187.303690] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=5047024worker1 # [ 187.308838] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387025worker1 # [ 187.318118] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7026worker1 # [ 187.325110] nix-daemon[866]: reaped child process 2022, status = succeeded7027worker1 # [ 187.328127] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7028worker1 # [ 188.342433] nix-daemon[866]: reaped child process 2031, status = succeeded7029worker1 # [ 188.416513] nix-daemon[866]: accepted connection from pid 2047, user nix-grpc-daemon (trusted)7030worker1 # [ 188.430388] nix-daemon[866]: reaped child process 2050, status = succeeded7031lb # [ 188.425327] niks3-server[1195]: 2026/09/24 12:28:26 INFO Received push request method=POST path=/api/pushes7032worker1 # [ 188.443689] nix-grpc-daemon[1865]: time=2026-09-24T12:28:26.732Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7033worker1 # [ 188.445176] nix-grpc-daemon[1865]: time=2026-09-24T12:28:26.734Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"7034lb # [ 188.467100] niks3-server[1195]: 2026/09/24 12:28:26 INFO Received sign narinfos request method=POST path=/api/pushes/73/sign7035worker1 # [ 188.486897] nix-grpc-daemon[1865]: time=2026-09-24T12:28:26.775Z level=INFO msg="Uploading 1 narinfos"7036lb # [ 188.476153] niks3-server[1195]: 2026/09/24 12:28:26 INFO Signed narinfos id=73 count=17037lb # [ 188.485162] niks3-server[1195]: 2026/09/24 12:28:26 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls7038lb # [ 188.490450] niks3-server[1195]: 2026/09/24 12:28:26 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst7039lb # [ 188.496174] niks3-server[1195]: 2026/09/24 12:28:26 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv7040lb # [ 188.507505] niks3-server[1195]: 2026/09/24 12:28:26 INFO Received complete push request method=POST path=/api/pushes/73/complete7041lb # [ 188.517169] niks3-server[1195]: 2026/09/24 12:28:26 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo7042worker1 # [ 188.527093] nix-grpc-daemon[1865]: time=2026-09-24T12:28:26.816Z level=INFO msg="Upload complete. (192ms)"7043worker2 # [ 188.539777] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:27Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=17044worker1 # [ 188.533661] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=13 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=07045worker1 # [ 188.543321] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387046worker2 # [ 188.549362] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:27Z level=debug event=want client=6 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=07047worker1 # [ 188.553871] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421387048worker1 # [ 188.562557] nix-daemon[866]: reaped child process 2029, status = succeeded7049worker1 # [ 188.565544] nix-grpc-daemon[1865]: time=2026-09-24T12:28:26.853Z level=INFO msg="All 1 paths already cached"7050worker1 # [ 188.568971] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421387051worker1 # [ 188.574800] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7052worker1 # [ 188.657423] nix-daemon[866]: accepted connection from pid 2054, user nix-grpc-daemon (trusted)7053worker1 # [ 188.670302] nix-daemon[866]: reaped child process 2057, status = succeeded7054lb # [ 188.666552] niks3-server[1195]: 2026/09/24 12:28:26 INFO Received push request method=POST path=/api/pushes7055worker1 # [ 188.684843] nix-grpc-daemon[1865]: time=2026-09-24T12:28:26.973Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7056worker1 # [ 188.686229] nix-grpc-daemon[1865]: time=2026-09-24T12:28:26.973Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"7057lb # [ 188.691818] niks3-server[1195]: 2026/09/24 12:28:27 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls7058lb # [ 188.701263] niks3-server[1195]: 2026/09/24 12:28:27 INFO Received sign narinfos request method=POST path=/api/pushes/74/sign7059lb # [ 188.707779] niks3-server[1195]: 2026/09/24 12:28:27 INFO Signed narinfos id=74 count=17060worker1 # [ 188.721847] nix-grpc-daemon[1865]: time=2026-09-24T12:28:27.010Z level=INFO msg="Uploading 1 narinfos"7061lb # [ 188.716327] niks3-server[1195]: 2026/09/24 12:28:27 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst7062lb # [ 188.725909] niks3-server[1195]: 2026/09/24 12:28:27 INFO Received complete push request method=POST path=/api/pushes/74/complete7063worker1 # [ 188.744155] nix-grpc-daemon[1865]: time=2026-09-24T12:28:27.033Z level=INFO msg="Upload complete. (164ms)"7064lb # [ 188.735348] niks3-server[1195]: 2026/09/24 12:28:27 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo7065worker1 # [ 188.746993] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=6247066worker1 # [ 188.751385] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387067worker1 # [ 188.759972] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7068worker1 # [ 188.761415] nix-daemon[866]: reaped child process 2052, status = succeeded7069worker1 # [ 188.766602] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7070worker1 # [ 189.402201] nix-daemon[866]: reaped child process 2061, status = succeeded7071worker1 # [ 189.483944] nix-daemon[866]: accepted connection from pid 2077, user nix-grpc-daemon (trusted)7072worker1 # [ 189.496679] nix-daemon[866]: reaped child process 2080, status = succeeded7073lb # [ 189.493955] niks3-server[1195]: 2026/09/24 12:28:27 INFO Received push request method=POST path=/api/pushes7074worker1 # [ 189.512466] nix-grpc-daemon[1865]: time=2026-09-24T12:28:27.801Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7075worker1 # [ 189.514044] nix-grpc-daemon[1865]: time=2026-09-24T12:28:27.803Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"7076lb # [ 189.534275] niks3-server[1195]: 2026/09/24 12:28:27 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst7077lb # [ 189.543977] niks3-server[1195]: 2026/09/24 12:28:27 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv7078lb # [ 189.551707] niks3-server[1195]: 2026/09/24 12:28:27 INFO Received sign narinfos request method=POST path=/api/pushes/75/sign7079lb # [ 189.559505] niks3-server[1195]: 2026/09/24 12:28:27 INFO Signed narinfos id=75 count=17080worker1 # [ 189.570542] nix-grpc-daemon[1865]: time=2026-09-24T12:28:27.859Z level=INFO msg="Uploading 1 narinfos"7081lb # [ 189.562805] niks3-server[1195]: 2026/09/24 12:28:27 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls7082lb # [ 189.573771] niks3-server[1195]: 2026/09/24 12:28:27 INFO Received complete push request method=POST path=/api/pushes/75/complete7083lb # [ 189.577940] niks3-server[1195]: 2026/09/24 12:28:27 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo7084worker1 # [ 189.587608] nix-grpc-daemon[1865]: time=2026-09-24T12:28:27.876Z level=INFO msg="Upload complete. (214ms)"7085worker2 # [ 189.600671] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:28Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=17086worker1 # [ 189.593942] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=14 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=07087worker2 # [ 189.609594] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:28Z level=debug event=want client=6 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=07088worker1 # [ 189.604615] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387089worker1 # [ 189.614121] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421387090worker1 # [ 189.624123] nix-grpc-daemon[1865]: time=2026-09-24T12:28:27.912Z level=INFO msg="All 1 paths already cached"7091worker1 # [ 189.626382] nix-daemon[866]: reaped child process 2059, status = succeeded7092worker1 # [ 189.628628] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421387093worker1 # [ 189.632438] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7094worker1 # [ 189.716625] nix-daemon[866]: accepted connection from pid 2084, user nix-grpc-daemon (trusted)7095worker1 # [ 189.729653] nix-daemon[866]: reaped child process 2087, status = succeeded7096lb # [ 189.726076] niks3-server[1195]: 2026/09/24 12:28:28 INFO Received push request method=POST path=/api/pushes7097worker1 # [ 189.745161] nix-grpc-daemon[1865]: time=2026-09-24T12:28:28.034Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7098worker1 # [ 189.747233] nix-grpc-daemon[1865]: time=2026-09-24T12:28:28.035Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"7099lb # [ 189.758080] niks3-server[1195]: 2026/09/24 12:28:28 INFO Received sign narinfos request method=POST path=/api/pushes/76/sign7100lb # [ 189.762876] niks3-server[1195]: 2026/09/24 12:28:28 INFO Signed narinfos id=76 count=17101worker1 # [ 189.776463] nix-grpc-daemon[1865]: time=2026-09-24T12:28:28.065Z level=INFO msg="Uploading 1 narinfos"7102lb # [ 189.772514] niks3-server[1195]: 2026/09/24 12:28:28 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls7103lb # [ 189.777810] niks3-server[1195]: 2026/09/24 12:28:28 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst7104lb # [ 189.788898] niks3-server[1195]: 2026/09/24 12:28:28 INFO Received complete push request method=POST path=/api/pushes/76/complete7105worker1 # [ 189.805338] nix-grpc-daemon[1865]: time=2026-09-24T12:28:28.094Z level=INFO msg="Upload complete. (167ms)"7106lb # [ 189.797051] niks3-server[1195]: 2026/09/24 12:28:28 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo7107worker1 # [ 189.808934] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=6247108worker1 # [ 189.814265] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387109worker1 # [ 189.824577] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7110worker1 # [ 189.832688] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7111worker1 # [ 189.834922] nix-daemon[866]: reaped child process 2082, status = succeeded7112worker1 # [ 190.671445] nix-daemon[866]: reaped child process 2091, status = succeeded7113worker1 # [ 190.756496] nix-daemon[866]: accepted connection from pid 2107, user nix-grpc-daemon (trusted)7114worker1 # [ 190.767814] nix-daemon[866]: reaped child process 2110, status = succeeded7115lb # [ 190.765221] niks3-server[1195]: 2026/09/24 12:28:29 INFO Received push request method=POST path=/api/pushes7116worker1 # [ 190.784331] nix-grpc-daemon[1865]: time=2026-09-24T12:28:29.073Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7117worker1 # [ 190.785960] nix-grpc-daemon[1865]: time=2026-09-24T12:28:29.074Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"7118lb # [ 190.801186] niks3-server[1195]: 2026/09/24 12:28:29 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst7119lb # [ 190.814244] niks3-server[1195]: 2026/09/24 12:28:29 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls7120lb # [ 190.820968] niks3-server[1195]: 2026/09/24 12:28:29 INFO Received sign narinfos request method=POST path=/api/pushes/77/sign7121lb # [ 190.828411] niks3-server[1195]: 2026/09/24 12:28:29 INFO Signed narinfos id=77 count=17122worker1 # [ 190.841483] nix-grpc-daemon[1865]: time=2026-09-24T12:28:29.130Z level=INFO msg="Uploading 1 narinfos"7123lb # [ 190.835922] niks3-server[1195]: 2026/09/24 12:28:29 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv7124lb # [ 190.844718] niks3-server[1195]: 2026/09/24 12:28:29 INFO Received complete push request method=POST path=/api/pushes/77/complete7125lb # [ 190.850957] niks3-server[1195]: 2026/09/24 12:28:29 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo7126worker1 # [ 190.860924] nix-grpc-daemon[1865]: time=2026-09-24T12:28:29.149Z level=INFO msg="Upload complete. (219ms)"7127worker1 # [ 190.868281] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=15 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=07128worker2 # [ 190.876563] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:30Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=17129worker1 # [ 190.876850] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387130worker2 # [ 190.882310] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:30Z level=debug event=want client=6 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=07131worker1 # [ 190.887254] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421387132worker1 # [ 190.896592] nix-daemon[866]: reaped child process 2089, status = succeeded7133worker1 # [ 190.898575] nix-grpc-daemon[1865]: time=2026-09-24T12:28:29.187Z level=INFO msg="All 1 paths already cached"7134worker1 # [ 190.903047] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421387135worker1 # [ 190.907882] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7136worker1 # [ 190.990405] nix-daemon[866]: accepted connection from pid 2114, user nix-grpc-daemon (trusted)7137worker1 # [ 191.004927] nix-daemon[866]: reaped child process 2117, status = succeeded7138lb # [ 190.999660] niks3-server[1195]: 2026/09/24 12:28:29 INFO Received push request method=POST path=/api/pushes7139worker1 # [ 191.018503] nix-grpc-daemon[1865]: time=2026-09-24T12:28:29.307Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7140worker1 # [ 191.020491] nix-grpc-daemon[1865]: time=2026-09-24T12:28:29.309Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"7141lb # [ 191.031303] niks3-server[1195]: 2026/09/24 12:28:29 INFO Received sign narinfos request method=POST path=/api/pushes/78/sign7142worker1 # [ 191.047828] nix-grpc-daemon[1865]: time=2026-09-24T12:28:29.336Z level=INFO msg="Uploading 1 narinfos"7143lb # [ 191.036895] niks3-server[1195]: 2026/09/24 12:28:29 INFO Signed narinfos id=78 count=17144lb # [ 191.045475] niks3-server[1195]: 2026/09/24 12:28:29 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls7145lb # [ 191.055280] niks3-server[1195]: 2026/09/24 12:28:29 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst7146lb # [ 191.064238] niks3-server[1195]: 2026/09/24 12:28:29 INFO Received complete push request method=POST path=/api/pushes/78/complete7147worker1 # [ 191.081182] nix-grpc-daemon[1865]: time=2026-09-24T12:28:29.370Z level=INFO msg="Upload complete. (168ms)"7148lb # [ 191.072032] niks3-server[1195]: 2026/09/24 12:28:29 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo7149worker1 # [ 191.085127] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=6247150worker1 # [ 191.089906] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387151worker1 # [ 191.101658] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7152worker1 # [ 191.107135] nix-daemon[866]: reaped child process 2112, status = succeeded7153worker1 # [ 191.111544] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7154worker1 # [ 192.125608] nix-daemon[866]: reaped child process 2121, status = succeeded7155worker1 # [ 192.200984] nix-daemon[866]: accepted connection from pid 2137, user nix-grpc-daemon (trusted)7156worker1 # [ 192.213769] nix-daemon[866]: reaped child process 2140, status = succeeded7157lb # [ 192.208754] niks3-server[1195]: 2026/09/24 12:28:30 INFO Received push request method=POST path=/api/pushes7158worker1 # [ 192.227435] nix-grpc-daemon[1865]: time=2026-09-24T12:28:30.516Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7159worker1 # [ 192.228877] nix-grpc-daemon[1865]: time=2026-09-24T12:28:30.517Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"7160lb # [ 192.249094] niks3-server[1195]: 2026/09/24 12:28:30 INFO Received sign narinfos request method=POST path=/api/pushes/79/sign7161worker1 # [ 192.266511] nix-grpc-daemon[1865]: time=2026-09-24T12:28:30.555Z level=INFO msg="Uploading 1 narinfos"7162lb # [ 192.255705] niks3-server[1195]: 2026/09/24 12:28:30 INFO Signed narinfos id=79 count=17163lb # [ 192.265062] niks3-server[1195]: 2026/09/24 12:28:30 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv7164lb # [ 192.269832] niks3-server[1195]: 2026/09/24 12:28:30 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst7165lb # [ 192.278978] niks3-server[1195]: 2026/09/24 12:28:30 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls7166lb # [ 192.286789] niks3-server[1195]: 2026/09/24 12:28:30 INFO Received complete push request method=POST path=/api/pushes/79/complete7167worker1 # [ 192.301858] nix-grpc-daemon[1865]: time=2026-09-24T12:28:30.590Z level=INFO msg="Upload complete. (183ms)"7168lb # [ 192.293205] niks3-server[1195]: 2026/09/24 12:28:30 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo7169worker1 # [ 192.306995] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=16 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=07170worker2 # [ 192.313713] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:31Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=17171worker1 # [ 192.314855] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387172worker2 # [ 192.322839] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:31Z level=debug event=want client=6 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=07173worker1 # [ 192.325506] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421387174worker1 # [ 192.330819] nix-daemon[866]: reaped child process 2119, status = succeeded7175worker1 # [ 192.332627] nix-grpc-daemon[1865]: time=2026-09-24T12:28:30.621Z level=INFO msg="All 2 paths already cached"7176worker1 # [ 192.336789] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421387177worker1 # [ 192.340514] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7178worker1 # [ 192.424196] nix-daemon[866]: accepted connection from pid 2144, user nix-grpc-daemon (trusted)7179worker1 # [ 192.436622] nix-daemon[866]: reaped child process 2147, status = succeeded7180lb # [ 192.433601] niks3-server[1195]: 2026/09/24 12:28:30 INFO Received push request method=POST path=/api/pushes7181worker1 # [ 192.452500] nix-grpc-daemon[1865]: time=2026-09-24T12:28:30.741Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7182worker1 # [ 192.454571] nix-grpc-daemon[1865]: time=2026-09-24T12:28:30.743Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"7183lb # [ 192.462333] niks3-server[1195]: 2026/09/24 12:28:30 INFO Received sign narinfos request method=POST path=/api/pushes/80/sign7184lb # [ 192.471558] niks3-server[1195]: 2026/09/24 12:28:30 INFO Signed narinfos id=80 count=17185worker1 # [ 192.486148] nix-grpc-daemon[1865]: time=2026-09-24T12:28:30.775Z level=INFO msg="Uploading 1 narinfos"7186lb # [ 192.477065] niks3-server[1195]: 2026/09/24 12:28:30 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls7187lb # [ 192.482980] niks3-server[1195]: 2026/09/24 12:28:30 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst7188lb # [ 192.494915] niks3-server[1195]: 2026/09/24 12:28:30 INFO Received complete push request method=POST path=/api/pushes/80/complete7189worker1 # [ 192.510883] nix-grpc-daemon[1865]: time=2026-09-24T12:28:30.799Z level=INFO msg="Upload complete. (164ms)"7190lb # [ 192.501769] niks3-server[1195]: 2026/09/24 12:28:30 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo7191worker1 # [ 192.513343] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=7527192worker1 # [ 192.518578] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387193worker1 # [ 192.528364] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7194worker1 # [ 192.533412] nix-daemon[866]: reaped child process 2142, status = succeeded7195worker1 # [ 192.538849] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7196worker1 # [ 193.366203] nix-daemon[866]: reaped child process 2151, status = succeeded7197worker1 # [ 193.442728] nix-daemon[866]: accepted connection from pid 2167, user nix-grpc-daemon (trusted)7198worker1 # [ 193.455361] nix-daemon[866]: reaped child process 2170, status = succeeded7199lb # [ 193.452862] niks3-server[1195]: 2026/09/24 12:28:31 INFO Received push request method=POST path=/api/pushes7200worker1 # [ 193.474753] nix-grpc-daemon[1865]: time=2026-09-24T12:28:31.763Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7201worker1 # [ 193.476235] nix-grpc-daemon[1865]: time=2026-09-24T12:28:31.765Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"7202lb # [ 193.496785] niks3-server[1195]: 2026/09/24 12:28:31 INFO Received sign narinfos request method=POST path=/api/pushes/81/sign7203worker1 # [ 193.511881] nix-grpc-daemon[1865]: time=2026-09-24T12:28:31.800Z level=INFO msg="Uploading 1 narinfos"7204lb # [ 193.502072] niks3-server[1195]: 2026/09/24 12:28:31 INFO Signed narinfos id=81 count=17205lb # [ 193.512392] niks3-server[1195]: 2026/09/24 12:28:31 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst7206lb # [ 193.517464] niks3-server[1195]: 2026/09/24 12:28:31 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls7207lb # [ 193.524538] niks3-server[1195]: 2026/09/24 12:28:31 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv7208lb # [ 193.532718] niks3-server[1195]: 2026/09/24 12:28:31 INFO Received complete push request method=POST path=/api/pushes/81/complete7209lb # [ 193.538678] niks3-server[1195]: 2026/09/24 12:28:31 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo7210worker1 # [ 193.548933] nix-grpc-daemon[1865]: time=2026-09-24T12:28:31.837Z level=INFO msg="Upload complete. (203ms)"7211worker2 # [ 193.562494] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:32Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=17212worker1 # [ 193.555730] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=17 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=07213worker1 # [ 193.566362] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387214worker1 # [ 193.580617] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421387215worker1 # [ 193.586452] nix-daemon[866]: reaped child process 2149, status = succeeded7216worker1 # [ 193.592472] nix-grpc-daemon[1865]: time=2026-09-24T12:28:31.881Z level=INFO msg="All 2 paths already cached"7217worker1 # [ 193.599693] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421387218worker1 # [ 193.606496] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7219worker1 # [ 193.693636] nix-daemon[866]: accepted connection from pid 2174, user nix-grpc-daemon (trusted)7220worker1 # [ 193.707084] nix-daemon[866]: reaped child process 2177, status = succeeded7221lb # [ 193.703443] niks3-server[1195]: 2026/09/24 12:28:32 INFO Received push request method=POST path=/api/pushes7222worker1 # [ 193.722359] nix-grpc-daemon[1865]: time=2026-09-24T12:28:32.011Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7223worker1 # [ 193.723873] nix-grpc-daemon[1865]: time=2026-09-24T12:28:32.012Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"7224lb # [ 193.736943] niks3-server[1195]: 2026/09/24 12:28:32 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst7225lb # [ 193.744814] niks3-server[1195]: 2026/09/24 12:28:32 INFO Received sign narinfos request method=POST path=/api/pushes/82/sign7226worker1 # [ 193.761956] nix-grpc-daemon[1865]: time=2026-09-24T12:28:32.050Z level=INFO msg="Uploading 1 narinfos"7227lb # [ 193.751659] niks3-server[1195]: 2026/09/24 12:28:32 INFO Signed narinfos id=82 count=17228lb # [ 193.760804] niks3-server[1195]: 2026/09/24 12:28:32 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls7229lb # [ 193.771137] niks3-server[1195]: 2026/09/24 12:28:32 INFO Received complete push request method=POST path=/api/pushes/82/complete7230lb # [ 193.778289] niks3-server[1195]: 2026/09/24 12:28:32 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo7231worker1 # [ 193.791696] nix-grpc-daemon[1865]: time=2026-09-24T12:28:32.080Z level=INFO msg="Upload complete. (176ms)"7232worker1 # [ 193.796222] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=7527233worker1 # [ 193.804138] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387234worker1 # [ 193.814522] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7235worker1 # [ 193.824391] nix-daemon[866]: reaped child process 2172, status = succeeded7236worker1 # [ 193.830372] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7237worker1 # [ 195.045500] nix-daemon[866]: reaped child process 2181, status = succeeded7238worker1 # [ 195.119655] nix-daemon[866]: accepted connection from pid 2197, user nix-grpc-daemon (trusted)7239worker1 # [ 195.133762] nix-daemon[866]: reaped child process 2200, status = succeeded7240lb # [ 195.129260] niks3-server[1195]: 2026/09/24 12:28:33 INFO Received push request method=POST path=/api/pushes7241worker1 # [ 195.148342] nix-grpc-daemon[1865]: time=2026-09-24T12:28:33.437Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7242worker1 # [ 195.150252] nix-grpc-daemon[1865]: time=2026-09-24T12:28:33.438Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"7243lb # [ 195.172559] niks3-server[1195]: 2026/09/24 12:28:33 INFO Received sign narinfos request method=POST path=/api/pushes/83/sign7244lb # [ 195.177576] niks3-server[1195]: 2026/09/24 12:28:33 INFO Signed narinfos id=83 count=17245worker1 # [ 195.190673] nix-grpc-daemon[1865]: time=2026-09-24T12:28:33.479Z level=INFO msg="Uploading 1 narinfos"7246lb # [ 195.185539] niks3-server[1195]: 2026/09/24 12:28:33 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv7247lb # [ 195.189662] niks3-server[1195]: 2026/09/24 12:28:33 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls7248lb # [ 195.200713] niks3-server[1195]: 2026/09/24 12:28:33 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst7249lb # [ 195.203778] niks3-server[1195]: 2026/09/24 12:28:33 INFO Received complete push request method=POST path=/api/pushes/83/complete7250lb # [ 195.208864] niks3-server[1195]: 2026/09/24 12:28:33 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo7251worker1 # [ 195.218319] nix-grpc-daemon[1865]: time=2026-09-24T12:28:33.507Z level=INFO msg="Upload complete. (180ms)"7252worker2 # [ 195.230350] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:34Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=17253worker1 # [ 195.223279] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=18 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=07254worker1 # [ 195.233595] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387255worker1 # [ 195.245361] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421387256worker1 # [ 195.249784] nix-daemon[866]: reaped child process 2179, status = succeeded7257worker1 # [ 195.251925] nix-grpc-daemon[1865]: time=2026-09-24T12:28:33.541Z level=INFO msg="All 2 paths already cached"7258worker1 # [ 195.256375] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421387259worker1 # [ 195.261913] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7260worker1 # [ 195.356709] nix-daemon[866]: accepted connection from pid 2204, user nix-grpc-daemon (trusted)7261worker1 # [ 195.372089] nix-daemon[866]: reaped child process 2207, status = succeeded7262lb # [ 195.369944] niks3-server[1195]: 2026/09/24 12:28:33 INFO Received push request method=POST path=/api/pushes7263worker1 # [ 195.388701] nix-grpc-daemon[1865]: time=2026-09-24T12:28:33.677Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7264worker1 # [ 195.390850] nix-grpc-daemon[1865]: time=2026-09-24T12:28:33.679Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"7265lb # [ 195.400509] niks3-server[1195]: 2026/09/24 12:28:33 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls7266lb # [ 195.407453] niks3-server[1195]: 2026/09/24 12:28:33 INFO Received sign narinfos request method=POST path=/api/pushes/84/sign7267worker1 # [ 195.425401] nix-grpc-daemon[1865]: time=2026-09-24T12:28:33.714Z level=INFO msg="Uploading 1 narinfos"7268lb # [ 195.414590] niks3-server[1195]: 2026/09/24 12:28:33 INFO Signed narinfos id=84 count=17269lb # [ 195.420995] niks3-server[1195]: 2026/09/24 12:28:33 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst7270lb # [ 195.435176] niks3-server[1195]: 2026/09/24 12:28:33 INFO Received complete push request method=POST path=/api/pushes/84/complete7271worker1 # [ 195.452404] nix-grpc-daemon[1865]: time=2026-09-24T12:28:33.741Z level=INFO msg="Upload complete. (185ms)"7272lb # [ 195.444106] niks3-server[1195]: 2026/09/24 12:28:33 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo7273worker1 # [ 195.455962] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=0 paths=1 nar_bytes_in=7527274worker1 # [ 195.461124] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421387275worker1 # [ 195.471378] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7276worker1 # [ 195.480288] nix-daemon[866]: reaped child process 2202, status = succeeded7277worker1 # [ 195.485401] nix-daemon[866]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)7278worker1 # [ 196.331628] nix-daemon[866]: reaped child process 2211, status = succeeded7279worker1 # [ 196.412101] nix-daemon[866]: accepted connection from pid 2227, user nix-grpc-daemon (trusted)7280worker1 # [ 196.426733] nix-daemon[866]: reaped child process 2230, status = succeeded7281lb # [ 196.424063] niks3-server[1195]: 2026/09/24 12:28:34 INFO Received push request method=POST path=/api/pushes7282worker1 # [ 196.443786] nix-grpc-daemon[1865]: time=2026-09-24T12:28:34.732Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7283worker1 # [ 196.445535] nix-grpc-daemon[1865]: time=2026-09-24T12:28:34.734Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"7284lb # [ 196.464152] niks3-server[1195]: 2026/09/24 12:28:34 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv7285lb # [ 196.471278] niks3-server[1195]: 2026/09/24 12:28:34 INFO Received sign narinfos request method=POST path=/api/pushes/85/sign7286lb # [ 196.479205] niks3-server[1195]: 2026/09/24 12:28:34 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls7287lb # [ 196.482685] niks3-server[1195]: 2026/09/24 12:28:34 INFO Signed narinfos id=85 count=17288worker1 # [ 196.495353] nix-grpc-daemon[1865]: time=2026-09-24T12:28:34.784Z level=INFO msg="Uploading 1 narinfos"7289lb # [ 196.487406] niks3-server[1195]: 2026/09/24 12:28:34 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst7290lb # [ 196.493165] niks3-server[1195]: 2026/09/24 12:28:34 INFO Received complete push request method=POST path=/api/pushes/85/complete7291worker1 # [ 196.506627] nix-grpc-daemon[1865]: time=2026-09-24T12:28:34.795Z level=INFO msg="Upload complete. (212ms)"7292lb # [ 196.497201] niks3-server[1195]: 2026/09/24 12:28:34 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo7293worker1 # [ 196.511949] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42138 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=19 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=07294worker1 # [ 196.525676] nix-daemon[866]: reaped child process 2209, status = succeeded7295client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 12.84 seconds)7296worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7297worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7298client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]'7299client # [ 196.643609] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]".7300client # Running as unit: gpu.service; invocation ID: c505853d4fb14edf9902c5e4a9c51c477301client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds)7302lb: must succeed: curl -sf localhost:9901/clusters7303lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7304lb: must succeed: curl -sf localhost:9901/clusters7305lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7306worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7307worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)7308worker1 # [ 196.790793] nix-grpc-daemon[1805]: ts=2026-09-24T12:28:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:421387309client # [ 196.790951] nix[1583]: don't know how to build these paths:7310client # [ 196.791891] nix[1583]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv7311worker2 # [ 196.804303] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586187312client # [ 196.812594] nix[1583]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker7313worker2 # [ 196.823575] nix-grpc-daemon[1580]: ts=2026-09-24T12:28:35Z level=debug event=want client=7 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=07314lb: must succeed: curl -sf localhost:9901/clusters7315lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7316lb: must succeed: curl -sf localhost:9901/clusters7317lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)7318worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7319worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)7320client: waiting for success: systemctl show -p Result gpu | grep -q exit-code7321lb # [ 206.356649] envoy[907]: conn peer=[2001:db8:1::1]:49514 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26969 tx=12265 ms=126577322client # [ 226.813941] nix[1583]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}7323client # [ 226.823484] nix[1583]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed7324client # [ 226.858533] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE7325client # [ 226.862719] systemd[1]: gpu.service: Failed with result 'exit-code'.7326client # [ 226.866489] systemd[1]: gpu.service: Consumed 160ms CPU time over 30.216s wall clock time, 37.5M memory peak, 5.6K incoming IP traffic, 5.2K outgoing IP traffic.7327client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.45 seconds)7328client: must succeed: journalctl -u gpu -o cat7329client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds)7330lb: must succeed: curl -sf localhost:9901/clusters7331lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)7332lb: must succeed: curl -sf localhost:9901/clusters7333lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)7334worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics7335worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7336(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 43.77 seconds)7337subtest: low disk drains a worker and builds go to the other7338worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill7339worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.93 seconds)7340worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'7341worker1 # [ 229.128255] nix-grpc-daemon[1805]: ts=2026-09-24T12:29:07Z level=info event=unhealthy reason=min_free7342worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds)7343client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&27344worker2 # [ 229.674270] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:586187345client # don't know how to build these paths:7346client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7347worker2 # [ 229.682594] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586187348worker2 # [ 229.704260] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:08Z level=debug event=want client=8 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=07349worker2 # [ 229.709817] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:08Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=17350worker2 # [ 229.715341] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586187351worker2 # [ 229.726391] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586187352client # copying 1 paths to 'lb:50051'...7353client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...7354worker2 # [ 229.739146] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:586187355worker2 # [ 229.747896] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)7356worker2 # [ 229.851485] nix-daemon[856]: accepted connection from pid 1958, user nix-grpc-daemon (trusted)7357worker2 # [ 229.865260] nix-daemon[856]: reaped child process 1961, status = succeeded7358lb # [ 229.858547] niks3-server[1195]: 2026/09/24 12:29:08 INFO Received push request method=POST path=/api/pushes7359worker2 # [ 229.885310] nix-grpc-daemon[1656]: time=2026-09-24T12:29:09.053Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7360worker2 # [ 229.886795] nix-grpc-daemon[1656]: time=2026-09-24T12:29:09.054Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"7361lb # [ 229.897790] niks3-server[1195]: 2026/09/24 12:29:08 INFO Received sign narinfos request method=POST path=/api/pushes/86/sign7362lb # [ 229.901946] niks3-server[1195]: 2026/09/24 12:29:08 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls7363lb # [ 229.908593] niks3-server[1195]: 2026/09/24 12:29:08 INFO Signed narinfos id=86 count=17364worker2 # [ 229.927468] nix-grpc-daemon[1656]: time=2026-09-24T12:29:09.096Z level=INFO msg="Uploading 1 narinfos"7365lb # [ 229.917215] niks3-server[1195]: 2026/09/24 12:29:08 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst7366lb # [ 229.928096] niks3-server[1195]: 2026/09/24 12:29:08 INFO Received complete push request method=POST path=/api/pushes/86/complete7367lb # [ 229.935754] niks3-server[1195]: 2026/09/24 12:29:08 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo7368worker2 # [ 229.954854] nix-grpc-daemon[1656]: time=2026-09-24T12:29:09.124Z level=INFO msg="Upload complete. (193ms)"7369worker2 # [ 229.959865] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=0 paths=1 nar_bytes_in=5127370worker2 # [ 229.965563] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586187371worker2 # [ 229.978104] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)7372worker2 # [ 229.986955] nix-daemon[856]: reaped child process 1956, status = succeeded7373worker2 # [ 229.991440] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)7374client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...7375client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv7376client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds7377client # farm-a> LOG-farm-a-drain7378worker2 # [ 231.227670] nix-daemon[856]: reaped child process 1965, status = succeeded7379worker2 # [ 231.308412] nix-daemon[856]: accepted connection from pid 1981, user nix-grpc-daemon (trusted)7380worker2 # [ 231.319793] nix-daemon[856]: reaped child process 1984, status = succeeded7381lb # [ 231.312361] niks3-server[1195]: 2026/09/24 12:29:09 INFO Received push request method=POST path=/api/pushes7382worker2 # [ 231.337602] nix-grpc-daemon[1656]: time=2026-09-24T12:29:10.506Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7383worker2 # [ 231.339150] nix-grpc-daemon[1656]: time=2026-09-24T12:29:10.508Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"7384lb # [ 231.359550] niks3-server[1195]: 2026/09/24 12:29:09 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7385lb # [ 231.364977] niks3-server[1195]: 2026/09/24 12:29:09 INFO Received sign narinfos request method=POST path=/api/pushes/87/sign7386lb # [ 231.369666] niks3-server[1195]: 2026/09/24 12:29:09 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls7387worker2 # [ 231.389312] nix-grpc-daemon[1656]: time=2026-09-24T12:29:10.558Z level=INFO msg="Uploading 1 narinfos"7388lb # [ 231.373958] niks3-server[1195]: 2026/09/24 12:29:09 INFO Signed narinfos id=87 count=17389lb # [ 231.381858] niks3-server[1195]: 2026/09/24 12:29:09 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv7390lb # [ 231.390162] niks3-server[1195]: 2026/09/24 12:29:09 INFO Received complete push request method=POST path=/api/pushes/87/complete7391lb # [ 231.396402] niks3-server[1195]: 2026/09/24 12:29:09 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo7392worker2 # [ 231.411636] nix-grpc-daemon[1656]: time=2026-09-24T12:29:10.580Z level=INFO msg="Upload complete. (211ms)"7393worker2 # [ 231.418302] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=20 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=07394worker2 # [ 231.431575] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:10Z level=debug event=want client=8 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=07395worker2 # [ 231.436407] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:10Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=17396worker2 # [ 231.439905] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586187397worker2 # [ 231.450335] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586187398worker2 # [ 231.453055] nix-daemon[856]: reaped child process 1963, status = succeeded7399worker2 # [ 231.458341] nix-grpc-daemon[1656]: time=2026-09-24T12:29:10.627Z level=INFO msg="All 1 paths already cached"7400client # copying 1 paths to 'lb:50051'...7401worker2 # [ 231.464060] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:586187402client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...7403worker2 # [ 231.469218] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)7404worker2 # [ 231.555511] nix-daemon[856]: accepted connection from pid 1990, user nix-grpc-daemon (trusted)7405worker2 # [ 231.569416] nix-daemon[856]: reaped child process 1993, status = succeeded7406lb # [ 231.558690] niks3-server[1195]: 2026/09/24 12:29:09 INFO Received push request method=POST path=/api/pushes7407worker2 # [ 231.583047] nix-grpc-daemon[1656]: time=2026-09-24T12:29:10.752Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7408worker2 # [ 231.584546] nix-grpc-daemon[1656]: time=2026-09-24T12:29:10.753Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"7409lb # [ 231.594308] niks3-server[1195]: 2026/09/24 12:29:09 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst7410lb # [ 231.598524] niks3-server[1195]: 2026/09/24 12:29:09 INFO Received sign narinfos request method=POST path=/api/pushes/88/sign7411lb # [ 231.603778] niks3-server[1195]: 2026/09/24 12:29:09 INFO Signed narinfos id=88 count=17412worker2 # [ 231.622564] nix-grpc-daemon[1656]: time=2026-09-24T12:29:10.791Z level=INFO msg="Uploading 1 narinfos"7413lb # [ 231.613580] niks3-server[1195]: 2026/09/24 12:29:09 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls7414lb # [ 231.625294] niks3-server[1195]: 2026/09/24 12:29:09 INFO Received complete push request method=POST path=/api/pushes/88/complete7415lb # [ 231.634528] niks3-server[1195]: 2026/09/24 12:29:09 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo7416worker2 # [ 231.649376] nix-grpc-daemon[1656]: time=2026-09-24T12:29:10.818Z level=INFO msg="Upload complete. (174ms)"7417worker2 # [ 231.653506] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=0 paths=1 nar_bytes_in=6247418worker2 # [ 231.658347] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586187419worker2 # [ 231.667673] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)7420worker2 # [ 231.675748] nix-daemon[856]: reaped child process 1988, status = succeeded7421client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...7422worker2 # [ 231.681247] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)7423client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7424client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7425client # farm-b> LOG-farm-b-drain7426worker2 # [ 232.911334] nix-daemon[856]: reaped child process 1997, status = succeeded7427worker2 # [ 232.983225] nix-daemon[856]: accepted connection from pid 2013, user nix-grpc-daemon (trusted)7428worker2 # [ 232.995731] nix-daemon[856]: reaped child process 2016, status = succeeded7429lb # [ 232.990112] niks3-server[1195]: 2026/09/24 12:29:11 INFO Received push request method=POST path=/api/pushes7430worker2 # [ 233.013364] nix-grpc-daemon[1656]: time=2026-09-24T12:29:12.182Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7431worker2 # [ 233.015098] nix-grpc-daemon[1656]: time=2026-09-24T12:29:12.184Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"7432lb # [ 233.038577] niks3-server[1195]: 2026/09/24 12:29:11 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst7433lb # [ 233.045154] niks3-server[1195]: 2026/09/24 12:29:11 INFO Received sign narinfos request method=POST path=/api/pushes/89/sign7434worker2 # [ 233.068585] nix-grpc-daemon[1656]: time=2026-09-24T12:29:12.237Z level=INFO msg="Uploading 1 narinfos"7435lb # [ 233.052753] niks3-server[1195]: 2026/09/24 12:29:11 INFO Signed narinfos id=89 count=17436lb # [ 233.056315] niks3-server[1195]: 2026/09/24 12:29:11 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls7437lb # [ 233.061506] niks3-server[1195]: 2026/09/24 12:29:11 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7438lb # [ 233.072444] niks3-server[1195]: 2026/09/24 12:29:11 INFO Received complete push request method=POST path=/api/pushes/89/complete7439lb # [ 233.078167] niks3-server[1195]: 2026/09/24 12:29:11 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo7440worker2 # [ 233.093524] nix-grpc-daemon[1656]: time=2026-09-24T12:29:12.262Z level=INFO msg="Upload complete. (205ms)"7441worker2 # [ 233.100798] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=21 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=07442worker2 # [ 233.114297] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:12Z level=debug event=want client=8 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=07443worker2 # [ 233.118505] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:12Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=17444worker2 # [ 233.122096] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586187445worker2 # [ 233.131281] nix-daemon[856]: reaped child process 1995, status = succeeded7446worker2 # [ 233.132806] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:586187447worker2 # [ 233.141236] nix-grpc-daemon[1656]: time=2026-09-24T12:29:12.310Z level=INFO msg="All 2 paths already cached"7448client # copying 1 paths to 'lb:50051'...7449worker2 # [ 233.147171] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:586187450client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...7451worker2 # [ 233.153082] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)7452worker2 # [ 233.242202] nix-daemon[856]: accepted connection from pid 2022, user nix-grpc-daemon (trusted)7453worker2 # [ 233.256941] nix-daemon[856]: reaped child process 2025, status = succeeded7454lb # [ 233.246429] niks3-server[1195]: 2026/09/24 12:29:11 INFO Received push request method=POST path=/api/pushes7455worker2 # [ 233.271395] nix-grpc-daemon[1656]: time=2026-09-24T12:29:12.440Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7456worker2 # [ 233.273434] nix-grpc-daemon[1656]: time=2026-09-24T12:29:12.442Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"7457lb # [ 233.276227] niks3-server[1195]: 2026/09/24 12:29:11 INFO Received sign narinfos request method=POST path=/api/pushes/90/sign7458lb # [ 233.281192] niks3-server[1195]: 2026/09/24 12:29:11 INFO Signed narinfos id=90 count=17459worker2 # [ 233.299685] nix-grpc-daemon[1656]: time=2026-09-24T12:29:12.468Z level=INFO msg="Uploading 1 narinfos"7460lb # [ 233.289705] niks3-server[1195]: 2026/09/24 12:29:11 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls7461lb # [ 233.300101] niks3-server[1195]: 2026/09/24 12:29:11 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst7462lb # [ 233.308239] niks3-server[1195]: 2026/09/24 12:29:11 INFO Received complete push request method=POST path=/api/pushes/90/complete7463worker2 # [ 233.330344] nix-grpc-daemon[1656]: time=2026-09-24T12:29:12.499Z level=INFO msg="Upload complete. (172ms)"7464lb # [ 233.316771] niks3-server[1195]: 2026/09/24 12:29:11 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo7465worker2 # [ 233.332857] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=0 paths=1 nar_bytes_in=7527466worker2 # [ 233.338076] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:586187467worker2 # [ 233.346099] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)7468worker2 # [ 233.354289] nix-daemon[856]: reaped child process 2020, status = succeeded7469worker2 # [ 233.357292] nix-daemon[856]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)7470client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...7471client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7472client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7473client # farm-top> LOG-farm-top-drain7474worker2 # [ 234.394802] nix-daemon[856]: reaped child process 2029, status = succeeded7475worker2 # [ 234.477677] nix-daemon[856]: accepted connection from pid 2045, user nix-grpc-daemon (trusted)7476worker2 # [ 234.489184] nix-daemon[856]: reaped child process 2048, status = succeeded7477lb # [ 234.481191] niks3-server[1195]: 2026/09/24 12:29:12 INFO Received push request method=POST path=/api/pushes7478worker2 # [ 234.505316] nix-grpc-daemon[1656]: time=2026-09-24T12:29:13.674Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7479worker2 # [ 234.507061] nix-grpc-daemon[1656]: time=2026-09-24T12:29:13.676Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"7480lb # [ 234.524379] niks3-server[1195]: 2026/09/24 12:29:12 INFO Received sign narinfos request method=POST path=/api/pushes/91/sign7481worker2 # [ 234.544965] nix-grpc-daemon[1656]: time=2026-09-24T12:29:13.714Z level=INFO msg="Uploading 1 narinfos"7482lb # [ 234.529238] niks3-server[1195]: 2026/09/24 12:29:12 INFO Signed narinfos id=91 count=17483lb # [ 234.537226] niks3-server[1195]: 2026/09/24 12:29:12 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst7484lb # [ 234.543598] niks3-server[1195]: 2026/09/24 12:29:12 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7485lb # [ 234.547469] niks3-server[1195]: 2026/09/24 12:29:12 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls7486lb # [ 234.556389] niks3-server[1195]: 2026/09/24 12:29:12 INFO Received complete push request method=POST path=/api/pushes/91/complete7487lb # [ 234.565373] niks3-server[1195]: 2026/09/24 12:29:12 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo7488worker2 # [ 234.579170] nix-grpc-daemon[1656]: time=2026-09-24T12:29:13.748Z level=INFO msg="Upload complete. (214ms)"7489worker2 # [ 234.587808] nix-grpc-daemon[1580]: ts=2026-09-24T12:29:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58618 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=22 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=07490worker2 # [ 234.603202] nix-daemon[856]: reaped child process 2027, status = succeeded7491client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 5.11 seconds)7492client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath7493client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.12 seconds)7494worker1: must succeed: rm /nix/.rw-store/fill7495worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)7496worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7497worker1 # [ 235.130718] nix-grpc-daemon[1805]: ts=2026-09-24T12:29:13Z level=info event=healthy reason=min_free7498worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds)7499(finished: subtest: low disk drains a worker and builds go to the other, in 8.50 seconds)7500(finished: run the VM test script, in 236.98 seconds)7501test script finished in 237.17s7502cleanup7503kill QemuMachine (pid 50)7504client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7505client # [2026-09-24T12:29:15Z INFO virtiofsd] Client disconnected, shutting down7506client # [2026-09-24T12:29:15Z INFO virtiofsd] Client disconnected, shutting down7507client # [2026-09-24T12:29:15Z INFO virtiofsd] Client disconnected, shutting down7508lb # [ 236.357636] envoy[907]: conn peer=[2001:db8:1::1]:35614 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=929 tx=596 ms=300527509lb # [ 236.361601] envoy[907]: conn peer=[2001:db8:1::1]:51084 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9482 tx=4327 ms=49287510kill QemuMachine (pid 49)7511lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7512lb # [2026-09-24T12:29:15Z INFO virtiofsd] Client disconnected, shutting down7513lb # [2026-09-24T12:29:15Z INFO virtiofsd] Client disconnected, shutting down7514lb # [2026-09-24T12:29:15Z INFO virtiofsd] Client disconnected, shutting down7515kill QemuMachine (pid 51)7516worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7517worker1 # [2026-09-24T12:29:15Z INFO virtiofsd] Client disconnected, shutting down7518worker1 # [2026-09-24T12:29:15Z INFO virtiofsd] Client disconnected, shutting down7519worker1 # [2026-09-24T12:29:15Z INFO virtiofsd] Client disconnected, shutting down7520kill QemuMachine (pid 52)7521worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7522worker2 # [2026-09-24T12:29:16Z INFO virtiofsd] Client disconnected, shutting down7523worker2 # [2026-09-24T12:29:16Z INFO virtiofsd] Client disconnected, shutting down7524worker2 # [2026-09-24T12:29:16Z INFO virtiofsd] Client disconnected, shutting down7525(finished: cleanup, in 1.01 seconds)7526additionally exposed symbols:7527 client, lb, worker1, worker2,7528 vlan1,7529 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh