vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #549
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.6WkcGBKAbN', fmt=raw size=107374182414lb: QEMU running (pid 50)15lb # mke2fs 1.47.4 (6-Mar-2025)16lb # Discarding device blocks: 0/262144 done17lb # Creating filesystem with 262144 4k blocks and 65536 inodes18lb # Filesystem UUID: b8e425b4-5660-4902-a74c-4c4d2eb0feb819lb # Superblock backups stored on blocks:20lb # 32768, 98304, 163840, 22937621lb # 22lb # Allocating group tables: 0/8 done23lb # Writing inode tables: 0/8 done24lb # Creating journal (8192 blocks): done25lb # Writing superblocks and filesystem accounting information: 0/8 done26lb # 27lb # Virtualisation disk image created.28lb # Starting virtiofs daemons...29lb # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)30lb # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether31lb # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...32lb # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)33lb # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether34lb # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...35lb # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)36lb # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether37lb # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...38lb # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests39lb # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests40lb # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests41client # Disk image does not exist, creating the virtualisation disk image...42client # Formatting '/build/vm-state-client/tmp.f3uJ2aecy2', fmt=raw size=107374182443client # mke2fs 1.47.4 (6-Mar-2025)44client # Discarding device blocks: 0/262144 done45client # Creating filesystem with 262144 4k blocks and 65536 inodes46client # Filesystem UUID: 5a9a03a5-b109-4704-8cc3-07f69e967ad447client: QEMU running (pid 49)48client # Superblock backups stored on blocks:49client # 32768, 98304, 163840, 22937650client # 51client # Allocating group tables: 0/8 done52client # Writing inode tables: 0/8 done53client # Creating journal (8192 blocks): done54client # Writing superblocks and filesystem accounting information: 0/8 done55client # 56client # Virtualisation disk image created.57client # Starting virtiofs daemons...58client # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)59client # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether60client # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...61client # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)62client # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether63client # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...64client # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)65client # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether66client # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...67client # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests68client # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests69client # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests70worker2 # Disk image does not exist, creating the virtualisation disk image...71worker2: QEMU running (pid 52)72worker2 # Formatting '/build/vm-state-worker2/tmp.rOdCVeMO5M', fmt=raw size=107374182473worker2 # mke2fs 1.47.4 (6-Mar-2025)74worker2 # Discarding device blocks: 0/262144 done75worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes76worker2 # Filesystem UUID: 0b1c875f-6032-40b0-aa51-1df32791753277worker2 # Superblock backups stored on blocks:78worker2 # 32768, 98304, 163840, 22937679worker2 # 80worker2 # Allocating group tables: 0/8 done81worker2 # Writing inode tables: 0/8 done82worker2 # Creating journal (8192 blocks): done83worker2 # Writing superblocks and filesystem accounting information: 0/8 done84worker2 # 85worker2 # Virtualisation disk image created.86worker2 # Starting virtiofs daemons...87worker2 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)88worker2 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether89worker2 # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...90worker2 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)91worker2 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether92worker2 # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...93worker2 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)94worker2 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether95worker2 # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...96worker2 # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests97worker2 # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests98worker2 # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests99worker1 # Disk image does not exist, creating the virtualisation disk image...100worker1: QEMU running (pid 51)101worker1 # Formatting '/build/vm-state-worker1/tmp.NWnK1Mh6o3', fmt=raw size=1073741824102worker1 # mke2fs 1.47.4 (6-Mar-2025)103worker1 # Discarding device blocks: 0/262144 done104worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes105worker1 # Filesystem UUID: aac78685-1968-4c52-96d2-1512f645e759106worker1 # Superblock backups stored on blocks:107worker1 # 32768, 98304, 163840, 229376108(finished: start all VMs, in 1.05 seconds)109worker1 # 110client: waiting for unit network-addresses-eth1.service111worker1 # Allocating group tables: 0/8 done112client: waiting for the VM to finish booting113worker1 # Writing inode tables: 0/8 done114worker1 # Creating journal (8192 blocks): done115worker1 # Writing superblocks and filesystem accounting information: 0/8 done116worker1 # 117worker1 # Virtualisation disk image created.118worker1 # Starting virtiofs daemons...119worker1 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)120worker1 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether121worker1 # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...122worker1 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)123worker1 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether124worker1 # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...125worker1 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)126worker1 # [2026-09-24T09:25:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether127worker1 # [2026-09-24T09:25:31Z INFO virtiofsd] Waiting for vhost-user socket connection...128worker1 # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests129worker1 # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests130worker1 # [2026-09-24T09:25:31Z INFO virtiofsd] Client connected, servicing requests131lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)132client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)133worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)134worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)135lb # 136lb # 137lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00138lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...139lb # 140lb # 141lb # 142lb # 143lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00144lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)...145lb # 146lb # 147client # 148client # 149client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00150client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...151client # 152client # 153client # 154client # 155client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00156client # Press Ctrl-B to configure iPXE (PCI 00:05.0)...157client # 158client # 159worker1 # 160worker1 # 161worker2 # 162worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00163worker2 # 164worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00165worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...166worker1 # 167worker1 # 168worker1 # 169worker1 # 170worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...171worker2 # 172worker2 # 173worker2 # 174worker2 # 175worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00176worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00177worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)...178worker1 # 179worker1 # 180worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)...181worker2 # 182worker2 # 183lb # Booting from ROM...184client # Booting from ROM...185worker2 # Booting from ROM...186worker1 # Booting from ROM...187lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026188lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0189lb # [ 0.000000] BIOS-provided physical RAM map:190lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable191lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved192lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved193lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable194lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved195lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved196lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved197lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved198lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved199lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved200lb # [ 0.000000] NX (Execute Disable) protection: active201lb # [ 0.000000] APIC: Static calls initialized202lb # [ 0.000000] SMBIOS 2.8 present.203lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014204lb # [ 0.000000] DMI: Memory slots populated: 1/1205lb # [ 0.000000] Hypervisor detected: KVM206lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000207lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00208lb # [ 0.000000] kvm-clock: using sched offset of 527301553 cycles209lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns210lb # [ 0.000004] tsc: Detected 2400.012 MHz processor211lb # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000212lb # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs213lb # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT214client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026215lb # [ 0.002728] found SMP MP-table at [mem 0x000f5450-0x000f545f]216lb # [ 0.002738] Using GB pages for direct mapping217lb # [ 0.002828] RAMDISK: [mem 0x5e36e000-0x5ffcffff]218lb # [ 0.002837] ACPI: Early table checksum verification disabled219lb # [ 0.002839] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )220client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/396v5x78hj7h1i5gpvblz5cnjins2rzk-nixos-system-client-test/init regInfo=/nix/store/bq18sfdnp0qqh8xrf70a6xwqjrbkk7dc-closure-info/registration console=ttyS0,115200n8 console=tty0221lb # [ 0.002843] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)222client # [ 0.000000] BIOS-provided physical RAM map:223client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable224lb # [ 0.002848] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)225client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved226lb # [ 0.002855] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)227lb # [ 0.002857] ACPI: FACS 0x000000005FFE0000 000040228client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved229client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable230lb # [ 0.002858] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)231client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved232lb # [ 0.002860] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)233client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved234lb # [ 0.002862] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)235client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved236lb # [ 0.002863] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)237client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved238lb # [ 0.002864] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]239client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved240lb # [ 0.002865] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]241client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved242client # [ 0.000000] NX (Execute Disable) protection: active243lb # [ 0.002866] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]244client # [ 0.000000] APIC: Static calls initialized245lb # [ 0.002866] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]246client # [ 0.000000] SMBIOS 2.8 present.247worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026248lb # [ 0.002867] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]249client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014250lb # [ 0.002867] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]251client # [ 0.000000] DMI: Memory slots populated: 1/1252client # [ 0.000000] Hypervisor detected: KVM253lb # [ 0.002868] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]254client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000255lb # [ 0.003092] No NUMA configuration found256client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00257lb # [ 0.003093] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]258client # [ 0.000000] kvm-clock: using sched offset of 552055641 cycles259worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5kdyxglvc8vkjxanr64206xisjz0i983-nixos-system-worker2-test/init regInfo=/nix/store/zb2i1i3p928plwjbmz1j82y918kvmc31-closure-info/registration console=ttyS0,115200n8 console=tty0260lb # [ 0.003095] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]261lb # [ 0.005237] Zone ranges:262worker2 # [ 0.000000] BIOS-provided physical RAM map:263lb # [ 0.005238] DMA [mem 0x0000000000001000-0x0000000000ffffff]264client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns265worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable266client # [ 0.000004] tsc: Detected 2400.012 MHz processor267lb # [ 0.005239] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]268worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved269lb # [ 0.005240] Normal empty270client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000271lb # [ 0.005241] Device empty272worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved273lb # [ 0.005241] Movable zone start for each node274client # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs275lb # [ 0.005242] Early memory node ranges276worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable277client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT278lb # [ 0.005242] node 0: [mem 0x0000000000001000-0x000000000009efff]279worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved280client # [ 0.002737] found SMP MP-table at [mem 0x000f5450-0x000f545f]281lb # [ 0.005243] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]282client # [ 0.002748] Using GB pages for direct mapping283worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved284lb # [ 0.005244] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]285client # [ 0.002860] RAMDISK: [mem 0x5e370000-0x5ffcffff]286worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved287client # [ 0.002868] ACPI: Early table checksum verification disabled288lb # [ 0.005263] On node 0, zone DMA: 1 pages in unavailable ranges289worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026290worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved291lb # [ 0.005512] On node 0, zone DMA: 97 pages in unavailable ranges292client # [ 0.002872] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )293worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved294lb # [ 0.030566] On node 0, zone DMA32: 40 pages in unavailable ranges295client # [ 0.002876] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)296lb # [ 0.031023] ACPI: PM-Timer IO Port: 0x608297worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved298lb # [ 0.031032] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])299worker2 # [ 0.000000] NX (Execute Disable) protection: active300client # [ 0.002879] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)301worker2 # [ 0.000000] APIC: Static calls initialized302lb # [ 0.031058] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23303worker2 # [ 0.000000] SMBIOS 2.8 present.304client # [ 0.002886] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)305worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/yyazm3lb0nakqk4g82cfs1y42if0868g-nixos-system-worker1-test/init regInfo=/nix/store/pws236k1fg161lp2fn5za3n9l10gwb2b-closure-info/registration console=ttyS0,115200n8 console=tty0306lb # [ 0.031060] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)307client # [ 0.002888] ACPI: FACS 0x000000005FFE0000 000040308worker1 # [ 0.000000] BIOS-provided physical RAM map:309worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014310lb # [ 0.031062] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)311worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable312worker2 # [ 0.000000] DMI: Memory slots populated: 1/1313client # [ 0.002890] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)314worker2 # [ 0.000000] Hypervisor detected: KVM315lb # [ 0.031063] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)316worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved317client # [ 0.002892] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)318worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000319lb # [ 0.031063] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)320worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved321worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00322lb # [ 0.031064] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)323client # [ 0.002893] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)324worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable325worker2 # [ 0.000000] kvm-clock: using sched offset of 542341749 cycles326lb # [ 0.031066] ACPI: Using ACPI (MADT) for SMP configuration information327client # [ 0.002895] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)328worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved329lb # [ 0.031067] ACPI: HPET id: 0x8086a201 base: 0xfed00000330worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns331client # [ 0.002896] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]332lb # [ 0.031071] TSC deadline timer available333worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved334worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor335lb # [ 0.031075] CPU topo: Max. logical packages: 1336client # [ 0.002897] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]337worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved338worker2 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000339lb # [ 0.031075] CPU topo: Max. logical dies: 1340lb # [ 0.031076] CPU topo: Max. dies per package: 1341worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved342client # [ 0.002897] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]343worker2 # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs344lb # [ 0.031079] CPU topo: Max. threads per core: 1345worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved346client # [ 0.002898] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]347lb # [ 0.031080] CPU topo: Num. cores per package: 1348worker2 # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT349lb # [ 0.031080] CPU topo: Num. threads per package: 1350worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved351worker2 # [ 0.002732] found SMP MP-table at [mem 0x000f5450-0x000f545f]352client # [ 0.002898] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]353worker1 # [ 0.000000] NX (Execute Disable) protection: active354worker2 # [ 0.002742] Using GB pages for direct mapping355lb # [ 0.031081] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs356client # [ 0.002899] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]357worker1 # [ 0.000000] APIC: Static calls initialized358worker2 # [ 0.002822] RAMDISK: [mem 0x5e36f000-0x5ffcffff]359worker1 # [ 0.000000] SMBIOS 2.8 present.360lb # [ 0.031097] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()361worker2 # [ 0.002829] ACPI: Early table checksum verification disabled362client # [ 0.002899] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]363client # [ 0.003130] No NUMA configuration found364worker2 # [ 0.002831] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )365lb # [ 0.031124] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]366worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014367client # [ 0.003131] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]368worker1 # [ 0.000000] DMI: Memory slots populated: 1/1369lb # [ 0.031126] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]370worker2 # [ 0.002835] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)371worker1 # [ 0.000000] Hypervisor detected: KVM372client # [ 0.003133] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]373client # [ 0.005426] Zone ranges:374lb # [ 0.031127] [mem 0x60000000-0xafffffff] available for PCI devices375worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000376worker2 # [ 0.002839] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)377lb # [ 0.031129] Booting paravirtualized kernel on KVM378client # [ 0.005427] DMA [mem 0x0000000000001000-0x0000000000ffffff]379worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00380client # [ 0.005428] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]381worker2 # [ 0.002846] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)382worker1 # [ 0.000000] kvm-clock: using sched offset of 547153714 cycles383client # [ 0.005429] Normal empty384lb # [ 0.031131] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns385worker2 # [ 0.002848] ACPI: FACS 0x000000005FFE0000 000040386client # [ 0.005430] Device empty387client # [ 0.005431] Movable zone start for each node388lb # [ 0.035609] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1389worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns390worker2 # [ 0.002849] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)391client # [ 0.005431] Early memory node ranges392worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor393lb # [ 0.037800] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152394client # [ 0.005432] node 0: [mem 0x0000000000001000-0x000000000009efff]395worker1 # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000396worker2 # [ 0.002851] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)397lb # [ 0.037844] kvm-guest: PV spinlocks disabled, single CPU398client # [ 0.005433] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]399worker1 # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs400worker2 # [ 0.002852] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)401client # [ 0.005434] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]402worker1 # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT403worker2 # [ 0.002854] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)404client # [ 0.005456] On node 0, zone DMA: 1 pages in unavailable ranges405worker1 # [ 0.002724] found SMP MP-table at [mem 0x000f5450-0x000f545f]406client # [ 0.005737] On node 0, zone DMA: 97 pages in unavailable ranges407worker2 # [ 0.002855] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]408worker1 # [ 0.002735] Using GB pages for direct mapping409client # [ 0.032012] On node 0, zone DMA32: 40 pages in unavailable ranges410worker1 # [ 0.002842] RAMDISK: [mem 0x5e370000-0x5ffcffff]411lb # [ 0.037845] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b57s96hna1n87xmygcaz6qx4i7f2zyzx-nixos-system-lb-test/init regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration console=ttyS0,115200n8 console=tty0412worker2 # [ 0.002856] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]413client # [ 0.032475] ACPI: PM-Timer IO Port: 0x608414worker1 # [ 0.002850] ACPI: Early table checksum verification disabled415client # [ 0.032486] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])416worker1 # [ 0.002853] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )417worker2 # [ 0.002857] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]418lb # [ 0.037935] Unknown kernel command line parameters "regInfo=/nix/store/jpd2qccg07hyc3sd9msmabx1jknjxkc6-closure-info/registration", will be passed to user space.419client # [ 0.032516] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23420worker2 # [ 0.002857] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]421lb # [ 0.037948] random: crng init done422worker1 # [ 0.002856] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)423client # [ 0.032518] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)424lb # [ 0.037948] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes425worker2 # [ 0.002858] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]426worker1 # [ 0.002859] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)427client # [ 0.032520] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)428worker2 # [ 0.002858] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]429lb # [ 0.039960] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)430client # [ 0.032521] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)431worker1 # [ 0.002867] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)432worker2 # [ 0.002858] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]433worker1 # [ 0.002869] ACPI: FACS 0x000000005FFE0000 000040434lb # [ 0.040975] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)435client # [ 0.032522] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)436worker2 # [ 0.003086] No NUMA configuration found437lb # [ 0.041006] Fallback order for Node 0: 0438worker1 # [ 0.002870] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)439client # [ 0.032522] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)440worker2 # [ 0.003087] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]441lb # [ 0.041008] Built 1 zonelists, mobility grouping on. Total pages: 393078442client # [ 0.032525] ACPI: Using ACPI (MADT) for SMP configuration information443lb # [ 0.041009] Policy zone: DMA32444worker2 # [ 0.003090] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]445worker1 # [ 0.002872] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)446worker2 # [ 0.005214] Zone ranges:447client # [ 0.032526] ACPI: HPET id: 0x8086a201 base: 0xfed00000448lb # [ 0.043381] mem auto-init: stack:all(zero), heap alloc:on, heap free:off449worker2 # [ 0.005214] DMA [mem 0x0000000000001000-0x0000000000ffffff]450client # [ 0.032530] TSC deadline timer available451worker1 # [ 0.002873] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)452lb # [ 0.046264] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1453client # [ 0.032533] CPU topo: Max. logical packages: 1454worker2 # [ 0.005216] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]455lb # [ 0.049564] allocated 3145728 bytes of page_ext456client # [ 0.032534] CPU topo: Max. logical dies: 1457worker2 # [ 0.005217] Normal empty458worker1 # [ 0.002875] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)459worker2 # [ 0.005217] Device empty460client # [ 0.032534] CPU topo: Max. dies per package: 1461lb # [ 0.059187] ftrace: allocating 48787 entries in 192 pages462worker2 # [ 0.005218] Movable zone start for each node463worker1 # [ 0.002876] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]464client # [ 0.032538] CPU topo: Max. threads per core: 1465lb # [ 0.059190] ftrace: allocated 192 pages with 2 groups466worker2 # [ 0.005219] Early memory node ranges467lb # [ 0.059994] Dynamic Preempt: lazy468client # [ 0.032539] CPU topo: Num. cores per package: 1469worker1 # [ 0.002877] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]470worker2 # [ 0.005219] node 0: [mem 0x0000000000001000-0x000000000009efff]471client # [ 0.032539] CPU topo: Num. threads per package: 1472lb # [ 0.060151] rcu: Preemptible hierarchical RCU implementation.473worker1 # [ 0.002878] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]474worker2 # [ 0.005220] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]475lb # [ 0.060152] rcu: RCU event tracing is enabled.476client # [ 0.032539] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs477worker1 # [ 0.002878] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]478worker2 # [ 0.005221] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]479lb # [ 0.060152] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.480client # [ 0.032559] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()481worker2 # [ 0.005240] On node 0, zone DMA: 1 pages in unavailable ranges482lb # [ 0.060154] Trampoline variant of Tasks RCU enabled.483worker1 # [ 0.002878] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]484client # [ 0.032589] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]485lb # [ 0.060154] Rude variant of Tasks RCU enabled.486worker2 # [ 0.005489] On node 0, zone DMA: 97 pages in unavailable ranges487worker1 # [ 0.002879] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]488lb # [ 0.060154] Tracing variant of Tasks RCU enabled.489client # [ 0.032591] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]490worker2 # [ 0.030514] On node 0, zone DMA32: 40 pages in unavailable ranges491worker1 # [ 0.002879] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]492worker2 # [ 0.030971] ACPI: PM-Timer IO Port: 0x608493lb # [ 0.060155] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.494client # [ 0.032592] [mem 0x60000000-0xafffffff] available for PCI devices495worker1 # [ 0.003107] No NUMA configuration found496worker2 # [ 0.030982] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])497client # [ 0.032593] Booting paravirtualized kernel on KVM498lb # [ 0.060156] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1499worker1 # [ 0.003108] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]500worker2 # [ 0.031008] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23501worker1 # [ 0.003110] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]502lb # [ 0.060170] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.503client # [ 0.032596] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns504worker1 # [ 0.005360] Zone ranges:505worker2 # [ 0.031011] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)506worker1 # [ 0.005361] DMA [mem 0x0000000000001000-0x0000000000ffffff]507client # [ 0.037066] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1508worker2 # [ 0.031013] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)509lb # [ 0.060178] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.510worker1 # [ 0.005362] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]511client # [ 0.037190] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152512worker2 # [ 0.031014] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)513worker1 # [ 0.005363] Normal empty514lb # [ 0.060179] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.515worker1 # [ 0.005364] Device empty516client # [ 0.037236] kvm-guest: PV spinlocks disabled, single CPU517worker2 # [ 0.031014] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)518worker1 # [ 0.005365] Movable zone start for each node519lb # [ 0.064477] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16520worker1 # [ 0.005366] Early memory node ranges521worker2 # [ 0.031015] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)522lb # [ 0.064744] rcu: srcu_init: Setting srcu_struct sizes based on contention.523worker1 # [ 0.005366] node 0: [mem 0x0000000000001000-0x000000000009efff]524worker2 # [ 0.031018] ACPI: Using ACPI (MADT) for SMP configuration information525worker1 # [ 0.005367] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]526worker2 # [ 0.031018] ACPI: HPET id: 0x8086a201 base: 0xfed00000527lb # [ 0.064751] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns528worker2 # [ 0.031022] TSC deadline timer available529worker1 # [ 0.005368] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]530worker2 # [ 0.031026] CPU topo: Max. logical packages: 1531lb # [ 0.064852] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)532client # [ 0.037238] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/396v5x78hj7h1i5gpvblz5cnjins2rzk-nixos-system-client-test/init regInfo=/nix/store/bq18sfdnp0qqh8xrf70a6xwqjrbkk7dc-closure-info/registration console=ttyS0,115200n8 console=tty0533worker1 # [ 0.005389] On node 0, zone DMA: 1 pages in unavailable ranges534lb # [ 0.068383] Console: colour VGA+ 80x25535worker2 # [ 0.031026] CPU topo: Max. logical dies: 1536worker2 # [ 0.031027] CPU topo: Max. dies per package: 1537worker1 # [ 0.005651] On node 0, zone DMA: 97 pages in unavailable ranges538lb # [ 0.068385] printk: legacy console [tty0] enabled539worker2 # [ 0.031030] CPU topo: Max. threads per core: 1540lb # [ 0.097759] printk: legacy console [ttyS0] enabled541worker1 # [ 0.031783] On node 0, zone DMA32: 40 pages in unavailable ranges542client # [ 0.037331] Unknown kernel command line parameters "regInfo=/nix/store/bq18sfdnp0qqh8xrf70a6xwqjrbkk7dc-closure-info/registration", will be passed to user space.543worker2 # [ 0.031031] CPU topo: Num. cores per package: 1544worker1 # [ 0.032243] ACPI: PM-Timer IO Port: 0x608545client # [ 0.037343] random: crng init done546lb # [ 0.195451] ACPI: Core revision 20250807547worker2 # [ 0.031031] CPU topo: Num. threads per package: 1548worker1 # [ 0.032254] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])549client # [ 0.037344] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes550worker2 # [ 0.031031] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs551worker1 # [ 0.032283] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23552lb # [ 0.196357] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns553worker2 # [ 0.031048] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()554client # [ 0.037672] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)555worker1 # [ 0.032287] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)556lb # [ 0.197841] APIC: Switch to symmetric I/O mode setup557worker2 # [ 0.031078] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]558client # [ 0.037702] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)559worker1 # [ 0.032288] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)560client # [ 0.037727] Fallback order for Node 0: 0561lb # [ 0.198830] x2apic enabled562worker2 # [ 0.031080] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]563worker1 # [ 0.032289] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)564client # [ 0.037730] Built 1 zonelists, mobility grouping on. Total pages: 393078565worker2 # [ 0.031081] [mem 0x60000000-0xafffffff] available for PCI devices566client # [ 0.037731] Policy zone: DMA32567worker1 # [ 0.032290] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)568lb # [ 0.199608] APIC: Switched APIC routing to: physical x2apic569worker2 # [ 0.031082] Booting paravirtualized kernel on KVM570client # [ 0.037836] mem auto-init: stack:all(zero), heap alloc:on, heap free:off571worker1 # [ 0.032291] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)572client # [ 0.040884] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1573worker1 # [ 0.032293] ACPI: Using ACPI (MADT) for SMP configuration information574worker2 # [ 0.031085] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns575lb # [ 0.201433] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1576client # [ 0.044220] allocated 3145728 bytes of page_ext577worker1 # [ 0.032294] ACPI: HPET id: 0x8086a201 base: 0xfed00000578worker2 # [ 0.035556] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1579worker1 # [ 0.032297] TSC deadline timer available580client # [ 0.054007] ftrace: allocating 48787 entries in 192 pages581worker2 # [ 0.037759] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152582client # [ 0.054010] ftrace: allocated 192 pages with 2 groups583worker1 # [ 0.032301] CPU topo: Max. logical packages: 1584lb # [ 0.202415] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns585client # [ 0.055079] Dynamic Preempt: lazy586worker1 # [ 0.032302] CPU topo: Max. logical dies: 1587worker2 # [ 0.037801] kvm-guest: PV spinlocks disabled, single CPU588worker1 # [ 0.032302] CPU topo: Max. dies per package: 1589client # [ 0.055333] rcu: Preemptible hierarchical RCU implementation.590worker1 # [ 0.032306] CPU topo: Max. threads per core: 1591client # [ 0.055334] rcu: RCU event tracing is enabled.592lb # [ 0.204069] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)593worker1 # [ 0.032306] CPU topo: Num. cores per package: 1594client # [ 0.055334] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.595worker1 # [ 0.032307] CPU topo: Num. threads per package: 1596lb # [ 0.205154] x86/cpu: User Mode Instruction Prevention (UMIP) activated597client # [ 0.055336] Trampoline variant of Tasks RCU enabled.598worker1 # [ 0.032307] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs599client # [ 0.055336] Rude variant of Tasks RCU enabled.600lb # [ 0.206189] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127601client # [ 0.055336] Tracing variant of Tasks RCU enabled.602worker2 # [ 0.037803] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5kdyxglvc8vkjxanr64206xisjz0i983-nixos-system-worker2-test/init regInfo=/nix/store/zb2i1i3p928plwjbmz1j82y918kvmc31-closure-info/registration console=ttyS0,115200n8 console=tty0603worker1 # [ 0.032325] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()604lb # [ 0.207740] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0605client # [ 0.055337] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.606worker1 # [ 0.032356] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]607client # [ 0.055338] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1608worker2 # [ 0.037892] Unknown kernel command line parameters "regInfo=/nix/store/zb2i1i3p928plwjbmz1j82y918kvmc31-closure-info/registration", will be passed to user space.609worker1 # [ 0.032358] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]610worker2 # [ 0.037905] random: crng init done611lb # [ 0.208070] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto612worker1 # [ 0.032359] [mem 0x60000000-0xafffffff] available for PCI devices613client # [ 0.055354] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.614worker2 # [ 0.037905] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes615worker1 # [ 0.032360] Booting paravirtualized kernel on KVM616lb # [ 0.210066] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl617client # [ 0.055356] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.618worker2 # [ 0.039917] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)619worker1 # [ 0.032363] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns620worker2 # [ 0.040915] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)621lb # [ 0.211066] Transient Scheduler Attacks: Vulnerable: No microcode622client # [ 0.055357] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.623worker2 # [ 0.040945] Fallback order for Node 0: 0624worker1 # [ 0.036843] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1625client # [ 0.059757] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16626lb # [ 0.212066] Spectre V2 : Mitigation: Enhanced / Automatic IBRS627worker2 # [ 0.040948] Built 1 zonelists, mobility grouping on. Total pages: 393078628worker1 # [ 0.038977] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152629client # [ 0.060051] rcu: srcu_init: Setting srcu_struct sizes based on contention.630worker2 # [ 0.040949] Policy zone: DMA32631lb # [ 0.213066] Speculative Return Stack Overflow: Mitigation: Safe RET632worker1 # [ 0.039024] kvm-guest: PV spinlocks disabled, single CPU633worker2 # [ 0.043317] mem auto-init: stack:all(zero), heap alloc:on, heap free:off634client # [ 0.060060] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns635worker2 # [ 0.046238] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1636worker2 # [ 0.049542] allocated 3145728 bytes of page_ext637client # [ 0.060163] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)638worker2 # [ 0.059024] ftrace: allocating 48787 entries in 192 pages639client # [ 0.063690] Console: colour VGA+ 80x25640worker2 # [ 0.059026] ftrace: allocated 192 pages with 2 groups641client # [ 0.063693] printk: legacy console [tty0] enabled642worker2 # [ 0.059804] Dynamic Preempt: lazy643client # [ 0.093267] printk: legacy console [ttyS0] enabled644worker1 # [ 0.039026] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/yyazm3lb0nakqk4g82cfs1y42if0868g-nixos-system-worker1-test/init regInfo=/nix/store/pws236k1fg161lp2fn5za3n9l10gwb2b-closure-info/registration console=ttyS0,115200n8 console=tty0645lb # [ 0.214066] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization646worker2 # [ 0.059933] rcu: Preemptible hierarchical RCU implementation.647client # [ 0.190656] ACPI: Core revision 20250807648worker2 # [ 0.059934] rcu: RCU event tracing is enabled.649lb # [ 0.216074] Spectre V2 : Enabling IBPB for BPF650worker2 # [ 0.059934] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.651worker1 # [ 0.039119] Unknown kernel command line parameters "regInfo=/nix/store/pws236k1fg161lp2fn5za3n9l10gwb2b-closure-info/registration", will be passed to user space.652worker1 # [ 0.039132] random: crng init done653worker2 # [ 0.059936] Trampoline variant of Tasks RCU enabled.654client # [ 0.191578] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns655lb # [ 0.217067] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier656worker2 # [ 0.059936] Rude variant of Tasks RCU enabled.657worker1 # [ 0.039132] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes658lb # [ 0.218067] active return thunk: srso_alias_return_thunk659client # [ 0.193076] APIC: Switch to symmetric I/O mode setup660worker2 # [ 0.059936] Tracing variant of Tasks RCU enabled.661client # [ 0.194058] x2apic enabled662worker1 # [ 0.041413] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)663worker2 # [ 0.059937] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.664lb # [ 0.219087] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'665worker1 # [ 0.042458] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)666worker2 # [ 0.059937] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1667client # [ 0.194840] APIC: Switched APIC routing to: physical x2apic668worker1 # [ 0.042488] Fallback order for Node 0: 0669lb # [ 0.220066] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'670worker2 # [ 0.059952] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.671worker1 # [ 0.042491] Built 1 zonelists, mobility grouping on. Total pages: 393078672lb # [ 0.221066] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'673worker1 # [ 0.042492] Policy zone: DMA32674client # [ 0.196644] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1675worker2 # [ 0.059954] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.676worker1 # [ 0.044927] mem auto-init: stack:all(zero), heap alloc:on, heap free:off677lb # [ 0.222066] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'678worker1 # [ 0.048024] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1679worker2 # [ 0.059955] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.680lb # [ 0.223066] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'681worker1 # [ 0.051286] allocated 3145728 bytes of page_ext682client # [ 0.197624] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns683worker2 # [ 0.064244] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16684worker1 # [ 0.061074] ftrace: allocating 48787 entries in 192 pages685lb # [ 0.224066] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'686worker2 # [ 0.064531] rcu: srcu_init: Setting srcu_struct sizes based on contention.687worker1 # [ 0.061075] ftrace: allocated 192 pages with 2 groups688client # [ 0.199288] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)689worker1 # [ 0.062104] Dynamic Preempt: lazy690lb # [ 0.225066] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'691worker2 # [ 0.064538] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns692worker1 # [ 0.062299] rcu: Preemptible hierarchical RCU implementation.693client # [ 0.200382] x86/cpu: User Mode Instruction Prevention (UMIP) activated694worker1 # [ 0.062299] rcu: RCU event tracing is enabled.695lb # [ 0.226953] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256696worker2 # [ 0.064637] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)697client # [ 0.201411] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127698worker1 # [ 0.062300] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.699worker2 # [ 0.068141] Console: colour VGA+ 80x25700lb # [ 0.227774] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64701worker1 # [ 0.062302] Trampoline variant of Tasks RCU enabled.702worker2 # [ 0.068144] printk: legacy console [tty0] enabled703client # [ 0.202956] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0704worker1 # [ 0.062302] Rude variant of Tasks RCU enabled.705worker2 # [ 0.097567] printk: legacy console [ttyS0] enabled706lb # [ 0.228769] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512707worker1 # [ 0.062302] Tracing variant of Tasks RCU enabled.708worker2 # [ 0.193509] ACPI: Core revision 20250807709lb # [ 0.229771] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024710worker1 # [ 0.062303] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.711client # [ 0.203289] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto712lb # [ 0.230066] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8713worker1 # [ 0.062304] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1714worker2 # [ 0.194363] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns715client # [ 0.205285] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl716worker2 # [ 0.195877] APIC: Switch to symmetric I/O mode setup717worker1 # [ 0.062318] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.718lb # [ 0.231066] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.719client # [ 0.206285] Transient Scheduler Attacks: Vulnerable: No microcode720worker2 # [ 0.196843] x2apic enabled721worker1 # [ 0.062320] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.722client # [ 0.207284] Spectre V2 : Mitigation: Enhanced / Automatic IBRS723worker2 # [ 0.197625] APIC: Switched APIC routing to: physical x2apic724worker1 # [ 0.062321] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.725client # [ 0.208283] Speculative Return Stack Overflow: Mitigation: Safe RET726worker1 # [ 0.066642] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16727worker2 # [ 0.199446] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1728worker1 # [ 0.066918] rcu: srcu_init: Setting srcu_struct sizes based on contention.729worker1 # [ 0.066925] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns730worker2 # [ 0.200437] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns731worker1 # [ 0.067029] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)732client # [ 0.209284] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization733worker1 # [ 0.070548] Console: colour VGA+ 80x25734worker2 # [ 0.202142] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)735worker1 # [ 0.070551] printk: legacy console [tty0] enabled736client # [ 0.211294] Spectre V2 : Enabling IBPB for BPF737worker1 # [ 0.099947] printk: legacy console [ttyS0] enabled738worker2 # [ 0.203223] x86/cpu: User Mode Instruction Prevention (UMIP) activated739worker1 # [ 0.196637] ACPI: Core revision 20250807740client # [ 0.212285] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier741worker2 # [ 0.204273] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127742client # [ 0.213285] active return thunk: srso_alias_return_thunk743worker2 # [ 0.205823] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0744worker1 # [ 0.197557] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns745client # [ 0.214949] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'746worker1 # [ 0.199078] APIC: Switch to symmetric I/O mode setup747worker2 # [ 0.206142] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto748client # [ 0.216194] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'749worker1 # [ 0.200072] x2apic enabled750client # [ 0.217039] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'751worker2 # [ 0.208139] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl752worker1 # [ 0.200859] APIC: Switched APIC routing to: physical x2apic753client # [ 0.218038] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'754worker2 # [ 0.209139] Transient Scheduler Attacks: Vulnerable: No microcode755client # [ 0.219284] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'756worker1 # [ 0.202684] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1757worker2 # [ 0.210873] Spectre V2 : Mitigation: Enhanced / Automatic IBRS758client # [ 0.220284] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'759worker2 # [ 0.211818] Speculative Return Stack Overflow: Mitigation: Safe RET760worker1 # [ 0.203673] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns761client # [ 0.221284] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'762worker1 # [ 0.205350] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)763client # [ 0.222285] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256764worker1 # [ 0.206435] x86/cpu: User Mode Instruction Prevention (UMIP) activated765client # [ 0.223284] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64766worker2 # [ 0.212139] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization767worker1 # [ 0.207481] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127768client # [ 0.224285] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512769worker2 # [ 0.214146] Spectre V2 : Enabling IBPB for BPF770worker1 # [ 0.209034] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0771client # [ 0.225285] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024772worker2 # [ 0.215139] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier773client # [ 0.226284] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8774worker1 # [ 0.210108] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto775worker2 # [ 0.216139] active return thunk: srso_alias_return_thunk776client # [ 0.227284] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.777worker2 # [ 0.217786] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'778worker1 # [ 0.211347] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl779worker2 # [ 0.219029] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'780worker1 # [ 0.212347] Transient Scheduler Attacks: Vulnerable: No microcode781worker2 # [ 0.219895] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'782worker1 # [ 0.214069] Spectre V2 : Mitigation: Enhanced / Automatic IBRS783worker2 # [ 0.220892] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'784worker1 # [ 0.215042] Speculative Return Stack Overflow: Mitigation: Safe RET785worker2 # [ 0.221905] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'786worker2 # [ 0.222894] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'787worker2 # [ 0.223937] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'788worker1 # [ 0.215347] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization789worker2 # [ 0.225139] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256790worker1 # [ 0.217354] Spectre V2 : Enabling IBPB for BPF791worker2 # [ 0.226138] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64792worker1 # [ 0.218348] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier793worker2 # [ 0.227138] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512794lb # [ 0.265740] Freeing SMP alternatives memory: 44K795worker1 # [ 0.219347] active return thunk: srso_alias_return_thunk796worker2 # [ 0.228138] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024797lb # [ 0.266069] pid_max: default: 32768 minimum: 301798worker2 # [ 0.229138] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8799worker1 # [ 0.220991] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'800lb # [ 0.267168] LSM: initializing lsm=capability,landlock,yama,bpf,ima801lb # [ 0.268166] landlock: Up and running.802worker1 # [ 0.222235] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'803worker2 # [ 0.230138] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.804lb # [ 0.269066] Yama: becoming mindful.805worker1 # [ 0.223093] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'806lb # [ 0.269870] LSM support for eBPF active807worker1 # [ 0.224091] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'808lb # [ 0.270641] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)809worker1 # [ 0.225115] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'810worker1 # [ 0.226104] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'811lb # [ 0.271986] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)812worker1 # [ 0.227142] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'813worker1 # [ 0.228347] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256814lb # [ 0.274336] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)815worker1 # [ 0.229347] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64816lb # [ 0.275629] Performance Events: Fam17h+ core perfctr, AMD PMU driver.817worker1 # [ 0.230346] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512818lb # [ 0.276075] ... version: 2819worker1 # [ 0.231347] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024820lb # [ 0.276803] ... bit width: 48821worker1 # [ 0.232346] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8822lb # [ 0.277068] ... generic counters: 6823lb # [ 0.277769] ... generic bitmap: 000000000000003f824worker1 # [ 0.233347] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.825lb # [ 0.278069] ... fixed-purpose counters: 0826lb # [ 0.278792] ... fixed-purpose bitmap: 0000000000000000827lb # [ 0.279069] ... value mask: 0000ffffffffffff828lb # [ 0.279981] ... max period: 00007fffffffffff829lb # [ 0.280733] ... global_ctrl mask: 000000000000003f830lb # [ 0.281164] signal: max sigframe size: 3376831lb # [ 0.281941] rcu: Hierarchical SRCU implementation.832lb # [ 0.282688] rcu: Max phase no-delay instances is 400.833client # [ 0.262245] Freeing SMP alternatives memory: 44K834client # [ 0.262939] pid_max: default: 32768 minimum: 301835client # [ 0.263962] LSM: initializing lsm=capability,landlock,yama,bpf,ima836lb # [ 0.287638] smp: Bringing up secondary CPUs ...837client # [ 0.264397] landlock: Up and running.838lb # [ 0.288082] smp: Brought up 1 node, 1 CPU839client # [ 0.265728] Yama: becoming mindful.840lb # [ 0.288780] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)841client # [ 0.266497] LSM support for eBPF active842client # [ 0.267405] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)843lb # [ 0.289242] Memory: 1454592K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109316K reserved, 0K cma-reserved)844client # [ 0.268328] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)845lb # [ 0.290303] devtmpfs: initialized846lb # [ 0.291121] x86/mm: Memory block size: 128MB847client # [ 0.271051] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)848lb # [ 0.292914] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)849client # [ 0.271808] Performance Events: Fam17h+ core perfctr, AMD PMU driver.850lb # [ 0.293975] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).851client # [ 0.272290] ... version: 2852worker2 # [ 0.263871] Freeing SMP alternatives memory: 44K853client # [ 0.272976] ... bit width: 48854lb # [ 0.295151] pinctrl core: initialized pinctrl subsystem855worker2 # [ 0.264142] pid_max: default: 32768 minimum: 301856client # [ 0.273287] ... generic counters: 6857lb # [ 0.296228] PM: RTC time: 09:25:31, date: 2026-09-24858worker2 # [ 0.265226] LSM: initializing lsm=capability,landlock,yama,bpf,ima859client # [ 0.274048] ... generic bitmap: 000000000000003f860worker2 # [ 0.266231] landlock: Up and running.861client # [ 0.274336] ... fixed-purpose counters: 0862worker2 # [ 0.267139] Yama: becoming mindful.863client # [ 0.275044] ... fixed-purpose bitmap: 0000000000000000864worker2 # [ 0.267939] LSM support for eBPF active865client # [ 0.275288] ... value mask: 0000ffffffffffff866lb # [ 0.299886] NET: Registered PF_NETLINK/PF_ROUTE protocol family867worker2 # [ 0.268703] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)868client # [ 0.276245] ... max period: 00007fffffffffff869client # [ 0.276995] ... global_ctrl mask: 000000000000003f870worker2 # [ 0.270044] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)871lb # [ 0.301296] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations872client # [ 0.277418] signal: max sigframe size: 3376873lb # [ 0.302088] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations874client # [ 0.278224] rcu: Hierarchical SRCU implementation.875client # [ 0.278914] rcu: Max phase no-delay instances is 400.876worker2 # [ 0.272424] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)877lb # [ 0.303353] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations878lb # [ 0.304079] audit: initializing netlink subsys (disabled)879worker2 # [ 0.273681] Performance Events: Fam17h+ core perfctr, AMD PMU driver.880worker2 # [ 0.274147] ... version: 2881lb # [ 0.305236] thermal_sys: Registered thermal governor 'fair_share'882worker1 # [ 0.268003] Freeing SMP alternatives memory: 44K883worker2 # [ 0.274863] ... bit width: 48884worker1 # [ 0.268350] pid_max: default: 32768 minimum: 301885worker2 # [ 0.275141] ... generic counters: 6886lb # [ 0.305238] thermal_sys: Registered thermal governor 'bang_bang'887worker2 # [ 0.275853] ... generic bitmap: 000000000000003f888lb # [ 0.306070] thermal_sys: Registered thermal governor 'step_wise'889worker1 # [ 0.269457] LSM: initializing lsm=capability,landlock,yama,bpf,ima890worker2 # [ 0.276141] ... fixed-purpose counters: 0891client # [ 0.283917] smp: Bringing up secondary CPUs ...892worker1 # [ 0.270449] landlock: Up and running.893lb # [ 0.307020] thermal_sys: Registered thermal governor 'user_space'894client # [ 0.284301] smp: Brought up 1 node, 1 CPU895worker2 # [ 0.276837] ... fixed-purpose bitmap: 0000000000000000896worker1 # [ 0.271347] Yama: becoming mindful.897worker2 # [ 0.277140] ... value mask: 0000ffffffffffff898worker1 # [ 0.272133] LSM support for eBPF active899lb # [ 0.307829] audit: type=2000 audit(1790241931.970:1): state=initialized audit_enabled=0 res=1900client # [ 0.284989] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)901worker2 # [ 0.277988] ... max period: 00007fffffffffff902lb # [ 0.309072] thermal_sys: Registered thermal governor 'power_allocator'903worker1 # [ 0.272919] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)904lb # [ 0.309086] cpuidle: using governor menu905worker2 # [ 0.278856] ... global_ctrl mask: 000000000000003f906client # [ 0.285458] Memory: 1454588K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved)907worker2 # [ 0.279258] signal: max sigframe size: 3376908worker1 # [ 0.274234] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)909lb # [ 0.311246] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5910client # [ 0.286557] devtmpfs: initialized911worker2 # [ 0.280087] rcu: Hierarchical SRCU implementation.912client # [ 0.287365] x86/mm: Memory block size: 128MB913worker2 # [ 0.280740] rcu: Max phase no-delay instances is 400.914lb # [ 0.312318] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]915worker1 # [ 0.276696] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)916lb # [ 0.313071] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry917client # [ 0.289165] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)918lb # [ 0.314080] PCI: Using configuration type 1 for base access919worker1 # [ 0.277922] Performance Events: Fam17h+ core perfctr, AMD PMU driver.920worker1 # [ 0.278355] ... version: 2921client # [ 0.290218] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).922worker1 # [ 0.279096] ... bit width: 48923lb # [ 0.315146] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.924client # [ 0.291376] pinctrl core: initialized pinctrl subsystem925worker1 # [ 0.279349] ... generic counters: 6926worker2 # [ 0.285687] smp: Bringing up secondary CPUs ...927worker1 # [ 0.280091] ... generic bitmap: 000000000000003f928client # [ 0.292491] PM: RTC time: 09:25:31, date: 2026-09-24929worker2 # [ 0.286155] smp: Brought up 1 node, 1 CPU930worker1 # [ 0.280349] ... fixed-purpose counters: 0931worker2 # [ 0.286844] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)932worker1 # [ 0.281082] ... fixed-purpose bitmap: 0000000000000000933worker1 # [ 0.281349] ... value mask: 0000ffffffffffff934worker1 # [ 0.282262] ... max period: 00007fffffffffff935client # [ 0.295982] NET: Registered PF_NETLINK/PF_ROUTE protocol family936lb # [ 0.320307] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages937worker2 # [ 0.287338] Memory: 1454628K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109312K reserved, 0K cma-reserved)938worker1 # [ 0.283026] ... global_ctrl mask: 000000000000003f939worker2 # [ 0.288358] devtmpfs: initialized940lb # [ 0.321070] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page941worker1 # [ 0.283462] signal: max sigframe size: 3376942client # [ 0.296795] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations943worker2 # [ 0.289177] x86/mm: Memory block size: 128MB944worker1 # [ 0.284233] rcu: Hierarchical SRCU implementation.945client # [ 0.297314] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations946worker1 # [ 0.284933] rcu: Max phase no-delay instances is 400.947worker2 # [ 0.290966] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)948client # [ 0.298567] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations949client # [ 0.299297] audit: initializing netlink subsys (disabled)950worker2 # [ 0.292062] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).951lb # [ 0.326070] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages952worker2 # [ 0.293216] pinctrl core: initialized pinctrl subsystem953client # [ 0.300289] audit: type=2000 audit(1790241931.992:1): state=initialized audit_enabled=0 res=1954lb # [ 0.327068] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page955worker2 # [ 0.294272] PM: RTC time: 09:25:31, date: 2026-09-24956client # [ 0.301486] thermal_sys: Registered thermal governor 'fair_share'957worker1 # [ 0.289902] smp: Bringing up secondary CPUs ...958client # [ 0.301488] thermal_sys: Registered thermal governor 'bang_bang'959worker1 # [ 0.290364] smp: Brought up 1 node, 1 CPU960client # [ 0.302288] thermal_sys: Registered thermal governor 'step_wise'961worker1 # [ 0.291055] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)962client # [ 0.303230] thermal_sys: Registered thermal governor 'user_space'963worker2 # [ 0.297863] NET: Registered PF_NETLINK/PF_ROUTE protocol family964client # [ 0.304024] thermal_sys: Registered thermal governor 'power_allocator'965worker1 # [ 0.291497] Memory: 1454596K/1572312K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 109308K reserved, 0K cma-reserved)966client # [ 0.304300] cpuidle: using governor menu967worker2 # [ 0.298624] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations968worker1 # [ 0.292627] devtmpfs: initialized969worker2 # [ 0.299160] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations970client # [ 0.306502] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5971worker1 # [ 0.293391] x86/mm: Memory block size: 128MB972worker2 # [ 0.300402] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations973client # [ 0.307529] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]974worker2 # [ 0.301150] audit: initializing netlink subsys (disabled)975worker1 # [ 0.295159] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)976client # [ 0.308290] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry977lb # [ 0.337395] ACPI: Added _OSI(Module Device)978client # [ 0.309298] PCI: Using configuration type 1 for base access979worker2 # [ 0.302282] thermal_sys: Registered thermal governor 'fair_share'980worker1 # [ 0.296225] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).981lb # [ 0.338070] ACPI: Added _OSI(Processor Device)982worker2 # [ 0.302284] thermal_sys: Registered thermal governor 'bang_bang'983lb # [ 0.338806] ACPI: Added _OSI(Processor Aggregator Device)984worker1 # [ 0.297435] pinctrl core: initialized pinctrl subsystem985client # [ 0.310362] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.986worker2 # [ 0.303142] thermal_sys: Registered thermal governor 'step_wise'987worker1 # [ 0.298535] PM: RTC time: 09:25:31, date: 2026-09-24988worker2 # [ 0.304078] thermal_sys: Registered thermal governor 'user_space'989worker2 # [ 0.304879] audit: type=2000 audit(1790241932.006:1): state=initialized audit_enabled=0 res=1990worker2 # [ 0.306144] thermal_sys: Registered thermal governor 'power_allocator'991worker1 # [ 0.302078] NET: Registered PF_NETLINK/PF_ROUTE protocol family992worker2 # [ 0.306157] cpuidle: using governor menu993worker2 # [ 0.308374] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5994worker1 # [ 0.302837] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations995client # [ 0.317302] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages996worker1 # [ 0.303375] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations997worker2 # [ 0.309372] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]998client # [ 0.318287] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page999lb # [ 0.347128] ACPI: 1 ACPI AML tables successfully acquired and loaded1000worker2 # [ 0.310144] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry1001worker1 # [ 0.304626] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations1002worker2 # [ 0.311152] PCI: Using configuration type 1 for base access1003worker1 # [ 0.305360] audit: initializing netlink subsys (disabled)1004worker1 # [ 0.306488] thermal_sys: Registered thermal governor 'fair_share'1005worker2 # [ 0.312251] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.1006worker1 # [ 0.306491] thermal_sys: Registered thermal governor 'bang_bang'1007lb # [ 0.351467] ACPI: Interpreter enabled1008worker1 # [ 0.307351] thermal_sys: Registered thermal governor 'step_wise'1009client # [ 0.323288] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1010lb # [ 0.352084] ACPI: PM: (supports S0 S3 S4 S5)1011worker1 # [ 0.308336] thermal_sys: Registered thermal governor 'user_space'1012lb # [ 0.352833] ACPI: Using IOAPIC for interrupt routing1013client # [ 0.324288] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1014worker1 # [ 0.309116] audit: type=2000 audit(1790241932.018:1): state=initialized audit_enabled=0 res=11015worker2 # [ 0.317355] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1016worker1 # [ 0.310353] thermal_sys: Registered thermal governor 'power_allocator'1017worker1 # [ 0.310365] cpuidle: using governor menu1018worker2 # [ 0.318142] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1019lb # [ 0.355103] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1020lb # [ 0.356069] PCI: Using E820 reservations for host bridge windows1021worker1 # [ 0.312578] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.51022worker1 # [ 0.313622] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]1023worker1 # [ 0.314352] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry1024lb # [ 0.359179] ACPI: Enabled 2 GPEs in block 00 to 3F1025worker1 # [ 0.315360] PCI: Using configuration type 1 for base access1026worker2 # [ 0.323143] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1027worker2 # [ 0.324143] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1028worker1 # [ 0.316501] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.1029client # [ 0.335517] ACPI: Added _OSI(Module Device)1030client # [ 0.336240] ACPI: Added _OSI(Processor Device)1031client # [ 0.336896] ACPI: Added _OSI(Processor Aggregator Device)1032lb # [ 0.366650] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1033worker1 # [ 0.321458] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1034worker1 # [ 0.322350] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1035lb # [ 0.367075] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1036lb # [ 0.368148] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1037lb # [ 0.369191] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1038client # [ 0.342644] ACPI: 1 ACPI AML tables successfully acquired and loaded1039worker2 # [ 0.334503] ACPI: Added _OSI(Module Device)1040lb # [ 0.370428] PCI host bridge to bus 0000:001041worker2 # [ 0.335143] ACPI: Added _OSI(Processor Device)1042lb # [ 0.371073] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1043worker2 # [ 0.335899] ACPI: Added _OSI(Processor Aggregator Device)1044worker1 # [ 0.327350] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1045lb # [ 0.372069] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1046worker1 # [ 0.328349] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1047client # [ 0.346705] ACPI: Interpreter enabled1048lb # [ 0.373069] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1049client # [ 0.347302] ACPI: PM: (supports S0 S3 S4 S5)1050lb # [ 0.374069] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1051client # [ 0.348005] ACPI: Using IOAPIC for interrupt routing1052lb # [ 0.375069] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1053lb # [ 0.376074] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1054lb # [ 0.377070] pci_bus 0000:00: root bus resource [bus 00-ff]1055client # [ 0.350340] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1056client # [ 0.351288] PCI: Using E820 reservations for host bridge windows1057lb # [ 0.378047] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1058worker2 # [ 0.344209] ACPI: 1 ACPI AML tables successfully acquired and loaded1059lb # [ 0.379604] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1060client # [ 0.354402] ACPI: Enabled 2 GPEs in block 00 to 3F1061worker1 # [ 0.338729] ACPI: Added _OSI(Module Device)1062worker1 # [ 0.339351] ACPI: Added _OSI(Processor Device)1063worker1 # [ 0.340133] ACPI: Added _OSI(Processor Aggregator Device)1064worker2 # [ 0.348556] ACPI: Interpreter enabled1065worker2 # [ 0.349156] ACPI: PM: (supports S0 S3 S4 S5)1066worker2 # [ 0.349943] ACPI: Using IOAPIC for interrupt routing1067lb # [ 0.382120] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1068lb # [ 0.383082] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1069worker2 # [ 0.353191] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1070client # [ 0.361786] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1071lb # [ 0.384058] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1072worker2 # [ 0.354142] PCI: Using E820 reservations for host bridge windows1073client # [ 0.362294] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1074lb # [ 0.384969] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1075client # [ 0.363365] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1076worker1 # [ 0.348399] ACPI: 1 ACPI AML tables successfully acquired and loaded1077worker2 # [ 0.357248] ACPI: Enabled 2 GPEs in block 00 to 3F1078client # [ 0.364409] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1079lb # [ 0.387189] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1080client # [ 0.365671] PCI host bridge to bus 0000:001081client # [ 0.366292] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1082worker1 # [ 0.352752] ACPI: Interpreter enabled1083client # [ 0.367288] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1084lb # [ 0.390108] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1085worker1 # [ 0.353365] ACPI: PM: (supports S0 S3 S4 S5)1086lb # [ 0.390938] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1087client # [ 0.368288] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1088worker1 # [ 0.354109] ACPI: Using IOAPIC for interrupt routing1089lb # [ 0.391789] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1090client # [ 0.369287] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1091lb # [ 0.392074] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1092worker2 # [ 0.364208] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1093client # [ 0.370287] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1094client # [ 0.371287] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1095worker2 # [ 0.365146] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1096worker1 # [ 0.356398] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1097lb # [ 0.393602] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1098client # [ 0.372288] pci_bus 0000:00: root bus resource [bus 00-ff]1099worker1 # [ 0.357350] PCI: Using E820 reservations for host bridge windows1100worker2 # [ 0.366219] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1101client # [ 0.373268] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1102worker2 # [ 0.367264] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1103worker2 # [ 0.368490] PCI host bridge to bus 0000:001104lb # [ 0.396912] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1105worker1 # [ 0.360451] ACPI: Enabled 2 GPEs in block 00 to 3F1106client # [ 0.374730] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1107worker2 # [ 0.369152] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1108lb # [ 0.397674] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1109worker2 # [ 0.370141] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1110lb # [ 0.398091] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1111worker2 # [ 0.371141] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1112lb # [ 0.399642] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1113worker2 # [ 0.372141] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1114worker2 # [ 0.373142] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1115worker2 # [ 0.374145] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1116lb # [ 0.402111] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1117worker2 # [ 0.375141] pci_bus 0000:00: root bus resource [bus 00-ff]1118worker1 # [ 0.368020] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1119client # [ 0.377377] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1120lb # [ 0.402944] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1121client # [ 0.378299] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1122worker2 # [ 0.376112] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1123worker1 # [ 0.368356] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1124client # [ 0.379228] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1125lb # [ 0.403799] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1126worker1 # [ 0.369429] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1127worker2 # [ 0.377610] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1128worker1 # [ 0.370472] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1129client # [ 0.380377] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1130lb # [ 0.404667] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1131worker1 # [ 0.371692] PCI host bridge to bus 0000:001132worker1 # [ 0.372354] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1133client # [ 0.382176] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1134lb # [ 0.406933] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1135worker1 # [ 0.373349] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1136lb # [ 0.407737] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1137worker1 # [ 0.374349] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1138lb # [ 0.408090] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1139worker1 # [ 0.375350] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1140client # [ 0.385326] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1141lb # [ 0.409075] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1142worker2 # [ 0.380191] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1143client # [ 0.386241] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1144worker1 # [ 0.376349] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1145worker2 # [ 0.381153] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1146client # [ 0.387032] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1147worker1 # [ 0.377350] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1148worker2 # [ 0.382096] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1149client # [ 0.388111] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1150lb # [ 0.410592] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1151worker1 # [ 0.378350] pci_bus 0000:00: root bus resource [bus 00-ff]1152worker2 # [ 0.383025] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1153worker1 # [ 0.379314] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1154lb # [ 0.412082] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1155client # [ 0.389607] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1156lb # [ 0.413057] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1157worker1 # [ 0.380791] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1158worker2 # [ 0.384855] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1159lb # [ 0.414447] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1160client # [ 0.392212] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1161worker2 # [ 0.387182] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1162client # [ 0.392965] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1163worker2 # [ 0.388064] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1164lb # [ 0.416082] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1165client # [ 0.393309] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1166worker2 # [ 0.388923] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1167lb # [ 0.417054] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1168worker2 # [ 0.390055] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1169client # [ 0.394847] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1170lb # [ 0.418540] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1171worker1 # [ 0.383439] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1172worker2 # [ 0.391556] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1173worker1 # [ 0.384362] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1174lb # [ 0.420081] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1175worker1 # [ 0.385424] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1176worker2 # [ 0.393181] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1177client # [ 0.397678] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1178lb # [ 0.421018] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1179worker2 # [ 0.394042] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1180worker1 # [ 0.386517] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1181client # [ 0.398946] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1182worker2 # [ 0.394872] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1183lb # [ 0.422527] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1184client # [ 0.399309] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1185worker1 # [ 0.388280] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1186worker2 # [ 0.395715] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1187client # [ 0.400838] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1188lb # [ 0.424113] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1189lb # [ 0.425091] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1190worker1 # [ 0.391358] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]1191client # [ 0.403174] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1192worker2 # [ 0.398182] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1193worker1 # [ 0.392230] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1194client # [ 0.403959] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1195lb # [ 0.426601] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1196worker2 # [ 0.399028] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1197worker1 # [ 0.393072] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1198client # [ 0.404310] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1199worker1 # [ 0.393362] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1200worker2 # [ 0.399895] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1201lb # [ 0.429887] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1202client # [ 0.405293] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1203worker2 # [ 0.400684] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1204worker1 # [ 0.394919] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1205lb # [ 0.430675] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1206client # [ 0.406826] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1207lb # [ 0.431092] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1208worker2 # [ 0.402183] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1209worker2 # [ 0.403069] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1210worker1 # [ 0.397386] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]1211lb # [ 0.432653] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1212client # [ 0.408329] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1213worker1 # [ 0.398267] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1214worker2 # [ 0.403885] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1215client # [ 0.409287] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1216worker1 # [ 0.399100] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1217worker2 # [ 0.404147] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1218client # [ 0.410875] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1219worker1 # [ 0.399889] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1220lb # [ 0.434110] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1221worker2 # [ 0.405815] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1222lb # [ 0.435076] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1223lb # [ 0.436058] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1224worker2 # [ 0.408038] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1225client # [ 0.412305] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1226worker2 # [ 0.408894] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1227client # [ 0.413311] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1228lb # [ 0.437501] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1229worker1 # [ 0.402660] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]1230worker1 # [ 0.403988] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1231worker2 # [ 0.409769] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1232client # [ 0.414892] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1233lb # [ 0.438923] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1234worker1 # [ 0.404371] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1235lb # [ 0.439900] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1236worker2 # [ 0.411189] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1237client # [ 0.416300] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1238worker1 # [ 0.405928] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1239worker2 # [ 0.412163] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1240client # [ 0.417267] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1241lb # [ 0.441784] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1242client # [ 0.418696] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1243worker2 # [ 0.413733] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1244worker1 # [ 0.407392] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]1245lb # [ 0.442305] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1246worker1 # [ 0.408258] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1247worker2 # [ 0.415987] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1248worker1 # [ 0.409129] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1249lb # [ 0.444892] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1250worker2 # [ 0.416896] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1251client # [ 0.420300] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1252worker1 # [ 0.410236] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]1253client # [ 0.421334] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1254worker2 # [ 0.417710] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1255worker1 # [ 0.411887] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1256client # [ 0.422831] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1257worker2 # [ 0.419154] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1258worker1 # [ 0.413394] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1259worker2 # [ 0.420164] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1260client # [ 0.425032] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1261worker1 # [ 0.414371] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1262client # [ 0.425296] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1263worker2 # [ 0.421681] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1264client # [ 0.426287] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1265worker1 # [ 0.415946] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1266worker2 # [ 0.423193] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1267worker1 # [ 0.417362] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1268worker2 # [ 0.424081] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1269client # [ 0.427869] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1270worker2 # [ 0.424940] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1271lb # [ 0.445897] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1272worker1 # [ 0.418359] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1273client # [ 0.429933] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1274worker2 # [ 0.426548] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1275lb # [ 0.447809] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1276worker1 # [ 0.419979] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1277client # [ 0.430294] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1278lb # [ 0.448349] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1279client # [ 0.431263] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1280worker2 # [ 0.428150] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1281worker1 # [ 0.421362] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1282lb # [ 0.449391] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1283client # [ 0.432715] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1284worker1 # [ 0.422371] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1285worker2 # [ 0.429029] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1286worker2 # [ 0.430163] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1287lb # [ 0.450544] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1288client # [ 0.434001] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1289worker1 # [ 0.423916] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1290client # [ 0.434482] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1291worker2 # [ 0.431701] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1292lb # [ 0.452097] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1293worker1 # [ 0.425362] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1294lb # [ 0.452968] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1295worker2 # [ 0.432705] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1296client # [ 0.436854] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1297worker1 # [ 0.426359] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1298lb # [ 0.454146] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1299worker2 # [ 0.433339] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1300client # [ 0.437510] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1301lb # [ 0.455729] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1302worker1 # [ 0.427910] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1303worker2 # [ 0.434701] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1304client # [ 0.439082] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1305worker2 # [ 0.435343] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1306worker1 # [ 0.429369] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]1307worker1 # [ 0.430327] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1308worker2 # [ 0.436969] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1309worker1 # [ 0.431084] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1310worker1 # [ 0.431932] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1311lb # [ 0.459858] ACPI: PCI: Interrupt link LNKA configured for IRQ 101312lb # [ 0.461302] ACPI: PCI: Interrupt link LNKB configured for IRQ 101313lb # [ 0.462171] ACPI: PCI: Interrupt link LNKC configured for IRQ 111314worker1 # [ 0.434386] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]1315lb # [ 0.463175] ACPI: PCI: Interrupt link LNKD configured for IRQ 111316worker1 # [ 0.435283] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1317lb # [ 0.464173] ACPI: PCI: Interrupt link LNKE configured for IRQ 101318worker1 # [ 0.436164] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1319lb # [ 0.465167] ACPI: PCI: Interrupt link LNKF configured for IRQ 101320worker1 # [ 0.437840] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1321worker1 # [ 0.438998] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]1322client # [ 0.440203] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1323worker2 # [ 0.438080] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1324lb # [ 0.466172] ACPI: PCI: Interrupt link LNKG configured for IRQ 111325worker1 # [ 0.439546] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1326lb # [ 0.467174] ACPI: PCI: Interrupt link LNKH configured for IRQ 111327worker2 # [ 0.440038] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1328lb # [ 0.468114] ACPI: PCI: Interrupt link GSIA configured for IRQ 161329client # [ 0.442809] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1330worker1 # [ 0.441035] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]1331lb # [ 0.469084] ACPI: PCI: Interrupt link GSIB configured for IRQ 171332worker2 # [ 0.441184] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1333lb # [ 0.470053] ACPI: PCI: Interrupt link GSIC configured for IRQ 181334worker1 # [ 0.441547] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1335client # [ 0.443597] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1336worker2 # [ 0.442429] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1337lb # [ 0.470818] ACPI: PCI: Interrupt link GSID configured for IRQ 191338worker1 # [ 0.443059] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]1339client # [ 0.444572] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1340lb # [ 0.471081] ACPI: PCI: Interrupt link GSIE configured for IRQ 201341worker2 # [ 0.443386] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1342lb # [ 0.472042] ACPI: PCI: Interrupt link GSIF configured for IRQ 211343client # [ 0.445550] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1344lb # [ 0.472847] ACPI: PCI: Interrupt link GSIG configured for IRQ 221345lb # [ 0.473086] ACPI: PCI: Interrupt link GSIH configured for IRQ 231346worker2 # [ 0.446164] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1347client # [ 0.447316] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1348worker2 # [ 0.447026] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1349client # [ 0.448160] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1350lb # [ 0.475187] iommu: Default domain type: Translated1351lb # [ 0.476008] iommu: DMA domain TLB invalidation policy: lazy mode1352lb # [ 0.477166] ACPI: bus type USB registered1353client # [ 0.449381] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1354lb # [ 0.477909] usbcore: registered new interface driver usbfs1355worker2 # [ 0.448470] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1356lb # [ 0.478790] usbcore: registered new interface driver hub1357client # [ 0.452161] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1358lb # [ 0.479078] usbcore: registered new device driver usb1359worker2 # [ 0.450711] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1360lb # [ 0.480896] NetLabel: Initializing1361lb # [ 0.481513] NetLabel: domain hash size = 1281362lb # [ 0.482068] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1363client # [ 0.456178] ACPI: PCI: Interrupt link LNKA configured for IRQ 101364lb # [ 0.483045] NetLabel: unlabeled traffic allowed by default1365worker1 # [ 0.443569] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1366client # [ 0.457189] ACPI: PCI: Interrupt link LNKB configured for IRQ 101367lb # [ 0.483769] PCI: Using ACPI for IRQ routing1368worker2 # [ 0.454333] ACPI: PCI: Interrupt link LNKA configured for IRQ 101369client # [ 0.458112] ACPI: PCI: Interrupt link LNKC configured for IRQ 111370worker1 # [ 0.446357] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1371worker2 # [ 0.455251] ACPI: PCI: Interrupt link LNKB configured for IRQ 101372client # [ 0.459147] ACPI: PCI: Interrupt link LNKD configured for IRQ 111373worker2 # [ 0.456281] ACPI: PCI: Interrupt link LNKC configured for IRQ 111374client # [ 0.460384] ACPI: PCI: Interrupt link LNKE configured for IRQ 101375worker1 # [ 0.447631] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1376worker2 # [ 0.457243] ACPI: PCI: Interrupt link LNKD configured for IRQ 111377client # [ 0.461382] ACPI: PCI: Interrupt link LNKF configured for IRQ 101378worker2 # [ 0.458248] ACPI: PCI: Interrupt link LNKE configured for IRQ 101379client # [ 0.462387] ACPI: PCI: Interrupt link LNKG configured for IRQ 111380worker1 # [ 0.448678] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1381worker2 # [ 0.459241] ACPI: PCI: Interrupt link LNKF configured for IRQ 101382client # [ 0.463385] ACPI: PCI: Interrupt link LNKH configured for IRQ 111383worker1 # [ 0.449608] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1384worker2 # [ 0.460241] ACPI: PCI: Interrupt link LNKG configured for IRQ 111385client # [ 0.464320] ACPI: PCI: Interrupt link GSIA configured for IRQ 161386client # [ 0.465250] ACPI: PCI: Interrupt link GSIB configured for IRQ 171387worker2 # [ 0.461238] ACPI: PCI: Interrupt link LNKH configured for IRQ 111388client # [ 0.466029] ACPI: PCI: Interrupt link GSIC configured for IRQ 181389worker2 # [ 0.462175] ACPI: PCI: Interrupt link GSIA configured for IRQ 161390worker1 # [ 0.451408] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]1391client # [ 0.466301] ACPI: PCI: Interrupt link GSID configured for IRQ 191392worker1 # [ 0.452271] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1393worker2 # [ 0.463152] ACPI: PCI: Interrupt link GSIB configured for IRQ 171394client # [ 0.467263] ACPI: PCI: Interrupt link GSIE configured for IRQ 201395worker2 # [ 0.464157] ACPI: PCI: Interrupt link GSIC configured for IRQ 181396worker1 # [ 0.453398] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1397client # [ 0.468112] ACPI: PCI: Interrupt link GSIF configured for IRQ 211398worker2 # [ 0.465150] ACPI: PCI: Interrupt link GSID configured for IRQ 191399client # [ 0.469190] ACPI: PCI: Interrupt link GSIG configured for IRQ 221400worker2 # [ 0.466155] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401client # [ 0.470035] ACPI: PCI: Interrupt link GSIH configured for IRQ 231402worker2 # [ 0.467153] ACPI: PCI: Interrupt link GSIF configured for IRQ 211403worker1 # [ 0.455378] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1404worker2 # [ 0.468155] ACPI: PCI: Interrupt link GSIG configured for IRQ 221405client # [ 0.471322] iommu: Default domain type: Translated1406worker2 # [ 0.469153] ACPI: PCI: Interrupt link GSIH configured for IRQ 231407client # [ 0.472116] iommu: DMA domain TLB invalidation policy: lazy mode1408client # [ 0.473348] ACPI: bus type USB registered1409worker2 # [ 0.471222] iommu: Default domain type: Translated1410worker1 # [ 0.460062] ACPI: PCI: Interrupt link LNKA configured for IRQ 101411client # [ 0.474135] usbcore: registered new interface driver usbfs1412worker2 # [ 0.472026] iommu: DMA domain TLB invalidation policy: lazy mode1413worker1 # [ 0.460460] ACPI: PCI: Interrupt link LNKB configured for IRQ 101414client # [ 0.475015] usbcore: registered new interface driver hub1415worker2 # [ 0.473176] ACPI: bus type USB registered1416client # [ 0.475297] usbcore: registered new device driver usb1417worker1 # [ 0.461449] ACPI: PCI: Interrupt link LNKC configured for IRQ 111418worker2 # [ 0.473909] usbcore: registered new interface driver usbfs1419worker1 # [ 0.462448] ACPI: PCI: Interrupt link LNKD configured for IRQ 111420worker2 # [ 0.474160] usbcore: registered new interface driver hub1421client # [ 0.477068] NetLabel: Initializing1422worker1 # [ 0.463473] ACPI: PCI: Interrupt link LNKE configured for IRQ 101423worker2 # [ 0.475059] usbcore: registered new device driver usb1424client # [ 0.477294] NetLabel: domain hash size = 1281425worker1 # [ 0.464468] ACPI: PCI: Interrupt link LNKF configured for IRQ 101426client # [ 0.478131] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1427worker2 # [ 0.476919] NetLabel: Initializing1428worker1 # [ 0.465454] ACPI: PCI: Interrupt link LNKG configured for IRQ 111429worker2 # [ 0.477148] NetLabel: domain hash size = 1281430client # [ 0.479131] NetLabel: unlabeled traffic allowed by default1431worker2 # [ 0.477867] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1432client # [ 0.480074] PCI: Using ACPI for IRQ routing1433worker1 # [ 0.466457] ACPI: PCI: Interrupt link LNKH configured for IRQ 111434worker2 # [ 0.478221] NetLabel: unlabeled traffic allowed by default1435worker1 # [ 0.467389] ACPI: PCI: Interrupt link GSIA configured for IRQ 161436worker2 # [ 0.479126] PCI: Using ACPI for IRQ routing1437worker1 # [ 0.468365] ACPI: PCI: Interrupt link GSIB configured for IRQ 171438worker1 # [ 0.469362] ACPI: PCI: Interrupt link GSIC configured for IRQ 181439worker1 # [ 0.470364] ACPI: PCI: Interrupt link GSID configured for IRQ 191440worker1 # [ 0.471363] ACPI: PCI: Interrupt link GSIE configured for IRQ 201441worker1 # [ 0.472361] ACPI: PCI: Interrupt link GSIF configured for IRQ 211442worker1 # [ 0.473362] ACPI: PCI: Interrupt link GSIG configured for IRQ 221443worker1 # [ 0.474362] ACPI: PCI: Interrupt link GSIH configured for IRQ 231444worker1 # [ 0.476394] iommu: Default domain type: Translated1445worker1 # [ 0.477220] iommu: DMA domain TLB invalidation policy: lazy mode1446worker1 # [ 0.478436] ACPI: bus type USB registered1447worker1 # [ 0.479203] usbcore: registered new interface driver usbfs1448worker1 # [ 0.480061] usbcore: registered new interface driver hub1449worker1 # [ 0.480358] usbcore: registered new device driver usb1450worker1 # [ 0.482132] NetLabel: Initializing1451worker1 # [ 0.482356] NetLabel: domain hash size = 1281452lb # [ 0.527208] pci 0000:00:01.0: vgaarb: setting as boot VGA device1453worker1 # [ 0.483092] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1454lb # [ 0.528065] pci 0000:00:01.0: vgaarb: bridge control possible1455worker1 # [ 0.483401] NetLabel: unlabeled traffic allowed by default1456worker1 # [ 0.484339] PCI: Using ACPI for IRQ routing1457lb # [ 0.528065] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1458lb # [ 0.528073] vgaarb: loaded1459lb # [ 0.528811] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01460lb # [ 0.529070] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1461lb # [ 0.533148] clocksource: Switched to clocksource kvm-clock1462lb # [ 0.536577] VFS: Disk quotas dquot_6.6.01463lb # [ 0.537345] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1464lb # [ 0.538779] pnp: PnP ACPI init1465lb # [ 0.539612] ACPI: IRQ 4 override to edge(!), high(!)1466lb # [ 0.540639] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1467lb # [ 0.542234] pnp: PnP ACPI: found 5 devices1468lb # [ 0.549836] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1469client # [ 0.523546] pci 0000:00:01.0: vgaarb: setting as boot VGA device1470lb # [ 0.551419] clocksource: Switched to clocksource acpi_pm1471client # [ 0.524283] pci 0000:00:01.0: vgaarb: bridge control possible1472lb # [ 0.552370] NET: Registered PF_INET protocol family1473worker2 # [ 0.523453] pci 0000:00:01.0: vgaarb: setting as boot VGA device1474client # [ 0.524283] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1475lb # [ 0.553497] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1476worker2 # [ 0.524137] pci 0000:00:01.0: vgaarb: bridge control possible1477client # [ 0.524292] vgaarb: loaded1478client # [ 0.525032] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01479worker2 # [ 0.524137] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1480worker2 # [ 0.524145] vgaarb: loaded1481client # [ 0.525287] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1482worker2 # [ 0.524887] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01483worker2 # [ 0.525143] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1484client # [ 0.528373] clocksource: Switched to clocksource kvm-clock1485client # [ 0.530137] VFS: Disk quotas dquot_6.6.01486worker2 # [ 0.529227] clocksource: Switched to clocksource kvm-clock1487client # [ 0.532696] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1488worker2 # [ 0.532704] VFS: Disk quotas dquot_6.6.01489client # [ 0.534109] pnp: PnP ACPI init1490worker2 # [ 0.533410] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1491client # [ 0.534952] ACPI: IRQ 4 override to edge(!), high(!)1492worker2 # [ 0.534817] pnp: PnP ACPI init1493client # [ 0.535940] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1494worker2 # [ 0.535587] ACPI: IRQ 4 override to edge(!), high(!)1495client # [ 0.537528] pnp: PnP ACPI: found 5 devices1496worker2 # [ 0.536558] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1497lb # [ 0.569745] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1498worker1 # [ 0.527896] pci 0000:00:01.0: vgaarb: setting as boot VGA device1499worker2 # [ 0.538136] pnp: PnP ACPI: found 5 devices1500worker1 # [ 0.528345] pci 0000:00:01.0: vgaarb: bridge control possible1501lb # [ 0.571286] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1502worker1 # [ 0.528345] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1503lb # [ 0.572611] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1504worker1 # [ 0.528354] vgaarb: loaded1505worker1 # [ 0.529104] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01506lb # [ 0.573972] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1507worker1 # [ 0.529351] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1508lb # [ 0.575234] TCP: Hash tables configured (established 16384 bind 16384)1509lb # [ 0.576434] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1510client # [ 0.545143] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1511lb # [ 0.577743] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1512client # [ 0.546584] clocksource: Switched to clocksource acpi_pm1513lb # [ 0.578860] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1514client # [ 0.547565] NET: Registered PF_INET protocol family1515worker2 # [ 0.545711] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1516worker1 # [ 0.533436] clocksource: Switched to clocksource kvm-clock1517worker2 # [ 0.547177] clocksource: Switched to clocksource acpi_pm1518lb # [ 0.580038] NET: Registered PF_UNIX/PF_LOCAL protocol family1519client # [ 0.548676] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1520lb # [ 0.580986] NET: Registered PF_XDP protocol family1521worker2 # [ 0.548159] NET: Registered PF_INET protocol family1522lb # [ 0.581850] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1523worker1 # [ 0.536912] VFS: Disk quotas dquot_6.6.01524worker2 # [ 0.549387] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1525lb # [ 0.582909] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1526worker1 # [ 0.537609] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1527lb # [ 0.583922] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1528worker1 # [ 0.538991] pnp: PnP ACPI init1529lb # [ 0.585070] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1530worker1 # [ 0.539829] ACPI: IRQ 4 override to edge(!), high(!)1531lb # [ 0.586203] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1532worker1 # [ 0.540769] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved1533lb # [ 0.587364] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1534worker1 # [ 0.542333] pnp: PnP ACPI: found 5 devices1535lb # [ 0.589198] ACPI: \_SB_.GSIA: Enabled at IRQ 161536lb # [ 0.591628] ACPI: \_SB_.GSIB: Enabled at IRQ 171537lb # [ 0.593554] ACPI: \_SB_.GSIC: Enabled at IRQ 181538lb # [ 0.595506] ACPI: \_SB_.GSID: Enabled at IRQ 191539worker1 # [ 0.549944] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1540lb # [ 0.597166] PCI: CLS 0 bytes, default 641541worker1 # [ 0.551440] clocksource: Switched to clocksource acpi_pm1542client # [ 0.565409] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1543worker1 # [ 0.552381] NET: Registered PF_INET protocol family1544lb # [ 0.598013] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1545client # [ 0.566836] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1546worker2 # [ 0.565562] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1547lb # [ 0.599712] Trying to unpack rootfs image as initramfs...1548worker1 # [ 0.553574] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1549client # [ 0.568114] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1550worker2 # [ 0.567098] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1551client # [ 0.569467] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1552worker2 # [ 0.568396] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1553client # [ 0.570714] TCP: Hash tables configured (established 16384 bind 16384)1554worker2 # [ 0.569787] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1555client # [ 0.571849] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1556worker2 # [ 0.571084] TCP: Hash tables configured (established 16384 bind 16384)1557client # [ 0.573141] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1558worker2 # [ 0.572420] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1559client # [ 0.574218] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1560worker2 # [ 0.573744] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1561client # [ 0.575459] NET: Registered PF_UNIX/PF_LOCAL protocol family1562worker2 # [ 0.574877] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1563client # [ 0.576456] NET: Registered PF_XDP protocol family1564worker2 # [ 0.576122] NET: Registered PF_UNIX/PF_LOCAL protocol family1565client # [ 0.577300] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1566worker2 # [ 0.577140] NET: Registered PF_XDP protocol family1567client # [ 0.578368] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1568worker2 # [ 0.578004] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1569client # [ 0.579378] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1570worker2 # [ 0.579063] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1571client # [ 0.580530] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1572worker2 # [ 0.580119] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1573client # [ 0.581667] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1574worker2 # [ 0.581247] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1575client # [ 0.582786] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1576worker2 # [ 0.582378] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1577client # [ 0.584522] ACPI: \_SB_.GSIA: Enabled at IRQ 161578worker1 # [ 0.569834] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1579worker2 # [ 0.583547] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1580worker1 # [ 0.571354] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1581worker2 # [ 0.585346] ACPI: \_SB_.GSIA: Enabled at IRQ 161582client # [ 0.586633] ACPI: \_SB_.GSIB: Enabled at IRQ 171583worker1 # [ 0.572739] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1584worker2 # [ 0.587401] ACPI: \_SB_.GSIB: Enabled at IRQ 171585worker1 # [ 0.574188] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1586client # [ 0.589084] ACPI: \_SB_.GSIC: Enabled at IRQ 181587worker1 # [ 0.575483] TCP: Hash tables configured (established 16384 bind 16384)1588worker2 # [ 0.589526] ACPI: \_SB_.GSIC: Enabled at IRQ 181589client # [ 0.591220] ACPI: \_SB_.GSID: Enabled at IRQ 191590worker1 # [ 0.576726] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1591worker1 # [ 0.578073] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1592worker2 # [ 0.591434] ACPI: \_SB_.GSID: Enabled at IRQ 191593client # [ 0.593057] PCI: CLS 0 bytes, default 641594worker1 # [ 0.579277] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1595worker2 # [ 0.593089] PCI: CLS 0 bytes, default 641596worker1 # [ 0.580511] NET: Registered PF_UNIX/PF_LOCAL protocol family1597client # [ 0.594046] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1598worker1 # [ 0.581444] NET: Registered PF_XDP protocol family1599client # [ 0.595807] Trying to unpack rootfs image as initramfs...1600worker2 # [ 0.594025] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1601worker1 # [ 0.582257] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1602worker2 # [ 0.595769] Trying to unpack rootfs image as initramfs...1603worker1 # [ 0.583310] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1604worker1 # [ 0.584381] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1605worker1 # [ 0.585559] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1606worker1 # [ 0.586734] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1607worker1 # [ 0.587885] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1608worker1 # [ 0.589643] ACPI: \_SB_.GSIA: Enabled at IRQ 161609worker1 # [ 0.591782] ACPI: \_SB_.GSIB: Enabled at IRQ 171610worker1 # [ 0.593841] ACPI: \_SB_.GSIC: Enabled at IRQ 181611worker1 # [ 0.595989] ACPI: \_SB_.GSID: Enabled at IRQ 191612lb # [ 0.642385] Initialise system trusted keyrings1613worker1 # [ 0.597780] PCI: CLS 0 bytes, default 641614worker1 # [ 0.598824] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1615lb # [ 0.645383] workingset: timestamp_bits=40 max_order=19 bucket_order=01616worker1 # [ 0.600623] Trying to unpack rootfs image as initramfs...1617lb # [ 0.667392] Key type asymmetric registered1618lb # [ 0.668117] Asymmetric key parser 'x509' registered1619lb # [ 0.669013] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1620client # [ 0.640671] Initialise system trusted keyrings1621worker2 # [ 0.641023] Initialise system trusted keyrings1622lb # [ 0.674451] io scheduler mq-deadline registered1623lb # [ 0.675218] io scheduler kyber registered1624client # [ 0.644313] workingset: timestamp_bits=40 max_order=19 bucket_order=01625worker2 # [ 0.644666] workingset: timestamp_bits=40 max_order=19 bucket_order=01626lb # [ 0.677868] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1627lb # [ 0.679171] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1628lb # [ 0.685111] Linux agpgart interface v0.1031629lb # [ 0.685935] ACPI: bus type drm_connector registered1630worker1 # [ 0.642405] Initialise system trusted keyrings1631worker1 # [ 0.644493] workingset: timestamp_bits=40 max_order=19 bucket_order=01632lb # [ 0.690803] usbcore: registered new interface driver usbserial_generic1633lb # [ 0.691916] usbserial: USB Serial support registered for generic1634lb # [ 0.694347] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1635client # [ 0.663564] Key type asymmetric registered1636lb # [ 0.694347] Please enable it if your BIOS has the CPPC option.1637lb # [ 0.696648] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1638worker2 # [ 0.665962] Key type asymmetric registered1639worker2 # [ 0.666743] Asymmetric key parser 'x509' registered1640lb # [ 0.699474] drop_monitor: Initializing network drop monitor service1641client # [ 0.668262] Asymmetric key parser 'x509' registered1642lb # [ 0.700666] NET: Registered PF_INET6 protocol family1643worker2 # [ 0.667564] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1644client # [ 0.669104] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1645client # [ 0.672388] io scheduler mq-deadline registered1646client # [ 0.673155] io scheduler kyber registered1647lb # [ 0.705792] Segment Routing with IPv61648worker2 # [ 0.672774] io scheduler mq-deadline registered1649lb # [ 0.706490] In-situ OAM (IOAM) with IPv61650worker2 # [ 0.673685] io scheduler kyber registered1651client # [ 0.676819] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1652lb # [ 0.709617] IPI shorthand broadcast: enabled1653worker2 # [ 0.677176] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1654client # [ 0.678140] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1655worker2 # [ 0.678421] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1656worker1 # [ 0.667553] Key type asymmetric registered1657client # [ 0.682042] Linux agpgart interface v0.1031658worker1 # [ 0.668266] Asymmetric key parser 'x509' registered1659client # [ 0.682841] ACPI: bus type drm_connector registered1660worker2 # [ 0.682406] Linux agpgart interface v0.1031661worker1 # [ 0.669173] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1662worker2 # [ 0.683183] ACPI: bus type drm_connector registered1663lb # [ 0.717943] sched_clock: Marking stable (582014096, 135314283)->(791894661, -74566282)1664worker2 # [ 0.686077] usbcore: registered new interface driver usbserial_generic1665client # [ 0.687672] usbcore: registered new interface driver usbserial_generic1666worker2 # [ 0.687181] usbserial: USB Serial support registered for generic1667worker1 # [ 0.674551] io scheduler mq-deadline registered1668client # [ 0.688818] usbserial: USB Serial support registered for generic1669worker1 # [ 0.675291] io scheduler kyber registered1670lb # [ 0.721413] registered taskstats version 11671lb # [ 0.722368] Loading compiled-in X.509 certificates1672worker2 # [ 0.689649] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1673client # [ 0.691258] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1674worker2 # [ 0.689649] Please enable it if your BIOS has the CPPC option.1675worker1 # [ 0.677980] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1676client # [ 0.691258] Please enable it if your BIOS has the CPPC option.1677worker2 # [ 0.691851] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1678client # [ 0.693460] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1679worker1 # [ 0.679242] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1680worker2 # [ 0.695772] drop_monitor: Initializing network drop monitor service1681worker2 # [ 0.696981] NET: Registered PF_INET6 protocol family1682client # [ 0.698396] drop_monitor: Initializing network drop monitor service1683worker1 # [ 0.684841] Linux agpgart interface v0.1031684client # [ 0.699564] NET: Registered PF_INET6 protocol family1685worker1 # [ 0.685621] ACPI: bus type drm_connector registered1686client # [ 0.702722] Segment Routing with IPv61687worker2 # [ 0.701932] Segment Routing with IPv61688worker1 # [ 0.688913] usbcore: registered new interface driver usbserial_generic1689worker2 # [ 0.702581] In-situ OAM (IOAM) with IPv61690worker1 # [ 0.690022] usbserial: USB Serial support registered for generic1691client # [ 0.705280] In-situ OAM (IOAM) with IPv61692client # [ 0.706414] IPI shorthand broadcast: enabled1693worker2 # [ 0.705899] IPI shorthand broadcast: enabled1694worker1 # [ 0.693460] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1695worker1 # [ 0.693460] Please enable it if your BIOS has the CPPC option.1696lb # [ 0.741344] Demotion targets for Node 0: null1697lb # [ 0.742205] Key type .fscrypt registered1698worker1 # [ 0.695817] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1699worker1 # [ 0.698623] drop_monitor: Initializing network drop monitor service1700lb # [ 0.745332] Key type fscrypt-provisioning registered1701worker2 # [ 0.712151] sched_clock: Marking stable (578014743, 133600202)->(781011424, -69396479)1702worker1 # [ 0.699906] NET: Registered PF_INET6 protocol family1703lb # [ 0.746272] ima: No TPM chip found, activating TPM-bypass!1704client # [ 0.714779] sched_clock: Marking stable (579015250, 135224444)->(792999175, -78759481)1705lb # [ 0.747165] ima: Allocated hash algorithm: sha11706lb # [ 0.747964] ima: No architecture policies found1707worker2 # [ 0.716733] registered taskstats version 11708lb # [ 0.750340] PM: Magic number: 10:151:4251709worker1 # [ 0.704555] Segment Routing with IPv61710worker2 # [ 0.717700] Loading compiled-in X.509 certificates1711worker1 # [ 0.705178] In-situ OAM (IOAM) with IPv61712client # [ 0.720388] registered taskstats version 11713lb # [ 0.751884] RAS: Correctable Errors collector initialized.1714client # [ 0.721370] Loading compiled-in X.509 certificates1715worker1 # [ 0.707721] IPI shorthand broadcast: enabled1716lb # [ 0.761995] clk: Disabling unused clocks1717worker1 # [ 0.716040] sched_clock: Marking stable (581015159, 134421387)->(789904971, -74468425)1718lb # [ 0.764347] PM: genpd: Disabling unused power domains1719worker1 # [ 0.720614] registered taskstats version 11720worker1 # [ 0.721604] Loading compiled-in X.509 certificates1721worker2 # [ 0.736628] Demotion targets for Node 0: null1722client # [ 0.737830] Demotion targets for Node 0: null1723worker2 # [ 0.737480] Key type .fscrypt registered1724worker2 # [ 0.739626] Key type fscrypt-provisioning registered1725client # [ 0.741283] Key type .fscrypt registered1726worker2 # [ 0.740565] ima: No TPM chip found, activating TPM-bypass!1727client # [ 0.741984] Key type fscrypt-provisioning registered1728worker2 # [ 0.741503] ima: Allocated hash algorithm: sha11729client # [ 0.742932] ima: No TPM chip found, activating TPM-bypass!1730client # [ 0.745257] ima: Allocated hash algorithm: sha11731client # [ 0.746059] ima: No architecture policies found1732worker2 # [ 0.745663] ima: No architecture policies found1733worker2 # [ 0.746631] PM: Magic number: 10:151:4251734client # [ 0.748259] PM: Magic number: 10:151:4251735worker2 # [ 0.748200] RAS: Correctable Errors collector initialized.1736client # [ 0.749863] RAS: Correctable Errors collector initialized.1737worker1 # [ 0.739450] Demotion targets for Node 0: null1738worker1 # [ 0.740389] Key type .fscrypt registered1739worker1 # [ 0.743441] Key type fscrypt-provisioning registered1740worker2 # [ 0.757295] clk: Disabling unused clocks1741worker1 # [ 0.744400] ima: No TPM chip found, activating TPM-bypass!1742worker1 # [ 0.745347] ima: Allocated hash algorithm: sha11743client # [ 0.759990] clk: Disabling unused clocks1744worker1 # [ 0.747471] ima: No architecture policies found1745worker2 # [ 0.761633] PM: genpd: Disabling unused power domains1746worker1 # [ 0.749450] PM: Magic number: 10:151:4251747client # [ 0.764262] PM: genpd: Disabling unused power domains1748worker1 # [ 0.751097] RAS: Correctable Errors collector initialized.1749worker1 # [ 0.760123] clk: Disabling unused clocks1750worker1 # [ 0.764474] PM: genpd: Disabling unused power domains1751lb # [ 0.926779] Freeing initrd memory: 29064K1752lb # [ 0.929886] Freeing unused decrypted memory: 2028K1753lb # [ 0.932488] Freeing unused kernel image (initmem) memory: 3652K1754lb # [ 0.933633] Write protecting the kernel read-only data: 32768k1755lb # [ 0.935513] Freeing unused kernel image (text/rodata gap) memory: 1184K1756lb # [ 0.937045] Freeing unused kernel image (rodata/data gap) memory: 720K1757worker2 # [ 0.917461] Freeing initrd memory: 29060K1758worker2 # [ 0.920585] Freeing unused decrypted memory: 2028K1759worker2 # [ 0.923164] Freeing unused kernel image (initmem) memory: 3652K1760client # [ 0.924677] Freeing initrd memory: 29056K1761worker2 # [ 0.924267] Write protecting the kernel read-only data: 32768k1762worker2 # [ 0.926147] Freeing unused kernel image (text/rodata gap) memory: 1184K1763client # [ 0.927844] Freeing unused decrypted memory: 2028K1764worker2 # [ 0.927693] Freeing unused kernel image (rodata/data gap) memory: 720K1765client # [ 0.930453] Freeing unused kernel image (initmem) memory: 3652K1766client # [ 0.931583] Write protecting the kernel read-only data: 32768k1767client # [ 0.933473] Freeing unused kernel image (text/rodata gap) memory: 1184K1768client # [ 0.935024] Freeing unused kernel image (rodata/data gap) memory: 720K1769worker1 # [ 0.926614] Freeing initrd memory: 29056K1770worker1 # [ 0.929772] Freeing unused decrypted memory: 2028K1771worker1 # [ 0.932355] Freeing unused kernel image (initmem) memory: 3652K1772worker1 # [ 0.933491] Write protecting the kernel read-only data: 32768k1773worker1 # [ 0.935374] Freeing unused kernel image (text/rodata gap) memory: 1184K1774worker1 # [ 0.936928] Freeing unused kernel image (rodata/data gap) memory: 720K1775lb # [ 0.988014] x86/mm: Checked W+X mappings: passed, no W+X pages found.1776lb # [ 0.989112] Run /init as init process1777lb # [ 0.999533] systemd[1]: Inserted module 'autofs4'1778worker2 # [ 0.978751] x86/mm: Checked W+X mappings: passed, no W+X pages found.1779worker2 # [ 0.979879] Run /init as init process1780client # [ 0.985916] x86/mm: Checked W+X mappings: passed, no W+X pages found.1781client # [ 0.987083] Run /init as init process1782lb # [ 1.019128] fuse: init (API version 7.45)1783worker2 # [ 0.990384] systemd[1]: Inserted module 'autofs4'1784lb # [ 1.026411] ACPI: \_SB_.GSIG: Enabled at IRQ 221785lb # [ 1.029157] ACPI: \_SB_.GSIH: Enabled at IRQ 231786client # [ 0.997960] systemd[1]: Inserted module 'autofs4'1787lb # [ 1.032906] ACPI: \_SB_.GSIE: Enabled at IRQ 201788worker1 # [ 0.987770] x86/mm: Checked W+X mappings: passed, no W+X pages found.1789worker1 # [ 0.988957] Run /init as init process1790lb # [ 1.035101] ACPI: \_SB_.GSIF: Enabled at IRQ 211791lb # [ 1.040945] virtiofs virtio5: discovered new tag: nix-store1792lb # [ 1.042630] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1793worker2 # [ 1.010169] fuse: init (API version 7.45)1794worker1 # [ 0.999705] systemd[1]: Inserted module 'autofs4'1795client # [ 1.017826] fuse: init (API version 7.45)1796lb # [ 1.050110] virtiofs virtio6: discovered new tag: shared1797worker2 # [ 1.017548] ACPI: \_SB_.GSIG: Enabled at IRQ 221798lb # [ 1.051617] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1799worker2 # [ 1.020154] ACPI: \_SB_.GSIH: Enabled at IRQ 231800lb # [ 1.055144] virtiofs virtio7: discovered new tag: xchg1801worker2 # [ 1.023441] ACPI: \_SB_.GSIE: Enabled at IRQ 201802lb # [ 1.056599] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1803client # [ 1.025273] ACPI: \_SB_.GSIG: Enabled at IRQ 221804worker2 # [ 1.025689] ACPI: \_SB_.GSIF: Enabled at IRQ 211805client # [ 1.027694] ACPI: \_SB_.GSIH: Enabled at IRQ 231806client # [ 1.030821] ACPI: \_SB_.GSIE: Enabled at IRQ 201807worker2 # [ 1.030855] virtiofs virtio5: discovered new tag: nix-store1808client # [ 1.032908] ACPI: \_SB_.GSIF: Enabled at IRQ 211809worker1 # [ 1.019576] fuse: init (API version 7.45)1810worker2 # [ 1.032370] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1811client # [ 1.038562] virtiofs virtio5: discovered new tag: nix-store1812worker2 # [ 1.039004] virtiofs virtio6: discovered new tag: shared1813client # [ 1.040410] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1814worker1 # [ 1.026992] ACPI: \_SB_.GSIG: Enabled at IRQ 221815worker2 # [ 1.040550] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1816worker1 # [ 1.029380] ACPI: \_SB_.GSIH: Enabled at IRQ 231817worker2 # [ 1.043807] virtiofs virtio7: discovered new tag: xchg1818worker1 # [ 1.032366] ACPI: \_SB_.GSIE: Enabled at IRQ 201819worker2 # [ 1.045213] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1820client # [ 1.047527] virtiofs virtio6: discovered new tag: shared1821worker1 # [ 1.034264] ACPI: \_SB_.GSIF: Enabled at IRQ 211822lb # [ 1.080426] systemd[1]: Successfully made /usr/ read-only.1823client # [ 1.049210] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1824client # [ 1.052397] virtiofs virtio7: discovered new tag: xchg1825worker1 # [ 1.039052] virtiofs virtio5: discovered new tag: nix-store1826client # [ 1.053794] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1827worker1 # [ 1.040902] virtiofs virtio5: virtio_fs_setup_dax: No cache capability1828worker1 # [ 1.047792] virtiofs virtio6: discovered new tag: shared1829worker1 # [ 1.049477] virtiofs virtio6: virtio_fs_setup_dax: No cache capability1830worker1 # [ 1.052878] virtiofs virtio7: discovered new tag: xchg1831worker2 # [ 1.067377] systemd[1]: Successfully made /usr/ read-only.1832worker1 # [ 1.054284] virtiofs virtio7: virtio_fs_setup_dax: No cache capability1833client # [ 1.076339] systemd[1]: Successfully made /usr/ read-only.1834worker1 # [ 1.073255] systemd[1]: Successfully made /usr/ read-only.1835lb # [ 1.417251] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1836lb # [ 1.429356] systemd[1]: Detected virtualization kvm.1837lb # [ 1.431487] systemd[1]: Detected architecture x86-64.1838lb # [ 1.433639] systemd[1]: Running in initrd.1839lb # [ 1.436117] systemd[1]: Initializing machine ID from random generator.1840lb # [ 1.439039] systemd[1]: Hostname set to <lb>.1841worker2 # [ 1.403991] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1842worker2 # [ 1.416141] systemd[1]: Detected virtualization kvm.1843worker2 # [ 1.418310] systemd[1]: Detected architecture x86-64.1844worker2 # [ 1.420465] systemd[1]: Running in initrd.1845client # [ 1.412967] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1846worker2 # [ 1.423069] systemd[1]: Initializing machine ID from random generator.1847client # [ 1.425108] systemd[1]: Detected virtualization kvm.1848worker2 # [ 1.426062] systemd[1]: Hostname set to <worker2>.1849client # [ 1.427301] systemd[1]: Detected architecture x86-64.1850client # [ 1.429570] systemd[1]: Running in initrd.1851client # [ 1.432118] systemd[1]: Initializing machine ID from random generator.1852worker1 # [ 1.410129] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1853client # [ 1.435025] systemd[1]: Hostname set to <client>.1854worker1 # [ 1.422210] systemd[1]: Detected virtualization kvm.1855worker1 # [ 1.424324] systemd[1]: Detected architecture x86-64.1856worker1 # [ 1.426518] systemd[1]: Running in initrd.1857worker1 # [ 1.428986] systemd[1]: Initializing machine ID from random generator.1858worker1 # [ 1.431795] systemd[1]: Hostname set to <worker1>.1859lb # [ 1.664691] systemd[1]: bpf-restrict-fs: LSM BPF program attached1860worker2 # [ 1.646494] systemd[1]: bpf-restrict-fs: LSM BPF program attached1861client # [ 1.660907] systemd[1]: bpf-restrict-fs: LSM BPF program attached1862worker1 # [ 1.649524] systemd[1]: bpf-restrict-fs: LSM BPF program attached1863lb # [ 1.718710] systemd[1]: Queued start job for default target Initrd Default Target.1864lb # [ 1.722724] systemd[1]: Created slice Slice /system/modprobe.1865lb # [ 1.723934] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1866lb # [ 1.725415] systemd[1]: Expecting device /dev/disk/by-label/nixos...1867lb # [ 1.726556] systemd[1]: Reached target Path Units.1868lb # [ 1.727509] systemd[1]: Reached target Slice Units.1869lb # [ 1.728475] systemd[1]: Reached target Swaps.1870lb # [ 1.729287] systemd[1]: Reached target Timer Units.1871lb # [ 1.730277] systemd[1]: Listening on D-Bus System Message Bus Socket.1872lb # [ 1.731555] systemd[1]: Listening on Journal Socket (/dev/log).1873worker2 # [ 1.699244] systemd[1]: Queued start job for default target Initrd Default Target.1874lb # [ 1.732813] systemd[1]: Listening on Journal Sockets.1875lb # [ 1.733834] systemd[1]: Listening on udev Control Socket.1876lb # [ 1.734915] systemd[1]: Listening on udev Kernel Socket.1877worker2 # [ 1.702869] systemd[1]: Created slice Slice /system/modprobe.1878lb # [ 1.735926] systemd[1]: Reached target Socket Units.1879worker2 # [ 1.704047] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1880lb # [ 1.737876] systemd[1]: Starting Create List of Static Device Nodes...1881worker2 # [ 1.705474] systemd[1]: Expecting device /dev/disk/by-label/nixos...1882worker2 # [ 1.706587] systemd[1]: Reached target Path Units.1883worker2 # [ 1.707483] systemd[1]: Reached target Slice Units.1884worker2 # [ 1.708366] systemd[1]: Reached target Swaps.1885worker2 # [ 1.709178] systemd[1]: Reached target Timer Units.1886lb # [ 1.742402] systemd[1]: Starting Load Kernel Module configfs...1887worker2 # [ 1.710156] systemd[1]: Listening on D-Bus System Message Bus Socket.1888worker2 # [ 1.711370] systemd[1]: Listening on Journal Socket (/dev/log).1889worker2 # [ 1.712532] systemd[1]: Listening on Journal Sockets.1890worker2 # [ 1.713543] systemd[1]: Listening on udev Control Socket.1891client # [ 1.715015] systemd[1]: Queued start job for default target Initrd Default Target.1892worker2 # [ 1.714570] systemd[1]: Listening on udev Kernel Socket.1893worker1 # [ 1.701920] systemd[1]: Queued start job for default target Initrd Default Target.1894worker2 # [ 1.715508] systemd[1]: Reached target Socket Units.1895worker2 # [ 1.717226] systemd[1]: Starting Create List of Static Device Nodes...1896client # [ 1.719617] systemd[1]: Created slice Slice /system/modprobe.1897worker1 # [ 1.705704] systemd[1]: Created slice Slice /system/modprobe.1898client # [ 1.720887] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1899worker1 # [ 1.706868] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1900client # [ 1.722322] systemd[1]: Expecting device /dev/disk/by-label/nixos...1901worker1 # [ 1.708221] systemd[1]: Expecting device /dev/disk/by-label/nixos...1902worker2 # [ 1.721693] systemd[1]: Starting Load Kernel Module configfs...1903client # [ 1.723448] systemd[1]: Reached target Path Units.1904worker1 # [ 1.709310] systemd[1]: Reached target Path Units.1905client # [ 1.724325] systemd[1]: Reached target Slice Units.1906worker1 # [ 1.710174] systemd[1]: Reached target Slice Units.1907client # [ 1.725161] systemd[1]: Reached target Swaps.1908worker1 # [ 1.711051] systemd[1]: Reached target Swaps.1909client # [ 1.725971] systemd[1]: Reached target Timer Units.1910worker1 # [ 1.711849] systemd[1]: Reached target Timer Units.1911client # [ 1.726982] systemd[1]: Listening on D-Bus System Message Bus Socket.1912worker1 # [ 1.712823] systemd[1]: Listening on D-Bus System Message Bus Socket.1913client # [ 1.728326] systemd[1]: Listening on Journal Socket (/dev/log).1914worker1 # [ 1.714030] systemd[1]: Listening on Journal Socket (/dev/log).1915client # [ 1.729469] systemd[1]: Listening on Journal Sockets.1916worker1 # [ 1.715215] systemd[1]: Listening on Journal Sockets.1917client # [ 1.730430] systemd[1]: Listening on udev Control Socket.1918worker1 # [ 1.716188] systemd[1]: Listening on udev Control Socket.1919worker1 # [ 1.717212] systemd[1]: Listening on udev Kernel Socket.1920client # [ 1.731464] systemd[1]: Listening on udev Kernel Socket.1921lb # [ 1.752026] systemd[1]: Starting Journal Service...1922worker1 # [ 1.718154] systemd[1]: Reached target Socket Units.1923client # [ 1.732434] systemd[1]: Reached target Socket Units.1924worker1 # [ 1.719903] systemd[1]: Starting Create List of Static Device Nodes...1925client # [ 1.734220] systemd[1]: Starting Create List of Static Device Nodes...1926client # [ 1.738123] systemd[1]: Starting Load Kernel Module configfs...1927worker1 # [ 1.724506] systemd[1]: Starting Load Kernel Module configfs...1928lb # [ 1.776945] systemd[1]: Starting Load Kernel Modules...1929worker2 # [ 1.733227] systemd[1]: Starting Journal Service...1930lb # [ 1.781462] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1931worker2 # [ 1.755227] systemd[1]: Starting Load Kernel Modules...1932worker1 # [ 1.732072] systemd[1]: Starting Journal Service...1933lb # [ 1.790575] systemd[1]: Starting Coldplug All udev Devices...1934client # [ 1.748427] systemd[1]: Starting Journal Service...1935worker2 # [ 1.759748] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1936worker2 # [ 1.766529] systemd[1]: Starting Coldplug All udev Devices...1937lb # [ 1.802525] systemd-journald[66]: Collecting audit messages is disabled.1938worker1 # [ 1.757634] systemd[1]: Starting Load Kernel Modules...1939lb # [ 1.804187] systemd[1]: Finished Create List of Static Device Nodes.1940client # [ 1.775428] systemd[1]: Starting Load Kernel Modules...1941worker1 # [ 1.761536] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1942lb # [ 1.810992] systemd[1]: modprobe@configfs.service: Deactivated successfully.1943client # [ 1.779340] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1944worker2 # [ 1.778990] systemd-journald[66]: Collecting audit messages is disabled.1945worker2 # [ 1.780178] systemd[1]: Finished Create List of Static Device Nodes.1946worker1 # [ 1.768501] systemd[1]: Starting Coldplug All udev Devices...1947lb # [ 1.816758] systemd[1]: Finished Load Kernel Module configfs.1948client # [ 1.787499] systemd[1]: Starting Coldplug All udev Devices...1949worker2 # [ 1.788104] systemd[1]: modprobe@configfs.service: Deactivated successfully.1950lb # [ 1.822769] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1951worker1 # [ 1.779996] systemd-journald[66]: Collecting audit messages is disabled.1952worker2 # [ 1.794027] systemd[1]: Finished Load Kernel Module configfs.1953worker1 # [ 1.784506] systemd[1]: Finished Create List of Static Device Nodes.1954client # [ 1.798732] systemd-journald[66]: Collecting audit messages is disabled.1955worker2 # [ 1.800031] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1956worker1 # [ 1.788120] systemd[1]: modprobe@configfs.service: Deactivated successfully.1957lb # [ 1.834522] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1958client # [ 1.803351] systemd[1]: Finished Create List of Static Device Nodes.1959client # [ 1.807872] systemd[1]: modprobe@configfs.service: Deactivated successfully.1960worker1 # [ 1.794824] systemd[1]: Finished Load Kernel Module configfs.1961worker2 # [ 1.811740] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1962lb # [ 1.845767] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1963client # [ 1.815668] systemd[1]: Finished Load Kernel Module configfs.1964worker1 # [ 1.801858] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1965lb # [ 1.853420] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1966client # [ 1.821663] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1967worker1 # [ 1.811204] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1968worker2 # [ 1.823823] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1969worker2 # [ 1.831857] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1970client # [ 1.835314] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1971worker1 # [ 1.821352] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1972client # [ 1.841728] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1973lb # [ 1.876941] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1974worker1 # [ 1.832780] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1975lb # [ 1.885537] systemd[1]: Starting Create Static Device Nodes in /dev...1976worker2 # [ 1.853188] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1977client # [ 1.854433] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1978worker2 # [ 1.861830] systemd[1]: Starting Create Static Device Nodes in /dev...1979lb # [ 1.898400] systemd[1]: Finished Load Kernel Modules.1980worker1 # [ 1.854557] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1981worker2 # [ 1.873690] systemd[1]: Finished Load Kernel Modules.1982lb # [ 1.907541] systemd[1]: Starting Apply Kernel Variables...1983client # [ 1.876836] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1984worker1 # [ 1.864228] systemd[1]: Starting Create Static Device Nodes in /dev...1985worker2 # [ 1.880904] systemd[1]: Starting Apply Kernel Variables...1986client # [ 1.886460] systemd[1]: Starting Create Static Device Nodes in /dev...1987worker1 # [ 1.875514] systemd[1]: Finished Load Kernel Modules.1988lb # [ 1.924484] systemd[1]: Started Journal Service.1989lb # [ 1.791669] systemd-modules-load[67]: Inserted module 'dm_mod'1990lb # [ 1.794233] systemd-modules-load[67]: Inserted module 'virtio_balloon'1991client # [ 1.898309] systemd[1]: Finished Load Kernel Modules.1992worker1 # [ 1.884631] systemd[1]: Starting Apply Kernel Variables...1993worker2 # [ 1.899475] systemd[1]: Finished Create Static Device Nodes in /dev.1994lb # [ 1.797352] systemd-modules-load[67]: Inserted module 'virtio_gpu'1995worker2 # [ 1.768331] systemd-modules-load[67]: Inserted module 'dm_mod'1996worker2 # [ 1.769691] systemd-modules-load[67]: Inserted module 'virtio_balloon'1997lb # [ 1.802310] systemd[1]: Finished Create Static Device Nodes in /dev.1998client # [ 1.906958] systemd[1]: Starting Apply Kernel Variables...1999worker2 # [ 1.773294] systemd-modules-load[67]: Inserted module 'virtio_gpu'2000worker2 # [ 1.908442] systemd[1]: Started Journal Service.
loading 2,577 hidden lines…
4578lb # [ 49.533504] niks3-server[985]: 2026/09/24 09:26:21 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4579lb # [ 49.541439] niks3-server[985]: 2026/09/24 09:26:21 INFO Received complete push request method=POST path=/api/pushes/7/complete4580worker2 # [ 49.518690] nix-grpc-daemon[883]: time=2026-09-24T09:26:21.725Z level=INFO msg="Upload complete. (178ms)"4581lb # [ 49.553870] niks3-server[985]: 2026/09/24 09:26:21 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4582worker2 # [ 49.521330] nix-grpc-daemon[781]: ts=2026-09-24T09:26:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_in=7524583worker2 # [ 49.526968] nix-grpc-daemon[781]: ts=2026-09-24T09:26:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348364584worker2 # [ 49.536492] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4585worker2 # [ 49.544732] nix-daemon[869]: reaped child process 1022, status = succeeded4586worker2 # [ 49.550594] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4587client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4588client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4589client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4590client # farm-top> LOG-farm-top-t1b4591worker2 # [ 50.163518] nix-daemon[869]: reaped child process 1031, status = succeeded4592worker2 # [ 50.235905] nix-daemon[869]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4593worker2 # [ 50.248567] nix-daemon[869]: reaped child process 1050, status = succeeded4594lb # [ 50.287245] niks3-server[985]: 2026/09/24 09:26:22 INFO Received push request method=POST path=/api/pushes4595worker2 # [ 50.264316] nix-grpc-daemon[883]: time=2026-09-24T09:26:22.471Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4596worker2 # [ 50.266157] nix-grpc-daemon[883]: time=2026-09-24T09:26:22.472Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4597lb # [ 50.332860] niks3-server[985]: 2026/09/24 09:26:22 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign4598lb # [ 50.339213] niks3-server[985]: 2026/09/24 09:26:22 INFO Signed narinfos id=8 count=14599worker2 # [ 50.311240] nix-grpc-daemon[883]: time=2026-09-24T09:26:22.518Z level=INFO msg="Uploading 1 narinfos"4600lb # [ 50.349383] niks3-server[985]: 2026/09/24 09:26:22 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4601lb # [ 50.353569] niks3-server[985]: 2026/09/24 09:26:22 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4602lb # [ 50.360939] niks3-server[985]: 2026/09/24 09:26:22 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4603lb # [ 50.368372] niks3-server[985]: 2026/09/24 09:26:22 INFO Received complete push request method=POST path=/api/pushes/8/complete4604worker2 # [ 50.344302] nix-grpc-daemon[883]: time=2026-09-24T09:26:22.551Z level=INFO msg="Upload complete. (188ms)"4605lb # [ 50.379253] niks3-server[985]: 2026/09/24 09:26:22 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4606worker2 # [ 50.352568] nix-grpc-daemon[781]: ts=2026-09-24T09:26:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=04607worker2 # [ 50.368277] nix-daemon[869]: reaped child process 1029, status = succeeded4608client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.27 seconds)4609client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath4610client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.12 seconds)4611lb: must succeed: curl -sf localhost:9901/clusters4612lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4613lb: must succeed: curl -sf localhost:9901/clusters4614lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4615worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4616worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds)4617(finished: subtest: inputs already in the cache are not sent to the scheduler, in 1.59 seconds)4618subtest: outputs read back through any worker carry the cache signature4619client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&24620worker1 # [ 50.748924] nix-grpc-daemon[511]: ts=2026-09-24T09:26:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542624621client # don't know how to build these paths:4622client # /nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv4623worker2 # [ 50.771188] nix-grpc-daemon[781]: ts=2026-09-24T09:26:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348364624worker2 # [ 50.792160] nix-grpc-daemon[781]: ts=2026-09-24T09:26:22Z level=debug event=want client=4 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=04625worker2 # [ 50.797358] nix-grpc-daemon[781]: ts=2026-09-24T09:26:22Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.3:50051 clients=14626worker1 # [ 50.785738] nix-grpc-daemon[511]: ts=2026-09-24T09:26:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542624627worker1 # [ 50.798759] nix-grpc-daemon[511]: ts=2026-09-24T09:26:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542624628client # copying 1 paths to 'lb:50051'...4629client # copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' to 'lb:50051'...4630worker1 # [ 50.810311] nix-grpc-daemon[511]: ts=2026-09-24T09:26:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542624631worker1 # [ 50.822463] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4632worker1 # [ 50.844488] nix-grpc-daemon[511]: ts=2026-09-24T09:26:22Z level=info event=niks3_push_started pid=8834633worker1 # [ 50.977253] nix-grpc-daemon[883]: time=2026-09-24T09:26:23.113Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""4634worker1 # [ 51.074456] nix-daemon[849]: accepted connection from pid 896, user nix-grpc-daemon (trusted)4635worker1 # [ 51.088026] nix-daemon[849]: reaped child process 899, status = succeeded4636lb # [ 51.139919] niks3-server[985]: 2026/09/24 09:26:23 INFO Received push request method=POST path=/api/pushes4637worker1 # [ 51.129125] nix-grpc-daemon[883]: time=2026-09-24T09:26:23.266Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4638worker1 # [ 51.130684] nix-grpc-daemon[883]: time=2026-09-24T09:26:23.268Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)"4639lb # [ 51.201377] niks3-server[985]: 2026/09/24 09:26:23 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign4640lb # [ 51.207237] niks3-server[985]: 2026/09/24 09:26:23 INFO Signed narinfos id=9 count=14641worker1 # [ 51.166883] nix-grpc-daemon[883]: time=2026-09-24T09:26:23.304Z level=INFO msg="Uploading 1 narinfos"4642lb # [ 51.219685] niks3-server[985]: 2026/09/24 09:26:23 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst4643lb # [ 51.227601] niks3-server[985]: 2026/09/24 09:26:23 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls4644lb # [ 51.235376] niks3-server[985]: 2026/09/24 09:26:23 INFO Received complete push request method=POST path=/api/pushes/9/complete4645worker1 # [ 51.199779] nix-grpc-daemon[883]: time=2026-09-24T09:26:23.337Z level=INFO msg="Upload complete. (217ms)"4646lb # [ 51.246196] niks3-server[985]: 2026/09/24 09:26:23 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo4647worker1 # [ 51.204977] nix-grpc-daemon[511]: ts=2026-09-24T09:26:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 paths=1 nar_bytes_in=5044648worker1 # [ 51.212270] nix-grpc-daemon[511]: ts=2026-09-24T09:26:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542624649worker1 # [ 51.222705] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4650worker1 # [ 51.231213] nix-daemon[849]: reaped child process 881, status = succeeded4651client # building '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' on lb:50051...4652worker1 # [ 51.240387] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4653client # farm-a> node-a: building lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv4654client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4655client # farm-a> LOG-farm-a-sig4656worker1 # [ 52.276136] nix-daemon[849]: reaped child process 903, status = succeeded4657worker1 # [ 52.361124] nix-daemon[849]: accepted connection from pid 919, user nix-grpc-daemon (trusted)4658worker1 # [ 52.374029] nix-daemon[849]: reaped child process 922, status = succeeded4659lb # [ 52.423852] niks3-server[985]: 2026/09/24 09:26:24 INFO Received push request method=POST path=/api/pushes4660worker1 # [ 52.387233] nix-grpc-daemon[883]: time=2026-09-24T09:26:24.524Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4661worker1 # [ 52.390699] nix-grpc-daemon[883]: time=2026-09-24T09:26:24.526Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)"4662lb # [ 52.454155] niks3-server[985]: 2026/09/24 09:26:24 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4663lb # [ 52.470841] niks3-server[985]: 2026/09/24 09:26:24 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv4664lb # [ 52.479076] niks3-server[985]: 2026/09/24 09:26:24 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign4665lb # [ 52.483600] niks3-server[985]: 2026/09/24 09:26:24 INFO Signed narinfos id=10 count=14666worker1 # [ 52.443233] nix-grpc-daemon[883]: time=2026-09-24T09:26:24.580Z level=INFO msg="Uploading 1 narinfos"4667lb # [ 52.489122] niks3-server[985]: 2026/09/24 09:26:24 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls4668lb # [ 52.500738] niks3-server[985]: 2026/09/24 09:26:24 INFO Received complete push request method=POST path=/api/pushes/10/complete4669lb # [ 52.505039] niks3-server[985]: 2026/09/24 09:26:24 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo4670worker1 # [ 52.459568] nix-grpc-daemon[883]: time=2026-09-24T09:26:24.597Z level=INFO msg="Upload complete. (212ms)"4671worker1 # [ 52.465662] nix-grpc-daemon[511]: ts=2026-09-24T09:26:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=5 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04672worker2 # [ 52.486558] nix-grpc-daemon[781]: ts=2026-09-24T09:26:24Z level=debug event=want client=4 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=04673worker1 # [ 52.477126] nix-grpc-daemon[511]: ts=2026-09-24T09:26:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542624674worker2 # [ 52.490836] nix-grpc-daemon[781]: ts=2026-09-24T09:26:24Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.3:50051 clients=14675worker1 # [ 52.485503] nix-grpc-daemon[511]: ts=2026-09-24T09:26:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542624676worker1 # [ 52.493390] nix-daemon[849]: reaped child process 901, status = succeeded4677worker1 # [ 52.498863] nix-grpc-daemon[883]: time=2026-09-24T09:26:24.636Z level=INFO msg="All 1 paths already cached"4678client # copying 1 paths to 'lb:50051'...4679worker1 # [ 52.504085] nix-grpc-daemon[511]: ts=2026-09-24T09:26:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542624680client # copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' to 'lb:50051'...4681worker1 # [ 52.508937] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4682worker1 # [ 52.593568] nix-daemon[849]: accepted connection from pid 926, user nix-grpc-daemon (trusted)4683worker1 # [ 52.607885] nix-daemon[849]: reaped child process 929, status = succeeded4684lb # [ 52.659279] niks3-server[985]: 2026/09/24 09:26:24 INFO Received push request method=POST path=/api/pushes4685worker1 # [ 52.622710] nix-grpc-daemon[883]: time=2026-09-24T09:26:24.760Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4686worker1 # [ 52.624671] nix-grpc-daemon[883]: time=2026-09-24T09:26:24.761Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)"4687lb # [ 52.690920] niks3-server[985]: 2026/09/24 09:26:24 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign4688lb # [ 52.698656] niks3-server[985]: 2026/09/24 09:26:24 INFO Signed narinfos id=11 count=14689worker1 # [ 52.656775] nix-grpc-daemon[883]: time=2026-09-24T09:26:24.794Z level=INFO msg="Uploading 1 narinfos"4690lb # [ 52.701902] niks3-server[985]: 2026/09/24 09:26:24 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls4691lb # [ 52.715891] niks3-server[985]: 2026/09/24 09:26:24 INFO Received complete push request method=POST path=/api/pushes/11/complete4692lb # [ 52.908756] niks3-server[985]: 2026/09/24 09:26:25 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst4693lb # [ 52.935553] niks3-server[985]: 2026/09/24 09:26:25 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo4694worker1 # [ 52.897377] nix-grpc-daemon[883]: time=2026-09-24T09:26:25.034Z level=INFO msg="Upload complete. (382ms)"4695worker1 # [ 52.902862] nix-grpc-daemon[511]: ts=2026-09-24T09:26:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 paths=1 nar_bytes_in=6244696worker1 # [ 52.909330] nix-grpc-daemon[511]: ts=2026-09-24T09:26:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542624697worker1 # [ 52.921172] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4698worker1 # [ 52.933140] nix-daemon[849]: reaped child process 924, status = succeeded4699client # building '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' on lb:50051...4700client # farm-b> node-a: building 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv4701worker1 # [ 52.943383] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4702client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4703client # farm-b> LOG-farm-b-sig4704worker1 # [ 54.164316] nix-daemon[849]: reaped child process 933, status = succeeded4705worker1 # [ 54.240090] nix-daemon[849]: accepted connection from pid 949, user nix-grpc-daemon (trusted)4706worker1 # [ 54.252545] nix-daemon[849]: reaped child process 952, status = succeeded4707lb # [ 54.303737] niks3-server[985]: 2026/09/24 09:26:26 INFO Received push request method=POST path=/api/pushes4708worker1 # [ 54.268604] nix-grpc-daemon[883]: time=2026-09-24T09:26:26.406Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4709worker1 # [ 54.270517] nix-grpc-daemon[883]: time=2026-09-24T09:26:26.408Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)"4710lb # [ 54.344266] niks3-server[985]: 2026/09/24 09:26:26 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign4711worker1 # [ 54.305706] nix-grpc-daemon[883]: time=2026-09-24T09:26:26.443Z level=INFO msg="Uploading 1 narinfos"4712lb # [ 54.350363] niks3-server[985]: 2026/09/24 09:26:26 INFO Signed narinfos id=12 count=14713lb # [ 54.359597] niks3-server[985]: 2026/09/24 09:26:26 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv4714lb # [ 54.366864] niks3-server[985]: 2026/09/24 09:26:26 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst4715lb # [ 54.371620] niks3-server[985]: 2026/09/24 09:26:26 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls4716lb # [ 54.381249] niks3-server[985]: 2026/09/24 09:26:26 INFO Received complete push request method=POST path=/api/pushes/12/complete4717worker1 # [ 54.342100] nix-grpc-daemon[883]: time=2026-09-24T09:26:26.479Z level=INFO msg="Upload complete. (186ms)"4718lb # [ 54.389564] niks3-server[985]: 2026/09/24 09:26:26 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo4719worker1 # [ 54.349156] nix-grpc-daemon[511]: ts=2026-09-24T09:26:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=6 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=04720worker2 # [ 54.368880] nix-grpc-daemon[781]: ts=2026-09-24T09:26:26Z level=debug event=want client=4 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=04721worker2 # [ 54.373506] nix-grpc-daemon[781]: ts=2026-09-24T09:26:26Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.3:50051 clients=14722worker1 # [ 54.361492] nix-grpc-daemon[511]: ts=2026-09-24T09:26:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542624723worker1 # [ 54.370413] nix-daemon[849]: reaped child process 931, status = succeeded4724worker1 # [ 54.373449] nix-grpc-daemon[511]: ts=2026-09-24T09:26:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542624725worker1 # [ 54.381924] nix-grpc-daemon[883]: time=2026-09-24T09:26:26.519Z level=INFO msg="All 2 paths already cached"4726client # copying 1 paths to 'lb:50051'...4727client # copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' to 'lb:50051'...4728worker1 # [ 54.389458] nix-grpc-daemon[511]: ts=2026-09-24T09:26:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542624729worker1 # [ 54.397134] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4730worker1 # [ 54.482413] nix-daemon[849]: accepted connection from pid 956, user nix-grpc-daemon (trusted)4731worker1 # [ 54.495753] nix-daemon[849]: reaped child process 959, status = succeeded4732lb # [ 54.547353] niks3-server[985]: 2026/09/24 09:26:26 INFO Received push request method=POST path=/api/pushes4733worker1 # [ 54.510103] nix-grpc-daemon[883]: time=2026-09-24T09:26:26.647Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4734worker1 # [ 54.512123] nix-grpc-daemon[883]: time=2026-09-24T09:26:26.649Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)"4735lb # [ 54.579323] niks3-server[985]: 2026/09/24 09:26:26 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign4736worker1 # [ 54.540929] nix-grpc-daemon[883]: time=2026-09-24T09:26:26.678Z level=INFO msg="Uploading 1 narinfos"4737lb # [ 54.586270] niks3-server[985]: 2026/09/24 09:26:26 INFO Signed narinfos id=13 count=14738lb # [ 54.598537] niks3-server[985]: 2026/09/24 09:26:26 INFO Received complete push request method=POST path=/api/pushes/13/complete4739lb # [ 54.780970] niks3-server[985]: 2026/09/24 09:26:26 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst4740lb # [ 54.787686] niks3-server[985]: 2026/09/24 09:26:26 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls4741worker1 # [ 54.752983] nix-grpc-daemon[883]: time=2026-09-24T09:26:26.890Z level=INFO msg="Upload complete. (350ms)"4742worker1 # [ 54.758138] nix-grpc-daemon[511]: ts=2026-09-24T09:26:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 paths=1 nar_bytes_in=7524743worker1 # [ 54.764347] nix-grpc-daemon[511]: ts=2026-09-24T09:26:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542624744lb # [ 54.810178] niks3-server[985]: 2026/09/24 09:26:26 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo4745worker1 # [ 54.778138] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4746worker1 # [ 54.787526] nix-daemon[849]: reaped child process 954, status = succeeded4747client # building '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' on lb:50051...4748client # farm-top> node-a: building cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv4749worker1 # [ 54.798859] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4750lb # [ 54.980855] envoy[904]: conn peer=[2001:db8:1::1]:46256 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9434 tx=4309 ms=44114751lb # [ 54.984802] envoy[904]: conn peer=[2001:db8:1::1]:46258 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=454752lb # [ 54.988285] envoy[904]: conn peer=[2001:db8:1::1]:46274 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4135 tx=1863 ms=11174753client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4754client # farm-top> LOG-farm-top-sig4755worker1 # [ 55.420366] nix-daemon[849]: reaped child process 963, status = succeeded4756worker1 # [ 55.493441] nix-daemon[849]: accepted connection from pid 979, user nix-grpc-daemon (trusted)4757worker1 # [ 55.505848] nix-daemon[849]: reaped child process 982, status = succeeded4758lb # [ 55.559377] niks3-server[985]: 2026/09/24 09:26:27 INFO Received push request method=POST path=/api/pushes4759worker1 # [ 55.522986] nix-grpc-daemon[883]: time=2026-09-24T09:26:27.660Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4760worker1 # [ 55.524518] nix-grpc-daemon[883]: time=2026-09-24T09:26:27.662Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)"4761lb # [ 55.600773] niks3-server[985]: 2026/09/24 09:26:27 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls4762lb # [ 55.605852] niks3-server[985]: 2026/09/24 09:26:27 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst4763lb # [ 55.619537] niks3-server[985]: 2026/09/24 09:26:27 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign4764lb # [ 55.623238] niks3-server[985]: 2026/09/24 09:26:27 INFO Signed narinfos id=14 count=14765worker1 # [ 55.581070] nix-grpc-daemon[883]: time=2026-09-24T09:26:27.718Z level=INFO msg="Uploading 1 narinfos"4766lb # [ 55.632813] niks3-server[985]: 2026/09/24 09:26:27 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv4767lb # [ 55.638341] niks3-server[985]: 2026/09/24 09:26:27 INFO Received complete push request method=POST path=/api/pushes/14/complete4768worker1 # [ 55.599206] nix-grpc-daemon[883]: time=2026-09-24T09:26:27.736Z level=INFO msg="Upload complete. (187ms)"4769lb # [ 55.645729] niks3-server[985]: 2026/09/24 09:26:27 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo4770worker1 # [ 55.605084] nix-grpc-daemon[511]: ts=2026-09-24T09:26:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=7 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=04771worker1 # [ 55.617162] nix-daemon[849]: reaped child process 961, status = succeeded4772client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig >&2, in 5.04 seconds)4773client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath4774client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag sig outPath, in 0.12 seconds)4775client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top4776worker1 # [ 55.861963] nix-grpc-daemon[511]: ts=2026-09-24T09:26:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:378844777worker1 # [ 55.868577] nix-grpc-daemon[511]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:378844778client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.12 seconds)4779client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top4780worker2 # [ 56.003269] nix-grpc-daemon[781]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:358064781client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):4782client # /nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a4783client # /nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b4784client # /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top4785worker2 # [ 56.033609] nix-grpc-daemon[781]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:358064786worker2 # [ 56.040252] nix-grpc-daemon[781]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'...4787worker2 # [ 56.055423] nix-grpc-daemon[781]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'...4788worker2 # [ 56.067402] nix-grpc-daemon[781]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'...4789client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&ca-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ca.pem' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.21 seconds)4790client: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top4791client # finding garbage collector roots...4792client # removing stale temporary roots file "/nix/var/nix/temproots/878"4793client # removing stale temporary roots file "/nix/var/nix/temproots/824"4794client # removing stale temporary roots file "/nix/var/nix/temproots/901"4795client # removing stale temporary roots file "/nix/var/nix/temproots/857"4796client # removing stale temporary roots file "/nix/var/nix/temproots/845"4797client # removing stale temporary roots file "/nix/var/nix/temproots/865"4798client # removing stale temporary roots file "/nix/var/nix/temproots/886"4799client # removing stale temporary roots file "/nix/var/nix/temproots/809"4800client # deleting specified paths...4801client # deleting '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top'4802client # deleting unused links...4803client # note: hard linking is currently saving 0.0 KiB4804worker2 # [ 56.531254] nix-grpc-daemon[781]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:348364805worker2 # [ 56.537413] nix-grpc-daemon[781]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348364806worker2 # [ 56.543345] nix-grpc-daemon[883]: time=2026-09-24T09:26:28.748Z level=INFO msg="All 1 paths already cached"4807worker1 # [ 56.533295] nix-grpc-daemon[511]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:542624808worker1 # [ 56.538185] nix-grpc-daemon[511]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:542624809client # copying 3 paths...4810worker1 # [ 56.547719] nix-grpc-daemon[511]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:542624811client # copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'grpc://lb:50051'...4812worker1 # [ 56.564095] nix-grpc-daemon[511]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:542624813worker1 # [ 56.569508] nix-grpc-daemon[511]: ts=2026-09-24T09:26:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 paths=1 nar_bytes_out=2324814worker2 # [ 56.585606] nix-grpc-daemon[781]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:348364815worker2 # [ 56.591283] nix-grpc-daemon[781]: ts=2026-09-24T09:26:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_out=1764816worker1 # [ 56.579317] nix-grpc-daemon[511]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:542624817worker1 # [ 56.583978] nix-grpc-daemon[511]: ts=2026-09-24T09:26:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 paths=1 nar_bytes_out=1284818client # copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'grpc://lb:50051'...4819client # copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'grpc://lb:50051'...4820client: (finished: must succeed: nix-store --delete /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top, in 0.52 seconds)4821(finished: subtest: outputs read back through any worker carry the cache signature, in 6.01 seconds)4822subtest: two clients wanting the same drv build it once4823client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup4824client # [ 56.651747] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup.4825client # Running as unit: dedup1.service; invocation ID: 659213c0e53f47b1a3e156c1fe4a3ffa4826client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 0.03 seconds)4827client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup4828worker1 # [ 56.769433] nix-grpc-daemon[511]: ts=2026-09-24T09:26:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542624829client # [ 56.788413] nix[954]: don't know how to build these paths:4830client # [ 56.789851] nix[954]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4831worker2 # [ 56.799388] nix-grpc-daemon[781]: ts=2026-09-24T09:26:29Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04832worker2 # [ 56.804332] nix-grpc-daemon[781]: ts=2026-09-24T09:26:29Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14833worker2 # [ 56.811527] nix-grpc-daemon[781]: ts=2026-09-24T09:26:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348364834worker2 # [ 56.822671] nix-grpc-daemon[781]: ts=2026-09-24T09:26:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348364835client # [ 56.833070] nix[954]: copying 1 paths to 'lb:50051'...4836client # [ 56.833896] nix[954]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4837worker2 # [ 56.834702] nix-grpc-daemon[781]: ts=2026-09-24T09:26:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348364838worker2 # [ 56.846329] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4839worker2 # [ 56.944907] nix-daemon[869]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4840worker2 # [ 56.958088] nix-daemon[869]: reaped child process 1073, status = succeeded4841lb # [ 56.997070] niks3-server[985]: 2026/09/24 09:26:29 INFO Received push request method=POST path=/api/pushes4842worker2 # [ 56.974126] nix-grpc-daemon[883]: time=2026-09-24T09:26:29.181Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4843worker2 # [ 56.976057] nix-grpc-daemon[883]: time=2026-09-24T09:26:29.182Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4844lb # [ 57.027179] niks3-server[985]: 2026/09/24 09:26:29 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4845lb # [ 57.033767] niks3-server[985]: 2026/09/24 09:26:29 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign4846worker2 # [ 57.011248] nix-grpc-daemon[883]: time=2026-09-24T09:26:29.218Z level=INFO msg="Uploading 1 narinfos"4847lb # [ 57.042890] niks3-server[985]: 2026/09/24 09:26:29 INFO Signed narinfos id=15 count=14848lb # [ 57.049143] niks3-server[985]: 2026/09/24 09:26:29 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4849lb # [ 57.061612] niks3-server[985]: 2026/09/24 09:26:29 INFO Received complete push request method=POST path=/api/pushes/15/complete4850lb # [ 57.069171] niks3-server[985]: 2026/09/24 09:26:29 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4851worker2 # [ 57.041347] nix-grpc-daemon[883]: time=2026-09-24T09:26:29.248Z level=INFO msg="Upload complete. (183ms)"4852worker2 # [ 57.046917] nix-grpc-daemon[781]: ts=2026-09-24T09:26:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_in=4324853worker2 # [ 57.054418] nix-grpc-daemon[781]: ts=2026-09-24T09:26:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348364854worker2 # [ 57.066112] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4855worker2 # [ 57.074494] nix-daemon[869]: reaped child process 1068, status = succeeded4856worker2 # [ 57.079050] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4857client # [ 57.078556] nix[954]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4858client # [ 57.707683] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup.4859client # Running as unit: dedup2.service; invocation ID: 4127678e301f42b2ac2b6ccceda949df4860client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag dedup, in 1.07 seconds)4861worker2 # [ 57.867454] nix-grpc-daemon[781]: ts=2026-09-24T09:26:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:348364862client # [ 57.879345] nix[970]: this derivation will be built:4863worker1 # [ 57.871169] nix-grpc-daemon[511]: ts=2026-09-24T09:26:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:542624864worker1 # [ 57.882289] nix-grpc-daemon[511]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' from 'http://lb:5751'...4865client # [ 57.911521] nix[970]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4866worker2 # [ 57.921200] nix-grpc-daemon[781]: ts=2026-09-24T09:26:30Z level=debug event=want client=6 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04867worker2 # [ 57.926345] nix-grpc-daemon[781]: ts=2026-09-24T09:26:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348364868client # [ 57.931056] nix[970]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4869client: must succeed: sleep 24870client: (finished: must succeed: sleep 2, in 2.04 seconds)4871client: waiting for success: ! systemctl is-active dedup1 dedup24872worker2 # [ 61.096706] nix-daemon[869]: reaped child process 1077, status = succeeded4873worker2 # [ 61.172245] nix-daemon[869]: accepted connection from pid 1109, user nix-grpc-daemon (trusted)4874worker2 # [ 61.183960] nix-daemon[869]: reaped child process 1112, status = succeeded4875lb # [ 61.221753] niks3-server[985]: 2026/09/24 09:26:33 INFO Received push request method=POST path=/api/pushes4876worker2 # [ 61.200493] nix-grpc-daemon[883]: time=2026-09-24T09:26:33.407Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4877worker2 # [ 61.203068] nix-grpc-daemon[883]: time=2026-09-24T09:26:33.409Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4878lb # [ 61.266115] niks3-server[985]: 2026/09/24 09:26:33 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4879lb # [ 61.270953] niks3-server[985]: 2026/09/24 09:26:33 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4880lb # [ 61.277256] niks3-server[985]: 2026/09/24 09:26:33 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign4881lb # [ 61.283369] niks3-server[985]: 2026/09/24 09:26:33 INFO Signed narinfos id=16 count=14882worker2 # [ 61.254865] nix-grpc-daemon[883]: time=2026-09-24T09:26:33.461Z level=INFO msg="Uploading 1 narinfos"4883lb # [ 61.288990] niks3-server[985]: 2026/09/24 09:26:33 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4884lb # [ 61.295717] niks3-server[985]: 2026/09/24 09:26:33 INFO Received complete push request method=POST path=/api/pushes/16/complete4885worker2 # [ 61.272421] nix-grpc-daemon[883]: time=2026-09-24T09:26:33.479Z level=INFO msg="Upload complete. (183ms)"4886lb # [ 61.306237] niks3-server[985]: 2026/09/24 09:26:33 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4887worker2 # [ 61.282450] nix-grpc-daemon[781]: ts=2026-09-24T09:26:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04888worker2 # [ 61.288219] nix-grpc-daemon[781]: ts=2026-09-24T09:26:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04889worker2 # [ 61.299402] nix-daemon[869]: reaped child process 1075, status = succeeded4890client # [ 61.322089] systemd[1]: dedup1.service: Deactivated successfully.4891client # [ 61.326086] systemd[1]: dedup1.service: Consumed 117ms CPU time over 4.672s wall clock time, 41.5M memory peak, 7.1K incoming IP traffic, 8.2K outgoing IP traffic.4892client # [ 61.331993] systemd[1]: dedup2.service: Deactivated successfully.4893client # [ 61.335902] systemd[1]: dedup2.service: Consumed 139ms CPU time over 3.627s wall clock time, 35.4M memory peak, 6.5K incoming IP traffic, 5.9K outgoing IP traffic.4894client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds)4895client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4896client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4897worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4898worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4899worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4900worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4901worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4902worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4903worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4904worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4905(finished: subtest: two clients wanting the same drv build it once, in 5.73 seconds)4906subtest: --timeout and --max-silent-time reach the builder4907worker1 # [ 62.498338] nix-grpc-daemon[511]: ts=2026-09-24T09:26:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542624908worker2 # [ 62.520812] nix-grpc-daemon[781]: ts=2026-09-24T09:26:34Z level=debug event=want client=7 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv cached=04909worker2 # [ 62.525487] nix-grpc-daemon[781]: ts=2026-09-24T09:26:34Z level=debug event=assigned drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv worker=192.168.1.3:50051 clients=14910worker1 # [ 62.513735] nix-grpc-daemon[511]: ts=2026-09-24T09:26:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542624911worker1 # [ 62.525651] nix-grpc-daemon[511]: ts=2026-09-24T09:26:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542624912worker1 # [ 62.536722] nix-grpc-daemon[511]: ts=2026-09-24T09:26:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542624913worker1 # [ 62.547801] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4914worker1 # [ 62.652193] nix-daemon[849]: accepted connection from pid 1008, user nix-grpc-daemon (trusted)4915worker1 # [ 62.664510] nix-daemon[849]: reaped child process 1011, status = succeeded4916lb # [ 62.719798] niks3-server[985]: 2026/09/24 09:26:34 INFO Received push request method=POST path=/api/pushes4917worker1 # [ 62.683313] nix-grpc-daemon[883]: time=2026-09-24T09:26:34.820Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4918worker1 # [ 62.684865] nix-grpc-daemon[883]: time=2026-09-24T09:26:34.820Z level=INFO msg="Uploading qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv (424B)"4919lb # [ 62.752394] niks3-server[985]: 2026/09/24 09:26:34 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign4920lb # [ 62.758633] niks3-server[985]: 2026/09/24 09:26:34 INFO Signed narinfos id=17 count=14921worker1 # [ 62.720412] nix-grpc-daemon[883]: time=2026-09-24T09:26:34.858Z level=INFO msg="Uploading 1 narinfos"4922lb # [ 62.767665] niks3-server[985]: 2026/09/24 09:26:34 INFO Registered completed upload object_key=nar/1s4sciw269ksj1s7ymwz5cy4dw9n7bxv3k8wqw69h694spdh4ha2.nar.zst4923lb # [ 62.775586] niks3-server[985]: 2026/09/24 09:26:34 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.ls4924lb # [ 62.786657] niks3-server[985]: 2026/09/24 09:26:34 INFO Received complete push request method=POST path=/api/pushes/17/complete4925lb # [ 62.795372] niks3-server[985]: 2026/09/24 09:26:34 INFO Registered completed upload object_key=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k.narinfo4926worker1 # [ 62.756192] nix-grpc-daemon[883]: time=2026-09-24T09:26:34.893Z level=INFO msg="Upload complete. (197ms)"4927worker1 # [ 62.760761] nix-grpc-daemon[511]: ts=2026-09-24T09:26:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 paths=1 nar_bytes_in=4244928worker1 # [ 62.768341] nix-grpc-daemon[511]: ts=2026-09-24T09:26:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542624929worker1 # [ 62.779715] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4930worker1 # [ 62.788186] nix-daemon[849]: reaped child process 1006, status = succeeded4931worker1 # [ 62.796240] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4932lb # [ 64.981210] envoy[904]: conn peer=[2001:db8:1::1]:46282 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9481 tx=4353 ms=48684933lb # [ 64.984975] envoy[904]: conn peer=[2001:db8:1::1]:43090 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1034 tx=2872 ms=924934lb # [ 64.988480] envoy[904]: conn peer=[2001:db8:1::1]:43116 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=329 ms=284935lb # [ 64.991846] envoy[904]: conn peer=[2001:db8:1::1]:43106 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=376 ms=364936lb # [ 64.995956] envoy[904]: conn peer=[2001:db8:1::1]:43104 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=384 tx=410 ms=444937lb # [ 64.999434] envoy[904]: conn peer=[2001:db8:1::1]:43142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1589 tx=1599 ms=34274938lb # [ 65.002892] envoy[904]: conn peer=[2001:db8:1::1]:43130 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2994 tx=1546 ms=45114939worker1 # [ 68.610790] nix-grpc-daemon[511]: ts=2026-09-24T09:26:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=5 drv=qkzy7qnn48bqc3ll9lb2m9zsrx1dr87k-slow-tmot.drv assign_id=9 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04940worker1 # [ 68.638669] nix-daemon[849]: reaped child process 1013, status = succeeded4941worker1 # [ 68.641404] nix-daemon[849]: reaped child process 1015, status = succeeded4942worker1 # [ 68.773158] nix-grpc-daemon[511]: ts=2026-09-24T09:26:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542624943worker2 # [ 68.798955] nix-grpc-daemon[781]: ts=2026-09-24T09:26:41Z level=debug event=want client=8 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv cached=04944worker2 # [ 68.804791] nix-grpc-daemon[781]: ts=2026-09-24T09:26:41Z level=debug event=assigned drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv worker=192.168.1.4:50051 clients=14945worker2 # [ 68.809318] nix-grpc-daemon[781]: ts=2026-09-24T09:26:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348364946worker2 # [ 68.822916] nix-grpc-daemon[781]: ts=2026-09-24T09:26:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348364947worker2 # [ 68.834224] nix-grpc-daemon[781]: ts=2026-09-24T09:26:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348364948worker2 # [ 68.844383] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4949worker2 # [ 68.946944] nix-daemon[869]: accepted connection from pid 1129, user nix-grpc-daemon (trusted)4950worker2 # [ 68.961275] nix-daemon[869]: reaped child process 1132, status = succeeded4951lb # [ 68.998859] niks3-server[985]: 2026/09/24 09:26:41 INFO Received push request method=POST path=/api/pushes4952worker2 # [ 68.975911] nix-grpc-daemon[883]: time=2026-09-24T09:26:41.182Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4953worker2 # [ 68.977784] nix-grpc-daemon[883]: time=2026-09-24T09:26:41.184Z level=INFO msg="Uploading fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv (424B)"4954lb # [ 69.028668] niks3-server[985]: 2026/09/24 09:26:41 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign4955lb # [ 69.033965] niks3-server[985]: 2026/09/24 09:26:41 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.ls4956lb # [ 69.039776] niks3-server[985]: 2026/09/24 09:26:41 INFO Signed narinfos id=18 count=14957worker2 # [ 69.013477] nix-grpc-daemon[883]: time=2026-09-24T09:26:41.220Z level=INFO msg="Uploading 1 narinfos"4958lb # [ 69.049330] niks3-server[985]: 2026/09/24 09:26:41 INFO Registered completed upload object_key=nar/013y5sy2r6v0qdwv0dzpgvdfy08bds4mfh2qpvbgjazzrg2v71hp.nar.zst4959lb # [ 69.061104] niks3-server[985]: 2026/09/24 09:26:41 INFO Received complete push request method=POST path=/api/pushes/18/complete4960lb # [ 69.068713] niks3-server[985]: 2026/09/24 09:26:41 INFO Registered completed upload object_key=fvgcnys8vngcgklsp349d5pjxr4c66sg.narinfo4961worker2 # [ 69.042619] nix-grpc-daemon[883]: time=2026-09-24T09:26:41.249Z level=INFO msg="Upload complete. (186ms)"4962worker2 # [ 69.047967] nix-grpc-daemon[781]: ts=2026-09-24T09:26:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_in=4244963worker2 # [ 69.054397] nix-grpc-daemon[781]: ts=2026-09-24T09:26:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348364964worker2 # [ 69.067174] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4965worker2 # [ 69.077136] nix-daemon[869]: reaped child process 1127, status = succeeded4966worker2 # [ 69.080229] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)4967worker2 # [ 74.891460] nix-grpc-daemon[781]: ts=2026-09-24T09:26:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=5 drv=fvgcnys8vngcgklsp349d5pjxr4c66sg-slow-tmom.drv assign_id=10 outputs=0 inputs=0 inputs_fetched=0 input_bytes=0 input_s=04968worker2 # [ 74.903761] nix-daemon[869]: reaped child process 1134, status = succeeded4969worker2 # [ 74.904968] nix-daemon[869]: reaped child process 1136, status = succeeded4970lb # [ 74.980834] envoy[904]: conn peer=[2001:db8:1::1]:43156 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=933 ms=61264971lb # [ 74.984838] envoy[904]: conn peer=[2001:db8:1::1]:38342 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=959 ms=61184972(finished: subtest: --timeout and --max-silent-time reach the builder, in 12.66 seconds)4973subtest: the first client leaving does not fail the second4974client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share4975client # [ 75.060475] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share.4976client # Running as unit: share1.service; invocation ID: 00d87f38cf9242478b86894a35fd94ed4977client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 0.06 seconds)4978client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share4979client # [ 75.205287] nix[1043]: don't know how to build these paths:4980client # [ 75.206175] nix[1043]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv4981worker1 # [ 75.190915] nix-grpc-daemon[511]: ts=2026-09-24T09:26:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542624982worker2 # [ 75.212703] nix-grpc-daemon[781]: ts=2026-09-24T09:26:47Z level=debug event=want client=9 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=04983worker2 # [ 75.217487] nix-grpc-daemon[781]: ts=2026-09-24T09:26:47Z level=debug event=assigned drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv worker=192.168.1.3:50051 clients=14984worker1 # [ 75.205709] nix-grpc-daemon[511]: ts=2026-09-24T09:26:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542624985worker1 # [ 75.218071] nix-grpc-daemon[511]: ts=2026-09-24T09:26:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542624986client # [ 75.241082] nix[1043]: copying 1 paths to 'lb:50051'...4987client # [ 75.241822] nix[1043]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' to 'lb:50051'...4988worker1 # [ 75.228601] nix-grpc-daemon[511]: ts=2026-09-24T09:26:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542624989worker1 # [ 75.239782] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)4990worker1 # [ 75.340935] nix-daemon[849]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)4991worker1 # [ 75.353308] nix-daemon[849]: reaped child process 1041, status = succeeded4992lb # [ 75.407306] niks3-server[985]: 2026/09/24 09:26:47 INFO Received push request method=POST path=/api/pushes4993worker1 # [ 75.370839] nix-grpc-daemon[883]: time=2026-09-24T09:26:47.508Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4994worker1 # [ 75.372305] nix-grpc-daemon[883]: time=2026-09-24T09:26:47.508Z level=INFO msg="Uploading j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv (432B)"4995lb # [ 75.441447] niks3-server[985]: 2026/09/24 09:26:47 INFO Registered completed upload object_key=nar/0s0b0gfhn36p0aylk1qa64cgw01bi7a8ca93iv4zg2q7wqcjcqhs.nar.zst4996lb # [ 75.451128] niks3-server[985]: 2026/09/24 09:26:47 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign4997lb # [ 75.458840] niks3-server[985]: 2026/09/24 09:26:47 INFO Signed narinfos id=19 count=14998worker1 # [ 75.417375] nix-grpc-daemon[883]: time=2026-09-24T09:26:47.554Z level=INFO msg="Uploading 1 narinfos"4999lb # [ 75.467369] niks3-server[985]: 2026/09/24 09:26:47 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.ls5000lb # [ 75.480023] niks3-server[985]: 2026/09/24 09:26:47 INFO Received complete push request method=POST path=/api/pushes/19/complete5001worker1 # [ 75.440080] nix-grpc-daemon[883]: time=2026-09-24T09:26:47.577Z level=INFO msg="Upload complete. (188ms)"5002lb # [ 75.486553] niks3-server[985]: 2026/09/24 09:26:47 INFO Registered completed upload object_key=j2xs6vfpc2dkbabf87x31z8q4j8chjfw.narinfo5003worker1 # [ 75.445148] nix-grpc-daemon[511]: ts=2026-09-24T09:26:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 paths=1 nar_bytes_in=4325004worker1 # [ 75.451153] nix-grpc-daemon[511]: ts=2026-09-24T09:26:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542625005worker1 # [ 75.463113] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)5006worker1 # [ 75.470888] nix-daemon[849]: reaped child process 1036, status = succeeded5007worker1 # [ 75.476413] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)5008client # [ 75.489572] nix[1043]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051...5009client # [ 76.127675] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share.5010client # Running as unit: share2.service; invocation ID: 6e1d87fdbb994b8a945f0717c92d3b225011client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag share, in 1.07 seconds)5012worker1 # [ 76.256297] nix-grpc-daemon[511]: ts=2026-09-24T09:26:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542625013client # [ 76.281138] nix[1059]: this derivation will be built:5014worker2 # [ 76.284915] nix-grpc-daemon[781]: ts=2026-09-24T09:26:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:348365015worker2 # [ 76.294484] nix-grpc-daemon[781]: copying path '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' from 'http://lb:5751'...5016client # [ 76.307584] nix[1059]: /nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5017worker2 # [ 76.314638] nix-grpc-daemon[781]: ts=2026-09-24T09:26:48Z level=debug event=want client=10 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv cached=05018worker1 # [ 76.307867] nix-grpc-daemon[511]: ts=2026-09-24T09:26:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542625019client # [ 76.326789] nix[1059]: building '/nix/store/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv' on lb:50051...5020client: must succeed: sleep 2; systemctl kill -s INT share15021client # [ 79.382122] systemd[1]: share1.service: Sent signal SIGINT to main process 1043 (nix) on client request.5022client # [ 79.385951] nix[1043]: shutting downj2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5023client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.06 seconds)5024client: waiting for success: ! systemctl is-active share15025client # [ 79.393623] nix[1043]: error: interrupted by the user5026client # [ 79.434805] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE5027client # [ 79.436560] systemd[1]: share1.service: Failed with result 'exit-code'.5028client # [ 79.438257] systemd[1]: share1.service: Consumed 115ms CPU time over 4.376s wall clock time, 43.5M memory peak, 6.1K incoming IP traffic, 8.1K outgoing IP traffic.5029client: (finished: waiting for success: ! systemctl is-active share1, in 1.08 seconds)5030client: waiting for success: ! systemctl is-active share25031worker1 # [ 80.714371] nix-daemon[849]: reaped child process 1045, status = succeeded5032worker1 # [ 80.787683] nix-daemon[849]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)5033worker1 # [ 80.799717] nix-daemon[849]: reaped child process 1082, status = succeeded5034lb # [ 80.851406] niks3-server[985]: 2026/09/24 09:26:53 INFO Received push request method=POST path=/api/pushes5035worker1 # [ 80.813619] nix-grpc-daemon[883]: time=2026-09-24T09:26:52.951Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5036worker1 # [ 80.815081] nix-grpc-daemon[883]: time=2026-09-24T09:26:52.952Z level=INFO msg="Uploading b9lg6znd0rinl36gy6ixq1dcj6b8bhhw-slow-share (120B)"5037lb # [ 80.878417] niks3-server[985]: 2026/09/24 09:26:53 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign5038lb # [ 80.880676] niks3-server[985]: 2026/09/24 09:26:53 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst5039lb # [ 80.883766] niks3-server[985]: 2026/09/24 09:26:53 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.ls5040lb # [ 80.886051] niks3-server[985]: 2026/09/24 09:26:53 INFO Signed narinfos id=20 count=15041worker1 # [ 80.842742] nix-grpc-daemon[883]: time=2026-09-24T09:26:52.980Z level=INFO msg="Uploading 1 narinfos"5042lb # [ 80.889580] niks3-server[985]: 2026/09/24 09:26:53 INFO Registered completed upload object_key=log/j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv5043lb # [ 80.895614] niks3-server[985]: 2026/09/24 09:26:53 INFO Received complete push request method=POST path=/api/pushes/20/complete5044worker1 # [ 80.854886] nix-grpc-daemon[883]: time=2026-09-24T09:26:52.992Z level=INFO msg="Upload complete. (167ms)"5045lb # [ 80.900494] niks3-server[985]: 2026/09/24 09:26:53 INFO Registered completed upload object_key=b9lg6znd0rinl36gy6ixq1dcj6b8bhhw.narinfo5046worker1 # [ 80.857663] nix-grpc-daemon[511]: ts=2026-09-24T09:26:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=4 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05047worker1 # [ 80.861065] nix-grpc-daemon[511]: ts=2026-09-24T09:26:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=5 drv=j2xs6vfpc2dkbabf87x31z8q4j8chjfw-slow-share.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05048worker1 # [ 80.867994] nix-daemon[849]: reaped child process 1043, status = succeeded5049client # [ 80.903178] systemd[1]: share2.service: Deactivated successfully.5050client # [ 80.907185] systemd[1]: share2.service: Consumed 120ms CPU time over 4.778s wall clock time, 35.4M memory peak, 6.5K incoming IP traffic, 5.9K outgoing IP traffic.5051client: (finished: waiting for success: ! systemctl is-active share2, in 1.08 seconds)5052client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }5053client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.03 seconds)5054(finished: subtest: the first client leaving does not fail the second, in 6.74 seconds)5055subtest: build hook: nix-daemon with builders = grpc://lb5056client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log5057client # [ 81.850099] systemd[1]: Started Nix Daemon.5058client # [ 81.936215] nix-daemon[1111]: accepted connection from pid 1108, user root (trusted)5059worker1 # [ 82.034392] nix-grpc-daemon[511]: ts=2026-09-24T09:26:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:542625060worker1 # [ 82.039633] nix-grpc-daemon[511]: ts=2026-09-24T09:26:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542625061worker2 # [ 82.065462] nix-grpc-daemon[781]: ts=2026-09-24T09:26:54Z level=debug event=want client=11 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=05062worker2 # [ 82.070325] nix-grpc-daemon[781]: ts=2026-09-24T09:26:54Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=15063worker2 # [ 82.074682] nix-grpc-daemon[781]: ts=2026-09-24T09:26:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348365064worker2 # [ 82.083739] nix-grpc-daemon[781]: ts=2026-09-24T09:26:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348365065worker2 # [ 82.092843] nix-grpc-daemon[781]: ts=2026-09-24T09:26:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348365066worker2 # [ 82.103966] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5067worker2 # [ 82.197401] nix-daemon[869]: accepted connection from pid 1182, user nix-grpc-daemon (trusted)5068worker2 # [ 82.209387] nix-daemon[869]: reaped child process 1185, status = succeeded5069lb # [ 82.248037] niks3-server[985]: 2026/09/24 09:26:54 INFO Received push request method=POST path=/api/pushes5070worker2 # [ 82.221779] nix-grpc-daemon[883]: time=2026-09-24T09:26:54.428Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5071worker2 # [ 82.223234] nix-grpc-daemon[883]: time=2026-09-24T09:26:54.428Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"5072lb # [ 82.260365] niks3-server[985]: 2026/09/24 09:26:54 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign5073lb # [ 82.262320] niks3-server[985]: 2026/09/24 09:26:54 INFO Signed narinfos id=21 count=15074worker2 # [ 82.231565] nix-grpc-daemon[883]: time=2026-09-24T09:26:54.438Z level=INFO msg="Uploading 1 narinfos"5075lb # [ 82.267771] niks3-server[985]: 2026/09/24 09:26:54 INFO Received complete push request method=POST path=/api/pushes/21/complete5076lb # [ 82.270769] niks3-server[985]: 2026/09/24 09:26:54 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst5077lb # [ 82.276427] niks3-server[985]: 2026/09/24 09:26:54 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls5078worker2 # [ 82.249122] nix-grpc-daemon[883]: time=2026-09-24T09:26:54.456Z level=INFO msg="Upload complete. (134ms)"5079lb # [ 82.281463] niks3-server[985]: 2026/09/24 09:26:54 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo5080worker2 # [ 82.251258] nix-grpc-daemon[781]: ts=2026-09-24T09:26:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_in=5125081worker2 # [ 82.254879] nix-grpc-daemon[781]: ts=2026-09-24T09:26:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348365082worker2 # [ 82.260913] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5083worker2 # [ 82.263160] nix-daemon[869]: reaped child process 1180, status = succeeded5084worker2 # [ 82.268196] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5085worker2 # [ 83.686258] nix-daemon[869]: reaped child process 1189, status = succeeded5086worker2 # [ 83.757278] nix-daemon[869]: accepted connection from pid 1205, user nix-grpc-daemon (trusted)5087worker2 # [ 83.769099] nix-daemon[869]: reaped child process 1208, status = succeeded5088lb # [ 83.805785] niks3-server[985]: 2026/09/24 09:26:55 INFO Received push request method=POST path=/api/pushes5089worker2 # [ 83.779333] nix-grpc-daemon[883]: time=2026-09-24T09:26:55.986Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5090worker2 # [ 83.780925] nix-grpc-daemon[883]: time=2026-09-24T09:26:55.987Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"5091lb # [ 83.829463] niks3-server[985]: 2026/09/24 09:26:56 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign5092lb # [ 83.832682] niks3-server[985]: 2026/09/24 09:26:56 INFO Signed narinfos id=22 count=15093worker2 # [ 83.801873] nix-grpc-daemon[883]: time=2026-09-24T09:26:56.008Z level=INFO msg="Uploading 1 narinfos"5094lb # [ 83.834943] niks3-server[985]: 2026/09/24 09:26:56 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst5095lb # [ 83.838576] niks3-server[985]: 2026/09/24 09:26:56 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv5096lb # [ 83.841244] niks3-server[985]: 2026/09/24 09:26:56 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls5097lb # [ 83.845361] niks3-server[985]: 2026/09/24 09:26:56 INFO Received complete push request method=POST path=/api/pushes/22/complete5098lb # [ 83.851584] niks3-server[985]: 2026/09/24 09:26:56 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo5099worker2 # [ 83.825507] nix-grpc-daemon[883]: time=2026-09-24T09:26:56.032Z level=INFO msg="Upload complete. (149ms)"5100worker2 # [ 83.828092] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05101worker2 # [ 83.834249] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:348365102worker2 # [ 83.838386] nix-daemon[869]: reaped child process 1187, status = succeeded5103worker2 # [ 83.849961] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:348365104worker2 # [ 83.852138] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_out=1285105worker1 # [ 84.009298] nix-grpc-daemon[511]: ts=2026-09-24T09:26:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:542625106worker2 # [ 84.025599] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348365107worker2 # [ 84.033475] nix-grpc-daemon[883]: time=2026-09-24T09:26:56.240Z level=INFO msg="All 1 paths already cached"5108worker2 # [ 84.045669] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=debug event=want client=12 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=05109worker2 # [ 84.050431] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=15110worker2 # [ 84.056410] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348365111worker2 # [ 84.065328] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348365112worker2 # [ 84.075501] nix-grpc-daemon[883]: time=2026-09-24T09:26:56.282Z level=INFO msg="All 1 paths already cached"5113worker2 # [ 84.081808] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348365114worker2 # [ 84.092145] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5115worker2 # [ 84.187472] nix-daemon[869]: accepted connection from pid 1214, user nix-grpc-daemon (trusted)5116worker2 # [ 84.201624] nix-daemon[869]: reaped child process 1217, status = succeeded5117lb # [ 84.237867] niks3-server[985]: 2026/09/24 09:26:56 INFO Received push request method=POST path=/api/pushes5118worker2 # [ 84.210858] nix-grpc-daemon[883]: time=2026-09-24T09:26:56.417Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5119worker2 # [ 84.212368] nix-grpc-daemon[883]: time=2026-09-24T09:26:56.419Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"5120lb # [ 84.254338] niks3-server[985]: 2026/09/24 09:26:56 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign5121lb # [ 84.257328] niks3-server[985]: 2026/09/24 09:26:56 INFO Signed narinfos id=23 count=15122worker2 # [ 84.226379] nix-grpc-daemon[883]: time=2026-09-24T09:26:56.433Z level=INFO msg="Uploading 1 narinfos"5123lb # [ 84.259064] niks3-server[985]: 2026/09/24 09:26:56 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst5124lb # [ 84.264192] niks3-server[985]: 2026/09/24 09:26:56 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls5125lb # [ 84.276396] niks3-server[985]: 2026/09/24 09:26:56 INFO Received complete push request method=POST path=/api/pushes/23/complete5126worker2 # [ 84.252970] nix-grpc-daemon[883]: time=2026-09-24T09:26:56.460Z level=INFO msg="Upload complete. (149ms)"5127lb # [ 84.285200] niks3-server[985]: 2026/09/24 09:26:56 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo5128worker2 # [ 84.255075] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_in=6245129worker2 # [ 84.258738] nix-grpc-daemon[781]: ts=2026-09-24T09:26:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348365130worker2 # [ 84.265101] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5131worker2 # [ 84.267412] nix-daemon[869]: reaped child process 1212, status = succeeded5132worker2 # [ 84.272589] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5133lb # [ 84.981878] envoy[904]: conn peer=[2001:db8:1::1]:39908 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2965 tx=770 ms=42015134lb # [ 84.985708] envoy[904]: conn peer=[2001:db8:1::1]:39918 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1589 tx=1599 ms=46135135lb # [ 84.989231] envoy[904]: conn peer=[2001:db8:1::1]:35016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=275136lb # [ 84.992639] envoy[904]: conn peer=[2001:db8:1::1]:39934 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3368 tx=1907 ms=18305137worker2 # [ 85.313733] nix-daemon[869]: reaped child process 1221, status = succeeded5138worker2 # [ 85.392593] nix-daemon[869]: accepted connection from pid 1237, user nix-grpc-daemon (trusted)5139worker2 # [ 85.403689] nix-daemon[869]: reaped child process 1240, status = succeeded5140lb # [ 85.442648] niks3-server[985]: 2026/09/24 09:26:57 INFO Received push request method=POST path=/api/pushes5141worker2 # [ 85.421455] nix-grpc-daemon[883]: time=2026-09-24T09:26:57.628Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5142worker2 # [ 85.423229] nix-grpc-daemon[883]: time=2026-09-24T09:26:57.630Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"5143lb # [ 85.486117] niks3-server[985]: 2026/09/24 09:26:57 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign5144worker2 # [ 85.464550] nix-grpc-daemon[883]: time=2026-09-24T09:26:57.671Z level=INFO msg="Uploading 1 narinfos"5145lb # [ 85.495955] niks3-server[985]: 2026/09/24 09:26:57 INFO Signed narinfos id=24 count=15146lb # [ 85.503817] niks3-server[985]: 2026/09/24 09:26:57 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls5147lb # [ 85.510277] niks3-server[985]: 2026/09/24 09:26:57 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv5148lb # [ 85.514463] niks3-server[985]: 2026/09/24 09:26:57 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst5149lb # [ 85.522986] niks3-server[985]: 2026/09/24 09:26:57 INFO Received complete push request method=POST path=/api/pushes/24/complete5150lb # [ 85.530755] niks3-server[985]: 2026/09/24 09:26:57 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo5151worker2 # [ 85.498787] nix-grpc-daemon[883]: time=2026-09-24T09:26:57.705Z level=INFO msg="Upload complete. (218ms)"5152worker2 # [ 85.508519] nix-grpc-daemon[781]: ts=2026-09-24T09:26:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=13 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05153worker2 # [ 85.516735] nix-grpc-daemon[781]: ts=2026-09-24T09:26:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:348365154worker2 # [ 85.527715] nix-daemon[869]: reaped child process 1219, status = succeeded5155worker2 # [ 85.532840] nix-grpc-daemon[781]: ts=2026-09-24T09:26:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:348365156worker2 # [ 85.537521] nix-grpc-daemon[781]: ts=2026-09-24T09:26:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_out=1765157worker1 # [ 85.691897] nix-grpc-daemon[511]: ts=2026-09-24T09:26:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:542625158worker1 # [ 85.698441] nix-grpc-daemon[511]: ts=2026-09-24T09:26:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542625159worker2 # [ 85.732610] nix-grpc-daemon[781]: ts=2026-09-24T09:26:57Z level=debug event=want client=13 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=05160worker2 # [ 85.738872] nix-grpc-daemon[781]: ts=2026-09-24T09:26:57Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=15161worker2 # [ 85.745264] nix-grpc-daemon[781]: ts=2026-09-24T09:26:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348365162worker2 # [ 85.757914] nix-grpc-daemon[781]: ts=2026-09-24T09:26:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348365163worker2 # [ 85.771522] nix-grpc-daemon[883]: time=2026-09-24T09:26:57.978Z level=INFO msg="All 2 paths already cached"5164worker2 # [ 85.780384] nix-grpc-daemon[781]: ts=2026-09-24T09:26:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348365165worker2 # [ 85.789391] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5166worker2 # [ 85.890816] nix-daemon[869]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5167worker2 # [ 85.904161] nix-daemon[869]: reaped child process 1249, status = succeeded5168lb # [ 85.942478] niks3-server[985]: 2026/09/24 09:26:58 INFO Received push request method=POST path=/api/pushes5169worker2 # [ 85.919774] nix-grpc-daemon[883]: time=2026-09-24T09:26:58.126Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5170worker2 # [ 85.921446] nix-grpc-daemon[883]: time=2026-09-24T09:26:58.128Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"5171lb # [ 85.975559] niks3-server[985]: 2026/09/24 09:26:58 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign5172worker2 # [ 85.950885] nix-grpc-daemon[883]: time=2026-09-24T09:26:58.158Z level=INFO msg="Uploading 1 narinfos"5173lb # [ 85.981762] niks3-server[985]: 2026/09/24 09:26:58 INFO Signed narinfos id=25 count=15174lb # [ 85.993262] niks3-server[985]: 2026/09/24 09:26:58 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst5175lb # [ 85.998092] niks3-server[985]: 2026/09/24 09:26:58 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls5176lb # [ 86.005243] niks3-server[985]: 2026/09/24 09:26:58 INFO Received complete push request method=POST path=/api/pushes/25/complete5177worker2 # [ 85.983081] nix-grpc-daemon[883]: time=2026-09-24T09:26:58.189Z level=INFO msg="Upload complete. (178ms)"5178lb # [ 86.015777] niks3-server[985]: 2026/09/24 09:26:58 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo5179worker2 # [ 85.987222] nix-grpc-daemon[781]: ts=2026-09-24T09:26:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_in=7525180worker2 # [ 85.992283] nix-grpc-daemon[781]: ts=2026-09-24T09:26:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348365181worker2 # [ 86.002126] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5182worker2 # [ 86.009106] nix-daemon[869]: reaped child process 1244, status = succeeded5183worker2 # [ 86.013708] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5184worker2 # [ 87.253986] nix-daemon[869]: reaped child process 1253, status = succeeded5185worker2 # [ 87.328954] nix-daemon[869]: accepted connection from pid 1269, user nix-grpc-daemon (trusted)5186worker2 # [ 87.341677] nix-daemon[869]: reaped child process 1272, status = succeeded5187lb # [ 87.380409] niks3-server[985]: 2026/09/24 09:26:59 INFO Received push request method=POST path=/api/pushes5188worker2 # [ 87.358327] nix-grpc-daemon[883]: time=2026-09-24T09:26:59.565Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5189worker2 # [ 87.359865] nix-grpc-daemon[883]: time=2026-09-24T09:26:59.566Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"5190lb # [ 87.415718] niks3-server[985]: 2026/09/24 09:26:59 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv5191lb # [ 87.427948] niks3-server[985]: 2026/09/24 09:26:59 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign5192lb # [ 87.433939] niks3-server[985]: 2026/09/24 09:26:59 INFO Signed narinfos id=26 count=15193worker2 # [ 87.406065] nix-grpc-daemon[883]: time=2026-09-24T09:26:59.613Z level=INFO msg="Uploading 1 narinfos"5194lb # [ 87.446194] niks3-server[985]: 2026/09/24 09:26:59 INFO Received complete push request method=POST path=/api/pushes/26/complete5195lb # [ 87.457682] niks3-server[985]: 2026/09/24 09:26:59 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls5196worker2 # [ 87.425843] nix-grpc-daemon[883]: time=2026-09-24T09:26:59.632Z level=INFO msg="Upload complete. (204ms)"5197lb # [ 87.460059] niks3-server[985]: 2026/09/24 09:26:59 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo5198lb # [ 87.461772] niks3-server[985]: 2026/09/24 09:26:59 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst5199worker2 # [ 87.431803] nix-grpc-daemon[781]: ts=2026-09-24T09:26:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=14 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=05200worker2 # [ 87.443392] nix-grpc-daemon[781]: ts=2026-09-24T09:26:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:348365201worker2 # [ 87.453156] nix-daemon[869]: reaped child process 1251, status = succeeded5202worker2 # [ 87.457934] nix-grpc-daemon[781]: ts=2026-09-24T09:26:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:348365203worker2 # [ 87.461924] nix-grpc-daemon[781]: ts=2026-09-24T09:26:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_out=2325204client # [ 87.530200] nix-daemon[1111]: reaped child process 1113, status = succeeded5205client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.78 seconds)5206client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top5207client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)5208client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5209client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.02 seconds)5210client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5211client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds)5212(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.83 seconds)5213subtest: an input only one worker has still reaches the builder5214client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only5215client # this derivation will be built:5216client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv5217client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...5218client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag w1only, in 0.24 seconds)5219client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure5220client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.09 seconds)5221worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5222worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.13 seconds)5223worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only5224worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)5225client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&25226client # [ 88.190525] nix-daemon[1111]: accepted connection from pid 1194, user root (trusted)5227client # this derivation will be built:5228client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5229worker2 # [ 88.308805] nix-grpc-daemon[781]: ts=2026-09-24T09:27:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:348365230client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5231worker1 # [ 88.299852] nix-grpc-daemon[511]: ts=2026-09-24T09:27:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542625232worker1 # [ 88.408813] nix-daemon[849]: accepted connection from pid 1089, user nix-grpc-daemon (trusted)5233worker1 # [ 88.419956] nix-daemon[849]: reaped child process 1092, status = succeeded5234lb # [ 88.474321] niks3-server[985]: 2026/09/24 09:27:00 INFO Received push request method=POST path=/api/pushes5235worker1 # [ 88.437923] nix-grpc-daemon[883]: time=2026-09-24T09:27:00.575Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5236worker1 # [ 88.439740] nix-grpc-daemon[883]: time=2026-09-24T09:27:00.575Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5237lb # [ 88.503515] niks3-server[985]: 2026/09/24 09:27:00 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign5238lb # [ 88.509503] niks3-server[985]: 2026/09/24 09:27:00 INFO Signed narinfos id=27 count=15239worker1 # [ 88.467750] nix-grpc-daemon[883]: time=2026-09-24T09:27:00.605Z level=INFO msg="Uploading 1 narinfos"5240lb # [ 88.514794] niks3-server[985]: 2026/09/24 09:27:00 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5241lb # [ 88.526477] niks3-server[985]: 2026/09/24 09:27:00 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5242lb # [ 88.534747] niks3-server[985]: 2026/09/24 09:27:00 INFO Received complete push request method=POST path=/api/pushes/27/complete5243worker1 # [ 88.499116] nix-grpc-daemon[883]: time=2026-09-24T09:27:00.636Z level=INFO msg="Upload complete. (195ms)"5244lb # [ 88.546920] niks3-server[985]: 2026/09/24 09:27:00 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5245worker2 # [ 88.533939] nix-grpc-daemon[781]: ts=2026-09-24T09:27:00Z level=debug event=want client=14 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05246worker2 # [ 88.538953] nix-grpc-daemon[781]: ts=2026-09-24T09:27:00Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=15247worker1 # [ 88.527207] nix-grpc-daemon[511]: ts=2026-09-24T09:27:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542625248worker1 # [ 88.538824] nix-grpc-daemon[511]: ts=2026-09-24T09:27:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542625249client # copying 2 paths to 'lb:50051'...5250client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5251worker1 # [ 88.557935] nix-grpc-daemon[511]: ts=2026-09-24T09:27:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542625252client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5253worker1 # [ 88.569164] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)5254worker1 # [ 88.670962] nix-daemon[849]: accepted connection from pid 1096, user nix-grpc-daemon (trusted)5255worker1 # [ 88.685209] nix-daemon[849]: reaped child process 1099, status = succeeded5256lb # [ 88.737413] niks3-server[985]: 2026/09/24 09:27:00 INFO Received push request method=POST path=/api/pushes5257worker1 # [ 88.701173] nix-grpc-daemon[883]: time=2026-09-24T09:27:00.838Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5258worker1 # [ 88.702917] nix-grpc-daemon[883]: time=2026-09-24T09:27:00.840Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5259worker1 # [ 88.706607] nix-grpc-daemon[883]: time=2026-09-24T09:27:00.842Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5260lb # [ 88.771573] niks3-server[985]: 2026/09/24 09:27:00 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5261lb # [ 88.789056] niks3-server[985]: 2026/09/24 09:27:00 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5262lb # [ 88.803575] niks3-server[985]: 2026/09/24 09:27:00 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign5263lb # [ 88.809692] niks3-server[985]: 2026/09/24 09:27:00 INFO Signed narinfos id=28 count=25264worker1 # [ 88.765414] nix-grpc-daemon[883]: time=2026-09-24T09:27:00.902Z level=INFO msg="Uploading 2 narinfos"5265lb # [ 88.815216] niks3-server[985]: 2026/09/24 09:27:01 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5266lb # [ 88.818164] niks3-server[985]: 2026/09/24 09:27:01 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5267lb # [ 88.826597] niks3-server[985]: 2026/09/24 09:27:01 INFO Received complete push request method=POST path=/api/pushes/28/complete5268lb # [ 88.830701] niks3-server[985]: 2026/09/24 09:27:01 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5269lb # [ 88.833449] niks3-server[985]: 2026/09/24 09:27:01 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5270worker1 # [ 88.791968] nix-grpc-daemon[883]: time=2026-09-24T09:27:00.929Z level=INFO msg="Upload complete. (208ms)"5271worker1 # [ 88.797446] nix-grpc-daemon[511]: ts=2026-09-24T09:27:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 paths=2 nar_bytes_in=9765272worker1 # [ 88.804542] nix-grpc-daemon[511]: ts=2026-09-24T09:27:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542625273worker1 # [ 88.815184] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)5274worker1 # [ 88.827336] nix-daemon[849]: reaped child process 1094, status = succeeded5275worker1 # [ 88.831051] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)5276client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5277client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5278client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds5279worker1 # [ 89.865723] nix-daemon[849]: reaped child process 1103, status = succeeded5280worker1 # [ 89.951784] nix-daemon[849]: accepted connection from pid 1119, user nix-grpc-daemon (trusted)5281worker1 # [ 89.964048] nix-daemon[849]: reaped child process 1122, status = succeeded5282lb # [ 90.016810] niks3-server[985]: 2026/09/24 09:27:02 INFO Received push request method=POST path=/api/pushes5283worker1 # [ 89.981916] nix-grpc-daemon[883]: time=2026-09-24T09:27:02.119Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5284lb # [ 90.047359] niks3-server[985]: 2026/09/24 09:27:02 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign5285worker1 # [ 90.009854] nix-grpc-daemon[883]: time=2026-09-24T09:27:02.147Z level=INFO msg="Uploading 1 narinfos"5286lb # [ 90.055769] niks3-server[985]: 2026/09/24 09:27:02 INFO Signed narinfos id=29 count=15287lb # [ 90.062062] niks3-server[985]: 2026/09/24 09:27:02 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5288lb # [ 90.067207] niks3-server[985]: 2026/09/24 09:27:02 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5289lb # [ 90.077546] niks3-server[985]: 2026/09/24 09:27:02 INFO Received complete push request method=POST path=/api/pushes/29/complete5290worker1 # [ 90.043792] nix-grpc-daemon[883]: time=2026-09-24T09:27:02.181Z level=INFO msg="Upload complete. (203ms)"5291lb # [ 90.089876] niks3-server[985]: 2026/09/24 09:27:02 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5292client # copying 1 paths...5293worker1 # [ 90.049928] nix-grpc-daemon[511]: ts=2026-09-24T09:27:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=15 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05294worker2 # [ 90.069594] nix-grpc-daemon[781]: ts=2026-09-24T09:27:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:348365295worker1 # [ 90.064546] nix-daemon[849]: reaped child process 1101, status = succeeded5296worker2 # [ 90.078061] nix-grpc-daemon[781]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5297client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5298worker2 # [ 90.104271] nix-grpc-daemon[781]: ts=2026-09-24T09:27:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:348365299worker2 # [ 90.109673] nix-grpc-daemon[781]: ts=2026-09-24T09:27:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_out=1205300client # [ 90.178390] nix-daemon[1111]: reaped child process 1197, status = succeeded5301client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.10 seconds)5302client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&25303client # [ 90.276097] nix-daemon[1111]: accepted connection from pid 1216, user root (trusted)5304client # this derivation will be built:5305client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5306worker2 # [ 90.393150] nix-grpc-daemon[781]: ts=2026-09-24T09:27:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:348365307client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5308worker1 # [ 90.382216] nix-grpc-daemon[511]: ts=2026-09-24T09:27:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542625309worker1 # [ 90.391546] nix-grpc-daemon[883]: time=2026-09-24T09:27:02.529Z level=INFO msg="All 1 paths already cached"5310worker2 # [ 90.420580] nix-grpc-daemon[781]: ts=2026-09-24T09:27:02Z level=debug event=want client=15 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05311worker2 # [ 90.426232] nix-grpc-daemon[781]: ts=2026-09-24T09:27:02Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15312worker2 # [ 90.431976] nix-grpc-daemon[781]: ts=2026-09-24T09:27:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348365313worker2 # [ 90.444226] nix-grpc-daemon[781]: ts=2026-09-24T09:27:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348365314client # copying 1 paths to 'lb:50051'...5315client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5316worker2 # [ 90.460581] nix-grpc-daemon[781]: ts=2026-09-24T09:27:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348365317worker2 # [ 90.469868] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5318worker2 # [ 90.487511] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 1/5)5319worker2 # [ 90.580490] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 106 ms (attempt 2/5)5320worker2 # [ 90.694527] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 3/5)5321worker2 # [ 90.737419] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 233 ms (attempt 4/5)5322worker2 # [ 90.973209] nix-grpc-daemon[781]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5323worker2 # [ 90.976394] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5324worker2 # [ 90.982576] nix-grpc-daemon[781]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5325worker2 # [ 91.110107] nix-daemon[869]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5326worker2 # [ 91.126806] nix-daemon[869]: reaped child process 1292, status = succeeded5327lb # [ 91.167772] niks3-server[985]: 2026/09/24 09:27:03 INFO Received push request method=POST path=/api/pushes5328worker2 # [ 91.146170] nix-grpc-daemon[883]: time=2026-09-24T09:27:03.352Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5329worker2 # [ 91.147934] nix-grpc-daemon[883]: time=2026-09-24T09:27:03.354Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5330lb # [ 91.198352] niks3-server[985]: 2026/09/24 09:27:03 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign5331lb # [ 91.201606] niks3-server[985]: 2026/09/24 09:27:03 INFO Signed narinfos id=30 count=15332worker2 # [ 91.170807] nix-grpc-daemon[883]: time=2026-09-24T09:27:03.377Z level=INFO msg="Uploading 1 narinfos"5333lb # [ 91.206618] niks3-server[985]: 2026/09/24 09:27:03 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5334lb # [ 91.209875] niks3-server[985]: 2026/09/24 09:27:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5335lb # [ 91.213062] niks3-server[985]: 2026/09/24 09:27:03 INFO Received complete push request method=POST path=/api/pushes/30/complete5336worker2 # [ 91.188522] nix-grpc-daemon[883]: time=2026-09-24T09:27:03.395Z level=INFO msg="Upload complete. (187ms)"5337lb # [ 91.220693] niks3-server[985]: 2026/09/24 09:27:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5338worker2 # [ 91.191883] nix-grpc-daemon[781]: ts=2026-09-24T09:27:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_in=5605339worker2 # [ 91.194896] nix-grpc-daemon[781]: ts=2026-09-24T09:27:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348365340worker2 # [ 91.201200] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5341worker2 # [ 91.207539] nix-daemon[869]: reaped child process 1282, status = succeeded5342worker2 # [ 91.213578] nix-grpc-daemon[781]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5343worker2 # [ 91.220420] nix-daemon[869]: accepted connection from pid 781, user nix-grpc-daemon (trusted)5344client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5345client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5346client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5347worker2 # [ 92.457822] nix-daemon[869]: reaped child process 1297, status = succeeded5348worker2 # [ 92.537653] nix-daemon[869]: accepted connection from pid 1313, user nix-grpc-daemon (trusted)5349worker2 # [ 92.549888] nix-daemon[869]: reaped child process 1316, status = succeeded5350lb # [ 92.588904] niks3-server[985]: 2026/09/24 09:27:04 INFO Received push request method=POST path=/api/pushes5351worker2 # [ 92.566108] nix-grpc-daemon[883]: time=2026-09-24T09:27:04.772Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5352lb # [ 92.616660] niks3-server[985]: 2026/09/24 09:27:04 INFO Received sign narinfos request method=POST path=/api/pushes/31/sign5353lb # [ 92.622099] niks3-server[985]: 2026/09/24 09:27:04 INFO Signed narinfos id=31 count=15354worker2 # [ 92.594205] nix-grpc-daemon[883]: time=2026-09-24T09:27:04.801Z level=INFO msg="Uploading 1 narinfos"5355lb # [ 92.632147] niks3-server[985]: 2026/09/24 09:27:04 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5356lb # [ 92.644192] niks3-server[985]: 2026/09/24 09:27:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5357lb # [ 92.652251] niks3-server[985]: 2026/09/24 09:27:04 INFO Received complete push request method=POST path=/api/pushes/31/complete5358lb # [ 92.660335] niks3-server[985]: 2026/09/24 09:27:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5359worker2 # [ 92.635719] nix-grpc-daemon[883]: time=2026-09-24T09:27:04.842Z level=INFO msg="Upload complete. (205ms)"5360worker2 # [ 92.642505] nix-grpc-daemon[781]: ts=2026-09-24T09:27:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=16 outputs=1 inputs=1 inputs_fetched=1 input_bytes=120 input_s=05361client # copying 1 paths...5362worker1 # [ 92.641832] nix-grpc-daemon[511]: ts=2026-09-24T09:27:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:542625363worker2 # [ 92.658361] nix-daemon[869]: reaped child process 1294, status = succeeded5364worker1 # [ 92.652298] nix-grpc-daemon[511]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5365client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5366worker2 # [ 92.695841] nix-grpc-daemon[781]: ts=2026-09-24T09:27:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:348365367worker2 # [ 92.700831] nix-grpc-daemon[781]: ts=2026-09-24T09:27:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_out=1205368client # [ 92.769509] nix-daemon[1111]: reaped child process 1219, status = succeeded5369client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.59 seconds)5370client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&25371client # [ 92.868507] nix-daemon[1111]: accepted connection from pid 1238, user root (trusted)5372client # this derivation will be built:5373client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5374worker1 # [ 92.969410] nix-grpc-daemon[511]: ts=2026-09-24T09:27:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:542625375client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux'...5376worker1 # [ 92.976676] nix-grpc-daemon[511]: ts=2026-09-24T09:27:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542625377worker1 # [ 92.987407] nix-grpc-daemon[883]: time=2026-09-24T09:27:05.124Z level=INFO msg="All 1 paths already cached"5378worker2 # [ 93.015271] nix-grpc-daemon[781]: ts=2026-09-24T09:27:05Z level=debug event=want client=16 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05379worker2 # [ 93.020702] nix-grpc-daemon[781]: ts=2026-09-24T09:27:05Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15380worker1 # [ 93.008885] nix-grpc-daemon[511]: ts=2026-09-24T09:27:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542625381worker1 # [ 93.020301] nix-grpc-daemon[511]: ts=2026-09-24T09:27:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542625382worker1 # [ 93.032762] nix-grpc-daemon[883]: time=2026-09-24T09:27:05.170Z level=INFO msg="All 1 paths already cached"5383client # copying 1 paths to 'lb:50051'...5384client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5385worker1 # [ 93.040693] nix-grpc-daemon[511]: ts=2026-09-24T09:27:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542625386worker1 # [ 93.052097] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)5387worker1 # [ 93.150442] nix-daemon[849]: accepted connection from pid 1127, user nix-grpc-daemon (trusted)5388worker1 # [ 93.162451] nix-daemon[849]: reaped child process 1130, status = succeeded5389lb # [ 93.216358] niks3-server[985]: 2026/09/24 09:27:05 INFO Received push request method=POST path=/api/pushes5390worker1 # [ 93.180783] nix-grpc-daemon[883]: time=2026-09-24T09:27:05.318Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5391worker1 # [ 93.182167] nix-grpc-daemon[883]: time=2026-09-24T09:27:05.318Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5392lb # [ 93.244159] niks3-server[985]: 2026/09/24 09:27:05 INFO Received sign narinfos request method=POST path=/api/pushes/32/sign5393lb # [ 93.252763] niks3-server[985]: 2026/09/24 09:27:05 INFO Signed narinfos id=32 count=15394worker1 # [ 93.210894] nix-grpc-daemon[883]: time=2026-09-24T09:27:05.348Z level=INFO msg="Uploading 1 narinfos"5395lb # [ 93.258847] niks3-server[985]: 2026/09/24 09:27:05 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5396lb # [ 93.265074] niks3-server[985]: 2026/09/24 09:27:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5397lb # [ 93.276395] niks3-server[985]: 2026/09/24 09:27:05 INFO Received complete push request method=POST path=/api/pushes/32/complete5398worker1 # [ 93.239044] nix-grpc-daemon[883]: time=2026-09-24T09:27:05.376Z level=INFO msg="Upload complete. (175ms)"5399lb # [ 93.284930] niks3-server[985]: 2026/09/24 09:27:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5400worker1 # [ 93.243580] nix-grpc-daemon[511]: ts=2026-09-24T09:27:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=0 paths=1 nar_bytes_in=5605401worker1 # [ 93.248209] nix-grpc-daemon[511]: ts=2026-09-24T09:27:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542625402worker1 # [ 93.259603] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)5403worker1 # [ 93.263642] nix-daemon[849]: reaped child process 1125, status = succeeded5404worker1 # [ 93.267709] nix-daemon[849]: accepted connection from pid 511, user nix-grpc-daemon (trusted)5405client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5406client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5407client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5408worker1 # [ 94.483360] nix-daemon[849]: reaped child process 1134, status = succeeded5409worker1 # [ 94.560955] nix-daemon[849]: accepted connection from pid 1150, user nix-grpc-daemon (trusted)5410worker1 # [ 94.572305] nix-daemon[849]: reaped child process 1153, status = succeeded5411lb # [ 94.626489] niks3-server[985]: 2026/09/24 09:27:06 INFO Received push request method=POST path=/api/pushes5412worker1 # [ 94.590137] nix-grpc-daemon[883]: time=2026-09-24T09:27:06.727Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5413lb # [ 94.660094] niks3-server[985]: 2026/09/24 09:27:06 INFO Received sign narinfos request method=POST path=/api/pushes/33/sign5414worker1 # [ 94.621224] nix-grpc-daemon[883]: time=2026-09-24T09:27:06.758Z level=INFO msg="Uploading 1 narinfos"5415lb # [ 94.666546] niks3-server[985]: 2026/09/24 09:27:06 INFO Signed narinfos id=33 count=15416lb # [ 94.669268] niks3-server[985]: 2026/09/24 09:27:06 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5417lb # [ 94.684836] niks3-server[985]: 2026/09/24 09:27:06 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5418lb # [ 94.692258] niks3-server[985]: 2026/09/24 09:27:06 INFO Received complete push request method=POST path=/api/pushes/33/complete5419worker1 # [ 94.655866] nix-grpc-daemon[883]: time=2026-09-24T09:27:06.793Z level=INFO msg="Upload complete. (181ms)"5420lb # [ 94.701304] niks3-server[985]: 2026/09/24 09:27:06 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5421client # copying 1 paths...5422worker1 # [ 94.662566] nix-grpc-daemon[511]: ts=2026-09-24T09:27:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54262 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=17 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05423worker2 # [ 94.682904] nix-grpc-daemon[781]: ts=2026-09-24T09:27:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:348365424worker1 # [ 94.678876] nix-daemon[849]: reaped child process 1132, status = succeeded5425worker2 # [ 94.692499] nix-grpc-daemon[781]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5426client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5427worker2 # [ 94.719391] nix-grpc-daemon[781]: ts=2026-09-24T09:27:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:348365428worker2 # [ 94.724763] nix-grpc-daemon[781]: ts=2026-09-24T09:27:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34836 duration_s=0 paths=1 nar_bytes_out=1205429client # [ 94.792192] nix-daemon[1111]: reaped child process 1241, status = succeeded5430client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.02 seconds)5431(finished: subtest: an input only one worker has still reaches the builder, in 7.20 seconds)5432subtest: upload whose reference the worker lacks is completed from the cache5433client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache5434client # this derivation will be built:5435client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5436lb # [ 94.983077] envoy[904]: conn peer=[2001:db8:1::1]:35030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=378 ms=145437lb # [ 94.987203] envoy[904]: conn peer=[2001:db8:1::1]:35028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3876 tx=2160 ms=15255438lb # [ 94.991208] envoy[904]: conn peer=[2001:db8:1::1]:35036 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4324 tx=2372 ms=17675439lb # [ 94.995100] envoy[904]: conn peer=[2001:db8:1::1]:35038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=411 tx=410 ms=135440lb # [ 94.998828] envoy[904]: conn peer=[2001:db8:1::1]:35044 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3865 tx=2041 ms=18125441lb # [ 95.002683] envoy[904]: conn peer=[2001:db8:1::1]:35052 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=175442lb # [ 95.007253] envoy[904]: conn peer=[2001:db8:1::1]:35058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3745 tx=2121 ms=23205443lb # [ 95.011213] envoy[904]: conn peer=[2001:db8:1::1]:35068 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=185444lb # [ 95.014975] envoy[904]: conn peer=[2001:db8:1::1]:55648 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3729 tx=2107 ms=17525445lb # [ 95.019185] envoy[904]: conn peer=[2001:db8:1::1]:55662 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=460 tx=307 ms=165446client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5447client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A input --argstr tag viacache, in 0.24 seconds)5448client: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache5449client # this derivation will be built:5450client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5451client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5452client: (finished: must succeed: nix-build --no-out-link /nix/store/f31x0nfj3flb882ga1as2gddqp8fka8w-dep.nix -A referrer --argstr tag viacache, in 0.23 seconds)5453client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5454client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.09 seconds)5455worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5456worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.13 seconds)5457worker2 # [ 95.533495] systemd[1]: Stopping Nix worker-protocol over gRPC...5458worker2 # [ 96.331657] nix-grpc-daemon[781]: ts=2026-09-24T09:27:08Z level=info event=signal_exit5459lb # [ 96.790335] niks3-server[985]: 2026/09/24 09:27:08 INFO lead: released remote=192.168.1.4:455925460worker2 # [ 97.760236] nix-grpc-daemon[781]: ts=2026-09-24T09:27:09Z level=info event=scheduler_restarting5461lb # [ 97.789833] envoy[904]: [2026-09-24 09:27:09.974][904][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream}5462worker2 # [ 97.765953] nix-grpc-daemon[781]: ts=2026-09-24T09:27:09Z level=info event=scheduler_restarting addr=lb:500515463worker1 # [ 97.753978] nix-grpc-daemon[511]: ts=2026-09-24T09:27:09Z level=info event=scheduler_restarting addr=lb:500515464worker2 # [ 97.773962] nix-grpc-daemon[781]: ts=2026-09-24T09:27:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:596325465worker2 # [ 97.777718] nix-grpc-daemon[781]: ts=2026-09-24T09:27:09Z level=info event=worker_gone addr=192.168.1.4:500515466worker2 # [ 97.781416] nix-grpc-daemon[781]: ts=2026-09-24T09:27:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:596325467worker2 # [ 97.785190] nix-grpc-daemon[781]: ts=2026-09-24T09:27:09Z level=info event=worker_gone addr=192.168.1.3:500515468worker2 # [ 97.808379] nix-daemon[869]: reaped child process 871, status = succeeded5469worker1 # [ 97.953539] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_connected addr=lb:500515470worker1 # [ 97.957656] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5471worker2 # [ 97.981849] nix-grpc-daemon[781]: ts=2026-09-24T09:27:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5472worker1 # [ 98.158584] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_connected addr=lb:500515473worker1 # [ 98.162547] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5474worker1 # [ 98.363417] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_connected addr=lb:500515475worker1 # [ 98.367379] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5476worker2 # [ 98.424492] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5477worker2 # [ 98.428599] systemd[1]: Stopped Nix worker-protocol over gRPC.5478worker2 # [ 98.431832] systemd[1]: nix-grpc-daemon.service: Consumed 2.458s CPU time over 1min 22.261s wall clock time, 70.1M memory peak, 333.2K incoming IP traffic, 372.7K outgoing IP traffic.5479lb: waiting until exactly ['worker1'] are healthy members of x86_64-linux5480lb: must succeed: curl -sf localhost:9901/clusters5481lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5482lb: (finished: waiting until exactly ['worker1'] are healthy members of x86_64-linux, in 0.05 seconds)5483client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25484worker1 # [ 98.568311] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_connected addr=lb:500515485worker1 # [ 98.572196] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5486worker1 # [ 98.615460] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542625487worker1 # [ 98.620207] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:542625488client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5489client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.16 seconds)5490worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5491worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5492worker2 # [ 98.717163] systemd[1]: Starting scheduler-token.service...5493worker2 # [ 98.760802] systemd[1]: scheduler-token.service: Deactivated successfully.5494worker2 # [ 98.762451] systemd[1]: Finished scheduler-token.service.5495worker2 # [ 98.763845] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 44ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5496worker2 # [ 98.768173] systemd[1]: Starting Nix worker-protocol over gRPC...5497worker1 # [ 98.773802] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_connected addr=lb:500515498worker1 # [ 98.777567] nix-grpc-daemon[511]: ts=2026-09-24T09:27:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5499worker2 # [ 98.842348] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5500worker2 # [ 98.844425] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5501worker2 # [ 98.848061] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15502worker2 # [ 98.852055] nix-grpc-daemon[1343]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5503worker2 # [ 98.854166] nix-grpc-daemon[1343]: E0000 00:00:1790242031.058916 1343 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5504worker2 # [ 98.857415] nix-grpc-daemon[1343]: E0000 00:00:1790242031.064453 1343 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5505worker2 # [ 98.861239] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket5506worker2 # [ 98.864504] systemd[1]: Started Nix worker-protocol over gRPC.5507lb # [ 98.901338] niks3-server[985]: 2026/09/24 09:27:11 INFO lead: acquired remote=192.168.1.4:394525508worker2 # [ 98.871084] nix-grpc-daemon[1343]: E0000 00:00:1790242031.076303 1384 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5509worker2 # [ 98.875049] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=scheduler_take_over5510worker2 # [ 98.883746] nix-grpc-daemon[1343]: E0000 00:00:1790242031.090812 1384 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5511worker2 # [ 98.887140] nix-grpc-daemon[1343]: E0000 00:00:1790242031.093061 1384 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5512worker2 # [ 98.897859] nix-grpc-daemon[1343]: E0000 00:00:1790242031.104927 1384 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5513worker2 # [ 98.909257] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=scheduler_connected addr=lb:500515514worker2 # [ 98.912030] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5515worker1 # [ 98.906977] systemd[1]: Stopping Nix worker-protocol over gRPC...5516worker1 # [ 98.962475] nix-grpc-daemon[511]: ts=2026-09-24T09:27:11Z level=info event=signal_exit5517worker1 # [ 98.978360] nix-grpc-daemon[511]: ts=2026-09-24T09:27:11Z level=info event=scheduler_connected addr=lb:500515518worker1 # [ 98.982162] nix-grpc-daemon[511]: ts=2026-09-24T09:27:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5519worker2 # [ 99.113929] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=scheduler_connected addr=lb:500515520worker2 # [ 99.120956] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5521worker1 # [ 99.183062] nix-grpc-daemon[511]: ts=2026-09-24T09:27:11Z level=info event=scheduler_connected addr=lb:500515522worker2 # [ 99.202199] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:540005523worker2 # [ 99.205867] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05524worker2 # [ 99.319599] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=scheduler_connected addr=lb:500515525worker2 # [ 99.329941] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=oidc_jwks provider=mock keys=15526worker2 # [ 99.333305] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:540005527worker2 # [ 99.337337] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05528worker2 # [ 100.772691] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:540005529worker2 # [ 100.776575] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:12Z level=info event=worker_gone addr=192.168.1.3:500515530worker1 # [ 100.761845] nix-grpc-daemon[511]: ts=2026-09-24T09:27:12Z level=info event=scheduler_restarting5531worker1 # [ 100.774910] nix-grpc-daemon[511]: ts=2026-09-24T09:27:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5532worker1 # [ 100.797648] nix-daemon[849]: reaped child process 851, status = succeeded5533worker1 # [ 102.372278] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5534worker1 # [ 102.375326] systemd[1]: Stopped Nix worker-protocol over gRPC.5535worker1 # [ 102.378693] systemd[1]: nix-grpc-daemon.service: Consumed 1.942s CPU time over 1min 34.715s wall clock time, 61.1M memory peak, 157.7K incoming IP traffic, 218.8K outgoing IP traffic.5536lb: waiting until exactly ['worker2'] are healthy members of x86_64-linux5537lb: must succeed: curl -sf localhost:9901/clusters5538lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5539lb: (finished: waiting until exactly ['worker2'] are healthy members of x86_64-linux, in 0.05 seconds)5540client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25541worker2 # [ 102.600469] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540145542worker2 # [ 102.611517] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5543worker2 # [ 102.627417] nix-grpc-daemon[1343]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)5544worker2 # [ 102.634274] nix-grpc-daemon[1343]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 181 ms (attempt 2/5)5545worker2 # [ 102.823107] nix-grpc-daemon[1343]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 263 ms (attempt 3/5)5546worker2 # [ 103.088144] nix-grpc-daemon[1343]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 400 ms (attempt 4/5)5547worker2 # [ 103.490356] nix-grpc-daemon[1343]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5548worker2 # [ 103.493884] nix-grpc-daemon[1343]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5549client # copying 2 paths...5550client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5551worker2 # [ 103.515596] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540145552client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5553worker2 # [ 103.527178] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5554worker2 # [ 103.549541] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:15Z level=info event=niks3_push_started pid=14035555worker2 # [ 103.650680] nix-grpc-daemon[1403]: time=2026-09-24T09:27:15.857Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""5556worker2 # [ 103.735850] nix-daemon[869]: accepted connection from pid 1416, user nix-grpc-daemon (trusted)5557worker2 # [ 103.747623] nix-daemon[869]: reaped child process 1419, status = succeeded5558lb # [ 103.786341] niks3-server[985]: 2026/09/24 09:27:15 INFO Received push request method=POST path=/api/pushes5559worker2 # [ 103.763583] nix-grpc-daemon[1403]: time=2026-09-24T09:27:15.970Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5560worker2 # [ 103.765334] nix-grpc-daemon[1403]: time=2026-09-24T09:27:15.972Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5561worker2 # [ 103.768615] nix-grpc-daemon[1403]: time=2026-09-24T09:27:15.974Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5562lb # [ 103.841259] niks3-server[985]: 2026/09/24 09:27:16 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5563lb # [ 103.852682] niks3-server[985]: 2026/09/24 09:27:16 INFO Received sign narinfos request method=POST path=/api/pushes/34/sign5564worker2 # [ 103.826148] nix-grpc-daemon[1403]: time=2026-09-24T09:27:16.032Z level=INFO msg="Uploading 2 narinfos"5565lb # [ 103.856836] niks3-server[985]: 2026/09/24 09:27:16 INFO Signed narinfos id=34 count=25566lb # [ 103.868381] niks3-server[985]: 2026/09/24 09:27:16 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5567lb # [ 103.872169] niks3-server[985]: 2026/09/24 09:27:16 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5568lb # [ 103.882184] niks3-server[985]: 2026/09/24 09:27:16 INFO Received complete push request method=POST path=/api/pushes/34/complete5569lb # [ 103.886906] niks3-server[985]: 2026/09/24 09:27:16 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5570worker2 # [ 103.860867] nix-grpc-daemon[1403]: time=2026-09-24T09:27:16.067Z level=INFO msg="Upload complete. (206ms)"5571lb # [ 103.894676] niks3-server[985]: 2026/09/24 09:27:16 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5572lb # [ 103.897541] niks3-server[985]: 2026/09/24 09:27:16 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5573worker2 # [ 103.867947] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54014 duration_s=0 paths=2 nar_bytes_in=3125574worker2 # [ 103.880502] nix-daemon[869]: reaped child process 1401, status = succeeded5575client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.44 seconds)5576worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5577worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5578worker1 # [ 103.950619] systemd[1]: Starting Nix worker-protocol over gRPC...5579worker1 # [ 104.040161] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:16Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5580worker1 # [ 104.042203] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5581worker1 # [ 104.045481] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15582worker1 # [ 104.049680] nix-grpc-daemon[1176]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5583worker1 # [ 104.051056] nix-grpc-daemon[1176]: E0000 00:00:1790242036.187360 1176 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5584worker1 # [ 104.055055] nix-grpc-daemon[1176]: E0000 00:00:1790242036.192751 1176 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5585worker1 # [ 104.060053] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:16Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket5586worker1 # [ 104.061720] systemd[1]: Started Nix worker-protocol over gRPC.5587worker1 # [ 104.066683] nix-grpc-daemon[1176]: E0000 00:00:1790242036.204502 1219 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5588lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux5589lb: must succeed: curl -sf localhost:9901/clusters5590worker1 # [ 104.080146] nix-grpc-daemon[1176]: E0000 00:00:1790242036.217956 1219 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5591worker1 # [ 104.083139] nix-grpc-daemon[1176]: E0000 00:00:1790242036.220220 1219 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5592worker1 # [ 104.094289] nix-grpc-daemon[1176]: E0000 00:00:1790242036.232051 1219 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5593worker1 # [ 104.106647] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:16Z level=info event=scheduler_connected addr=lb:500515594worker2 # [ 104.122822] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:16Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:540005595worker2 # [ 104.126816] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05596lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5597lb # [ 104.983164] envoy[904]: conn peer=192.168.1.4:56724 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=3310 tx=1369 ms=670545598lb # [ 104.987458] envoy[904]: conn peer=[2001:db8:1::1]:55668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=195599lb # [ 104.990852] envoy[904]: conn peer=[2001:db8:1::3]:57164 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3430 tx=1137 ms=677685600lb # [ 104.994640] envoy[904]: conn peer=[2001:db8:1::1]:55678 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1009 tx=282 ms=12815601lb: must succeed: curl -sf localhost:9901/clusters5602lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5603lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 1.10 seconds)5604(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.39 seconds)5605subtest: a niks3 restart does not cost the leader its role5606lb: must succeed: curl -sf localhost:9901/clusters5607lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5608lb: must succeed: curl -sf localhost:9901/clusters5609lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5610lb # [ 105.290206] systemd[1]: Stopping niks3 server...5611lb # [ 105.292440] niks3-server[985]: 2026/09/24 09:27:17 INFO Shutdown signal received, draining in-flight requests timeout=10s5612worker1 # [ 105.246103] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:17Z level=info event=scheduler_lock_lost status=2005613worker2 # [ 105.260554] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:17Z level=info event=scheduler_lock_lost status=2005614lb # [ 105.295615] niks3-server[985]: 2026/09/24 09:27:17 INFO lead: released remote=192.168.1.4:394525615lb # [ 105.308251] systemd[1]: niks3.service: Deactivated successfully.5616lb # [ 105.309738] systemd[1]: Stopped niks3 server.5617lb # [ 105.311152] systemd[1]: niks3.service: Consumed 710ms CPU time over 1min 24.752s wall clock time, 28.7M memory peak, 96.5K incoming IP traffic, 138.8K outgoing IP traffic.5618lb # [ 105.317867] systemd[1]: Starting niks3 server...5619lb # [ 105.365645] niks3-server[1162]: 2026/09/24 09:27:17 goose: no migrations to run. current version: 202609231200005620lb # [ 105.371907] niks3-server[1162]: 2026/09/24 09:27:17 OK 1_commit_pending_closure.sql (4.4ms)5621lb # [ 105.375515] niks3-server[1162]: 2026/09/24 09:27:17 OK 2_object_stats_trigger.sql (3.58ms)5622lb # [ 105.379055] niks3-server[1162]: 2026/09/24 09:27:17 OK 3_commit_push.sql (3.19ms)5623lb # [ 105.379977] niks3-server[1162]: 2026/09/24 09:27:17 goose: up to current file version: 35624lb # [ 105.381230] niks3-server[1162]: 2026/09/24 09:27:17 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key5625lb # [ 105.391487] niks3-server[1162]: 2026/09/24 09:27:17 INFO Read proxy enabled — serving cache objects from S35626lb # [ 105.392722] niks3-server[1162]: 2026/09/24 09:27:17 INFO Using socket-activated listener address=0.0.0.0:57515627lb # [ 105.395221] niks3-server[1162]: 2026/09/24 09:27:17 INFO systemd watchdog enabled interval=15s5628lb # [ 105.396367] niks3-server[1162]: 2026/09/24 09:27:17 INFO Starting HTTP server address=0.0.0.0:57515629lb # [ 105.397692] systemd[1]: Started niks3 server.5630lb: waiting for unit niks3.service5631lb: (finished: waiting for unit niks3.service, in 0.02 seconds)5632lb: must succeed: curl -sf localhost:9901/clusters5633lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5634worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5635worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5636lb: must succeed: curl -sf localhost:9901/clusters5637lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5638lb: must succeed: curl -sf localhost:9901/clusters5639lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5640worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5641worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.04 seconds)5642client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&25643worker1 # [ 105.678659] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:398805644worker1 # [ 105.690334] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5645client # don't know how to build these paths:5646client # /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv5647worker2 # [ 105.719611] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540145648worker2 # [ 105.744839] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:17Z level=debug event=want client=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv cached=05649worker2 # [ 105.751698] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:17Z level=debug event=assigned drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv worker=192.168.1.4:50051 clients=15650worker2 # [ 105.756634] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540145651worker2 # [ 105.767499] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540145652client # copying 1 paths to 'lb:50051'...5653client # copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'...5654worker2 # [ 105.780219] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540145655worker2 # [ 105.791263] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5656worker2 # [ 105.887300] nix-daemon[869]: accepted connection from pid 1436, user nix-grpc-daemon (trusted)5657worker2 # [ 105.900162] nix-daemon[869]: reaped child process 1439, status = succeeded5658lb # [ 105.937572] niks3-server[1162]: 2026/09/24 09:27:18 INFO Received push request method=POST path=/api/pushes5659worker2 # [ 105.919663] nix-grpc-daemon[1403]: time=2026-09-24T09:27:18.126Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5660worker2 # [ 105.921922] nix-grpc-daemon[1403]: time=2026-09-24T09:27:18.128Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)"5661lb # [ 105.977154] niks3-server[1162]: 2026/09/24 09:27:18 INFO Received sign narinfos request method=POST path=/api/pushes/35/sign5662lb # [ 105.985308] niks3-server[1162]: 2026/09/24 09:27:18 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls5663lb # [ 106.007583] niks3-server[1162]: 2026/09/24 09:27:18 INFO Signed narinfos id=35 count=15664worker2 # [ 105.978874] nix-grpc-daemon[1403]: time=2026-09-24T09:27:18.185Z level=INFO msg="Uploading 1 narinfos"5665lb # [ 106.015450] niks3-server[1162]: 2026/09/24 09:27:18 INFO Registered completed upload object_key=nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst5666lb # [ 106.018733] niks3-server[1162]: 2026/09/24 09:27:18 INFO Received complete push request method=POST path=/api/pushes/35/complete5667lb # [ 106.026894] niks3-server[1162]: 2026/09/24 09:27:18 INFO Registered completed upload object_key=6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo5668worker2 # [ 106.001570] nix-grpc-daemon[1403]: time=2026-09-24T09:27:18.208Z level=INFO msg="Upload complete. (199ms)"5669worker2 # [ 106.006696] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54014 duration_s=0 paths=1 nar_bytes_in=5365670worker2 # [ 106.012406] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540145671worker2 # [ 106.023474] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5672worker2 # [ 106.034167] nix-daemon[869]: reaped child process 1434, status = succeeded5673client # building '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' on lb:50051...5674worker2 # [ 106.041938] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5675client # farm-a> worker2: building 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv5676lb # [ 106.296928] niks3-server[1162]: 2026/09/24 09:27:18 INFO lead: acquired remote=192.168.1.4:581165677worker2 # [ 106.361626] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:18Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:478825678client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5679client # farm-a> LOG-farm-a-after-niks3-restart5680worker2 # [ 107.480709] nix-daemon[869]: reaped child process 1443, status = succeeded5681worker2 # [ 107.561949] nix-daemon[869]: accepted connection from pid 1461, user nix-grpc-daemon (trusted)5682worker2 # [ 107.574429] nix-daemon[869]: reaped child process 1464, status = succeeded5683lb # [ 107.612926] niks3-server[1162]: 2026/09/24 09:27:19 INFO Received push request method=POST path=/api/pushes5684worker2 # [ 107.593351] nix-grpc-daemon[1403]: time=2026-09-24T09:27:19.800Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5685worker2 # [ 107.594905] nix-grpc-daemon[1403]: time=2026-09-24T09:27:19.802Z level=INFO msg="Uploading vllq1krpcvis69h349hy98vfz55ld1wv-farm-a (144B)"5686lb # [ 107.649224] niks3-server[1162]: 2026/09/24 09:27:19 INFO Received sign narinfos request method=POST path=/api/pushes/36/sign5687lb # [ 107.654821] niks3-server[1162]: 2026/09/24 09:27:19 INFO Signed narinfos id=36 count=15688worker2 # [ 107.628584] nix-grpc-daemon[1403]: time=2026-09-24T09:27:19.835Z level=INFO msg="Uploading 1 narinfos"5689lb # [ 107.666465] niks3-server[1162]: 2026/09/24 09:27:19 INFO Registered completed upload object_key=log/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv5690lb # [ 107.675394] niks3-server[1162]: 2026/09/24 09:27:19 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5691lb # [ 107.678864] niks3-server[1162]: 2026/09/24 09:27:19 INFO Received complete push request method=POST path=/api/pushes/36/complete5692lb # [ 107.683047] niks3-server[1162]: 2026/09/24 09:27:19 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.ls5693worker2 # [ 107.661087] nix-grpc-daemon[1403]: time=2026-09-24T09:27:19.868Z level=INFO msg="Upload complete. (209ms)"5694lb # [ 107.695490] niks3-server[1162]: 2026/09/24 09:27:19 INFO Registered completed upload object_key=vllq1krpcvis69h349hy98vfz55ld1wv.narinfo5695worker2 # [ 107.670660] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54014 duration_s=1 drv=6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05696worker2 # [ 107.681922] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:19Z level=debug event=want client=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv cached=05697worker2 # [ 107.687909] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:19Z level=debug event=assigned drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv worker=192.168.1.4:50051 clients=15698worker2 # [ 107.691344] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540145699worker2 # [ 107.699467] nix-daemon[869]: reaped child process 1441, status = succeeded5700worker2 # [ 107.700902] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540145701worker2 # [ 107.707167] nix-grpc-daemon[1403]: time=2026-09-24T09:27:19.914Z level=INFO msg="All 1 paths already cached"5702client # copying 1 paths to 'lb:50051'...5703worker2 # [ 107.712426] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540145704client # copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'...5705worker2 # [ 107.717637] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5706worker2 # [ 107.800532] nix-daemon[869]: accepted connection from pid 1470, user nix-grpc-daemon (trusted)5707worker2 # [ 107.813232] nix-daemon[869]: reaped child process 1473, status = succeeded5708lb # [ 107.851056] niks3-server[1162]: 2026/09/24 09:27:20 INFO Received push request method=POST path=/api/pushes5709worker2 # [ 107.828707] nix-grpc-daemon[1403]: time=2026-09-24T09:27:20.035Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5710worker2 # [ 107.830779] nix-grpc-daemon[1403]: time=2026-09-24T09:27:20.037Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)"5711lb # [ 107.878738] niks3-server[1162]: 2026/09/24 09:27:20 INFO Registered completed upload object_key=nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst5712lb # [ 107.884482] niks3-server[1162]: 2026/09/24 09:27:20 INFO Received sign narinfos request method=POST path=/api/pushes/37/sign5713worker2 # [ 107.860637] nix-grpc-daemon[1403]: time=2026-09-24T09:27:20.067Z level=INFO msg="Uploading 1 narinfos"5714lb # [ 107.889209] niks3-server[1162]: 2026/09/24 09:27:20 INFO Signed narinfos id=37 count=15715lb # [ 107.900447] niks3-server[1162]: 2026/09/24 09:27:20 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls5716lb # [ 107.904282] niks3-server[1162]: 2026/09/24 09:27:20 INFO Received complete push request method=POST path=/api/pushes/37/complete5717worker2 # [ 107.877940] nix-grpc-daemon[1403]: time=2026-09-24T09:27:20.085Z level=INFO msg="Upload complete. (154ms)"5718lb # [ 107.911735] niks3-server[1162]: 2026/09/24 09:27:20 INFO Registered completed upload object_key=5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo5719worker2 # [ 107.880165] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54014 duration_s=0 paths=1 nar_bytes_in=6565720worker2 # [ 107.882938] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540145721worker2 # [ 107.890145] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5722worker2 # [ 107.892756] nix-daemon[869]: reaped child process 1468, status = succeeded5723worker2 # [ 107.897681] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5724client # building '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' on lb:50051...5725client # farm-b> worker2: building 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv5726client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5727client # farm-b> LOG-farm-b-after-niks3-restart5728worker2 # [ 108.726814] nix-daemon[869]: reaped child process 1477, status = succeeded5729worker2 # [ 108.793226] nix-daemon[869]: accepted connection from pid 1493, user nix-grpc-daemon (trusted)5730worker2 # [ 108.805529] nix-daemon[869]: reaped child process 1496, status = succeeded5731lb # [ 108.844817] niks3-server[1162]: 2026/09/24 09:27:21 INFO Received push request method=POST path=/api/pushes5732worker2 # [ 108.822392] nix-grpc-daemon[1403]: time=2026-09-24T09:27:21.029Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5733worker2 # [ 108.824058] nix-grpc-daemon[1403]: time=2026-09-24T09:27:21.031Z level=INFO msg="Uploading vkqg7lcax8h1mxs0g750ficqiii1falw-farm-b (192B)"5734lb # [ 108.883512] niks3-server[1162]: 2026/09/24 09:27:21 INFO Registered completed upload object_key=log/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv5735lb # [ 108.890865] niks3-server[1162]: 2026/09/24 09:27:21 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.ls5736lb # [ 108.900220] niks3-server[1162]: 2026/09/24 09:27:21 INFO Received sign narinfos request method=POST path=/api/pushes/38/sign5737worker2 # [ 108.876926] nix-grpc-daemon[1403]: time=2026-09-24T09:27:21.083Z level=INFO msg="Uploading 1 narinfos"5738lb # [ 108.907827] niks3-server[1162]: 2026/09/24 09:27:21 INFO Signed narinfos id=38 count=15739lb # [ 108.913942] niks3-server[1162]: 2026/09/24 09:27:21 INFO Registered completed upload object_key=nar/12zl6l8xhwx5hdivnvf1vw18yzvz3764mhdd9n03x81phzqblxj0.nar.zst5740lb # [ 108.925173] niks3-server[1162]: 2026/09/24 09:27:21 INFO Received complete push request method=POST path=/api/pushes/38/complete5741lb # [ 108.932452] niks3-server[1162]: 2026/09/24 09:27:21 INFO Registered completed upload object_key=vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo5742worker2 # [ 108.900351] nix-grpc-daemon[1403]: time=2026-09-24T09:27:21.107Z level=INFO msg="Upload complete. (196ms)"5743worker2 # [ 108.906704] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54014 duration_s=1 drv=5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05744worker2 # [ 108.919497] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:21Z level=debug event=want client=1 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv cached=05745worker2 # [ 108.925189] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:21Z level=debug event=assigned drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv worker=192.168.1.4:50051 clients=15746worker2 # [ 108.929264] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540145747worker2 # [ 108.939674] nix-daemon[869]: reaped child process 1475, status = succeeded5748worker2 # [ 108.940835] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540145749worker2 # [ 108.948107] nix-grpc-daemon[1403]: time=2026-09-24T09:27:21.155Z level=INFO msg="All 2 paths already cached"5750client # copying 1 paths to 'lb:50051'...5751worker2 # [ 108.953702] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540145752client # copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'...5753worker2 # [ 108.958609] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5754worker2 # [ 109.041575] nix-daemon[869]: accepted connection from pid 1502, user nix-grpc-daemon (trusted)5755worker2 # [ 109.054383] nix-daemon[869]: reaped child process 1505, status = succeeded5756lb # [ 109.092392] niks3-server[1162]: 2026/09/24 09:27:21 INFO Received push request method=POST path=/api/pushes5757worker2 # [ 109.069523] nix-grpc-daemon[1403]: time=2026-09-24T09:27:21.276Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5758worker2 # [ 109.071452] nix-grpc-daemon[1403]: time=2026-09-24T09:27:21.278Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)"5759lb # [ 109.122493] niks3-server[1162]: 2026/09/24 09:27:21 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls5760lb # [ 109.129480] niks3-server[1162]: 2026/09/24 09:27:21 INFO Received sign narinfos request method=POST path=/api/pushes/39/sign5761worker2 # [ 109.103908] nix-grpc-daemon[1403]: time=2026-09-24T09:27:21.310Z level=INFO msg="Uploading 1 narinfos"5762lb # [ 109.134361] niks3-server[1162]: 2026/09/24 09:27:21 INFO Signed narinfos id=39 count=15763lb # [ 109.147490] niks3-server[1162]: 2026/09/24 09:27:21 INFO Registered completed upload object_key=nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst5764lb # [ 109.151757] niks3-server[1162]: 2026/09/24 09:27:21 INFO Received complete push request method=POST path=/api/pushes/39/complete5765worker2 # [ 109.130770] nix-grpc-daemon[1403]: time=2026-09-24T09:27:21.337Z level=INFO msg="Upload complete. (166ms)"5766lb # [ 109.163590] niks3-server[1162]: 2026/09/24 09:27:21 INFO Registered completed upload object_key=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo5767worker2 # [ 109.135062] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54014 duration_s=0 paths=1 nar_bytes_in=7845768worker2 # [ 109.139846] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540145769worker2 # [ 109.151122] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5770worker2 # [ 109.157699] nix-daemon[869]: reaped child process 1500, status = succeeded5771worker2 # [ 109.160523] nix-daemon[869]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)5772client # building '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' on lb:50051...5773client # farm-top> worker2: building v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv5774client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5775client # farm-top> LOG-farm-top-after-niks3-restart5776worker2 # [ 109.774225] nix-daemon[869]: reaped child process 1509, status = succeeded5777worker2 # [ 109.849912] nix-daemon[869]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)5778worker2 # [ 109.862933] nix-daemon[869]: reaped child process 1528, status = succeeded5779lb # [ 109.902184] niks3-server[1162]: 2026/09/24 09:27:22 INFO Received push request method=POST path=/api/pushes5780worker2 # [ 109.880151] nix-grpc-daemon[1403]: time=2026-09-24T09:27:22.087Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5781worker2 # [ 109.882070] nix-grpc-daemon[1403]: time=2026-09-24T09:27:22.088Z level=INFO msg="Uploading lyi0sw9pvmhznkzgfl39callq9c0n87r-farm-top (248B)"5782lb # [ 109.942857] niks3-server[1162]: 2026/09/24 09:27:22 INFO Received sign narinfos request method=POST path=/api/pushes/40/sign5783lb # [ 109.951276] niks3-server[1162]: 2026/09/24 09:27:22 INFO Signed narinfos id=40 count=15784worker2 # [ 109.923235] nix-grpc-daemon[1403]: time=2026-09-24T09:27:22.130Z level=INFO msg="Uploading 1 narinfos"5785lb # [ 109.957505] niks3-server[1162]: 2026/09/24 09:27:22 INFO Registered completed upload object_key=log/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv5786lb # [ 109.960645] niks3-server[1162]: 2026/09/24 09:27:22 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.ls5787lb # [ 109.965544] niks3-server[1162]: 2026/09/24 09:27:22 INFO Registered completed upload object_key=nar/141220x0digv3f58fbh9c79avwg0fwgsk5jyac9ymkxmr8zs2prw.nar.zst5788lb # [ 109.973193] niks3-server[1162]: 2026/09/24 09:27:22 INFO Received complete push request method=POST path=/api/pushes/40/complete5789worker2 # [ 109.945908] nix-grpc-daemon[1403]: time=2026-09-24T09:27:22.152Z level=INFO msg="Upload complete. (179ms)"5790lb # [ 109.978644] niks3-server[1162]: 2026/09/24 09:27:22 INFO Registered completed upload object_key=lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo5791worker2 # [ 109.952563] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54014 duration_s=0 drv=v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=05792worker2 # [ 109.965933] nix-daemon[869]: reaped child process 1507, status = succeeded5793client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart >&2, in 4.45 seconds)5794client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath5795client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag after-niks3-restart outPath, in 0.11 seconds)5796(finished: subtest: a niks3 restart does not cost the leader its role, in 4.92 seconds)5797subtest: scheduler down: the other node takes the lock and keeps it5798lb: must succeed: curl -sf localhost:9901/clusters5799lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5800lb: must succeed: curl -sf localhost:9901/clusters5801lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5802lb: must succeed: curl -sf localhost:9901/clusters5803lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5804lb: must succeed: curl -sf localhost:9901/clusters5805lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)5806worker2 # [ 110.264936] systemd[1]: Stopping Nix worker-protocol over gRPC...5807worker2 # [ 110.867961] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:23Z level=info event=signal_exit5808lb # [ 111.300813] niks3-server[1162]: 2026/09/24 09:27:23 INFO lead: released remote=192.168.1.4:581165809worker2 # [ 112.271450] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:24Z level=info event=scheduler_restarting5810worker1 # [ 112.257551] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:24Z level=info event=scheduler_restarting addr=lb:500515811lb # [ 112.300808] envoy[904]: [2026-09-24 09:27:24.484][904][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream}5812worker2 # [ 112.274799] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:24Z level=info event=scheduler_restarting addr=lb:500515813worker2 # [ 112.281632] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:540005814worker2 # [ 112.285717] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:24Z level=info event=worker_gone addr=192.168.1.4:500515815worker2 # [ 112.288800] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:540005816worker2 # [ 112.292383] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:24Z level=info event=worker_gone addr=192.168.1.3:500515817worker2 # [ 112.314987] nix-daemon[869]: reaped child process 1395, status = succeeded5818worker1 # [ 112.457941] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:24Z level=info event=scheduler_connected addr=lb:500515819worker1 # [ 112.462221] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5820worker2 # [ 112.483263] nix-grpc-daemon[1343]: ts=2026-09-24T09:27:24Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5821worker1 # [ 112.663113] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:24Z level=info event=scheduler_connected addr=lb:500515822worker1 # [ 112.667202] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5823worker1 # [ 112.868097] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_connected addr=lb:500515824worker1 # [ 112.872146] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5825worker1 # [ 113.072897] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_connected addr=lb:500515826worker1 # [ 113.076888] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5827worker1 # [ 113.278705] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_connected addr=lb:500515828worker1 # [ 113.282596] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5829worker2 # [ 113.490318] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5830worker2 # [ 113.494243] systemd[1]: Stopped Nix worker-protocol over gRPC.5831worker1 # [ 113.483578] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_connected addr=lb:500515832worker2 # [ 113.498434] systemd[1]: nix-grpc-daemon.service: Consumed 869ms CPU time over 14.725s wall clock time, 38.1M memory peak, 198.2K incoming IP traffic, 112.5K outgoing IP traffic.5833worker1 # [ 113.487509] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5834worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5835worker1 # [ 113.688442] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_connected addr=lb:500515836worker1 # [ 113.692517] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5837worker1 # [ 113.893573] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_connected addr=lb:500515838worker1 # [ 113.897690] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5839worker1 # [ 114.098554] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_connected addr=lb:500515840worker1 # [ 114.102505] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5841worker1 # [ 114.304304] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_connected addr=lb:500515842worker1 # [ 114.308135] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5843worker1 # [ 114.509293] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_connected addr=lb:500515844worker1 # [ 114.513917] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5845worker1 # [ 114.714746] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_connected addr=lb:500515846worker1 # [ 114.718639] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5847worker1 # [ 114.921493] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_connected addr=lb:500515848worker1 # [ 114.924685] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5849lb # [ 114.984187] envoy[904]: conn peer=[2001:db8:1::1]:53898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9662 tx=4391 ms=42845850lb # [ 114.988178] envoy[904]: conn peer=[2001:db8:1::4]:42234 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=3422 tx=581 ms=135715851worker1 # [ 115.122615] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_connected addr=lb:500515852worker1 # [ 115.126631] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5853worker1 # [ 115.328357] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_connected addr=lb:500515854worker1 # [ 115.332156] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5855worker1 # [ 115.533071] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_connected addr=lb:500515856worker1 # [ 115.537203] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5857worker1 # [ 115.738083] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_connected addr=lb:500515858worker1 # [ 115.742269] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5859worker1 # [ 115.942875] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_connected addr=lb:500515860worker1 # [ 115.946949] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5861worker1 # [ 116.147605] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_connected addr=lb:500515862worker1 # [ 116.152124] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5863worker1 # [ 116.253812] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_take_over5864lb # [ 116.298802] niks3-server[1162]: 2026/09/24 09:27:28 INFO lead: acquired remote=192.168.1.3:577365865worker1 # [ 116.353874] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_connected addr=lb:500515866worker1 # [ 116.357660] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5867worker1 # [ 116.558733] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_connected addr=lb:500515868worker1 # [ 116.562786] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5869worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 3.20 seconds)5870worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5871worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.02 seconds)5872worker1 # [ 116.763509] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_connected addr=lb:500515873worker1 # [ 116.766919] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5874worker1 # [ 116.967763] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:29Z level=info event=scheduler_connected addr=lb:500515875worker1 # [ 116.971766] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5876worker1 # [ 117.172326] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:29Z level=info event=scheduler_connected addr=lb:500515877worker1 # [ 117.183119] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:593485878worker1 # [ 117.186767] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05879worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5880worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5881client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&25882worker1 # [ 117.905181] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:398805883client # don't know how to build these paths:5884client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5885worker1 # [ 117.913533] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398805886worker1 # [ 117.925187] nix-grpc-daemon[1176]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5)5887worker1 # [ 118.031909] nix-grpc-daemon[1176]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 116 ms (attempt 2/5)5888worker1 # [ 118.149908] nix-grpc-daemon[1176]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 3/5)5889worker1 # [ 118.169680] nix-grpc-daemon[1176]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 135 ms (attempt 4/5)5890worker1 # [ 118.307126] nix-grpc-daemon[1176]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5891worker1 # [ 118.310933] nix-grpc-daemon[1176]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5892worker1 # [ 118.339066] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05893worker1 # [ 118.344389] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15894worker1 # [ 118.351063] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398805895worker1 # [ 118.362422] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398805896client # copying 1 paths to 'lb:50051'...5897client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5898worker1 # [ 118.375340] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398805899worker1 # [ 118.386846] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5900worker1 # [ 118.403762] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=info event=niks3_push_started pid=12705901worker1 # [ 118.503378] nix-grpc-daemon[1270]: time=2026-09-24T09:27:30.640Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""5902worker1 # [ 118.591679] nix-daemon[849]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5903worker1 # [ 118.602842] nix-daemon[849]: reaped child process 1286, status = succeeded5904lb # [ 118.657767] niks3-server[1162]: 2026/09/24 09:27:30 INFO Received push request method=POST path=/api/pushes5905worker1 # [ 118.621154] nix-grpc-daemon[1270]: time=2026-09-24T09:27:30.758Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5906worker1 # [ 118.622669] nix-grpc-daemon[1270]: time=2026-09-24T09:27:30.760Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5907lb # [ 118.699510] niks3-server[1162]: 2026/09/24 09:27:30 INFO Received sign narinfos request method=POST path=/api/pushes/41/sign5908lb # [ 118.704496] niks3-server[1162]: 2026/09/24 09:27:30 INFO Signed narinfos id=41 count=15909worker1 # [ 118.662819] nix-grpc-daemon[1270]: time=2026-09-24T09:27:30.800Z level=INFO msg="Uploading 1 narinfos"5910lb # [ 118.715816] niks3-server[1162]: 2026/09/24 09:27:30 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5911lb # [ 118.726153] niks3-server[1162]: 2026/09/24 09:27:30 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5912lb # [ 118.733775] niks3-server[1162]: 2026/09/24 09:27:30 INFO Received complete push request method=POST path=/api/pushes/41/complete5913lb # [ 118.740961] niks3-server[1162]: 2026/09/24 09:27:30 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5914worker1 # [ 118.699449] nix-grpc-daemon[1270]: time=2026-09-24T09:27:30.837Z level=INFO msg="Upload complete. (193ms)"5915worker1 # [ 118.704113] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39880 duration_s=0 paths=1 nar_bytes_in=5205916worker1 # [ 118.710334] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398805917worker1 # [ 118.721255] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5918worker1 # [ 118.729494] nix-daemon[849]: reaped child process 1268, status = succeeded5919worker1 # [ 118.733665] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5920client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5921client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5922client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5923client # farm-a> LOG-farm-a-on-standby5924worker1 # [ 119.971334] nix-daemon[849]: reaped child process 1290, status = succeeded5925worker1 # [ 120.048874] nix-daemon[849]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)5926worker1 # [ 120.061712] nix-daemon[849]: reaped child process 1309, status = succeeded5927lb # [ 120.115319] niks3-server[1162]: 2026/09/24 09:27:32 INFO Received push request method=POST path=/api/pushes5928worker1 # [ 120.078589] nix-grpc-daemon[1270]: time=2026-09-24T09:27:32.216Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5929worker1 # [ 120.081050] nix-grpc-daemon[1270]: time=2026-09-24T09:27:32.217Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5930lb # [ 120.150960] niks3-server[1162]: 2026/09/24 09:27:32 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5931lb # [ 120.164859] niks3-server[1162]: 2026/09/24 09:27:32 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5932lb # [ 120.171169] niks3-server[1162]: 2026/09/24 09:27:32 INFO Received sign narinfos request method=POST path=/api/pushes/42/sign5933worker1 # [ 120.131069] nix-grpc-daemon[1270]: time=2026-09-24T09:27:32.268Z level=INFO msg="Uploading 1 narinfos"5934lb # [ 120.176156] niks3-server[1162]: 2026/09/24 09:27:32 INFO Signed narinfos id=42 count=15935lb # [ 120.184759] niks3-server[1162]: 2026/09/24 09:27:32 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5936lb # [ 120.193197] niks3-server[1162]: 2026/09/24 09:27:32 INFO Received complete push request method=POST path=/api/pushes/42/complete5937lb # [ 120.200115] niks3-server[1162]: 2026/09/24 09:27:32 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5938worker1 # [ 120.158867] nix-grpc-daemon[1270]: time=2026-09-24T09:27:32.296Z level=INFO msg="Upload complete. (217ms)"5939worker1 # [ 120.165659] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39880 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=05940worker1 # [ 120.181057] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:32Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05941worker1 # [ 120.185750] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:32Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15942worker1 # [ 120.189421] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398805943worker1 # [ 120.198745] nix-daemon[849]: reaped child process 1288, status = succeeded5944worker1 # [ 120.200322] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398805945worker1 # [ 120.207930] nix-grpc-daemon[1270]: time=2026-09-24T09:27:32.345Z level=INFO msg="All 1 paths already cached"5946client # copying 1 paths to 'lb:50051'...5947worker1 # [ 120.213376] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398805948client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5949worker1 # [ 120.218290] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5950worker1 # [ 120.304945] nix-daemon[849]: accepted connection from pid 1315, user nix-grpc-daemon (trusted)5951worker1 # [ 120.319205] nix-daemon[849]: reaped child process 1318, status = succeeded5952lb # [ 120.369448] niks3-server[1162]: 2026/09/24 09:27:32 INFO Received push request method=POST path=/api/pushes5953worker1 # [ 120.333254] nix-grpc-daemon[1270]: time=2026-09-24T09:27:32.471Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5954worker1 # [ 120.335226] nix-grpc-daemon[1270]: time=2026-09-24T09:27:32.472Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5955lb # [ 120.399831] niks3-server[1162]: 2026/09/24 09:27:32 INFO Received sign narinfos request method=POST path=/api/pushes/43/sign5956worker1 # [ 120.360543] nix-grpc-daemon[1270]: time=2026-09-24T09:27:32.497Z level=INFO msg="Uploading 1 narinfos"5957lb # [ 120.405167] niks3-server[1162]: 2026/09/24 09:27:32 INFO Signed narinfos id=43 count=15958lb # [ 120.414967] niks3-server[1162]: 2026/09/24 09:27:32 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5959lb # [ 120.423429] niks3-server[1162]: 2026/09/24 09:27:32 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5960lb # [ 120.431425] niks3-server[1162]: 2026/09/24 09:27:32 INFO Received complete push request method=POST path=/api/pushes/43/complete5961worker1 # [ 120.395486] nix-grpc-daemon[1270]: time=2026-09-24T09:27:32.533Z level=INFO msg="Upload complete. (171ms)"5962lb # [ 120.442581] niks3-server[1162]: 2026/09/24 09:27:32 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5963worker1 # [ 120.399363] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39880 duration_s=0 paths=1 nar_bytes_in=6405964worker1 # [ 120.404424] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398805965worker1 # [ 120.416069] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5966worker1 # [ 120.419497] nix-daemon[849]: reaped child process 1313, status = succeeded5967worker1 # [ 120.424547] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5968client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5969client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5970client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5971client # farm-b> LOG-farm-b-on-standby5972worker1 # [ 121.439296] nix-daemon[849]: reaped child process 1322, status = succeeded5973worker1 # [ 121.517882] nix-daemon[849]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)5974worker1 # [ 121.531297] nix-daemon[849]: reaped child process 1341, status = succeeded5975lb # [ 121.584444] niks3-server[1162]: 2026/09/24 09:27:33 INFO Received push request method=POST path=/api/pushes5976worker1 # [ 121.548050] nix-grpc-daemon[1270]: time=2026-09-24T09:27:33.685Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5977worker1 # [ 121.549783] nix-grpc-daemon[1270]: time=2026-09-24T09:27:33.687Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5978lb # [ 121.626151] niks3-server[1162]: 2026/09/24 09:27:33 INFO Received sign narinfos request method=POST path=/api/pushes/44/sign5979worker1 # [ 121.586163] nix-grpc-daemon[1270]: time=2026-09-24T09:27:33.723Z level=INFO msg="Uploading 1 narinfos"5980lb # [ 121.630823] niks3-server[1162]: 2026/09/24 09:27:33 INFO Signed narinfos id=44 count=15981lb # [ 121.641112] niks3-server[1162]: 2026/09/24 09:27:33 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5982lb # [ 121.648439] niks3-server[1162]: 2026/09/24 09:27:33 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5983lb # [ 121.650621] niks3-server[1162]: 2026/09/24 09:27:33 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5984lb # [ 121.657358] niks3-server[1162]: 2026/09/24 09:27:33 INFO Received complete push request method=POST path=/api/pushes/44/complete5985worker1 # [ 121.616246] nix-grpc-daemon[1270]: time=2026-09-24T09:27:33.753Z level=INFO msg="Upload complete. (184ms)"5986lb # [ 121.662113] niks3-server[1162]: 2026/09/24 09:27:33 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5987worker1 # [ 121.621698] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39880 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=05988worker1 # [ 121.631589] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:33Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05989worker1 # [ 121.636589] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:33Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15990worker1 # [ 121.639759] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398805991worker1 # [ 121.646308] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398805992worker1 # [ 121.648757] nix-daemon[849]: reaped child process 1320, status = succeeded5993worker1 # [ 121.652920] nix-grpc-daemon[1270]: time=2026-09-24T09:27:33.790Z level=INFO msg="All 2 paths already cached"5994client # copying 1 paths to 'lb:50051'...5995worker1 # [ 121.658059] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398805996client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5997worker1 # [ 121.663123] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5998worker1 # [ 121.750948] nix-daemon[849]: accepted connection from pid 1347, user nix-grpc-daemon (trusted)5999worker1 # [ 121.764205] nix-daemon[849]: reaped child process 1350, status = succeeded6000lb # [ 121.816187] niks3-server[1162]: 2026/09/24 09:27:34 INFO Received push request method=POST path=/api/pushes6001worker1 # [ 121.781592] nix-grpc-daemon[1270]: time=2026-09-24T09:27:33.919Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6002worker1 # [ 121.783627] nix-grpc-daemon[1270]: time=2026-09-24T09:27:33.920Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"6003lb # [ 121.846513] niks3-server[1162]: 2026/09/24 09:27:34 INFO Received sign narinfos request method=POST path=/api/pushes/45/sign6004lb # [ 121.859084] niks3-server[1162]: 2026/09/24 09:27:34 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst6005lb # [ 121.869821] niks3-server[1162]: 2026/09/24 09:27:34 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls6006lb # [ 121.873962] niks3-server[1162]: 2026/09/24 09:27:34 INFO Signed narinfos id=45 count=16007worker1 # [ 121.829417] nix-grpc-daemon[1270]: time=2026-09-24T09:27:33.966Z level=INFO msg="Uploading 1 narinfos"6008lb # [ 121.879216] niks3-server[1162]: 2026/09/24 09:27:34 INFO Received complete push request method=POST path=/api/pushes/45/complete6009lb # [ 121.886565] niks3-server[1162]: 2026/09/24 09:27:34 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo6010worker1 # [ 121.847293] nix-grpc-daemon[1270]: time=2026-09-24T09:27:33.985Z level=INFO msg="Upload complete. (178ms)"6011worker1 # [ 121.852118] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39880 duration_s=0 paths=1 nar_bytes_in=7686012worker1 # [ 121.857674] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398806013worker1 # [ 121.867875] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)6014worker1 # [ 121.877212] nix-daemon[849]: reaped child process 1345, status = succeeded6015worker1 # [ 121.880693] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)6016client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...6017client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6018client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6019client # farm-top> LOG-farm-top-on-standby6020worker1 # [ 122.905659] nix-daemon[849]: reaped child process 1354, status = succeeded6021worker1 # [ 122.985867] nix-daemon[849]: accepted connection from pid 1370, user nix-grpc-daemon (trusted)6022worker1 # [ 122.997888] nix-daemon[849]: reaped child process 1373, status = succeeded6023lb # [ 123.051513] niks3-server[1162]: 2026/09/24 09:27:35 INFO Received push request method=POST path=/api/pushes6024worker1 # [ 123.017204] nix-grpc-daemon[1270]: time=2026-09-24T09:27:35.154Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6025worker1 # [ 123.020190] nix-grpc-daemon[1270]: time=2026-09-24T09:27:35.156Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"6026lb # [ 123.092722] niks3-server[1162]: 2026/09/24 09:27:35 INFO Received sign narinfos request method=POST path=/api/pushes/46/sign6027worker1 # [ 123.060106] nix-grpc-daemon[1270]: time=2026-09-24T09:27:35.197Z level=INFO msg="Uploading 1 narinfos"6028lb # [ 123.106118] niks3-server[1162]: 2026/09/24 09:27:35 INFO Signed narinfos id=46 count=16029lb # [ 123.111360] niks3-server[1162]: 2026/09/24 09:27:35 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls6030lb # [ 123.116504] niks3-server[1162]: 2026/09/24 09:27:35 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv6031lb # [ 123.121818] niks3-server[1162]: 2026/09/24 09:27:35 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst6032lb # [ 123.125819] niks3-server[1162]: 2026/09/24 09:27:35 INFO Received complete push request method=POST path=/api/pushes/46/complete6033lb # [ 123.131772] niks3-server[1162]: 2026/09/24 09:27:35 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo6034worker1 # [ 123.086287] nix-grpc-daemon[1270]: time=2026-09-24T09:27:35.224Z level=INFO msg="Upload complete. (198ms)"6035worker1 # [ 123.093816] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39880 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=06036worker1 # [ 123.108553] nix-daemon[849]: reaped child process 1352, status = succeeded6037client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby >&2, in 5.36 seconds)6038client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath6039client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag on-standby outPath, in 0.11 seconds)6040worker2 # [ 123.302557] systemd[1]: Starting scheduler-token.service...6041worker2 # [ 123.346750] systemd[1]: scheduler-token.service: Deactivated successfully.6042worker2 # [ 123.348384] systemd[1]: Finished scheduler-token.service.6043worker2 # [ 123.349789] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 46ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6044worker2 # [ 123.353874] systemd[1]: Starting Nix worker-protocol over gRPC...6045worker2 # [ 123.431366] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6046worker2 # [ 123.434902] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6047worker2 # [ 123.437167] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16048worker2 # [ 123.441082] nix-grpc-daemon[1549]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6049worker2 # [ 123.442454] nix-grpc-daemon[1549]: E0000 00:00:1790242055.647454 1549 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6050worker2 # [ 123.445579] nix-grpc-daemon[1549]: E0000 00:00:1790242055.652626 1549 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6051worker2 # [ 123.450108] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:35Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket6052worker2 # [ 123.453519] systemd[1]: Started Nix worker-protocol over gRPC.6053worker2 # [ 123.457456] nix-grpc-daemon[1549]: E0000 00:00:1790242055.664583 1591 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6054lb: must succeed: curl -sf localhost:9901/clusters6055worker2 # [ 123.470706] nix-grpc-daemon[1549]: E0000 00:00:1790242055.677767 1591 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6056worker2 # [ 123.474141] nix-grpc-daemon[1549]: E0000 00:00:1790242055.680049 1591 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6057worker2 # [ 123.484806] nix-grpc-daemon[1549]: E0000 00:00:1790242055.691885 1591 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6058worker2 # [ 123.494409] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:35Z level=info event=scheduler_connected addr=lb:500516059worker1 # [ 123.488170] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:35Z level=info event=oidc_jwks provider=mock keys=16060worker1 # [ 123.491925] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:35Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:593486061worker1 # [ 123.495890] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06062lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6063worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6064worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6065lb: must succeed: curl -sf localhost:9901/clusters6066lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6067lb: must succeed: curl -sf localhost:9901/clusters6068lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6069worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6070worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6071(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.56 seconds)6072subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise6073client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs6074client # [ 123.705112] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs.6075client # Running as unit: rs.service; invocation ID: dd0887b54656423da33b35e30cea5ba16076client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag rs, in 0.06 seconds)6077worker1 # [ 123.830300] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:398806078client # [ 123.850245] nix[1365]: don't know how to build these paths:6079client # [ 123.851182] nix[1365]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv6080worker1 # [ 123.843693] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:35Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=06081worker1 # [ 123.849838] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:35Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=16082worker1 # [ 123.854620] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398806083worker1 # [ 123.865476] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398806084client # [ 123.888855] nix[1365]: copying 1 paths to 'lb:50051'...6085client # [ 123.889741] nix[1365]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...6086worker1 # [ 123.876558] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398806087worker1 # [ 123.886172] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)6088worker1 # [ 123.984331] nix-daemon[849]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)6089worker1 # [ 123.997677] nix-daemon[849]: reaped child process 1389, status = succeeded6090lb # [ 124.049482] niks3-server[1162]: 2026/09/24 09:27:36 INFO Received push request method=POST path=/api/pushes6091worker1 # [ 124.012719] nix-grpc-daemon[1270]: time=2026-09-24T09:27:36.150Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6092worker1 # [ 124.014172] nix-grpc-daemon[1270]: time=2026-09-24T09:27:36.152Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"6093lb # [ 124.083667] niks3-server[1162]: 2026/09/24 09:27:36 INFO Received sign narinfos request method=POST path=/api/pushes/47/sign6094worker1 # [ 124.043840] nix-grpc-daemon[1270]: time=2026-09-24T09:27:36.181Z level=INFO msg="Uploading 1 narinfos"6095lb # [ 124.089840] niks3-server[1162]: 2026/09/24 09:27:36 INFO Signed narinfos id=47 count=16096lb # [ 124.095807] niks3-server[1162]: 2026/09/24 09:27:36 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst6097lb # [ 124.102256] niks3-server[1162]: 2026/09/24 09:27:36 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls6098lb # [ 124.115922] niks3-server[1162]: 2026/09/24 09:27:36 INFO Received complete push request method=POST path=/api/pushes/47/complete6099worker1 # [ 124.078484] nix-grpc-daemon[1270]: time=2026-09-24T09:27:36.216Z level=INFO msg="Upload complete. (181ms)"6100lb # [ 124.124370] niks3-server[1162]: 2026/09/24 09:27:36 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo6101worker1 # [ 124.083123] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39880 duration_s=0 paths=1 nar_bytes_in=4166102worker1 # [ 124.087617] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398806103worker1 # [ 124.097032] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)6104worker1 # [ 124.102171] nix-daemon[849]: reaped child process 1384, status = succeeded6105worker1 # [ 124.106726] nix-daemon[849]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)6106client # [ 124.119823] nix[1365]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...6107lb # [ 124.985896] envoy[904]: conn peer=[2001:db8:1::1]:54112 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9586 tx=4372 ms=52076108lb: must succeed: curl -sf localhost:9901/clusters6109lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6110lb: must succeed: curl -sf localhost:9901/clusters6111lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6112lb: must succeed: curl -sf localhost:9901/clusters6113lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6114lb: must succeed: curl -sf localhost:9901/clusters6115lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6116worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true6117worker2 # [ 126.366057] systemd-journald[283]: Received client request to rotate journal, rotating.6118worker2 # [ 126.385028] systemd-journald[283]: Vacuuming done, freed 0B of archived journals from /var/log/journal/0fbd9217ffce423db8664ed08d6a2f06.6119worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds)6120worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service6121worker1 # [ 126.281520] systemd[1]: Stopping Nix worker-protocol over gRPC...6122worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.03 seconds)6123client: must succeed: sleep 5.06124worker1 # [ 127.024327] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:39Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:556066125worker1 # [ 127.066945] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:39Z level=info event=draining6126client: (finished: must succeed: sleep 5.0, in 5.03 seconds)6127worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='6128worker1 # [ 131.528346] nix-daemon[849]: reaped child process 1393, status = succeeded6129worker1 # [ 131.605253] nix-daemon[849]: accepted connection from pid 1434, user nix-grpc-daemon (trusted)6130worker1 # [ 131.617794] nix-daemon[849]: reaped child process 1437, status = succeeded6131lb # [ 131.672160] niks3-server[1162]: 2026/09/24 09:27:43 INFO Received push request method=POST path=/api/pushes6132worker1 # [ 131.635613] nix-grpc-daemon[1270]: time=2026-09-24T09:27:43.773Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6133worker1 # [ 131.637272] nix-grpc-daemon[1270]: time=2026-09-24T09:27:43.774Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"6134lb # [ 131.717784] niks3-server[1162]: 2026/09/24 09:27:43 INFO Received sign narinfos request method=POST path=/api/pushes/48/sign6135lb # [ 131.723096] niks3-server[1162]: 2026/09/24 09:27:43 INFO Signed narinfos id=48 count=16136worker1 # [ 131.681701] nix-grpc-daemon[1270]: time=2026-09-24T09:27:43.819Z level=INFO msg="Uploading 1 narinfos"6137lb # [ 131.735234] niks3-server[1162]: 2026/09/24 09:27:43 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst6138lb # [ 131.741910] niks3-server[1162]: 2026/09/24 09:27:43 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv6139lb # [ 131.745897] niks3-server[1162]: 2026/09/24 09:27:43 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls6140lb # [ 131.755800] niks3-server[1162]: 2026/09/24 09:27:43 INFO Received complete push request method=POST path=/api/pushes/48/complete6141worker1 # [ 131.713814] nix-grpc-daemon[1270]: time=2026-09-24T09:27:43.851Z level=INFO msg="Upload complete. (194ms)"6142lb # [ 131.761976] niks3-server[1162]: 2026/09/24 09:27:43 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo6143worker1 # [ 131.722804] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39880 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06144worker1 # [ 131.737553] nix-daemon[849]: reaped child process 1391, status = succeeded6145client # [ 131.763812] systemd[1]: rs.service: Deactivated successfully.6146client # [ 131.768127] systemd[1]: rs.service: Consumed 128ms CPU time over 8.061s wall clock time, 41.4M memory peak, 7.1K incoming IP traffic, 8.2K outgoing IP traffic.6147worker1 # [ 132.069204] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:44Z level=info event=signal_exit6148lb # [ 132.300780] niks3-server[1162]: 2026/09/24 09:27:44 INFO lead: released remote=192.168.1.3:577366149worker2 # [ 133.272078] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:45Z level=info event=scheduler_restarting addr=lb:500516150worker1 # [ 133.259997] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:45Z level=info event=scheduler_restarting6151lb # [ 133.302914] envoy[904]: [2026-09-24 09:27:45.486][904][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream}6152worker1 # [ 133.263194] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:45Z level=info event=scheduler_restarting addr=lb:500516153worker1 # [ 133.268860] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:593486154worker1 # [ 133.272867] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:45Z level=info event=worker_gone addr=192.168.1.4:500516155worker1 # [ 133.276242] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:593486156worker1 # [ 133.279972] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:45Z level=info event=worker_gone addr=192.168.1.3:500516157worker1 # [ 133.302327] nix-daemon[849]: reaped child process 1228, status = succeeded6158worker2 # [ 133.458801] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:45Z level=info event=scheduler_take_over6159lb # [ 133.490256] niks3-server[1162]: 2026/09/24 09:27:45 INFO lead: acquired remote=192.168.1.4:537006160worker2 # [ 133.472474] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:45Z level=info event=scheduler_connected addr=lb:500516161worker2 # [ 133.476823] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6162worker1 # [ 133.471107] nix-grpc-daemon[1176]: ts=2026-09-24T09:27:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6163worker1 # [ 133.575563] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6164worker1 # [ 133.580201] systemd[1]: Stopped Nix worker-protocol over gRPC.6165worker1 # [ 133.582488] systemd[1]: nix-grpc-daemon.service: Consumed 1.057s CPU time over 29.631s wall clock time, 37.9M memory peak, 274.9K incoming IP traffic, 151.3K outgoing IP traffic.6166worker1 # [ 133.598155] systemd[1]: Starting Nix worker-protocol over gRPC...6167worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.12 seconds)6168client: waiting for success: ! systemctl is-active rs6169client: (finished: waiting for success: ! systemctl is-active rs, in 0.04 seconds)6170client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }6171worker2 # [ 133.678272] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:45Z level=info event=scheduler_connected addr=lb:500516172worker2 # [ 133.682719] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6173worker1 # [ 133.689705] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:45Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6174client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)6175client: must fail: journalctl -u rs | grep -q 'reconnecting'6176worker1 # [ 133.694219] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6177worker1 # [ 133.697511] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16178worker1 # [ 133.702283] nix-grpc-daemon[1445]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6179client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.01 seconds)6180lb: must succeed: curl -sf localhost:9901/clusters6181worker1 # [ 133.705760] nix-grpc-daemon[1445]: E0000 00:00:1790242065.834527 1445 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6182worker1 # [ 133.708503] nix-grpc-daemon[1445]: E0000 00:00:1790242065.838520 1445 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6183worker1 # [ 133.711736] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:45Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket6184worker1 # [ 133.714139] systemd[1]: Started Nix worker-protocol over gRPC.6185worker1 # [ 133.715091] nix-grpc-daemon[1445]: E0000 00:00:1790242065.851388 1488 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6186worker1 # [ 133.726811] nix-grpc-daemon[1445]: E0000 00:00:1790242065.864570 1488 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6187worker1 # [ 133.731053] nix-grpc-daemon[1445]: E0000 00:00:1790242065.866827 1488 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6188worker1 # [ 133.740822] nix-grpc-daemon[1445]: E0000 00:00:1790242065.878590 1488 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6189worker1 # [ 133.750983] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:45Z level=info event=scheduler_connected addr=lb:500516190worker1 # [ 133.752879] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6191lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6192worker2 # [ 133.884465] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=scheduler_connected addr=lb:500516193worker2 # [ 133.889678] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6194worker1 # [ 133.953899] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:46Z level=info event=scheduler_connected addr=lb:500516195worker1 # [ 133.961314] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6196worker2 # [ 134.090963] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=scheduler_connected addr=lb:500516197worker2 # [ 134.095376] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6198worker1 # [ 134.159456] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:46Z level=info event=scheduler_connected addr=lb:500516199worker1 # [ 134.165382] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6200worker2 # [ 134.297653] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=scheduler_connected addr=lb:500516201worker2 # [ 134.315991] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=oidc_jwks provider=mock keys=16202worker2 # [ 134.319558] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:408146203worker2 # [ 134.324063] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06204worker1 # [ 134.365241] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:46Z level=info event=scheduler_connected addr=lb:500516205worker2 # [ 134.381288] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:408146206worker2 # [ 134.385062] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:46Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06207lb: must succeed: curl -sf localhost:9901/clusters6208lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6209worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6210worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6211(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 11.21 seconds)6212subtest: scheduler restart mid-build: build finishes, no double build6213client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid6214client # [ 134.911881] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid.6215client # Running as unit: mid.service; invocation ID: c445f8416b7a476b829b1b6e7ec87d1d6216client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag mid, in 0.06 seconds)6217lb # [ 134.986271] envoy[904]: conn peer=[2001:db8:1::1]:48424 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2943 tx=1521 ms=79056218lb # [ 134.989934] envoy[904]: conn peer=[2001:db8:1::3]:40250 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6207 tx=1387 ms=293626219worker2 # [ 135.054556] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:408186220worker2 # [ 135.065511] nix-daemon[869]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6221client # [ 135.076589] nix[1401]: don't know how to build these paths:6222client # [ 135.077566] nix[1401]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6223worker2 # [ 135.083279] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:47Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=06224worker2 # [ 135.086980] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:47Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=16225worker2 # [ 135.092435] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:408186226worker2 # [ 135.100185] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)6227worker2 # [ 135.165397] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 2/5)6228worker2 # [ 135.217059] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:47Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:408346229worker2 # [ 135.344386] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 3/5)6230worker2 # [ 135.486434] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 783 ms (attempt 4/5)6231worker2 # [ 136.272277] nix-grpc-daemon[1549]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6232worker2 # [ 136.275203] nix-grpc-daemon[1549]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6233worker2 # [ 136.292478] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:408186234client # [ 136.302858] nix[1401]: copying 1 paths to 'lb:50051'...6235client # [ 136.306542] nix[1401]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...6236worker2 # [ 136.307303] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:408186237worker2 # [ 136.318175] nix-daemon[869]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6238worker2 # [ 136.340180] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:48Z level=info event=niks3_push_started pid=16726239worker2 # [ 136.440239] nix-grpc-daemon[1672]: time=2026-09-24T09:27:48.646Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""6240worker2 # [ 136.524712] nix-daemon[869]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6241worker2 # [ 136.535552] nix-daemon[869]: reaped child process 1688, status = succeeded6242lb # [ 136.575992] niks3-server[1162]: 2026/09/24 09:27:48 INFO Received push request method=POST path=/api/pushes6243worker2 # [ 136.555290] nix-grpc-daemon[1672]: time=2026-09-24T09:27:48.762Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6244worker2 # [ 136.556828] nix-grpc-daemon[1672]: time=2026-09-24T09:27:48.763Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"6245lb # [ 136.614263] niks3-server[1162]: 2026/09/24 09:27:48 INFO Received sign narinfos request method=POST path=/api/pushes/49/sign6246worker2 # [ 136.595261] nix-grpc-daemon[1672]: time=2026-09-24T09:27:48.801Z level=INFO msg="Uploading 1 narinfos"6247lb # [ 136.625519] niks3-server[1162]: 2026/09/24 09:27:48 INFO Signed narinfos id=49 count=16248lb # [ 136.631759] niks3-server[1162]: 2026/09/24 09:27:48 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst6249lb # [ 136.636741] niks3-server[1162]: 2026/09/24 09:27:48 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls6250lb # [ 136.648922] niks3-server[1162]: 2026/09/24 09:27:48 INFO Received complete push request method=POST path=/api/pushes/49/complete6251lb # [ 136.656798] niks3-server[1162]: 2026/09/24 09:27:48 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo6252worker2 # [ 136.631833] nix-grpc-daemon[1672]: time=2026-09-24T09:27:48.838Z level=INFO msg="Upload complete. (188ms)"6253worker2 # [ 136.636959] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40818 duration_s=0 paths=1 nar_bytes_in=4246254worker2 # [ 136.643516] nix-grpc-daemon[1549]: ts=2026-09-24T09:27:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:408186255worker2 # [ 136.652148] nix-daemon[869]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6256worker2 # [ 136.664245] nix-daemon[869]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)6257client # [ 136.663812] nix[1401]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...6258worker2 # [ 136.666434] nix-daemon[869]: reaped child process 1670, status = succeeded6259lb: must succeed: curl -sf localhost:9901/clusters6260lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6261lb: must succeed: curl -sf localhost:9901/clusters6262lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6263worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6264worker2 # [ 138.502371] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1549 (nix-grpc-daemon) on client request.6265worker2 # [ 138.506342] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6266lb # [ 138.546269] niks3-server[1162]: 2026/09/24 09:27:50 INFO lead: released remote=192.168.1.4:537006267worker2 # [ 138.517817] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6268client # [ 138.515469] nix[1401]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again6269worker1 # [ 138.501736] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"6270lb # [ 138.549755] envoy[904]: [2026-09-24 09:27:50.734][904][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 13, upstream_reset_after_response_started{connection_termination}6271worker2 # [ 138.521178] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6272client # [ 138.520398] nix[1401]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6273worker2 # [ 138.522634] systemd[1]: nix-grpc-daemon.service: Consumed 396ms CPU time over 15.164s wall clock time, 35.7M memory peak, 160.2K incoming IP traffic, 56.2K outgoing IP traffic.6274worker2 # [ 138.532793] systemd[1]: Starting scheduler-token.service...6275worker2 # [ 138.550721] nix-daemon[869]: reaped child process 1690, status = succeeded6276worker2 # [ 138.552203] nix-daemon[869]: reaped child process 1658, status = succeeded6277worker2 # [ 138.560760] nix-daemon[1692]: unexpected Nix daemon error: error: interrupted by the user6278worker2 # [ 138.567230] nix-daemon[869]: reaped child process 1692, status = failed with exit code 16279worker2 # [ 138.586594] systemd[1]: scheduler-token.service: Deactivated successfully.6280worker2 # [ 138.587700] systemd[1]: Finished scheduler-token.service.6281worker2 # [ 138.589530] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 54ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6282worker2 # [ 138.591796] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6283worker2 # [ 138.595233] systemd[1]: Starting scheduler-token.service...6284worker2 # [ 138.629279] systemd[1]: scheduler-token.service: Deactivated successfully.6285worker2 # [ 138.630425] systemd[1]: Finished scheduler-token.service.6286worker2 # [ 138.633163] systemd[1]: scheduler-token.service: Consumed 15ms CPU time over 33ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6287worker2 # [ 138.635854] systemd[1]: Starting Nix worker-protocol over gRPC...6288worker2 # [ 138.710332] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6289worker2 # [ 138.712361] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6290worker2 # [ 138.715474] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16291worker1 # [ 138.701978] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:50Z level=info event=scheduler_connected addr=lb:500516292worker2 # [ 138.720020] nix-grpc-daemon[1735]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6293worker2 # [ 138.721361] nix-grpc-daemon[1735]: E0000 00:00:1790242070.926931 1735 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6294worker2 # [ 138.725401] nix-grpc-daemon[1735]: E0000 00:00:1790242070.932320 1735 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6295worker2 # [ 138.729864] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:50Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket6296lb # [ 138.760497] niks3-server[1162]: 2026/09/24 09:27:50 INFO lead: acquired remote=192.168.1.3:357406297worker2 # [ 138.734136] systemd[1]: Started Nix worker-protocol over gRPC.6298worker1 # [ 138.719096] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:50Z level=info event=scheduler_take_over6299worker2 # [ 138.738084] nix-grpc-daemon[1735]: E0000 00:00:1790242070.943641 1777 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6300worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.28 seconds)6301client: must succeed: sleep 5.06302worker1 # [ 138.736773] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6303worker2 # [ 138.753076] nix-grpc-daemon[1735]: E0000 00:00:1790242070.960117 1777 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6304worker2 # [ 138.756157] nix-grpc-daemon[1735]: E0000 00:00:1790242070.962422 1777 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6305worker2 # [ 138.767311] nix-grpc-daemon[1735]: E0000 00:00:1790242070.974392 1777 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6306worker2 # [ 138.777319] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:50Z level=info event=scheduler_connected addr=lb:500516307worker2 # [ 138.779789] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6308worker1 # [ 138.938115] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=scheduler_connected addr=lb:500516309worker1 # [ 138.942219] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6310worker2 # [ 138.981175] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:51Z level=info event=scheduler_connected addr=lb:500516311worker2 # [ 138.986848] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6312client # [ 139.023595] nix[1401]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting6313worker1 # [ 139.143086] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=scheduler_connected addr=lb:500516314worker1 # [ 139.147192] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6315worker2 # [ 139.188264] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:51Z level=info event=scheduler_connected addr=lb:500516316worker2 # [ 139.193396] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6317worker1 # [ 139.348161] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=scheduler_connected addr=lb:500516318worker1 # [ 139.355148] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6319worker2 # [ 139.394292] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:51Z level=info event=scheduler_connected addr=lb:500516320worker1 # [ 139.395130] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=oidc_jwks provider=mock keys=16321worker1 # [ 139.398220] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:600206322worker1 # [ 139.402531] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06323worker1 # [ 139.557149] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=scheduler_connected addr=lb:500516324worker1 # [ 139.561181] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6325worker1 # [ 139.761961] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=scheduler_connected addr=lb:500516326worker1 # [ 139.766979] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:600206327worker1 # [ 139.770614] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06328client # [ 140.028274] nix[1401]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting6329worker1 # [ 140.089260] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:52Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:600306330worker1 # [ 142.024677] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:54Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=06331worker1 # [ 142.029349] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:54Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=16332worker2 # [ 142.045805] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409066333worker2 # [ 142.056765] nix-daemon[869]: accepted connection from pid 1735, user nix-grpc-daemon (trusted)6334worker2 # [ 142.069849] nix-daemon[869]: accepted connection from pid 1735, user nix-grpc-daemon (trusted)6335client # [ 142.082984] nix[1401]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...6336worker2 # [ 142.084917] nix-daemon[869]: accepted connection from pid 1735, user nix-grpc-daemon (trusted)6337client: (finished: must succeed: sleep 5.0, in 5.03 seconds)6338client: waiting for success: ! systemctl is-active mid6339worker2 # [ 144.106729] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:56Z level=info event=niks3_push_started pid=18166340worker2 # [ 144.145445] nix-daemon[869]: reaped child process 1791, status = succeeded6341worker2 # [ 144.216526] nix-grpc-daemon[1816]: time=2026-09-24T09:27:56.423Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""6342worker2 # [ 144.300650] nix-daemon[869]: accepted connection from pid 1829, user nix-grpc-daemon (trusted)6343worker2 # [ 144.312594] nix-daemon[869]: reaped child process 1832, status = succeeded6344lb # [ 144.352861] niks3-server[1162]: 2026/09/24 09:27:56 INFO Received push request method=POST path=/api/pushes6345worker2 # [ 144.333450] nix-grpc-daemon[1816]: time=2026-09-24T09:27:56.540Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6346worker2 # [ 144.334957] nix-grpc-daemon[1816]: time=2026-09-24T09:27:56.542Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"6347lb # [ 144.404489] niks3-server[1162]: 2026/09/24 09:27:56 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls6348lb # [ 144.413806] niks3-server[1162]: 2026/09/24 09:27:56 INFO Received sign narinfos request method=POST path=/api/pushes/50/sign6349worker2 # [ 144.388352] nix-grpc-daemon[1816]: time=2026-09-24T09:27:56.595Z level=INFO msg="Uploading 1 narinfos"6350lb # [ 144.418941] niks3-server[1162]: 2026/09/24 09:27:56 INFO Signed narinfos id=50 count=16351lb # [ 144.428787] niks3-server[1162]: 2026/09/24 09:27:56 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6352lb # [ 144.443283] niks3-server[1162]: 2026/09/24 09:27:56 INFO Received complete push request method=POST path=/api/pushes/50/complete6353lb # [ 144.448097] niks3-server[1162]: 2026/09/24 09:27:56 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6354worker2 # [ 144.431087] nix-grpc-daemon[1816]: time=2026-09-24T09:27:56.637Z level=INFO msg="Upload complete. (211ms)"6355lb # [ 144.464320] niks3-server[1162]: 2026/09/24 09:27:56 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo6356worker2 # [ 144.437247] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40906 duration_s=2 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06357worker2 # [ 144.453788] nix-daemon[869]: reaped child process 1789, status = succeeded6358client # [ 144.472163] systemd[1]: mid.service: Deactivated successfully.6359client # [ 144.474747] systemd[1]: mid.service: Consumed 148ms CPU time over 9.560s wall clock time, 43.4M memory peak, 9.2K incoming IP traffic, 11.2K outgoing IP traffic.6360lb # [ 144.986285] envoy[904]: conn peer=[2001:db8:1::4]:48146 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5363 tx=500 ms=150256361lb # [ 144.990506] envoy[904]: conn peer=[2001:db8:1::1]:53044 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4291 tx=2100 ms=94036362client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds)6363client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6364client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)6365(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.21 seconds)6366subtest: interrupting the client stops the build on the worker6367client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr6368client # [ 145.092189] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr.6369client # Running as unit: intr.service; invocation ID: 669d5ad0a42c4239869ea30ecc5b5d766370client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag intr, in 0.03 seconds)6371client # [ 145.211680] nix[1436]: don't know how to build these paths:6372client # [ 145.212574] nix[1436]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6373worker2 # [ 145.210860] nix-grpc-daemon[1735]: ts=2026-09-24T09:27:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:409066374worker1 # [ 145.208545] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:57Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=06375worker1 # [ 145.215671] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:57Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=16376worker1 # [ 145.222834] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386377worker1 # [ 145.234583] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6378worker1 # [ 145.249647] nix-grpc-daemon[1445]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 1/5)6379worker1 # [ 145.322228] nix-grpc-daemon[1445]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 178 ms (attempt 2/5)6380worker1 # [ 145.502226] nix-grpc-daemon[1445]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 384 ms (attempt 3/5)6381worker1 # [ 145.888688] nix-grpc-daemon[1445]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 319 ms (attempt 4/5)6382worker1 # [ 146.213731] nix-grpc-daemon[1445]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6383worker1 # [ 146.218509] nix-grpc-daemon[1445]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6384worker1 # [ 146.238870] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508386385client # [ 146.259641] nix[1436]: copying 1 paths to 'lb:50051'...6386client # [ 146.263149] nix[1436]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...6387worker1 # [ 146.249762] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508386388worker1 # [ 146.258748] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6389worker1 # [ 146.272111] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:58Z level=info event=niks3_push_started pid=15456390worker1 # [ 146.364900] nix-grpc-daemon[1545]: time=2026-09-24T09:27:58.502Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker1.key ca=""6391worker1 # [ 146.452171] nix-daemon[849]: accepted connection from pid 1558, user nix-grpc-daemon (trusted)6392worker1 # [ 146.465047] nix-daemon[849]: reaped child process 1561, status = succeeded6393lb # [ 146.519125] niks3-server[1162]: 2026/09/24 09:27:58 INFO Received push request method=POST path=/api/pushes6394worker1 # [ 146.486355] nix-grpc-daemon[1545]: time=2026-09-24T09:27:58.624Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6395worker1 # [ 146.487893] nix-grpc-daemon[1545]: time=2026-09-24T09:27:58.625Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6396lb # [ 146.558583] niks3-server[1162]: 2026/09/24 09:27:58 INFO Received sign narinfos request method=POST path=/api/pushes/51/sign6397lb # [ 146.569393] niks3-server[1162]: 2026/09/24 09:27:58 INFO Signed narinfos id=51 count=16398worker1 # [ 146.527522] nix-grpc-daemon[1545]: time=2026-09-24T09:27:58.665Z level=INFO msg="Uploading 1 narinfos"6399lb # [ 146.578166] niks3-server[1162]: 2026/09/24 09:27:58 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6400lb # [ 146.584118] niks3-server[1162]: 2026/09/24 09:27:58 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6401lb # [ 146.595382] niks3-server[1162]: 2026/09/24 09:27:58 INFO Received complete push request method=POST path=/api/pushes/51/complete6402lb # [ 146.603921] niks3-server[1162]: 2026/09/24 09:27:58 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6403worker1 # [ 146.562810] nix-grpc-daemon[1545]: time=2026-09-24T09:27:58.700Z level=INFO msg="Upload complete. (194ms)"6404worker1 # [ 146.567064] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=4246405worker1 # [ 146.571953] nix-grpc-daemon[1445]: ts=2026-09-24T09:27:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386406worker1 # [ 146.583115] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6407worker1 # [ 146.587443] nix-daemon[849]: reaped child process 1543, status = succeeded6408worker1 # [ 146.592407] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6409client # [ 146.605679] nix[1436]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6410client: must succeed: systemctl kill -s INT intr6411client # [ 148.540160] systemd[1]: intr.service: Sent signal SIGINT to main process 1436 (nix) on client request.6412worker1 # [ 148.533210] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:00Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6413client # [ 148.546348] nix[1436]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6414client # [ 148.552841] nix[1436]: error: interrupted by the user6415client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)6416client # [ 148.580602] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6417client # [ 148.583374] systemd[1]: intr.service: Failed with result 'exit-code'.6418client # [ 148.586953] systemd[1]: intr.service: Consumed 117ms CPU time over 3.493s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic.6419worker1 # [ 148.610581] nix-daemon[849]: reaped child process 1563, status = succeeded6420worker1 # [ 148.613282] nix-daemon[1565]: unexpected Nix daemon error: error: interrupted by the user6421worker1 # [ 148.617535] nix-daemon[849]: reaped child process 1565, status = failed with exit code 16422(finished: subtest: interrupting the client stops the build on the worker, in 4.67 seconds)6423subtest: a deploy mid-build drains: the build finishes, the new generation takes over6424client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw6425client # [ 149.784795] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw.6426client # Running as unit: sw.service; invocation ID: 06c583eeaa814e9489c6ea265c6bf3ed6427client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix --argstr tag sw, in 0.06 seconds)6428worker1 # [ 149.907748] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:508386429client # [ 149.927403] nix[1457]: don't know how to build these paths:6430client # [ 149.928380] nix[1457]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6431worker1 # [ 149.921483] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:02Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06432worker1 # [ 149.925857] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:02Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=16433worker2 # [ 149.943175] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409066434worker2 # [ 149.955393] nix-grpc-daemon[1735]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5)6435worker2 # [ 149.978535] nix-grpc-daemon[1735]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 2/5)6436worker2 # [ 150.051531] nix-grpc-daemon[1735]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 282 ms (attempt 3/5)6437worker2 # [ 150.341463] nix-grpc-daemon[1735]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 633 ms (attempt 4/5)6438worker2 # [ 150.979970] nix-grpc-daemon[1735]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6439worker2 # [ 150.984531] nix-grpc-daemon[1735]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6440worker2 # [ 151.004680] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:409066441client # [ 151.010528] nix[1457]: copying 1 paths to 'lb:50051'...6442client # [ 151.013744] nix[1457]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6443worker2 # [ 151.014493] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:409066444worker2 # [ 151.023204] nix-daemon[869]: accepted connection from pid 1735, user nix-grpc-daemon (trusted)6445worker2 # [ 151.106055] nix-daemon[869]: accepted connection from pid 1872, user nix-grpc-daemon (trusted)6446worker2 # [ 151.118438] nix-daemon[869]: reaped child process 1875, status = succeeded6447lb # [ 151.156486] niks3-server[1162]: 2026/09/24 09:28:03 INFO Received push request method=POST path=/api/pushes6448worker2 # [ 151.136719] nix-grpc-daemon[1816]: time=2026-09-24T09:28:03.343Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6449worker2 # [ 151.139058] nix-grpc-daemon[1816]: time=2026-09-24T09:28:03.345Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6450lb # [ 151.190806] niks3-server[1162]: 2026/09/24 09:28:03 INFO Received sign narinfos request method=POST path=/api/pushes/52/sign6451lb # [ 151.195249] niks3-server[1162]: 2026/09/24 09:28:03 INFO Signed narinfos id=52 count=16452worker2 # [ 151.167589] nix-grpc-daemon[1816]: time=2026-09-24T09:28:03.374Z level=INFO msg="Uploading 1 narinfos"6453lb # [ 151.203719] niks3-server[1162]: 2026/09/24 09:28:03 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6454lb # [ 151.211111] niks3-server[1162]: 2026/09/24 09:28:03 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6455lb # [ 151.221226] niks3-server[1162]: 2026/09/24 09:28:03 INFO Received complete push request method=POST path=/api/pushes/52/complete6456lb # [ 151.226625] niks3-server[1162]: 2026/09/24 09:28:03 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6457worker2 # [ 151.194835] nix-grpc-daemon[1816]: time=2026-09-24T09:28:03.401Z level=INFO msg="Upload complete. (167ms)"6458worker2 # [ 151.199140] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40906 duration_s=0 paths=1 nar_bytes_in=4166459worker2 # [ 151.203842] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:409066460worker2 # [ 151.214294] nix-daemon[869]: accepted connection from pid 1735, user nix-grpc-daemon (trusted)6461worker2 # [ 151.217931] nix-daemon[869]: reaped child process 1870, status = succeeded6462worker2 # [ 151.222701] nix-daemon[869]: accepted connection from pid 1735, user nix-grpc-daemon (trusted)6463client # [ 151.221824] nix[1457]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6464worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26465worker2 # Checking switch inhibitors... done6466worker2 # [ 153.607667] nixos[1911]: switching to system configuration /nix/store/x0i4kkwxa5jb0hhq30yabnm5zfc82k4d-nixos-system-worker2-test6467worker2 # activating the configuration...6468worker2 # [ 153.611389] systemd[1]: Stopped target Local File Systems.6469worker2 # [ 153.613317] systemd[1]: Stopped target Remote File Systems.6470worker2 # setting up /etc...6471worker2 # [ 154.013462] systemd[1]: Reload requested from client PID 1911 ('.switch-to-conf') (unit backdoor.service)...6472worker2 # [ 154.015232] systemd[1]: Reloading...6473lb # [ 154.986856] envoy[904]: conn peer=[2001:db8:1::1]:39150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2993 tx=826 ms=33566474worker2 # [ 155.363108] systemd[1]: Reloading finished in 1344 ms.6475worker2 # restarting sysinit-reactivation.target6476worker2 # [ 155.420166] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6477worker2 # [ 155.525100] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6478worker2 # [ 155.526398] systemd[1]: Reached target Reactivate sysinit units.6479worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6480worker2 # [ 155.530081] systemd[1]: Reloading D-Bus System Message Bus...6481worker2 # [ 155.532220] dbus-broker-launch[517]: Caught SIGHUP, trigger reload.6482worker2 # [ 155.538073] systemd[1]: Reloading Nix worker-protocol over gRPC...6483worker2 # [ 155.550991] dbus-broker-launch[517]: Looking up NSS user entry for 'systemd-timesync'...6484worker2 # [ 155.554035] dbus-broker-launch[517]: NSS returned no entry for 'systemd-timesync'6485worker2 # [ 155.557048] dbus-broker-launch[517]: Invalid user-name in /nix/store/9f31zf0wixjfmyvwg6m53sif40vrkysg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6486worker2 # [ 155.570378] systemd[1]: Reloaded Nix worker-protocol over gRPC.6487worker2 # [ 155.576341] systemd[1]: Reloaded D-Bus System Message Bus.6488worker2 # [ 155.581838] systemd[1]: Reached target Remote File Systems.6489worker2 # [ 155.583772] systemd[1]: Starting linger-users.service...6490worker2 # [ 155.591168] systemd[1]: Reached target Local File Systems.6491worker2 # [ 155.591917] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6492worker2 # [ 155.596066] systemd[1]: Starting Create SUID/SGID Wrappers...6493worker2 # [ 155.596824] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6494worker2 # [ 155.598075] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676495worker2 # [ 155.600132] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6496worker2 # [ 155.603327] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6497worker2 # [ 155.604522] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6498worker2 # [ 155.613089] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6499worker2 # [ 155.614636] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6500worker2 # [ 155.645147] systemd[1]: linger-users.service: Deactivated successfully.6501worker2 # [ 155.647336] systemd[1]: Finished linger-users.service.6502worker2 # [ 155.738437] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:07Z level=info event=draining6503worker2 # [ 155.862571] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6504worker2 # [ 155.863975] systemd[1]: Finished Create SUID/SGID Wrappers.6505worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6506worker2 # [ 156.121108] nixos[1911]: finished switching to system configuration /nix/store/x0i4kkwxa5jb0hhq30yabnm5zfc82k4d-nixos-system-worker2-test6507worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.83 seconds)6508worker2: must succeed: pgrep -f 'read -t [9]0 x'6509worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds)6510client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&26511worker1 # [ 156.296873] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:508386512client # don't know how to build these paths:6513client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6514worker1 # [ 156.305433] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508386515worker1 # [ 156.328632] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:08Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06516worker1 # [ 156.334618] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:08Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=16517worker1 # [ 156.339444] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386518worker1 # [ 156.349910] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508386519client # copying 1 paths to 'lb:50051'...6520worker1 # [ 156.361389] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508386521client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6522worker1 # [ 156.376705] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6523worker1 # [ 156.476373] nix-daemon[849]: accepted connection from pid 1624, user nix-grpc-daemon (trusted)6524worker1 # [ 156.489182] nix-daemon[849]: reaped child process 1627, status = succeeded6525lb # [ 156.543172] niks3-server[1162]: 2026/09/24 09:28:08 INFO Received push request method=POST path=/api/pushes6526worker1 # [ 156.510837] nix-grpc-daemon[1545]: time=2026-09-24T09:28:08.648Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6527worker1 # [ 156.513186] nix-grpc-daemon[1545]: time=2026-09-24T09:28:08.650Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6528lb # [ 156.579563] niks3-server[1162]: 2026/09/24 09:28:08 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6529lb # [ 156.585351] niks3-server[1162]: 2026/09/24 09:28:08 INFO Received sign narinfos request method=POST path=/api/pushes/53/sign6530worker1 # [ 156.548099] nix-grpc-daemon[1545]: time=2026-09-24T09:28:08.685Z level=INFO msg="Uploading 1 narinfos"6531lb # [ 156.592933] niks3-server[1162]: 2026/09/24 09:28:08 INFO Signed narinfos id=53 count=16532lb # [ 156.609263] niks3-server[1162]: 2026/09/24 09:28:08 INFO Received complete push request method=POST path=/api/pushes/53/complete6533lb # [ 156.612120] niks3-server[1162]: 2026/09/24 09:28:08 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6534worker1 # [ 156.576921] nix-grpc-daemon[1545]: time=2026-09-24T09:28:08.714Z level=INFO msg="Upload complete. (186ms)"6535lb # [ 156.623469] niks3-server[1162]: 2026/09/24 09:28:08 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6536worker1 # [ 156.581317] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=5286537worker1 # [ 156.587669] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386538worker1 # [ 156.598500] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6539worker1 # [ 156.608476] nix-daemon[849]: reaped child process 1622, status = succeeded6540client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6541worker1 # [ 156.613770] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6542client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6543client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6544client # farm-a> LOG-farm-a-during-drain6545worker1 # [ 157.654584] nix-daemon[849]: reaped child process 1631, status = succeeded6546worker1 # [ 157.736697] nix-daemon[849]: accepted connection from pid 1647, user nix-grpc-daemon (trusted)6547worker1 # [ 157.748048] nix-daemon[849]: reaped child process 1650, status = succeeded6548lb # [ 157.801794] niks3-server[1162]: 2026/09/24 09:28:09 INFO Received push request method=POST path=/api/pushes6549worker1 # [ 157.767310] nix-grpc-daemon[1545]: time=2026-09-24T09:28:09.904Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6550worker1 # [ 157.768801] nix-grpc-daemon[1545]: time=2026-09-24T09:28:09.906Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6551lb # [ 157.840150] niks3-server[1162]: 2026/09/24 09:28:10 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6552lb # [ 157.862171] niks3-server[1162]: 2026/09/24 09:28:10 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6553lb # [ 157.865408] niks3-server[1162]: 2026/09/24 09:28:10 INFO Received sign narinfos request method=POST path=/api/pushes/54/sign6554lb # [ 157.872162] niks3-server[1162]: 2026/09/24 09:28:10 INFO Signed narinfos id=54 count=16555worker1 # [ 157.827036] nix-grpc-daemon[1545]: time=2026-09-24T09:28:09.964Z level=INFO msg="Uploading 1 narinfos"6556lb # [ 157.877599] niks3-server[1162]: 2026/09/24 09:28:10 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6557lb # [ 157.886819] niks3-server[1162]: 2026/09/24 09:28:10 INFO Received complete push request method=POST path=/api/pushes/54/complete6558lb # [ 157.892457] niks3-server[1162]: 2026/09/24 09:28:10 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6559worker1 # [ 157.846131] nix-grpc-daemon[1545]: time=2026-09-24T09:28:09.983Z level=INFO msg="Upload complete. (225ms)"6560worker1 # [ 157.852846] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06561worker1 # [ 157.865828] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:10Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06562worker1 # [ 157.870556] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:10Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16563worker1 # [ 157.875227] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386564worker1 # [ 157.883175] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508386565worker1 # [ 157.888237] nix-daemon[849]: reaped child process 1629, status = succeeded6566worker1 # [ 157.892027] nix-grpc-daemon[1545]: time=2026-09-24T09:28:10.029Z level=INFO msg="All 1 paths already cached"6567client # copying 1 paths to 'lb:50051'...6568worker1 # [ 157.897664] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508386569client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6570worker1 # [ 157.913727] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6571worker1 # [ 158.003550] nix-daemon[849]: accepted connection from pid 1656, user nix-grpc-daemon (trusted)6572worker1 # [ 158.018049] nix-daemon[849]: reaped child process 1659, status = succeeded6573lb # [ 158.069239] niks3-server[1162]: 2026/09/24 09:28:10 INFO Received push request method=POST path=/api/pushes6574worker1 # [ 158.032335] nix-grpc-daemon[1545]: time=2026-09-24T09:28:10.170Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6575worker1 # [ 158.033900] nix-grpc-daemon[1545]: time=2026-09-24T09:28:10.171Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6576lb # [ 158.096369] niks3-server[1162]: 2026/09/24 09:28:10 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6577lb # [ 158.106850] niks3-server[1162]: 2026/09/24 09:28:10 INFO Received sign narinfos request method=POST path=/api/pushes/55/sign6578lb # [ 158.114406] niks3-server[1162]: 2026/09/24 09:28:10 INFO Signed narinfos id=55 count=16579worker1 # [ 158.072513] nix-grpc-daemon[1545]: time=2026-09-24T09:28:10.210Z level=INFO msg="Uploading 1 narinfos"6580lb # [ 158.122202] niks3-server[1162]: 2026/09/24 09:28:10 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6581lb # [ 158.131738] niks3-server[1162]: 2026/09/24 09:28:10 INFO Received complete push request method=POST path=/api/pushes/55/complete6582worker1 # [ 158.094658] nix-grpc-daemon[1545]: time=2026-09-24T09:28:10.232Z level=INFO msg="Upload complete. (173ms)"6583lb # [ 158.141730] niks3-server[1162]: 2026/09/24 09:28:10 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6584worker1 # [ 158.098204] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=6406585worker1 # [ 158.103113] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386586worker1 # [ 158.112879] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6587worker1 # [ 158.118513] nix-daemon[849]: reaped child process 1654, status = succeeded6588worker1 # [ 158.122688] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6589client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6590client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6591client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6592client # farm-b> LOG-farm-b-during-drain6593worker1 # [ 158.957704] nix-daemon[849]: reaped child process 1663, status = succeeded6594worker1 # [ 159.041090] nix-daemon[849]: accepted connection from pid 1679, user nix-grpc-daemon (trusted)6595worker1 # [ 159.053097] nix-daemon[849]: reaped child process 1682, status = succeeded6596lb # [ 159.106340] niks3-server[1162]: 2026/09/24 09:28:11 INFO Received push request method=POST path=/api/pushes6597worker1 # [ 159.069880] nix-grpc-daemon[1545]: time=2026-09-24T09:28:11.207Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6598worker1 # [ 159.072162] nix-grpc-daemon[1545]: time=2026-09-24T09:28:11.209Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6599lb # [ 159.146068] niks3-server[1162]: 2026/09/24 09:28:11 INFO Received sign narinfos request method=POST path=/api/pushes/56/sign6600worker1 # [ 159.107507] nix-grpc-daemon[1545]: time=2026-09-24T09:28:11.245Z level=INFO msg="Uploading 1 narinfos"6601lb # [ 159.152182] niks3-server[1162]: 2026/09/24 09:28:11 INFO Signed narinfos id=56 count=16602lb # [ 159.161235] niks3-server[1162]: 2026/09/24 09:28:11 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6603lb # [ 159.169595] niks3-server[1162]: 2026/09/24 09:28:11 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6604lb # [ 159.177445] niks3-server[1162]: 2026/09/24 09:28:11 INFO Received complete push request method=POST path=/api/pushes/56/complete6605worker1 # [ 159.140476] nix-grpc-daemon[1545]: time=2026-09-24T09:28:11.278Z level=INFO msg="Upload complete. (210ms)"6606lb # [ 159.186754] niks3-server[1162]: 2026/09/24 09:28:11 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6607lb # [ 159.189266] niks3-server[1162]: 2026/09/24 09:28:11 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6608worker1 # [ 159.148178] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=06609worker1 # [ 159.160675] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:11Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06610worker1 # [ 159.165298] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:11Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16611worker1 # [ 159.168738] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386612worker1 # [ 159.177119] nix-daemon[849]: reaped child process 1661, status = succeeded6613worker1 # [ 159.184360] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508386614worker1 # [ 159.192627] nix-grpc-daemon[1545]: time=2026-09-24T09:28:11.330Z level=INFO msg="All 2 paths already cached"6615client # copying 1 paths to 'lb:50051'...6616worker1 # [ 159.198209] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508386617client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6618worker1 # [ 159.213964] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6619worker1 # [ 159.302422] nix-daemon[849]: accepted connection from pid 1688, user nix-grpc-daemon (trusted)6620worker1 # [ 159.315100] nix-daemon[849]: reaped child process 1691, status = succeeded6621lb # [ 159.368213] niks3-server[1162]: 2026/09/24 09:28:11 INFO Received push request method=POST path=/api/pushes6622worker1 # [ 159.332300] nix-grpc-daemon[1545]: time=2026-09-24T09:28:11.470Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6623worker1 # [ 159.333976] nix-grpc-daemon[1545]: time=2026-09-24T09:28:11.471Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6624lb # [ 159.400145] niks3-server[1162]: 2026/09/24 09:28:11 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6625lb # [ 159.407698] niks3-server[1162]: 2026/09/24 09:28:11 INFO Received sign narinfos request method=POST path=/api/pushes/57/sign6626lb # [ 159.413328] niks3-server[1162]: 2026/09/24 09:28:11 INFO Signed narinfos id=57 count=16627worker1 # [ 159.371399] nix-grpc-daemon[1545]: time=2026-09-24T09:28:11.509Z level=INFO msg="Uploading 1 narinfos"6628lb # [ 159.422283] niks3-server[1162]: 2026/09/24 09:28:11 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6629lb # [ 159.430569] niks3-server[1162]: 2026/09/24 09:28:11 INFO Received complete push request method=POST path=/api/pushes/57/complete6630worker1 # [ 159.394074] nix-grpc-daemon[1545]: time=2026-09-24T09:28:11.531Z level=INFO msg="Upload complete. (174ms)"6631lb # [ 159.440564] niks3-server[1162]: 2026/09/24 09:28:11 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6632worker1 # [ 159.397997] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=7686633worker1 # [ 159.402835] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386634worker1 # [ 159.412996] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6635worker1 # [ 159.419103] nix-daemon[849]: reaped child process 1686, status = succeeded6636worker1 # [ 159.422400] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6637client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6638client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6639client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6640client # farm-top> LOG-farm-top-during-drain6641worker1 # [ 160.236214] nix-daemon[849]: reaped child process 1695, status = succeeded6642worker1 # [ 160.313121] nix-daemon[849]: accepted connection from pid 1711, user nix-grpc-daemon (trusted)6643worker1 # [ 160.325653] nix-daemon[849]: reaped child process 1714, status = succeeded6644lb # [ 160.381748] niks3-server[1162]: 2026/09/24 09:28:12 INFO Received push request method=POST path=/api/pushes6645worker1 # [ 160.343473] nix-grpc-daemon[1545]: time=2026-09-24T09:28:12.481Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6646worker1 # [ 160.344976] nix-grpc-daemon[1545]: time=2026-09-24T09:28:12.482Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6647lb # [ 160.421612] niks3-server[1162]: 2026/09/24 09:28:12 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6648lb # [ 160.430500] niks3-server[1162]: 2026/09/24 09:28:12 INFO Received sign narinfos request method=POST path=/api/pushes/58/sign6649worker1 # [ 160.393440] nix-grpc-daemon[1545]: time=2026-09-24T09:28:12.531Z level=INFO msg="Uploading 1 narinfos"6650lb # [ 160.438249] niks3-server[1162]: 2026/09/24 09:28:12 INFO Signed narinfos id=58 count=16651lb # [ 160.443764] niks3-server[1162]: 2026/09/24 09:28:12 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6652lb # [ 160.452248] niks3-server[1162]: 2026/09/24 09:28:12 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6653lb # [ 160.461144] niks3-server[1162]: 2026/09/24 09:28:12 INFO Received complete push request method=POST path=/api/pushes/58/complete6654worker1 # [ 160.421097] nix-grpc-daemon[1545]: time=2026-09-24T09:28:12.558Z level=INFO msg="Upload complete. (192ms)"6655lb # [ 160.467900] niks3-server[1162]: 2026/09/24 09:28:12 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6656worker1 # [ 160.427669] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=06657worker1 # [ 160.443490] nix-daemon[849]: reaped child process 1693, status = succeeded6658client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain >&2, in 4.32 seconds)6659client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath6660client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag during-drain outPath, in 0.11 seconds)6661worker2: must succeed: pkill -f 'read -t [9]0 x'6662worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.04 seconds)6663client: waiting for success: ! systemctl is-active sw6664worker2 # [ 160.646319] nix-daemon[869]: reaped child process 1879, status = succeeded6665worker2 # [ 160.719087] nix-daemon[869]: accepted connection from pid 2051, user nix-grpc-daemon (trusted)6666worker2 # [ 160.731524] nix-daemon[869]: reaped child process 2054, status = succeeded6667lb # [ 160.767895] niks3-server[1162]: 2026/09/24 09:28:12 INFO Received push request method=POST path=/api/pushes6668worker2 # [ 160.745962] nix-grpc-daemon[1816]: time=2026-09-24T09:28:12.952Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6669worker2 # [ 160.747881] nix-grpc-daemon[1816]: time=2026-09-24T09:28:12.954Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6670lb # [ 160.805593] niks3-server[1162]: 2026/09/24 09:28:12 INFO Received sign narinfos request method=POST path=/api/pushes/59/sign6671lb # [ 160.814539] niks3-server[1162]: 2026/09/24 09:28:13 INFO Signed narinfos id=59 count=16672worker2 # [ 160.786549] nix-grpc-daemon[1816]: time=2026-09-24T09:28:12.993Z level=INFO msg="Uploading 1 narinfos"6673lb # [ 160.823537] niks3-server[1162]: 2026/09/24 09:28:13 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6674lb # [ 160.829273] niks3-server[1162]: 2026/09/24 09:28:13 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6675lb # [ 160.834931] niks3-server[1162]: 2026/09/24 09:28:13 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6676lb # [ 160.846435] niks3-server[1162]: 2026/09/24 09:28:13 INFO Received complete push request method=POST path=/api/pushes/59/complete6677lb # [ 160.850496] niks3-server[1162]: 2026/09/24 09:28:13 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6678worker2 # [ 160.822467] nix-grpc-daemon[1816]: time=2026-09-24T09:28:13.029Z level=INFO msg="Upload complete. (184ms)"6679worker2 # [ 160.829723] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40906 duration_s=9 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06680worker2 # [ 160.844493] nix-daemon[869]: reaped child process 1877, status = succeeded6681client # [ 160.858462] systemd[1]: sw.service: Deactivated successfully.6682client # [ 160.862280] systemd[1]: sw.service: Consumed 131ms CPU time over 11.077s wall clock time, 43.4M memory peak, 7.5K incoming IP traffic, 8.4K outgoing IP traffic.6683client: (finished: waiting for success: ! systemctl is-active sw, in 1.06 seconds)6684client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6685client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6686worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6687worker2 # [ 161.740189] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:13Z level=info event=signal_exit6688worker2 # [ 161.780672] systemd[1]: Starting scheduler-token.service...6689worker2 # [ 161.817098] systemd[1]: scheduler-token.service: Deactivated successfully.6690worker2 # [ 161.818525] systemd[1]: Finished scheduler-token.service.6691worker2 # [ 161.819829] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 36ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6692worker1 # [ 163.735381] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:600206693worker1 # [ 163.742354] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:15Z level=info event=worker_gone addr=192.168.1.4:500516694worker2 # [ 163.747704] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:15Z level=info event=scheduler_restarting6695worker2 # [ 163.763925] nix-grpc-daemon[1735]: ts=2026-09-24T09:28:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6696worker2 # [ 163.787581] nix-daemon[869]: reaped child process 1787, status = succeeded6697worker2 # [ 164.765453] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6698worker2 # [ 164.769489] systemd[1]: nix-grpc-daemon.service: Consumed 593ms CPU time over 26.247s wall clock time, 35.3M memory peak, 179.9K incoming IP traffic, 67.3K outgoing IP traffic.6699worker2 # [ 164.782560] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6700worker2 # [ 164.792584] systemd[1]: Starting scheduler-token.service...6701worker2 # [ 164.834620] systemd[1]: scheduler-token.service: Deactivated successfully.6702worker2 # [ 164.836225] systemd[1]: Finished scheduler-token.service.6703worker2 # [ 164.837269] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 44ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6704worker2 # [ 164.841841] systemd[1]: Starting Nix worker-protocol over gRPC...6705worker2 # [ 164.916683] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6706worker2 # [ 164.922592] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6707worker2 # [ 164.925131] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16708worker2 # [ 164.927102] nix-grpc-daemon[2075]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6709worker2 # [ 164.928439] nix-grpc-daemon[2075]: E0000 00:00:1790242097.129249 2075 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6710worker2 # [ 164.931272] nix-grpc-daemon[2075]: E0000 00:00:1790242097.138316 2075 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6711worker2 # [ 164.938700] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:17Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket6712worker2 # [ 164.941270] systemd[1]: Started Nix worker-protocol over gRPC.6713worker2 # [ 164.945156] nix-grpc-daemon[2075]: E0000 00:00:1790242097.149484 2115 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6714worker2 # [ 164.958053] nix-grpc-daemon[2075]: E0000 00:00:1790242097.163064 2115 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6715lb # [ 164.987785] envoy[904]: conn peer=[2001:db8:1::1]:42966 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9551 tx=4361 ms=41526716worker2 # [ 164.960200] nix-grpc-daemon[2075]: E0000 00:00:1790242097.163521 2115 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6717lb # [ 164.991745] envoy[904]: conn peer=[2001:db8:1::1]:39164 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2962 tx=1566 ms=109206718lb # [ 164.995486] envoy[904]: conn peer=[2001:db8:1::4]:52986 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4050 tx=523 ms=249836719worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.25 seconds)6720lb: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux6721lb: must succeed: curl -sf localhost:9901/clusters6722worker2 # [ 164.971436] nix-grpc-daemon[2075]: E0000 00:00:1790242097.178513 2115 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6723worker2 # [ 164.982916] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:17Z level=info event=scheduler_connected addr=lb:500516724worker1 # [ 164.972446] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:600206725worker1 # [ 164.977500] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06726lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6727lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of x86_64-linux, in 0.06 seconds)6728lb: must succeed: curl -sf localhost:9901/clusters6729lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6730worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6731worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6732(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.35 seconds)6733subtest: queue gauges show a burst while every build blocks6734lb: must succeed: curl -sf localhost:9901/clusters6735lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6736lb: must succeed: curl -sf localhost:9901/clusters6737lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6738worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6739worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6740client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]'6741client # [ 165.226683] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]".6742client # Running as unit: burst.service; invocation ID: 809fe4225794466388bf41f72c8ec2706743client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/xm9d525p8sv28c6nivsdjrjpb8kgp3fa-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.06 seconds)6744lb: must succeed: curl -sf localhost:9901/clusters6745lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6746lb: must succeed: curl -sf localhost:9901/clusters6747lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6748worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6749worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6750worker2 # [ 165.364867] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:599146751worker2 # [ 165.376409] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)6752client # [ 165.388395] nix[1513]: don't know how to build these paths:6753client # [ 165.389282] nix[1513]: /nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv6754client # [ 165.390239] nix[1513]: /nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv6755client # [ 165.391209] nix[1513]: /nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv6756client # [ 165.392827] nix[1513]: /nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv6757worker1 # [ 165.386935] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=want client=5 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv cached=06758worker2 # [ 165.403789] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599146759worker1 # [ 165.393900] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=assigned drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv worker=192.168.1.3:50051 clients=16760worker1 # [ 165.398995] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=want client=5 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv cached=06761worker2 # [ 165.414843] nix-grpc-daemon[2075]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 1/5)6762worker1 # [ 165.403101] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=assigned drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv worker=192.168.1.4:50051 clients=16763worker1 # [ 165.407456] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=want client=5 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv cached=06764worker1 # [ 165.411685] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=want client=5 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv cached=06765worker1 # [ 165.416412] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386766worker1 # [ 165.422655] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508386767client # [ 165.445156] nix[1513]: copying 1 paths to 'lb:50051'...6768worker1 # [ 165.432674] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508386769client # [ 165.448140] nix[1513]: copying path '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' to 'lb:50051'...6770worker1 # [ 165.444459] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6771worker2 # [ 165.474202] nix-grpc-daemon[2075]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 2/5)6772worker2 # [ 165.515448] nix-grpc-daemon[2075]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 3/5)6773worker1 # [ 165.534455] nix-daemon[849]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)6774worker2 # [ 165.554228] nix-grpc-daemon[2075]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 246 ms (attempt 4/5)6775worker1 # [ 165.547815] nix-daemon[849]: reaped child process 1732, status = succeeded6776lb # [ 165.600217] niks3-server[1162]: 2026/09/24 09:28:17 INFO Received push request method=POST path=/api/pushes6777worker1 # [ 165.564639] nix-grpc-daemon[1545]: time=2026-09-24T09:28:17.701Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6778worker1 # [ 165.566072] nix-grpc-daemon[1545]: time=2026-09-24T09:28:17.701Z level=INFO msg="Uploading 2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv (416B)"6779lb # [ 165.635718] niks3-server[1162]: 2026/09/24 09:28:17 INFO Registered completed upload object_key=nar/0raymp7y3ngiv7lj2qq6nkp63sms2510yhhlnr7hnz7ldnl7b3qc.nar.zst6780lb # [ 165.646061] niks3-server[1162]: 2026/09/24 09:28:17 INFO Received sign narinfos request method=POST path=/api/pushes/60/sign6781lb # [ 165.651970] niks3-server[1162]: 2026/09/24 09:28:17 INFO Signed narinfos id=60 count=16782worker1 # [ 165.610143] nix-grpc-daemon[1545]: time=2026-09-24T09:28:17.747Z level=INFO msg="Uploading 1 narinfos"6783lb # [ 165.663102] niks3-server[1162]: 2026/09/24 09:28:17 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.ls6784lb # [ 165.675892] niks3-server[1162]: 2026/09/24 09:28:17 INFO Received complete push request method=POST path=/api/pushes/60/complete6785lb # [ 165.682179] niks3-server[1162]: 2026/09/24 09:28:17 INFO Registered completed upload object_key=2s9psgqm7awsyhlfyaclma7yr7qmrk0g.narinfo6786worker1 # [ 165.636128] nix-grpc-daemon[1545]: time=2026-09-24T09:28:17.773Z level=INFO msg="Upload complete. (183ms)"6787worker1 # [ 165.640950] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=4166788worker1 # [ 165.647591] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386789worker1 # [ 165.661110] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6790worker1 # [ 165.670276] nix-daemon[849]: reaped child process 1727, status = succeeded6791worker1 # [ 165.673917] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6792client # [ 165.687195] nix[1513]: building '/nix/store/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv' on lb:50051...6793worker2 # [ 165.803161] nix-grpc-daemon[2075]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6794worker2 # [ 165.806133] nix-grpc-daemon[2075]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6795worker2 # [ 165.823156] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:599146796client # [ 165.833372] nix[1513]: copying 1 paths to 'lb:50051'...6797worker2 # [ 165.834800] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:599146798client # [ 165.836151] nix[1513]: copying path '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' to 'lb:50051'...6799worker2 # [ 165.845302] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)6800worker2 # [ 165.867851] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:18Z level=info event=niks3_push_started pid=21356801worker2 # [ 165.969410] nix-grpc-daemon[2135]: time=2026-09-24T09:28:18.176Z level=INFO msg="Configuring client TLS" cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.pem key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/worker2.key ca=""6802worker2 # [ 166.054877] nix-daemon[869]: accepted connection from pid 2148, user nix-grpc-daemon (trusted)6803worker2 # [ 166.066196] nix-daemon[869]: reaped child process 2151, status = succeeded6804lb # [ 166.104779] niks3-server[1162]: 2026/09/24 09:28:18 INFO Received push request method=POST path=/api/pushes6805worker2 # [ 166.082712] nix-grpc-daemon[2135]: time=2026-09-24T09:28:18.289Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6806worker2 # [ 166.085521] nix-grpc-daemon[2135]: time=2026-09-24T09:28:18.291Z level=INFO msg="Uploading 885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv (416B)"6807lb # [ 166.143623] niks3-server[1162]: 2026/09/24 09:28:18 INFO Received sign narinfos request method=POST path=/api/pushes/61/sign6808lb # [ 166.150704] niks3-server[1162]: 2026/09/24 09:28:18 INFO Registered completed upload object_key=nar/0mmcg3cvna05ngbx6v5vspkmc5gj8lna2zc48rllhxr0g8i9mg6y.nar.zst6809worker2 # [ 166.125607] nix-grpc-daemon[2135]: time=2026-09-24T09:28:18.332Z level=INFO msg="Uploading 1 narinfos"6810lb # [ 166.156287] niks3-server[1162]: 2026/09/24 09:28:18 INFO Signed narinfos id=61 count=16811lb # [ 166.165202] niks3-server[1162]: 2026/09/24 09:28:18 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.ls6812lb # [ 166.171852] niks3-server[1162]: 2026/09/24 09:28:18 INFO Received complete push request method=POST path=/api/pushes/61/complete6813worker2 # [ 166.150023] nix-grpc-daemon[2135]: time=2026-09-24T09:28:18.357Z level=INFO msg="Upload complete. (177ms)"6814lb # [ 166.182286] niks3-server[1162]: 2026/09/24 09:28:18 INFO Registered completed upload object_key=885n55y9srkrjs4p487lr255wvhla7hq.narinfo6815worker2 # [ 166.154443] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=0 paths=1 nar_bytes_in=4166816worker2 # [ 166.160056] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599146817worker2 # [ 166.169469] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)6818worker2 # [ 166.173187] nix-daemon[869]: reaped child process 2133, status = succeeded6819worker2 # [ 166.177923] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)6820client # [ 166.176952] nix[1513]: building '/nix/store/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv' on lb:50051...6821lb: must succeed: curl -sf localhost:9901/clusters6822lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6823lb: must succeed: curl -sf localhost:9901/clusters6824lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6825worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6826worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6827worker1 # [ 167.691167] nix-daemon[849]: reaped child process 1736, status = succeeded6828worker1 # [ 167.765867] nix-daemon[849]: accepted connection from pid 1764, user nix-grpc-daemon (trusted)6829worker1 # [ 167.778806] nix-daemon[849]: reaped child process 1767, status = succeeded6830worker2 # [ 167.794567] nix-daemon[869]: reaped child process 2155, status = succeeded6831lb # [ 167.831241] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received push request method=POST path=/api/pushes6832worker1 # [ 167.794387] nix-grpc-daemon[1545]: time=2026-09-24T09:28:19.931Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6833worker1 # [ 167.797331] nix-grpc-daemon[1545]: time=2026-09-24T09:28:19.933Z level=INFO msg="Uploading vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq-slow-q3 (120B)"6834lb # [ 167.872527] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=log/2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv6835lb # [ 167.880842] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received sign narinfos request method=POST path=/api/pushes/62/sign6836worker1 # [ 167.845071] nix-grpc-daemon[1545]: time=2026-09-24T09:28:19.982Z level=INFO msg="Uploading 1 narinfos"6837lb # [ 167.889678] niks3-server[1162]: 2026/09/24 09:28:20 INFO Signed narinfos id=62 count=16838lb # [ 167.894113] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.ls6839worker2 # [ 167.866361] nix-daemon[869]: accepted connection from pid 2180, user nix-grpc-daemon (trusted)6840lb # [ 167.899429] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst6841worker2 # [ 167.880076] nix-daemon[869]: reaped child process 2183, status = succeeded6842lb # [ 167.910406] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received complete push request method=POST path=/api/pushes/62/complete6843lb # [ 167.914951] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received push request method=POST path=/api/pushes6844lb # [ 167.916739] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=vn3s5fgnxq5d2l4d4nn96l2q9wfdg4mq.narinfo6845worker1 # [ 167.874339] nix-grpc-daemon[1545]: time=2026-09-24T09:28:20.012Z level=INFO msg="Upload complete. (192ms)"6846worker2 # [ 167.891462] nix-grpc-daemon[2135]: time=2026-09-24T09:28:20.098Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6847worker2 # [ 167.892931] nix-grpc-daemon[2135]: time=2026-09-24T09:28:20.100Z level=INFO msg="Uploading nv0kp5b571hsjibnd9v06981i024iima-slow-q2 (120B)"6848worker1 # [ 167.882847] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=2 drv=2s9psgqm7awsyhlfyaclma7yr7qmrk0g-slow-q3.drv assign_id=7 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06849worker1 # [ 167.892355] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:20Z level=debug event=assigned drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv worker=192.168.1.3:50051 clients=16850lb # [ 167.940591] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=log/885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv6851lb # [ 167.942678] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received sign narinfos request method=POST path=/api/pushes/63/sign6852worker1 # [ 167.896837] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386853worker2 # [ 167.913441] nix-grpc-daemon[2135]: time=2026-09-24T09:28:20.120Z level=INFO msg="Uploading 1 narinfos"6854lb # [ 167.944820] niks3-server[1162]: 2026/09/24 09:28:20 INFO Signed narinfos id=63 count=16855lb # [ 167.947149] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst6856lb # [ 167.953021] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.ls6857worker1 # [ 167.909112] nix-daemon[849]: reaped child process 1734, status = succeeded6858worker1 # [ 167.910681] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508386859lb # [ 167.957141] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received complete push request method=POST path=/api/pushes/63/complete6860lb # [ 167.961140] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=nv0kp5b571hsjibnd9v06981i024iima.narinfo6861worker2 # [ 167.934521] nix-grpc-daemon[2135]: time=2026-09-24T09:28:20.141Z level=INFO msg="Upload complete. (149ms)"6862worker1 # [ 167.920299] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508386863client # [ 167.933885] nix[1513]: copying 1 paths to 'lb:50051'...6864worker1 # [ 167.923748] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:20Z level=debug event=assigned drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv worker=192.168.1.4:50051 clients=16865client # [ 167.936607] nix[1513]: copying path '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' to 'lb:50051'...6866worker2 # [ 167.937413] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=1 drv=885n55y9srkrjs4p487lr255wvhla7hq-slow-q2.drv assign_id=8 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06867worker2 # [ 167.942090] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599146868worker1 # [ 167.931132] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6869worker2 # [ 167.948647] nix-daemon[869]: reaped child process 2153, status = succeeded6870worker2 # [ 167.950201] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:599146871client # [ 167.953965] nix[1513]: copying 1 paths to 'lb:50051'...6872worker2 # [ 167.957494] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:599146873client # [ 167.956619] nix[1513]: copying path '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' to 'lb:50051'...6874worker2 # [ 167.962830] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)6875worker1 # [ 168.016074] nix-daemon[849]: accepted connection from pid 1771, user nix-grpc-daemon (trusted)6876worker1 # [ 168.029892] nix-daemon[849]: reaped child process 1774, status = succeeded6877worker2 # [ 168.045652] nix-daemon[869]: accepted connection from pid 2187, user nix-grpc-daemon (trusted)6878lb # [ 168.081862] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received push request method=POST path=/api/pushes6879worker2 # [ 168.058197] nix-daemon[869]: reaped child process 2190, status = succeeded6880worker1 # [ 168.045122] nix-grpc-daemon[1545]: time=2026-09-24T09:28:20.182Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6881worker1 # [ 168.047084] nix-grpc-daemon[1545]: time=2026-09-24T09:28:20.184Z level=INFO msg="Uploading 8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv (416B)"6882lb # [ 168.096350] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received push request method=POST path=/api/pushes6883worker2 # [ 168.073897] nix-grpc-daemon[2135]: time=2026-09-24T09:28:20.281Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6884worker2 # [ 168.075851] nix-grpc-daemon[2135]: time=2026-09-24T09:28:20.282Z level=INFO msg="Uploading qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv (416B)"6885lb # [ 168.123188] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received sign narinfos request method=POST path=/api/pushes/65/sign6886worker2 # [ 168.098441] nix-grpc-daemon[2135]: time=2026-09-24T09:28:20.305Z level=INFO msg="Uploading 1 narinfos"6887lb # [ 168.129145] niks3-server[1162]: 2026/09/24 09:28:20 INFO Signed narinfos id=65 count=16888lb # [ 168.136275] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received sign narinfos request method=POST path=/api/pushes/64/sign6889lb # [ 168.139875] niks3-server[1162]: 2026/09/24 09:28:20 INFO Signed narinfos id=64 count=16890worker1 # [ 168.097745] nix-grpc-daemon[1545]: time=2026-09-24T09:28:20.235Z level=INFO msg="Uploading 1 narinfos"6891lb # [ 168.146348] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.ls6892lb # [ 168.148881] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.ls6893lb # [ 168.151465] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=nar/1spxkiwzvlj9sgbjal4jf4p68h5kbylxymfww73s5va157qxgafi.nar.zst6894lb # [ 168.158569] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received complete push request method=POST path=/api/pushes/65/complete6895lb # [ 168.160149] niks3-server[1162]: 2026/09/24 09:28:20 INFO Received complete push request method=POST path=/api/pushes/64/complete6896lb # [ 168.162684] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=nar/1xibay372y9by9a678y9h7bfzwahsxi0vq51acgywak31q6q2m87.nar.zst6897lb # [ 168.169531] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=8v867csm7d9sip4xd4nlg9jwvrpqqwv9.narinfo6898worker1 # [ 168.124182] nix-grpc-daemon[1545]: time=2026-09-24T09:28:20.261Z level=INFO msg="Upload complete. (188ms)"6899worker2 # [ 168.141627] nix-grpc-daemon[2135]: time=2026-09-24T09:28:20.348Z level=INFO msg="Upload complete. (173ms)"6900lb # [ 168.175369] niks3-server[1162]: 2026/09/24 09:28:20 INFO Registered completed upload object_key=qs0cgdr560r5cllf2djj9bb4gz0vrp4p.narinfo6901worker1 # [ 168.129082] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=4166902worker2 # [ 168.146468] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=0 paths=1 nar_bytes_in=4166903worker1 # [ 168.135639] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386904worker2 # [ 168.152383] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599146905worker1 # [ 168.147117] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6906worker2 # [ 168.162734] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)6907worker2 # [ 168.170494] nix-daemon[869]: reaped child process 2185, status = succeeded6908worker1 # [ 168.157158] nix-daemon[849]: reaped child process 1769, status = succeeded6909worker2 # [ 168.175156] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)6910client # [ 168.174494] nix[1513]: building '/nix/store/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv' on lb:50051...6911worker1 # [ 168.164128] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6912client # [ 168.178095] nix[1513]: building '/nix/store/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv' on lb:50051...6913worker2 # [ 169.991192] nix-daemon[869]: reaped child process 2194, status = succeeded6914worker1 # [ 169.982385] nix-daemon[849]: reaped child process 1778, status = succeeded6915worker2 # [ 170.064576] nix-daemon[869]: accepted connection from pid 2219, user nix-grpc-daemon (trusted)6916worker1 # [ 170.055912] nix-daemon[849]: accepted connection from pid 1803, user nix-grpc-daemon (trusted)6917worker2 # [ 170.077037] nix-daemon[869]: reaped child process 2222, status = succeeded6918worker1 # [ 170.068873] nix-daemon[849]: reaped child process 1806, status = succeeded6919lb # [ 170.115549] niks3-server[1162]: 2026/09/24 09:28:22 INFO Received push request method=POST path=/api/pushes6920lb # [ 170.121400] niks3-server[1162]: 2026/09/24 09:28:22 INFO Received push request method=POST path=/api/pushes6921worker2 # [ 170.095917] nix-grpc-daemon[2135]: time=2026-09-24T09:28:22.302Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6922worker2 # [ 170.097444] nix-grpc-daemon[2135]: time=2026-09-24T09:28:22.304Z level=INFO msg="Uploading 106i40yblbkazayvn9ppswrq6kqs26sj-slow-q1 (120B)"6923worker1 # [ 170.085900] nix-grpc-daemon[1545]: time=2026-09-24T09:28:22.223Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6924worker1 # [ 170.087489] nix-grpc-daemon[1545]: time=2026-09-24T09:28:22.225Z level=INFO msg="Uploading wmw8972gq2nf739xhg7is7lylxf8299y-slow-q0 (120B)"6925lb # [ 170.167411] niks3-server[1162]: 2026/09/24 09:28:22 INFO Received sign narinfos request method=POST path=/api/pushes/66/sign6926lb # [ 170.169631] niks3-server[1162]: 2026/09/24 09:28:22 INFO Signed narinfos id=66 count=16927worker2 # [ 170.138854] nix-grpc-daemon[2135]: time=2026-09-24T09:28:22.345Z level=INFO msg="Uploading 1 narinfos"6928lb # [ 170.174571] niks3-server[1162]: 2026/09/24 09:28:22 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.ls6929lb # [ 170.177313] niks3-server[1162]: 2026/09/24 09:28:22 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst6930lb # [ 170.180345] niks3-server[1162]: 2026/09/24 09:28:22 INFO Received sign narinfos request method=POST path=/api/pushes/67/sign6931lb # [ 170.184932] niks3-server[1162]: 2026/09/24 09:28:22 INFO Signed narinfos id=67 count=16932worker1 # [ 170.139652] nix-grpc-daemon[1545]: time=2026-09-24T09:28:22.277Z level=INFO msg="Uploading 1 narinfos"6933lb # [ 170.187302] niks3-server[1162]: 2026/09/24 09:28:22 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst6934lb # [ 170.189245] niks3-server[1162]: 2026/09/24 09:28:22 INFO Registered completed upload object_key=log/qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv6935lb # [ 170.193816] niks3-server[1162]: 2026/09/24 09:28:22 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.ls6936lb # [ 170.196791] niks3-server[1162]: 2026/09/24 09:28:22 INFO Registered completed upload object_key=log/8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv6937lb # [ 170.201895] niks3-server[1162]: 2026/09/24 09:28:22 INFO Received complete push request method=POST path=/api/pushes/66/complete6938lb # [ 170.205560] niks3-server[1162]: 2026/09/24 09:28:22 INFO Received complete push request method=POST path=/api/pushes/67/complete6939worker2 # [ 170.178504] nix-grpc-daemon[2135]: time=2026-09-24T09:28:22.385Z level=INFO msg="Upload complete. (195ms)"6940lb # [ 170.211714] niks3-server[1162]: 2026/09/24 09:28:22 INFO Registered completed upload object_key=106i40yblbkazayvn9ppswrq6kqs26sj.narinfo6941lb # [ 170.215958] niks3-server[1162]: 2026/09/24 09:28:22 INFO Registered completed upload object_key=wmw8972gq2nf739xhg7is7lylxf8299y.narinfo6942worker1 # [ 170.169924] nix-grpc-daemon[1545]: time=2026-09-24T09:28:22.307Z level=INFO msg="Upload complete. (198ms)"6943worker2 # [ 170.184706] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=2 drv=qs0cgdr560r5cllf2djj9bb4gz0vrp4p-slow-q1.drv assign_id=10 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06944worker1 # [ 170.178889] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=2 drv=8v867csm7d9sip4xd4nlg9jwvrpqqwv9-slow-q0.drv assign_id=9 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=06945worker2 # [ 170.201421] nix-daemon[869]: reaped child process 2192, status = succeeded6946worker1 # [ 170.193945] nix-daemon[849]: reaped child process 1776, status = succeeded6947client # [ 170.221808] systemd[1]: burst.service: Deactivated successfully.6948client # [ 170.225576] systemd[1]: burst.service: Consumed 153ms CPU time over 4.998s wall clock time, 49.7M memory peak, 13.9K incoming IP traffic, 18.6K outgoing IP traffic.6949client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }6950client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.04 seconds)6951lb: must succeed: curl -sf localhost:9901/clusters6952lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6953lb: must succeed: curl -sf localhost:9901/clusters6954lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6955worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6956worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6957lb: must succeed: curl -sf localhost:9901/clusters6958lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6959lb: must succeed: curl -sf localhost:9901/clusters6960lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)6961worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6962worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6963(finished: subtest: queue gauges show a burst while every build blocks, in 6.29 seconds)6964subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6965client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16966worker2 # [ 171.523878] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:599146967worker2 # [ 171.529361] nix-grpc-daemon[2075]: ts=2026-09-24T09:28:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:599146968worker1 # [ 171.552199] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:23Z level=debug event=want client=6 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06969worker1 # [ 171.558164] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:23Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16970worker1 # [ 171.562530] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:23Z level=debug event=want client=6 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06971worker1 # [ 171.567212] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:23Z level=debug event=want client=6 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06972worker1 # [ 171.571284] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386973worker1 # [ 171.579512] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508386974worker1 # [ 171.590714] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508386975worker1 # [ 171.602214] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6976worker1 # [ 171.701173] nix-daemon[849]: accepted connection from pid 1822, user nix-grpc-daemon (trusted)6977worker1 # [ 171.713486] nix-daemon[849]: reaped child process 1825, status = succeeded6978lb # [ 171.767615] niks3-server[1162]: 2026/09/24 09:28:23 INFO Received push request method=POST path=/api/pushes6979worker1 # [ 171.730510] nix-grpc-daemon[1545]: time=2026-09-24T09:28:23.868Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6980worker1 # [ 171.732478] nix-grpc-daemon[1545]: time=2026-09-24T09:28:23.869Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6981lb # [ 171.797875] niks3-server[1162]: 2026/09/24 09:28:23 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6982lb # [ 171.803367] niks3-server[1162]: 2026/09/24 09:28:23 INFO Received sign narinfos request method=POST path=/api/pushes/68/sign6983worker1 # [ 171.766816] nix-grpc-daemon[1545]: time=2026-09-24T09:28:23.904Z level=INFO msg="Uploading 1 narinfos"6984lb # [ 171.811977] niks3-server[1162]: 2026/09/24 09:28:23 INFO Signed narinfos id=68 count=16985lb # [ 171.816646] niks3-server[1162]: 2026/09/24 09:28:24 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6986lb # [ 171.829869] niks3-server[1162]: 2026/09/24 09:28:24 INFO Received complete push request method=POST path=/api/pushes/68/complete6987worker1 # [ 171.792542] nix-grpc-daemon[1545]: time=2026-09-24T09:28:23.930Z level=INFO msg="Upload complete. (179ms)"6988lb # [ 171.839827] niks3-server[1162]: 2026/09/24 09:28:24 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6989worker1 # [ 171.796654] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=5046990worker1 # [ 171.802286] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508386991worker1 # [ 171.811507] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6992worker1 # [ 171.819098] nix-daemon[849]: reaped child process 1820, status = succeeded6993worker1 # [ 171.822706] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)6994worker1 # [ 172.662195] nix-daemon[849]: reaped child process 1829, status = succeeded6995worker1 # [ 172.746090] nix-daemon[849]: accepted connection from pid 1845, user nix-grpc-daemon (trusted)6996worker1 # [ 172.759551] nix-daemon[849]: reaped child process 1848, status = succeeded6997lb # [ 172.810240] niks3-server[1162]: 2026/09/24 09:28:24 INFO Received push request method=POST path=/api/pushes6998worker1 # [ 172.775231] nix-grpc-daemon[1545]: time=2026-09-24T09:28:24.912Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6999worker1 # [ 172.777805] nix-grpc-daemon[1545]: time=2026-09-24T09:28:24.914Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"7000lb # [ 172.850357] niks3-server[1162]: 2026/09/24 09:28:25 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst7001lb # [ 172.857267] niks3-server[1162]: 2026/09/24 09:28:25 INFO Received sign narinfos request method=POST path=/api/pushes/69/sign7002worker1 # [ 172.817506] nix-grpc-daemon[1545]: time=2026-09-24T09:28:24.955Z level=INFO msg="Uploading 1 narinfos"7003lb # [ 172.862108] niks3-server[1162]: 2026/09/24 09:28:25 INFO Signed narinfos id=69 count=17004lb # [ 172.868995] niks3-server[1162]: 2026/09/24 09:28:25 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv7005lb # [ 172.870996] niks3-server[1162]: 2026/09/24 09:28:25 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls7006lb # [ 172.876245] niks3-server[1162]: 2026/09/24 09:28:25 INFO Received complete push request method=POST path=/api/pushes/69/complete7007worker1 # [ 172.835547] nix-grpc-daemon[1545]: time=2026-09-24T09:28:24.973Z level=INFO msg="Upload complete. (206ms)"7008lb # [ 172.881764] niks3-server[1162]: 2026/09/24 09:28:25 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo7009worker1 # [ 172.842349] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=07010worker1 # [ 172.850362] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:24Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=17011worker1 # [ 172.854328] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387012worker1 # [ 172.859558] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:24Z level=debug event=want client=6 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=07013worker1 # [ 172.866843] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508387014worker1 # [ 172.869137] nix-daemon[849]: reaped child process 1827, status = succeeded7015worker1 # [ 172.872522] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508387016worker1 # [ 172.877217] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7017worker1 # [ 172.961562] nix-daemon[849]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)7018worker1 # [ 172.974053] nix-daemon[849]: reaped child process 1857, status = succeeded7019lb # [ 173.027116] niks3-server[1162]: 2026/09/24 09:28:25 INFO Received push request method=POST path=/api/pushes7020worker1 # [ 172.990484] nix-grpc-daemon[1545]: time=2026-09-24T09:28:25.128Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7021worker1 # [ 172.992449] nix-grpc-daemon[1545]: time=2026-09-24T09:28:25.129Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"7022lb # [ 173.057847] niks3-server[1162]: 2026/09/24 09:28:25 INFO Received sign narinfos request method=POST path=/api/pushes/70/sign7023lb # [ 173.063867] niks3-server[1162]: 2026/09/24 09:28:25 INFO Signed narinfos id=70 count=17024worker1 # [ 173.021577] nix-grpc-daemon[1545]: time=2026-09-24T09:28:25.159Z level=INFO msg="Uploading 1 narinfos"7025lb # [ 173.071149] niks3-server[1162]: 2026/09/24 09:28:25 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls7026lb # [ 173.075239] niks3-server[1162]: 2026/09/24 09:28:25 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst7027lb # [ 173.084060] niks3-server[1162]: 2026/09/24 09:28:25 INFO Received complete push request method=POST path=/api/pushes/70/complete7028worker1 # [ 173.043174] nix-grpc-daemon[1545]: time=2026-09-24T09:28:25.180Z level=INFO msg="Upload complete. (161ms)"7029lb # [ 173.089366] niks3-server[1162]: 2026/09/24 09:28:25 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo7030worker1 # [ 173.045414] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=5047031worker1 # [ 173.049234] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387032worker1 # [ 173.057857] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7033worker1 # [ 173.060124] nix-daemon[849]: reaped child process 1852, status = succeeded7034worker1 # [ 173.065145] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7035worker1 # [ 173.903171] nix-daemon[849]: reaped child process 1861, status = succeeded7036worker1 # [ 173.981567] nix-daemon[849]: accepted connection from pid 1877, user nix-grpc-daemon (trusted)7037worker1 # [ 173.993732] nix-daemon[849]: reaped child process 1880, status = succeeded7038lb # [ 174.047763] niks3-server[1162]: 2026/09/24 09:28:26 INFO Received push request method=POST path=/api/pushes7039worker1 # [ 174.011869] nix-grpc-daemon[1545]: time=2026-09-24T09:28:26.149Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7040worker1 # [ 174.013425] nix-grpc-daemon[1545]: time=2026-09-24T09:28:26.151Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"7041lb # [ 174.090443] niks3-server[1162]: 2026/09/24 09:28:26 INFO Received sign narinfos request method=POST path=/api/pushes/71/sign7042worker1 # [ 174.059178] nix-grpc-daemon[1545]: time=2026-09-24T09:28:26.196Z level=INFO msg="Uploading 1 narinfos"7043lb # [ 174.104159] niks3-server[1162]: 2026/09/24 09:28:26 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls7044lb # [ 174.107280] niks3-server[1162]: 2026/09/24 09:28:26 INFO Signed narinfos id=71 count=17045lb # [ 174.114090] niks3-server[1162]: 2026/09/24 09:28:26 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv7046lb # [ 174.119349] niks3-server[1162]: 2026/09/24 09:28:26 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst7047lb # [ 174.126655] niks3-server[1162]: 2026/09/24 09:28:26 INFO Received complete push request method=POST path=/api/pushes/71/complete7048lb # [ 174.137465] niks3-server[1162]: 2026/09/24 09:28:26 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo7049worker1 # [ 174.091346] nix-grpc-daemon[1545]: time=2026-09-24T09:28:26.228Z level=INFO msg="Upload complete. (219ms)"7050worker1 # [ 174.101847] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=12 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=07051worker1 # [ 174.110490] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:26Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=17052worker1 # [ 174.116748] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387053worker1 # [ 174.120174] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:26Z level=debug event=want client=6 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=07054worker1 # [ 174.131915] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508387055worker1 # [ 174.134145] nix-daemon[849]: reaped child process 1859, status = succeeded7056worker1 # [ 174.138684] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508387057worker1 # [ 174.142392] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7058worker1 # [ 174.225440] nix-daemon[849]: accepted connection from pid 1886, user nix-grpc-daemon (trusted)7059worker1 # [ 174.239170] nix-daemon[849]: reaped child process 1889, status = succeeded7060lb # [ 174.291353] niks3-server[1162]: 2026/09/24 09:28:26 INFO Received push request method=POST path=/api/pushes7061worker1 # [ 174.254611] nix-grpc-daemon[1545]: time=2026-09-24T09:28:26.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7062worker1 # [ 174.257079] nix-grpc-daemon[1545]: time=2026-09-24T09:28:26.394Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"7063lb # [ 174.321805] niks3-server[1162]: 2026/09/24 09:28:26 INFO Received sign narinfos request method=POST path=/api/pushes/72/sign7064worker1 # [ 174.286409] nix-grpc-daemon[1545]: time=2026-09-24T09:28:26.424Z level=INFO msg="Uploading 1 narinfos"7065lb # [ 174.331270] niks3-server[1162]: 2026/09/24 09:28:26 INFO Signed narinfos id=72 count=17066lb # [ 174.335153] niks3-server[1162]: 2026/09/24 09:28:26 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls7067lb # [ 174.342599] niks3-server[1162]: 2026/09/24 09:28:26 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst7068lb # [ 174.355627] niks3-server[1162]: 2026/09/24 09:28:26 INFO Received complete push request method=POST path=/api/pushes/72/complete7069worker1 # [ 174.316384] nix-grpc-daemon[1545]: time=2026-09-24T09:28:26.454Z level=INFO msg="Upload complete. (168ms)"7070lb # [ 174.362506] niks3-server[1162]: 2026/09/24 09:28:26 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo7071worker1 # [ 174.320738] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=5047072worker1 # [ 174.325748] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387073worker1 # [ 174.336917] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7074worker1 # [ 174.342728] nix-daemon[849]: reaped child process 1884, status = succeeded7075worker1 # [ 174.345525] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7076lb # [ 174.987347] envoy[904]: conn peer=[2001:db8:1::1]:50296 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9682 tx=5189 ms=48387077worker1 # [ 175.381486] nix-daemon[849]: reaped child process 1893, status = succeeded7078worker1 # [ 175.458933] nix-daemon[849]: accepted connection from pid 1909, user nix-grpc-daemon (trusted)7079worker1 # [ 175.470434] nix-daemon[849]: reaped child process 1912, status = succeeded7080lb # [ 175.523140] niks3-server[1162]: 2026/09/24 09:28:27 INFO Received push request method=POST path=/api/pushes7081worker1 # [ 175.486416] nix-grpc-daemon[1545]: time=2026-09-24T09:28:27.624Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7082worker1 # [ 175.487901] nix-grpc-daemon[1545]: time=2026-09-24T09:28:27.625Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"7083lb # [ 175.566943] niks3-server[1162]: 2026/09/24 09:28:27 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv7084lb # [ 175.572242] niks3-server[1162]: 2026/09/24 09:28:27 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst7085lb # [ 175.577207] niks3-server[1162]: 2026/09/24 09:28:27 INFO Received sign narinfos request method=POST path=/api/pushes/73/sign7086worker1 # [ 175.535998] nix-grpc-daemon[1545]: time=2026-09-24T09:28:27.673Z level=INFO msg="Uploading 1 narinfos"7087lb # [ 175.581075] niks3-server[1162]: 2026/09/24 09:28:27 INFO Signed narinfos id=73 count=17088lb # [ 175.588170] niks3-server[1162]: 2026/09/24 09:28:27 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls7089lb # [ 175.598046] niks3-server[1162]: 2026/09/24 09:28:27 INFO Received complete push request method=POST path=/api/pushes/73/complete7090lb # [ 175.603656] niks3-server[1162]: 2026/09/24 09:28:27 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo7091worker1 # [ 175.557213] nix-grpc-daemon[1545]: time=2026-09-24T09:28:27.694Z level=INFO msg="Upload complete. (203ms)"7092worker1 # [ 175.567515] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=13 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=07093worker1 # [ 175.574328] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:27Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=17094worker1 # [ 175.578239] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387095worker1 # [ 175.581600] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:27Z level=debug event=want client=6 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=07096worker1 # [ 175.591301] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508387097worker1 # [ 175.593903] nix-daemon[849]: reaped child process 1891, status = succeeded7098worker1 # [ 175.598517] nix-grpc-daemon[1545]: time=2026-09-24T09:28:27.736Z level=INFO msg="All 1 paths already cached"7099worker1 # [ 175.602769] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508387100worker1 # [ 175.607101] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7101worker1 # [ 175.691656] nix-daemon[849]: accepted connection from pid 1918, user nix-grpc-daemon (trusted)7102worker1 # [ 175.704166] nix-daemon[849]: reaped child process 1921, status = succeeded7103lb # [ 175.756902] niks3-server[1162]: 2026/09/24 09:28:27 INFO Received push request method=POST path=/api/pushes7104worker1 # [ 175.719841] nix-grpc-daemon[1545]: time=2026-09-24T09:28:27.857Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7105worker1 # [ 175.721234] nix-grpc-daemon[1545]: time=2026-09-24T09:28:27.857Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"7106lb # [ 175.785212] niks3-server[1162]: 2026/09/24 09:28:27 INFO Received sign narinfos request method=POST path=/api/pushes/74/sign7107worker1 # [ 175.746234] nix-grpc-daemon[1545]: time=2026-09-24T09:28:27.883Z level=INFO msg="Uploading 1 narinfos"7108lb # [ 175.791310] niks3-server[1162]: 2026/09/24 09:28:27 INFO Signed narinfos id=74 count=17109lb # [ 175.800971] niks3-server[1162]: 2026/09/24 09:28:27 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst7110lb # [ 175.806569] niks3-server[1162]: 2026/09/24 09:28:27 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls7111lb # [ 175.817198] niks3-server[1162]: 2026/09/24 09:28:28 INFO Received complete push request method=POST path=/api/pushes/74/complete7112worker1 # [ 175.777758] nix-grpc-daemon[1545]: time=2026-09-24T09:28:27.915Z level=INFO msg="Upload complete. (165ms)"7113lb # [ 175.824615] niks3-server[1162]: 2026/09/24 09:28:28 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo7114worker1 # [ 175.780480] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=6247115worker1 # [ 175.785797] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387116worker1 # [ 175.796769] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7117worker1 # [ 175.802606] nix-daemon[849]: reaped child process 1916, status = succeeded7118worker1 # [ 175.805447] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7119worker1 # [ 176.840492] nix-daemon[849]: reaped child process 1925, status = succeeded7120worker1 # [ 176.925574] nix-daemon[849]: accepted connection from pid 1941, user nix-grpc-daemon (trusted)7121worker1 # [ 176.938094] nix-daemon[849]: reaped child process 1944, status = succeeded7122lb # [ 176.991906] niks3-server[1162]: 2026/09/24 09:28:29 INFO Received push request method=POST path=/api/pushes7123worker1 # [ 176.955604] nix-grpc-daemon[1545]: time=2026-09-24T09:28:29.093Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7124worker1 # [ 176.957096] nix-grpc-daemon[1545]: time=2026-09-24T09:28:29.094Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"7125lb # [ 177.031797] niks3-server[1162]: 2026/09/24 09:28:29 INFO Received sign narinfos request method=POST path=/api/pushes/75/sign7126lb # [ 177.039685] niks3-server[1162]: 2026/09/24 09:28:29 INFO Signed narinfos id=75 count=17127worker1 # [ 176.997854] nix-grpc-daemon[1545]: time=2026-09-24T09:28:29.135Z level=INFO msg="Uploading 1 narinfos"7128lb # [ 177.048687] niks3-server[1162]: 2026/09/24 09:28:29 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst7129lb # [ 177.055121] niks3-server[1162]: 2026/09/24 09:28:29 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv7130lb # [ 177.059890] niks3-server[1162]: 2026/09/24 09:28:29 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls7131lb # [ 177.068601] niks3-server[1162]: 2026/09/24 09:28:29 INFO Received complete push request method=POST path=/api/pushes/75/complete7132lb # [ 177.076485] niks3-server[1162]: 2026/09/24 09:28:29 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo7133worker1 # [ 177.030654] nix-grpc-daemon[1545]: time=2026-09-24T09:28:29.168Z level=INFO msg="Upload complete. (217ms)"7134worker1 # [ 177.038744] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=14 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=07135worker1 # [ 177.049664] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:29Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=17136worker1 # [ 177.054839] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387137worker1 # [ 177.058168] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:29Z level=debug event=want client=6 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=07138worker1 # [ 177.069314] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508387139worker1 # [ 177.071938] nix-daemon[849]: reaped child process 1923, status = succeeded7140worker1 # [ 177.076885] nix-grpc-daemon[1545]: time=2026-09-24T09:28:29.214Z level=INFO msg="All 1 paths already cached"7141worker1 # [ 177.081356] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508387142worker1 # [ 177.085056] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7143worker1 # [ 177.170861] nix-daemon[849]: accepted connection from pid 1950, user nix-grpc-daemon (trusted)7144worker1 # [ 177.184750] nix-daemon[849]: reaped child process 1953, status = succeeded7145lb # [ 177.235129] niks3-server[1162]: 2026/09/24 09:28:29 INFO Received push request method=POST path=/api/pushes7146worker1 # [ 177.199355] nix-grpc-daemon[1545]: time=2026-09-24T09:28:29.337Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7147worker1 # [ 177.200802] nix-grpc-daemon[1545]: time=2026-09-24T09:28:29.338Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"7148lb # [ 177.266651] niks3-server[1162]: 2026/09/24 09:28:29 INFO Received sign narinfos request method=POST path=/api/pushes/76/sign7149lb # [ 177.272122] niks3-server[1162]: 2026/09/24 09:28:29 INFO Signed narinfos id=76 count=17150worker1 # [ 177.230532] nix-grpc-daemon[1545]: time=2026-09-24T09:28:29.368Z level=INFO msg="Uploading 1 narinfos"7151lb # [ 177.281150] niks3-server[1162]: 2026/09/24 09:28:29 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls7152lb # [ 177.287735] niks3-server[1162]: 2026/09/24 09:28:29 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst7153lb # [ 177.297232] niks3-server[1162]: 2026/09/24 09:28:29 INFO Received complete push request method=POST path=/api/pushes/76/complete7154worker1 # [ 177.260509] nix-grpc-daemon[1545]: time=2026-09-24T09:28:29.398Z level=INFO msg="Upload complete. (169ms)"7155lb # [ 177.306253] niks3-server[1162]: 2026/09/24 09:28:29 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo7156worker1 # [ 177.262743] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=6247157worker1 # [ 177.267572] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387158worker1 # [ 177.278183] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7159worker1 # [ 177.279748] nix-daemon[849]: reaped child process 1948, status = succeeded7160worker1 # [ 177.285057] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7161worker1 # [ 178.322731] nix-daemon[849]: reaped child process 1957, status = succeeded7162worker1 # [ 178.399244] nix-daemon[849]: accepted connection from pid 1973, user nix-grpc-daemon (trusted)7163worker1 # [ 178.411602] nix-daemon[849]: reaped child process 1976, status = succeeded7164lb # [ 178.465565] niks3-server[1162]: 2026/09/24 09:28:30 INFO Received push request method=POST path=/api/pushes7165worker1 # [ 178.428491] nix-grpc-daemon[1545]: time=2026-09-24T09:28:30.566Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7166worker1 # [ 178.429955] nix-grpc-daemon[1545]: time=2026-09-24T09:28:30.567Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"7167lb # [ 178.507584] niks3-server[1162]: 2026/09/24 09:28:30 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv7168lb # [ 178.513552] niks3-server[1162]: 2026/09/24 09:28:30 INFO Received sign narinfos request method=POST path=/api/pushes/77/sign7169lb # [ 178.518616] niks3-server[1162]: 2026/09/24 09:28:30 INFO Signed narinfos id=77 count=17170worker1 # [ 178.477127] nix-grpc-daemon[1545]: time=2026-09-24T09:28:30.614Z level=INFO msg="Uploading 1 narinfos"7171lb # [ 178.523327] niks3-server[1162]: 2026/09/24 09:28:30 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst7172lb # [ 178.538136] niks3-server[1162]: 2026/09/24 09:28:30 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls7173lb # [ 178.544287] niks3-server[1162]: 2026/09/24 09:28:30 INFO Received complete push request method=POST path=/api/pushes/77/complete7174worker1 # [ 178.504236] nix-grpc-daemon[1545]: time=2026-09-24T09:28:30.641Z level=INFO msg="Upload complete. (211ms)"7175lb # [ 178.550685] niks3-server[1162]: 2026/09/24 09:28:30 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo7176worker1 # [ 178.512086] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=15 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=07177worker1 # [ 178.522286] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:30Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=17178worker1 # [ 178.528948] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387179worker1 # [ 178.533446] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:30Z level=debug event=want client=6 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=07180worker1 # [ 178.544349] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508387181worker1 # [ 178.547130] nix-daemon[849]: reaped child process 1955, status = succeeded7182worker1 # [ 178.552238] nix-grpc-daemon[1545]: time=2026-09-24T09:28:30.690Z level=INFO msg="All 1 paths already cached"7183worker1 # [ 178.556763] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508387184worker1 # [ 178.560631] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7185worker1 # [ 178.646507] nix-daemon[849]: accepted connection from pid 1982, user nix-grpc-daemon (trusted)7186worker1 # [ 178.659407] nix-daemon[849]: reaped child process 1985, status = succeeded7187lb # [ 178.711803] niks3-server[1162]: 2026/09/24 09:28:30 INFO Received push request method=POST path=/api/pushes7188worker1 # [ 178.675092] nix-grpc-daemon[1545]: time=2026-09-24T09:28:30.812Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7189worker1 # [ 178.677090] nix-grpc-daemon[1545]: time=2026-09-24T09:28:30.814Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"7190lb # [ 178.743470] niks3-server[1162]: 2026/09/24 09:28:30 INFO Received sign narinfos request method=POST path=/api/pushes/78/sign7191worker1 # [ 178.707776] nix-grpc-daemon[1545]: time=2026-09-24T09:28:30.845Z level=INFO msg="Uploading 1 narinfos"7192lb # [ 178.751989] niks3-server[1162]: 2026/09/24 09:28:30 INFO Signed narinfos id=78 count=17193lb # [ 178.756591] niks3-server[1162]: 2026/09/24 09:28:30 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls7194lb # [ 178.767112] niks3-server[1162]: 2026/09/24 09:28:30 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst7195lb # [ 178.773832] niks3-server[1162]: 2026/09/24 09:28:30 INFO Received complete push request method=POST path=/api/pushes/78/complete7196lb # [ 178.782680] niks3-server[1162]: 2026/09/24 09:28:30 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo7197worker1 # [ 178.736905] nix-grpc-daemon[1545]: time=2026-09-24T09:28:30.874Z level=INFO msg="Upload complete. (170ms)"7198worker1 # [ 178.740975] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=6247199worker1 # [ 178.745945] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387200worker1 # [ 178.756509] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7201worker1 # [ 178.760496] nix-daemon[849]: reaped child process 1980, status = succeeded7202worker1 # [ 178.765349] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7203worker1 # [ 179.606574] nix-daemon[849]: reaped child process 1989, status = succeeded7204worker1 # [ 179.684557] nix-daemon[849]: accepted connection from pid 2005, user nix-grpc-daemon (trusted)7205worker1 # [ 179.697224] nix-daemon[849]: reaped child process 2008, status = succeeded7206lb # [ 179.750569] niks3-server[1162]: 2026/09/24 09:28:31 INFO Received push request method=POST path=/api/pushes7207worker1 # [ 179.713888] nix-grpc-daemon[1545]: time=2026-09-24T09:28:31.851Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7208worker1 # [ 179.715388] nix-grpc-daemon[1545]: time=2026-09-24T09:28:31.853Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"7209lb # [ 179.795422] niks3-server[1162]: 2026/09/24 09:28:31 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls7210lb # [ 179.800364] niks3-server[1162]: 2026/09/24 09:28:31 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst7211lb # [ 179.806853] niks3-server[1162]: 2026/09/24 09:28:31 INFO Received sign narinfos request method=POST path=/api/pushes/79/sign7212worker1 # [ 179.766718] nix-grpc-daemon[1545]: time=2026-09-24T09:28:31.904Z level=INFO msg="Uploading 1 narinfos"7213lb # [ 179.811646] niks3-server[1162]: 2026/09/24 09:28:31 INFO Signed narinfos id=79 count=17214lb # [ 179.816218] niks3-server[1162]: 2026/09/24 09:28:32 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv7215lb # [ 179.826567] niks3-server[1162]: 2026/09/24 09:28:32 INFO Received complete push request method=POST path=/api/pushes/79/complete7216worker1 # [ 179.784885] nix-grpc-daemon[1545]: time=2026-09-24T09:28:31.922Z level=INFO msg="Upload complete. (212ms)"7217lb # [ 179.831079] niks3-server[1162]: 2026/09/24 09:28:32 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo7218worker1 # [ 179.791434] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=16 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=07219worker1 # [ 179.800369] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:31Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=17220worker1 # [ 179.806132] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387221worker1 # [ 179.809237] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:31Z level=debug event=want client=6 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=07222worker1 # [ 179.818043] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508387223worker1 # [ 179.820122] nix-daemon[849]: reaped child process 1987, status = succeeded7224worker1 # [ 179.826420] nix-grpc-daemon[1545]: time=2026-09-24T09:28:31.964Z level=INFO msg="All 2 paths already cached"7225worker1 # [ 179.830901] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508387226worker1 # [ 179.835867] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7227worker1 # [ 179.919795] nix-daemon[849]: accepted connection from pid 2014, user nix-grpc-daemon (trusted)7228worker1 # [ 179.932947] nix-daemon[849]: reaped child process 2017, status = succeeded7229lb # [ 179.984703] niks3-server[1162]: 2026/09/24 09:28:32 INFO Received push request method=POST path=/api/pushes7230worker1 # [ 179.947666] nix-grpc-daemon[1545]: time=2026-09-24T09:28:32.085Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7231worker1 # [ 179.949629] nix-grpc-daemon[1545]: time=2026-09-24T09:28:32.087Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"7232lb # [ 180.017367] niks3-server[1162]: 2026/09/24 09:28:32 INFO Received sign narinfos request method=POST path=/api/pushes/80/sign7233worker1 # [ 179.982117] nix-grpc-daemon[1545]: time=2026-09-24T09:28:32.119Z level=INFO msg="Uploading 1 narinfos"7234lb # [ 180.027336] niks3-server[1162]: 2026/09/24 09:28:32 INFO Signed narinfos id=80 count=17235lb # [ 180.030827] niks3-server[1162]: 2026/09/24 09:28:32 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls7236lb # [ 180.035803] niks3-server[1162]: 2026/09/24 09:28:32 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst7237lb # [ 180.049417] niks3-server[1162]: 2026/09/24 09:28:32 INFO Received complete push request method=POST path=/api/pushes/80/complete7238lb # [ 180.056531] niks3-server[1162]: 2026/09/24 09:28:32 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo7239worker1 # [ 180.014780] nix-grpc-daemon[1545]: time=2026-09-24T09:28:32.152Z level=INFO msg="Upload complete. (174ms)"7240worker1 # [ 180.019282] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=7527241worker1 # [ 180.025290] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387242worker1 # [ 180.035106] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7243worker1 # [ 180.044872] nix-daemon[849]: reaped child process 2012, status = succeeded7244worker1 # [ 180.049703] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7245worker1 # [ 180.881707] nix-daemon[849]: reaped child process 2021, status = succeeded7246worker1 # [ 180.957419] nix-daemon[849]: accepted connection from pid 2037, user nix-grpc-daemon (trusted)7247worker1 # [ 180.970178] nix-daemon[849]: reaped child process 2040, status = succeeded7248lb # [ 181.022808] niks3-server[1162]: 2026/09/24 09:28:33 INFO Received push request method=POST path=/api/pushes7249worker1 # [ 180.986190] nix-grpc-daemon[1545]: time=2026-09-24T09:28:33.123Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7250worker1 # [ 180.987896] nix-grpc-daemon[1545]: time=2026-09-24T09:28:33.125Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"7251lb # [ 181.065341] niks3-server[1162]: 2026/09/24 09:28:33 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv7252lb # [ 181.073376] niks3-server[1162]: 2026/09/24 09:28:33 INFO Received sign narinfos request method=POST path=/api/pushes/81/sign7253worker1 # [ 181.033844] nix-grpc-daemon[1545]: time=2026-09-24T09:28:33.171Z level=INFO msg="Uploading 1 narinfos"7254lb # [ 181.079755] niks3-server[1162]: 2026/09/24 09:28:33 INFO Signed narinfos id=81 count=17255lb # [ 181.084555] niks3-server[1162]: 2026/09/24 09:28:33 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst7256lb # [ 181.091595] niks3-server[1162]: 2026/09/24 09:28:33 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls7257lb # [ 181.103332] niks3-server[1162]: 2026/09/24 09:28:33 INFO Received complete push request method=POST path=/api/pushes/81/complete7258lb # [ 181.109315] niks3-server[1162]: 2026/09/24 09:28:33 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo7259worker1 # [ 181.063815] nix-grpc-daemon[1545]: time=2026-09-24T09:28:33.201Z level=INFO msg="Upload complete. (206ms)"7260worker1 # [ 181.070769] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=17 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=07261worker1 # [ 181.079973] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:33Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=17262worker1 # [ 181.084904] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387263worker1 # [ 181.097592] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508387264worker1 # [ 181.102692] nix-daemon[849]: reaped child process 2019, status = succeeded7265worker1 # [ 181.109648] nix-grpc-daemon[1545]: time=2026-09-24T09:28:33.247Z level=INFO msg="All 2 paths already cached"7266worker1 # [ 181.113975] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508387267worker1 # [ 181.117886] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7268worker1 # [ 181.201221] nix-daemon[849]: accepted connection from pid 2044, user nix-grpc-daemon (trusted)7269worker1 # [ 181.214357] nix-daemon[849]: reaped child process 2047, status = succeeded7270lb # [ 181.265351] niks3-server[1162]: 2026/09/24 09:28:33 INFO Received push request method=POST path=/api/pushes7271worker1 # [ 181.229377] nix-grpc-daemon[1545]: time=2026-09-24T09:28:33.367Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7272worker1 # [ 181.231409] nix-grpc-daemon[1545]: time=2026-09-24T09:28:33.368Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"7273lb # [ 181.293370] niks3-server[1162]: 2026/09/24 09:28:33 INFO Received sign narinfos request method=POST path=/api/pushes/82/sign7274worker1 # [ 181.255663] nix-grpc-daemon[1545]: time=2026-09-24T09:28:33.393Z level=INFO msg="Uploading 1 narinfos"7275lb # [ 181.300517] niks3-server[1162]: 2026/09/24 09:28:33 INFO Signed narinfos id=82 count=17276lb # [ 181.309434] niks3-server[1162]: 2026/09/24 09:28:33 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls7277lb # [ 181.314132] niks3-server[1162]: 2026/09/24 09:28:33 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst7278lb # [ 181.325736] niks3-server[1162]: 2026/09/24 09:28:33 INFO Received complete push request method=POST path=/api/pushes/82/complete7279worker1 # [ 181.288829] nix-grpc-daemon[1545]: time=2026-09-24T09:28:33.426Z level=INFO msg="Upload complete. (165ms)"7280lb # [ 181.335723] niks3-server[1162]: 2026/09/24 09:28:33 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo7281worker1 # [ 181.291707] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=7527282worker1 # [ 181.296309] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387283worker1 # [ 181.307580] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7284worker1 # [ 181.313367] nix-daemon[849]: reaped child process 2042, status = succeeded7285worker1 # [ 181.315953] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7286worker1 # [ 181.930100] nix-daemon[849]: reaped child process 2051, status = succeeded7287worker1 # [ 182.004772] nix-daemon[849]: accepted connection from pid 2067, user nix-grpc-daemon (trusted)7288worker1 # [ 182.017043] nix-daemon[849]: reaped child process 2070, status = succeeded7289lb # [ 182.069979] niks3-server[1162]: 2026/09/24 09:28:34 INFO Received push request method=POST path=/api/pushes7290worker1 # [ 182.033928] nix-grpc-daemon[1545]: time=2026-09-24T09:28:34.171Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7291worker1 # [ 182.035455] nix-grpc-daemon[1545]: time=2026-09-24T09:28:34.173Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"7292lb # [ 182.112692] niks3-server[1162]: 2026/09/24 09:28:34 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst7293lb # [ 182.120257] niks3-server[1162]: 2026/09/24 09:28:34 INFO Received sign narinfos request method=POST path=/api/pushes/83/sign7294lb # [ 182.124547] niks3-server[1162]: 2026/09/24 09:28:34 INFO Signed narinfos id=83 count=17295worker1 # [ 182.082785] nix-grpc-daemon[1545]: time=2026-09-24T09:28:34.220Z level=INFO msg="Uploading 1 narinfos"7296lb # [ 182.128586] niks3-server[1162]: 2026/09/24 09:28:34 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls7297lb # [ 182.138798] niks3-server[1162]: 2026/09/24 09:28:34 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv7298lb # [ 182.149533] niks3-server[1162]: 2026/09/24 09:28:34 INFO Received complete push request method=POST path=/api/pushes/83/complete7299worker1 # [ 182.109706] nix-grpc-daemon[1545]: time=2026-09-24T09:28:34.247Z level=INFO msg="Upload complete. (188ms)"7300lb # [ 182.155429] niks3-server[1162]: 2026/09/24 09:28:34 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo7301worker1 # [ 182.112318] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=18 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=07302worker1 # [ 182.116561] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:34Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=17303worker1 # [ 182.118908] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387304worker1 # [ 182.126062] nix-daemon[849]: reaped child process 2049, status = succeeded7305worker1 # [ 182.127531] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508387306worker1 # [ 182.133499] nix-grpc-daemon[1545]: time=2026-09-24T09:28:34.271Z level=INFO msg="All 2 paths already cached"7307worker1 # [ 182.137773] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:508387308worker1 # [ 182.146968] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7309worker1 # [ 182.230930] nix-daemon[849]: accepted connection from pid 2074, user nix-grpc-daemon (trusted)7310worker1 # [ 182.244139] nix-daemon[849]: reaped child process 2077, status = succeeded7311lb # [ 182.295169] niks3-server[1162]: 2026/09/24 09:28:34 INFO Received push request method=POST path=/api/pushes7312worker1 # [ 182.258845] nix-grpc-daemon[1545]: time=2026-09-24T09:28:34.396Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7313worker1 # [ 182.260966] nix-grpc-daemon[1545]: time=2026-09-24T09:28:34.398Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"7314lb # [ 182.326940] niks3-server[1162]: 2026/09/24 09:28:34 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst7315lb # [ 182.337464] niks3-server[1162]: 2026/09/24 09:28:34 INFO Received sign narinfos request method=POST path=/api/pushes/84/sign7316lb # [ 182.343870] niks3-server[1162]: 2026/09/24 09:28:34 INFO Signed narinfos id=84 count=17317worker1 # [ 182.302507] nix-grpc-daemon[1545]: time=2026-09-24T09:28:34.440Z level=INFO msg="Uploading 1 narinfos"7318lb # [ 182.349110] niks3-server[1162]: 2026/09/24 09:28:34 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls7319lb # [ 182.358724] niks3-server[1162]: 2026/09/24 09:28:34 INFO Received complete push request method=POST path=/api/pushes/84/complete7320lb # [ 182.366726] niks3-server[1162]: 2026/09/24 09:28:34 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo7321worker1 # [ 182.326693] nix-grpc-daemon[1545]: time=2026-09-24T09:28:34.464Z level=INFO msg="Upload complete. (174ms)"7322worker1 # [ 182.328880] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=0 paths=1 nar_bytes_in=7527323worker1 # [ 182.331645] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:508387324worker1 # [ 182.337135] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7325worker1 # [ 182.342530] nix-daemon[849]: reaped child process 2072, status = succeeded7326worker1 # [ 182.346698] nix-daemon[849]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)7327worker1 # [ 183.386918] nix-daemon[849]: reaped child process 2081, status = succeeded7328worker1 # [ 183.468089] nix-daemon[849]: accepted connection from pid 2097, user nix-grpc-daemon (trusted)7329worker1 # [ 183.480658] nix-daemon[849]: reaped child process 2100, status = succeeded7330lb # [ 183.533126] niks3-server[1162]: 2026/09/24 09:28:35 INFO Received push request method=POST path=/api/pushes7331worker1 # [ 183.497900] nix-grpc-daemon[1545]: time=2026-09-24T09:28:35.635Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7332worker1 # [ 183.499639] nix-grpc-daemon[1545]: time=2026-09-24T09:28:35.637Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"7333lb # [ 183.573200] niks3-server[1162]: 2026/09/24 09:28:35 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv7334lb # [ 183.583331] niks3-server[1162]: 2026/09/24 09:28:35 INFO Received sign narinfos request method=POST path=/api/pushes/85/sign7335worker1 # [ 183.544910] nix-grpc-daemon[1545]: time=2026-09-24T09:28:35.682Z level=INFO msg="Uploading 1 narinfos"7336lb # [ 183.590196] niks3-server[1162]: 2026/09/24 09:28:35 INFO Signed narinfos id=85 count=17337lb # [ 183.596883] niks3-server[1162]: 2026/09/24 09:28:35 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls7338lb # [ 183.603548] niks3-server[1162]: 2026/09/24 09:28:35 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst7339lb # [ 183.612104] niks3-server[1162]: 2026/09/24 09:28:35 INFO Received complete push request method=POST path=/api/pushes/85/complete7340lb # [ 183.619458] niks3-server[1162]: 2026/09/24 09:28:35 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo7341worker1 # [ 183.574164] nix-grpc-daemon[1545]: time=2026-09-24T09:28:35.711Z level=INFO msg="Upload complete. (220ms)"7342worker1 # [ 183.582290] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50838 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=19 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=07343worker1 # [ 183.597758] nix-daemon[849]: reaped child process 2079, status = succeeded7344client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 12.26 seconds)7345worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7346worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7347client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]'7348client # [ 183.719756] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features "[\"gpu\"]".7349client # Running as unit: gpu.service; invocation ID: 119660fa004e46fc9ac8d930a6a8b6d57350client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.06 seconds)7351lb: must succeed: curl -sf localhost:9901/clusters7352lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7353lb: must succeed: curl -sf localhost:9901/clusters7354lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7355worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7356client # [ 183.855688] nix[1583]: don't know how to build these paths:7357client # [ 183.856558] nix[1583]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv7358worker1 # [ 183.841234] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:508387359worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)7360worker1 # [ 183.845577] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:508387361client # [ 183.875101] nix[1583]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}, waiting up to 30s for a worker7362worker1 # [ 183.860941] nix-grpc-daemon[1445]: ts=2026-09-24T09:28:35Z level=debug event=want client=7 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=07363lb: must succeed: curl -sf localhost:9901/clusters7364lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7365lb: must succeed: curl -sf localhost:9901/clusters7366lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.02 seconds)7367worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7368lb # [ 184.987572] envoy[904]: conn peer=[2001:db8:1::1]:50304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27081 tx=12303 ms=120887369worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7370client: waiting for success: systemctl show -p Result gpu | grep -q exit-code7371client # [ 213.876290] nix[1583]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,kvm,nixos-test,vip}7372client # [ 213.885858] nix[1583]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed7373client # [ 213.914269] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE7374client # [ 213.917832] systemd[1]: gpu.service: Failed with result 'exit-code'.7375client # [ 213.921964] systemd[1]: gpu.service: Consumed 153ms CPU time over 30.198s wall clock time, 37.7M memory peak, 5.6K incoming IP traffic, 5.2K outgoing IP traffic.7376client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.41 seconds)7377client: must succeed: journalctl -u gpu -o cat7378client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds)7379lb: must succeed: curl -sf localhost:9901/clusters7380lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)7381lb: must succeed: curl -sf localhost:9901/clusters7382lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)7383worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7384worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)7385(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 43.15 seconds)7386subtest: low disk drains a worker and builds go to the other7387worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill7388lb # [ 214.989977] envoy[904]: conn peer=[2001:db8:1::1]:42572 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=929 tx=596 ms=300397389worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.91 seconds)7390worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'7391worker1 # [ 215.734351] nix-grpc-daemon[1445]: ts=2026-09-24T09:29:07Z level=info event=unhealthy reason=min_free7392worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds)7393client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&27394client # don't know how to build these paths:7395client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7396worker2 # [ 216.660819] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:599147397worker2 # [ 216.666265] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:599147398worker1 # [ 216.669185] nix-grpc-daemon[1445]: ts=2026-09-24T09:29:08Z level=debug event=want client=8 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=07399worker2 # [ 216.684868] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599147400worker1 # [ 216.673836] nix-grpc-daemon[1445]: ts=2026-09-24T09:29:08Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=17401worker2 # [ 216.694286] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:599147402client # copying 1 paths to 'lb:50051'...7403client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...7404worker2 # [ 216.703773] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:599147405worker2 # [ 216.712768] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7406worker2 # [ 216.809898] nix-daemon[869]: accepted connection from pid 2230, user nix-grpc-daemon (trusted)7407worker2 # [ 216.822670] nix-daemon[869]: reaped child process 2233, status = succeeded7408lb # [ 216.860236] niks3-server[1162]: 2026/09/24 09:29:09 INFO Received push request method=POST path=/api/pushes7409worker2 # [ 216.834310] nix-grpc-daemon[2135]: time=2026-09-24T09:29:09.041Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7410worker2 # [ 216.836373] nix-grpc-daemon[2135]: time=2026-09-24T09:29:09.042Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"7411lb # [ 216.877872] niks3-server[1162]: 2026/09/24 09:29:09 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst7412lb # [ 216.887692] niks3-server[1162]: 2026/09/24 09:29:09 INFO Received sign narinfos request method=POST path=/api/pushes/86/sign7413lb # [ 216.890187] niks3-server[1162]: 2026/09/24 09:29:09 INFO Signed narinfos id=86 count=17414worker2 # [ 216.859180] nix-grpc-daemon[2135]: time=2026-09-24T09:29:09.066Z level=INFO msg="Uploading 1 narinfos"7415lb # [ 216.893282] niks3-server[1162]: 2026/09/24 09:29:09 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls7416lb # [ 216.899775] niks3-server[1162]: 2026/09/24 09:29:09 INFO Received complete push request method=POST path=/api/pushes/86/complete7417worker2 # [ 216.875040] nix-grpc-daemon[2135]: time=2026-09-24T09:29:09.082Z level=INFO msg="Upload complete. (148ms)"7418lb # [ 216.907070] niks3-server[1162]: 2026/09/24 09:29:09 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo7419worker2 # [ 216.877226] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=0 paths=1 nar_bytes_in=5127420worker2 # [ 216.880251] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599147421worker2 # [ 216.886974] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7422worker2 # [ 216.889505] nix-daemon[869]: reaped child process 2228, status = succeeded7423client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...7424worker2 # [ 216.894176] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7425client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv7426client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds7427client # farm-a> LOG-farm-a-drain7428worker2 # [ 218.338325] nix-daemon[869]: reaped child process 2237, status = succeeded7429worker2 # [ 218.413108] nix-daemon[869]: accepted connection from pid 2253, user nix-grpc-daemon (trusted)7430worker2 # [ 218.431916] nix-daemon[869]: reaped child process 2256, status = succeeded7431lb # [ 218.467616] niks3-server[1162]: 2026/09/24 09:29:10 INFO Received push request method=POST path=/api/pushes7432worker2 # [ 218.442171] nix-grpc-daemon[2135]: time=2026-09-24T09:29:10.648Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7433worker2 # [ 218.445478] nix-grpc-daemon[2135]: time=2026-09-24T09:29:10.650Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"7434lb # [ 218.487328] niks3-server[1162]: 2026/09/24 09:29:10 INFO Received sign narinfos request method=POST path=/api/pushes/87/sign7435lb # [ 218.489442] niks3-server[1162]: 2026/09/24 09:29:10 INFO Signed narinfos id=87 count=17436worker2 # [ 218.458195] nix-grpc-daemon[2135]: time=2026-09-24T09:29:10.665Z level=INFO msg="Uploading 1 narinfos"7437lb # [ 218.493593] niks3-server[1162]: 2026/09/24 09:29:10 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7438lb # [ 218.496748] niks3-server[1162]: 2026/09/24 09:29:10 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv7439lb # [ 218.501957] niks3-server[1162]: 2026/09/24 09:29:10 INFO Received complete push request method=POST path=/api/pushes/87/complete7440lb # [ 218.503494] niks3-server[1162]: 2026/09/24 09:29:10 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls7441worker2 # [ 218.478043] nix-grpc-daemon[2135]: time=2026-09-24T09:29:10.685Z level=INFO msg="Upload complete. (176ms)"7442lb # [ 218.511151] niks3-server[1162]: 2026/09/24 09:29:10 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo7443worker2 # [ 218.481136] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=20 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=07444worker2 # [ 218.490083] nix-daemon[869]: reaped child process 2235, status = succeeded7445worker1 # [ 218.475812] nix-grpc-daemon[1445]: ts=2026-09-24T09:29:10Z level=debug event=want client=8 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=07446worker2 # [ 218.496050] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599147447worker1 # [ 218.480560] nix-grpc-daemon[1445]: ts=2026-09-24T09:29:10Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=17448worker2 # [ 218.501964] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:599147449worker2 # [ 218.507932] nix-grpc-daemon[2135]: time=2026-09-24T09:29:10.715Z level=INFO msg="All 1 paths already cached"7450client # copying 1 paths to 'lb:50051'...7451worker2 # [ 218.512839] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:599147452client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...7453worker2 # [ 218.517875] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7454worker2 # [ 218.613101] nix-daemon[869]: accepted connection from pid 2260, user nix-grpc-daemon (trusted)7455worker2 # [ 218.628730] nix-daemon[869]: reaped child process 2263, status = succeeded7456lb # [ 218.666713] niks3-server[1162]: 2026/09/24 09:29:10 INFO Received push request method=POST path=/api/pushes7457worker2 # [ 218.640240] nix-grpc-daemon[2135]: time=2026-09-24T09:29:10.847Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7458worker2 # [ 218.642291] nix-grpc-daemon[2135]: time=2026-09-24T09:29:10.848Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"7459lb # [ 218.680970] niks3-server[1162]: 2026/09/24 09:29:10 INFO Received sign narinfos request method=POST path=/api/pushes/88/sign7460lb # [ 218.683471] niks3-server[1162]: 2026/09/24 09:29:10 INFO Signed narinfos id=88 count=17461worker2 # [ 218.652750] nix-grpc-daemon[2135]: time=2026-09-24T09:29:10.859Z level=INFO msg="Uploading 1 narinfos"7462lb # [ 218.687745] niks3-server[1162]: 2026/09/24 09:29:10 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls7463lb # [ 218.691181] niks3-server[1162]: 2026/09/24 09:29:10 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst7464lb # [ 218.693676] niks3-server[1162]: 2026/09/24 09:29:10 INFO Received complete push request method=POST path=/api/pushes/88/complete7465worker2 # [ 218.668337] nix-grpc-daemon[2135]: time=2026-09-24T09:29:10.875Z level=INFO msg="Upload complete. (144ms)"7466lb # [ 218.700970] niks3-server[1162]: 2026/09/24 09:29:10 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo7467worker2 # [ 218.670650] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=0 paths=1 nar_bytes_in=6247468worker2 # [ 218.674246] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599147469worker2 # [ 218.682623] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7470worker2 # [ 218.687170] nix-daemon[869]: reaped child process 2258, status = succeeded7471worker2 # [ 218.690265] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7472client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...7473client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7474client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7475client # farm-b> LOG-farm-b-drain7476worker2 # [ 219.932876] nix-daemon[869]: reaped child process 2267, status = succeeded7477worker2 # [ 220.020106] nix-daemon[869]: accepted connection from pid 2283, user nix-grpc-daemon (trusted)7478worker2 # [ 220.034600] nix-daemon[869]: reaped child process 2286, status = succeeded7479lb # [ 220.072359] niks3-server[1162]: 2026/09/24 09:29:12 INFO Received push request method=POST path=/api/pushes7480worker2 # [ 220.046229] nix-grpc-daemon[2135]: time=2026-09-24T09:29:12.253Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7481worker2 # [ 220.048411] nix-grpc-daemon[2135]: time=2026-09-24T09:29:12.254Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"7482lb # [ 220.095619] niks3-server[1162]: 2026/09/24 09:29:12 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls7483lb # [ 220.099626] niks3-server[1162]: 2026/09/24 09:29:12 INFO Received sign narinfos request method=POST path=/api/pushes/89/sign7484lb # [ 220.101659] niks3-server[1162]: 2026/09/24 09:29:12 INFO Signed narinfos id=89 count=17485worker2 # [ 220.070778] nix-grpc-daemon[2135]: time=2026-09-24T09:29:12.277Z level=INFO msg="Uploading 1 narinfos"7486lb # [ 220.103404] niks3-server[1162]: 2026/09/24 09:29:12 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst7487lb # [ 220.109826] niks3-server[1162]: 2026/09/24 09:29:12 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv7488lb # [ 220.112713] niks3-server[1162]: 2026/09/24 09:29:12 INFO Received complete push request method=POST path=/api/pushes/89/complete7489worker2 # [ 220.086259] nix-grpc-daemon[2135]: time=2026-09-24T09:29:12.293Z level=INFO msg="Upload complete. (186ms)"7490lb # [ 220.118310] niks3-server[1162]: 2026/09/24 09:29:12 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo7491worker2 # [ 220.089306] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=21 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=07492worker2 # [ 220.097724] nix-daemon[869]: reaped child process 2265, status = succeeded7493worker1 # [ 220.082830] nix-grpc-daemon[1445]: ts=2026-09-24T09:29:12Z level=debug event=want client=8 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=07494worker2 # [ 220.103499] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599147495worker1 # [ 220.088440] nix-grpc-daemon[1445]: ts=2026-09-24T09:29:12Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=17496worker2 # [ 220.109646] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:599147497worker2 # [ 220.116198] nix-grpc-daemon[2135]: time=2026-09-24T09:29:12.323Z level=INFO msg="All 2 paths already cached"7498client # copying 1 paths to 'lb:50051'...7499worker2 # [ 220.121386] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:599147500client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...7501worker2 # [ 220.127404] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7502worker2 # [ 220.221940] nix-daemon[869]: accepted connection from pid 2290, user nix-grpc-daemon (trusted)7503worker2 # [ 220.237078] nix-daemon[869]: reaped child process 2293, status = succeeded7504lb # [ 220.276451] niks3-server[1162]: 2026/09/24 09:29:12 INFO Received push request method=POST path=/api/pushes7505worker2 # [ 220.253591] nix-grpc-daemon[2135]: time=2026-09-24T09:29:12.460Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7506worker2 # [ 220.255824] nix-grpc-daemon[2135]: time=2026-09-24T09:29:12.462Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"7507lb # [ 220.308267] niks3-server[1162]: 2026/09/24 09:29:12 INFO Received sign narinfos request method=POST path=/api/pushes/90/sign7508lb # [ 220.313394] niks3-server[1162]: 2026/09/24 09:29:12 INFO Signed narinfos id=90 count=17509worker2 # [ 220.285434] nix-grpc-daemon[2135]: time=2026-09-24T09:29:12.492Z level=INFO msg="Uploading 1 narinfos"7510lb # [ 220.322288] niks3-server[1162]: 2026/09/24 09:29:12 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls7511lb # [ 220.327232] niks3-server[1162]: 2026/09/24 09:29:12 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst7512lb # [ 220.343106] niks3-server[1162]: 2026/09/24 09:29:12 INFO Received complete push request method=POST path=/api/pushes/90/complete7513worker2 # [ 220.317765] nix-grpc-daemon[2135]: time=2026-09-24T09:29:12.524Z level=INFO msg="Upload complete. (183ms)"7514lb # [ 220.349946] niks3-server[1162]: 2026/09/24 09:29:12 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo7515worker2 # [ 220.321986] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=0 paths=1 nar_bytes_in=7527516worker2 # [ 220.327443] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:599147517worker2 # [ 220.336251] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7518worker2 # [ 220.343384] nix-daemon[869]: reaped child process 2288, status = succeeded7519worker2 # [ 220.348484] nix-daemon[869]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7520client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...7521client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7522client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7523client # farm-top> LOG-farm-top-drain7524worker2 # [ 220.965099] nix-daemon[869]: reaped child process 2297, status = succeeded7525worker2 # [ 221.047630] nix-daemon[869]: accepted connection from pid 2313, user nix-grpc-daemon (trusted)7526worker2 # [ 221.062905] nix-daemon[869]: reaped child process 2316, status = succeeded7527lb # [ 221.102940] niks3-server[1162]: 2026/09/24 09:29:13 INFO Received push request method=POST path=/api/pushes7528worker2 # [ 221.080130] nix-grpc-daemon[2135]: time=2026-09-24T09:29:13.286Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7529worker2 # [ 221.083059] nix-grpc-daemon[2135]: time=2026-09-24T09:29:13.288Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"7530lb # [ 221.142520] niks3-server[1162]: 2026/09/24 09:29:13 INFO Received sign narinfos request method=POST path=/api/pushes/91/sign7531worker2 # [ 221.123951] nix-grpc-daemon[2135]: time=2026-09-24T09:29:13.330Z level=INFO msg="Uploading 1 narinfos"7532lb # [ 221.155547] niks3-server[1162]: 2026/09/24 09:29:13 INFO Signed narinfos id=91 count=17533lb # [ 221.159532] niks3-server[1162]: 2026/09/24 09:29:13 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7534lb # [ 221.164626] niks3-server[1162]: 2026/09/24 09:29:13 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls7535lb # [ 221.169559] niks3-server[1162]: 2026/09/24 09:29:13 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst7536lb # [ 221.180414] niks3-server[1162]: 2026/09/24 09:29:13 INFO Received complete push request method=POST path=/api/pushes/91/complete7537lb # [ 221.190177] niks3-server[1162]: 2026/09/24 09:29:13 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo7538worker2 # [ 221.158300] nix-grpc-daemon[2135]: time=2026-09-24T09:29:13.365Z level=INFO msg="Upload complete. (203ms)"7539worker2 # [ 221.164863] nix-grpc-daemon[2075]: ts=2026-09-24T09:29:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59914 duration_s=0 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=22 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=07540worker2 # [ 221.180982] nix-daemon[869]: reaped child process 2295, status = succeeded7541client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.pem&client-key=/nix/store/pp86g1qg7pz3xz5b0jg8c12b7nz5nsbd-farm-certs/ci.key' --eval-store auto -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain >&2, in 4.68 seconds)7542client: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath7543client: (finished: must succeed: nix eval --raw -f /nix/store/1v3figrsha1j7bs9k2jhjd61g006bb3c-job.nix --argstr tag drain outPath, in 0.12 seconds)7544worker1: must succeed: rm /nix/.rw-store/fill7545worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)7546worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7547worker1 # [ 221.742490] nix-grpc-daemon[1445]: ts=2026-09-24T09:29:13Z level=info event=healthy reason=min_free7548worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds)7549(finished: subtest: low disk drains a worker and builds go to the other, in 8.05 seconds)7550(finished: run the VM test script, in 224.36 seconds)7551test script finished in 224.54s7552cleanup7553kill QemuMachine (pid 49)7554client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7555client # [2026-09-24T09:29:14Z INFO virtiofsd] Client disconnected, shutting down7556client # [2026-09-24T09:29:14Z INFO virtiofsd] Client disconnected, shutting down7557client # [2026-09-24T09:29:14Z INFO virtiofsd] Client disconnected, shutting down7558kill QemuMachine (pid 50)7559lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7560lb # [2026-09-24T09:29:15Z INFO virtiofsd] Client disconnected, shutting down7561lb # [2026-09-24T09:29:15Z INFO virtiofsd] Client disconnected, shutting down7562lb # [2026-09-24T09:29:15Z INFO virtiofsd] Client disconnected, shutting down7563kill QemuMachine (pid 51)7564worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7565worker1 # [2026-09-24T09:29:15Z INFO virtiofsd] Client disconnected, shutting down7566worker1 # [2026-09-24T09:29:15Z INFO virtiofsd] Client disconnected, shutting down7567worker1 # [2026-09-24T09:29:15Z INFO virtiofsd] Client disconnected, shutting down7568kill QemuMachine (pid 52)7569worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)7570worker2 # [2026-09-24T09:29:15Z INFO virtiofsd] Client disconnected, shutting down7571worker2 # [2026-09-24T09:29:15Z INFO virtiofsd] Client disconnected, shutting down7572worker2 # [2026-09-24T09:29:15Z INFO virtiofsd] Client disconnected, shutting down7573(finished: cleanup, in 0.97 seconds)7574additionally exposed symbols:7575 client, lb, worker1, worker2,7576 vlan1,7577 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh