vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #313
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client: QEMU running (pid 50)14worker2 # Disk image does not exist, creating the virtualisation disk image...15worker2: QEMU running (pid 52)16worker2 # Formatting '/build/vm-state-worker2/tmp.hav9EAym9l', fmt=raw size=107374182417client # Formatting '/build/vm-state-client/tmp.zc5jz6cXzX', fmt=raw size=107374182418worker2 # mke2fs 1.47.4 (6-Mar-2025)19client # mke2fs 1.47.4 (6-Mar-2025)20worker2 # Discarding device blocks: 0/262144 done21lb: QEMU running (pid 51)22lb # Disk image does not exist, creating the virtualisation disk image...23lb # Formatting '/build/vm-state-lb/tmp.eaeyXjG3Cr', fmt=raw size=107374182424lb # mke2fs 1.47.4 (6-Mar-2025)25lb # Discarding device blocks: 0/262144 done26client # Discarding device blocks: 0/262144 done27worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes28lb # Creating filesystem with 262144 4k blocks and 65536 inodes29client # Creating filesystem with 262144 4k blocks and 65536 inodes30worker2 # Filesystem UUID: a5e13f28-89c5-4b91-b24c-5fddc181009631lb # Filesystem UUID: 9827e334-2427-4168-a316-f3a5607351b332client # Filesystem UUID: 2d604846-cb33-4aa2-9995-d5095859d84b33worker2 # Superblock backups stored on blocks:34lb # Superblock backups stored on blocks:35client # Superblock backups stored on blocks:36worker2 # 32768, 98304, 163840, 22937637lb # 32768, 98304, 163840, 22937638client # 32768, 98304, 163840, 22937639worker2 # 40lb # 41client # 42worker2 # Allocating group tables: 0/8 done43lb # Allocating group tables: 0/8 done44client # Allocating group tables: 0/8 done45worker2 # Writing inode tables: 0/8 done46lb # Writing inode tables: 0/8 done47client # Writing inode tables: 0/8 done48worker2 # Creating journal (8192 blocks): done49lb # Creating journal (8192 blocks): done50client # Creating journal (8192 blocks): done51worker2 # Writing superblocks and filesystem accounting information: 0/8 done52lb # Writing superblocks and filesystem accounting information: 0/8 done53client # Writing superblocks and filesystem accounting information: 0/8 done54worker2 # 55lb # 56client # 57worker2 # Virtualisation disk image created.58lb # Virtualisation disk image created.59client # Virtualisation disk image created.60worker1 # Disk image does not exist, creating the virtualisation disk image...61worker1: QEMU running (pid 49)62worker1 # Formatting '/build/vm-state-worker1/tmp.5kyFb5C8QT', fmt=raw size=107374182463worker1 # mke2fs 1.47.4 (6-Mar-2025)64worker1 # Discarding device blocks: 0/262144 done65worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes66worker1 # Filesystem UUID: b13c2985-688a-4552-9167-d87a5db2af5267worker1 # Superblock backups stored on blocks:68worker1 # 32768, 98304, 163840, 22937669worker1 # 70worker1 # Allocating group tables: 0/8 done71worker1 # Writing inode tables: 0/8 done72worker1 # Creating journal (8192 blocks): done73worker1 # Writing superblocks and filesystem accounting information: 0/8 done74worker1 # 75worker1 # Virtualisation disk image created.76(finished: start all VMs, in 0.24 seconds)77client: waiting for unit network-addresses-eth1.service78client: waiting for the VM to finish booting79worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker2 # 84worker2 # 85client # 86client # 87worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0088client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...90worker2 # 91worker2 # 92worker2 # 93worker2 # 94client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...95client # 96client # 97client # 98client # 99worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00100client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00101worker1 # 102worker1 # 103worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00104worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105worker2 # 106worker2 # 107client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...108client # 109client # 110lb # 111lb # 112worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...113worker1 # 114worker1 # 115worker1 # 116worker1 # 117lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00118worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00119lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...120lb # 121lb # 122lb # 123lb # 124lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00125worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...126worker1 # 127worker1 # 128lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129lb # 130lb # 131client # Booting from ROM...132worker2 # Booting from ROM...133worker1 # Booting from ROM...134lb # Booting from ROM...135worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026137worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/v52vz29636q5v9vkbg5mvds1sg0spc18-nixos-system-worker2-test/init regInfo=/nix/store/09f5rg1zlf2xj73cixpi2zq4w4970in7-closure-info/registration console=ttyS0,115200n8 console=tty0138client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test/init regInfo=/nix/store/rnw9wiiddpcs8mxc1hyrq4v8z6kvsy0c-closure-info/registration console=ttyS0,115200n8 console=tty0139worker2 # [ 0.000000] BIOS-provided physical RAM map:140client # [ 0.000000] BIOS-provided physical RAM map:141worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable142client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable143worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved144client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved145worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved146client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved147worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable148client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable149worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved150client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved151worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved152client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved153worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved154client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved155worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved156client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved157worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved158client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved159worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved160client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved161worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026162worker2 # [ 0.000000] NX (Execute Disable) protection: active163client # [ 0.000000] NX (Execute Disable) protection: active164worker2 # [ 0.000000] APIC: Static calls initialized165client # [ 0.000000] APIC: Static calls initialized166worker2 # [ 0.000000] SMBIOS 2.8 present.167client # [ 0.000000] SMBIOS 2.8 present.168worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014169client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014170worker2 # [ 0.000000] DMI: Memory slots populated: 1/1171client # [ 0.000000] DMI: Memory slots populated: 1/1172worker2 # [ 0.000000] Hypervisor detected: KVM173client # [ 0.000000] Hypervisor detected: KVM174worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/32z47cdh4wsgk78pfxg163gygb7hgis3-nixos-system-worker1-test/init regInfo=/nix/store/hnvzgpjwyv1a6wsajpyr3idwpr3v1603-closure-info/registration console=ttyS0,115200n8 console=tty0175worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000176worker1 # [ 0.000000] BIOS-provided physical RAM map:177client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000178worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00179client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00180worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable181worker2 # [ 0.000000] kvm-clock: using sched offset of 475196584 cycles182client # [ 0.000001] kvm-clock: using sched offset of 471391723 cycles183worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved184lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026185worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns186worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved187client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns188worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor189client # [ 0.000005] tsc: Detected 2400.012 MHz processor190worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable191worker2 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000192client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000193worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved194worker2 # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs195client # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs196worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved197worker2 # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT198client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT199lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0200worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved201worker2 # [ 0.002736] found SMP MP-table at [mem 0x000f5450-0x000f545f]202lb # [ 0.000000] BIOS-provided physical RAM map:203client # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f]204worker2 # [ 0.002748] Using GB pages for direct mapping205worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved206client # [ 0.002749] Using GB pages for direct mapping207lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable208worker2 # [ 0.002840] RAMDISK: [mem 0x5e367000-0x5ffcffff]209client # [ 0.002868] RAMDISK: [mem 0x5e366000-0x5ffcffff]210worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved211worker2 # [ 0.002849] ACPI: Early table checksum verification disabled212lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved213client # [ 0.002876] ACPI: Early table checksum verification disabled214worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved215worker2 # [ 0.002853] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )216lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved217client # [ 0.002880] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )218worker1 # [ 0.000000] NX (Execute Disable) protection: active219worker1 # [ 0.000000] APIC: Static calls initialized220worker2 # [ 0.002856] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)221lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable222client # [ 0.002884] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)223worker1 # [ 0.000000] SMBIOS 2.8 present.224lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved225worker2 # [ 0.002861] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)226client # [ 0.002888] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)227worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014228lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved229worker2 # [ 0.002868] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)230worker1 # [ 0.000000] DMI: Memory slots populated: 1/1231client # [ 0.002895] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)232lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved233worker2 # [ 0.002870] ACPI: FACS 0x000000005FFE0000 000040234client # [ 0.002898] ACPI: FACS 0x000000005FFE0000 000040235worker1 # [ 0.000000] Hypervisor detected: KVM236lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved237worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000238worker2 # [ 0.002871] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)239worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00240client # [ 0.002899] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)241lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved242worker1 # [ 0.000000] kvm-clock: using sched offset of 467774872 cycles243worker2 # [ 0.002873] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)244client # [ 0.002901] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)245lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved246worker2 # [ 0.002874] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)247lb # [ 0.000000] NX (Execute Disable) protection: active248worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns249client # [ 0.002902] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)250lb # [ 0.000000] APIC: Static calls initialized251worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor252lb # [ 0.000000] SMBIOS 2.8 present.253worker2 # [ 0.002876] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)254client # [ 0.002904] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)255worker1 # [ 0.000835] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000256worker2 # [ 0.002877] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]257lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014258client # [ 0.002905] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]259worker1 # [ 0.000872] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs260lb # [ 0.000000] DMI: Memory slots populated: 1/1261worker2 # [ 0.002878] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]262client # [ 0.002906] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]263lb # [ 0.000000] Hypervisor detected: KVM264worker1 # [ 0.000875] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT265worker2 # [ 0.002879] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]266lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000267client # [ 0.002907] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]268worker1 # [ 0.002764] found SMP MP-table at [mem 0x000f5450-0x000f545f]269lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00270worker2 # [ 0.002879] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]271worker1 # [ 0.002779] Using GB pages for direct mapping272client # [ 0.002907] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]273worker1 # [ 0.002864] RAMDISK: [mem 0x5e367000-0x5ffcffff]274lb # [ 0.000000] kvm-clock: using sched offset of 476643926 cycles275worker2 # [ 0.002880] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]276client # [ 0.002908] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]277worker1 # [ 0.002875] ACPI: Early table checksum verification disabled278worker2 # [ 0.002880] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]279lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns280worker1 # [ 0.002879] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )281client # [ 0.002908] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]282lb # [ 0.000005] tsc: Detected 2400.012 MHz processor283worker2 # [ 0.002880] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]284client # [ 0.002909] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]285worker2 # [ 0.003111] No NUMA configuration found286worker1 # [ 0.002883] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)287lb # [ 0.000805] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000288client # [ 0.003137] No NUMA configuration found289worker2 # [ 0.003112] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]290worker1 # [ 0.002888] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)291lb # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs292client # [ 0.003138] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]293worker2 # [ 0.003115] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]294client # [ 0.003140] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]295worker2 # [ 0.005555] Zone ranges:296lb # [ 0.000835] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT297client # [ 0.005597] Zone ranges:298worker1 # [ 0.002896] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)299worker2 # [ 0.005556] DMA [mem 0x0000000000001000-0x0000000000ffffff]300lb # [ 0.002728] found SMP MP-table at [mem 0x000f5450-0x000f545f]301worker1 # [ 0.002898] ACPI: FACS 0x000000005FFE0000 000040302client # [ 0.005598] DMA [mem 0x0000000000001000-0x0000000000ffffff]303lb # [ 0.002740] Using GB pages for direct mapping304worker2 # [ 0.005558] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]305worker2 # [ 0.005559] Normal empty306client # [ 0.005600] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]307worker1 # [ 0.002900] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)308lb # [ 0.002826] RAMDISK: [mem 0x5e367000-0x5ffcffff]309client # [ 0.005601] Normal empty310worker2 # [ 0.005560] Device empty311client # [ 0.005602] Device empty312lb # [ 0.002834] ACPI: Early table checksum verification disabled313worker2 # [ 0.005561] Movable zone start for each node314worker1 # [ 0.002901] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)315client # [ 0.005603] Movable zone start for each node316worker2 # [ 0.005561] Early memory node ranges317lb # [ 0.002837] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )318client # [ 0.005603] Early memory node ranges319worker2 # [ 0.005562] node 0: [mem 0x0000000000001000-0x000000000009efff]320worker1 # [ 0.002903] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)321client # [ 0.005604] node 0: [mem 0x0000000000001000-0x000000000009efff]322lb # [ 0.002842] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)323worker2 # [ 0.005563] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]324client # [ 0.005605] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]325worker1 # [ 0.002905] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)326lb # [ 0.002846] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)327worker2 # [ 0.005564] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]328worker1 # [ 0.002906] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]329client # [ 0.005606] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]330worker2 # [ 0.005586] On node 0, zone DMA: 1 pages in unavailable ranges331lb # [ 0.002853] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)332client # [ 0.005631] On node 0, zone DMA: 1 pages in unavailable ranges333worker1 # [ 0.002907] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]334worker2 # [ 0.005863] On node 0, zone DMA: 97 pages in unavailable ranges335lb # [ 0.002855] ACPI: FACS 0x000000005FFE0000 000040336client # [ 0.005911] On node 0, zone DMA: 97 pages in unavailable ranges337worker1 # [ 0.002907] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]338worker2 # [ 0.034474] On node 0, zone DMA32: 40 pages in unavailable ranges339lb # [ 0.002857] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)340client # [ 0.034503] On node 0, zone DMA32: 40 pages in unavailable ranges341worker2 # [ 0.034938] ACPI: PM-Timer IO Port: 0x608342client # [ 0.034952] ACPI: PM-Timer IO Port: 0x608343worker1 # [ 0.002908] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]344worker2 # [ 0.034950] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])345lb # [ 0.002858] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)346client # [ 0.034963] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])347worker1 # [ 0.002908] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]348worker2 # [ 0.034979] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23349client # [ 0.034991] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23350lb # [ 0.002860] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)351worker1 # [ 0.002909] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]352worker2 # [ 0.034982] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)353client # [ 0.034994] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)354worker1 # [ 0.002909] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]355lb # [ 0.002861] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)356worker2 # [ 0.034983] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)357worker1 # [ 0.003158] No NUMA configuration found358client # [ 0.034996] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)359lb # [ 0.002863] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]360worker2 # [ 0.034984] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)361worker1 # [ 0.003159] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]362client # [ 0.034998] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)363lb # [ 0.002864] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]364worker2 # [ 0.034985] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)365worker1 # [ 0.003161] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]366client # [ 0.034999] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)367worker1 # [ 0.005599] Zone ranges:368lb # [ 0.002864] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]369worker2 # [ 0.034986] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)370client # [ 0.034999] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)371worker1 # [ 0.005600] DMA [mem 0x0000000000001000-0x0000000000ffffff]372worker2 # [ 0.034989] ACPI: Using ACPI (MADT) for SMP configuration information373lb # [ 0.002865] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]374client # [ 0.035002] ACPI: Using ACPI (MADT) for SMP configuration information375worker1 # [ 0.005602] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]376worker2 # [ 0.034989] ACPI: HPET id: 0x8086a201 base: 0xfed00000377worker1 # [ 0.005603] Normal empty378lb # [ 0.002865] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]379client # [ 0.035003] ACPI: HPET id: 0x8086a201 base: 0xfed00000380worker2 # [ 0.034993] TSC deadline timer available381worker1 # [ 0.005604] Device empty382client # [ 0.035006] TSC deadline timer available383worker1 # [ 0.005604] Movable zone start for each node384worker2 # [ 0.034997] CPU topo: Max. logical packages: 1385lb # [ 0.002866] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]386client # [ 0.035010] CPU topo: Max. logical packages: 1387worker1 # [ 0.005605] Early memory node ranges388worker2 # [ 0.034998] CPU topo: Max. logical dies: 1389lb # [ 0.002866] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]390client # [ 0.035011] CPU topo: Max. logical dies: 1391worker1 # [ 0.005606] node 0: [mem 0x0000000000001000-0x000000000009efff]392worker2 # [ 0.034999] CPU topo: Max. dies per package: 1393lb # [ 0.003099] No NUMA configuration found394client # [ 0.035012] CPU topo: Max. dies per package: 1395worker2 # [ 0.035002] CPU topo: Max. threads per core: 1396worker1 # [ 0.005607] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]397client # [ 0.035015] CPU topo: Max. threads per core: 1398lb # [ 0.003100] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]399worker2 # [ 0.035003] CPU topo: Num. cores per package: 1400client # [ 0.035016] CPU topo: Num. cores per package: 1401worker1 # [ 0.005608] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]402worker2 # [ 0.035003] CPU topo: Num. threads per package: 1403lb # [ 0.003103] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]404client # [ 0.035016] CPU topo: Num. threads per package: 1405lb # [ 0.005455] Zone ranges:406worker1 # [ 0.005629] On node 0, zone DMA: 1 pages in unavailable ranges407worker2 # [ 0.035003] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs408client # [ 0.035016] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs409lb # [ 0.005457] DMA [mem 0x0000000000001000-0x0000000000ffffff]410worker1 # [ 0.005939] On node 0, zone DMA: 97 pages in unavailable ranges411worker2 # [ 0.035022] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()412lb # [ 0.005458] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]413client # [ 0.035037] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()414worker1 # [ 0.034803] On node 0, zone DMA32: 40 pages in unavailable ranges415lb # [ 0.005460] Normal empty416worker2 # [ 0.035056] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]417worker1 # [ 0.035287] ACPI: PM-Timer IO Port: 0x608418lb # [ 0.005460] Device empty419client # [ 0.035074] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]420lb # [ 0.005461] Movable zone start for each node421worker1 # [ 0.035301] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])422worker2 # [ 0.035058] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]423lb # [ 0.005462] Early memory node ranges424client # [ 0.035076] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]425worker1 # [ 0.035331] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23426lb # [ 0.005462] node 0: [mem 0x0000000000001000-0x000000000009efff]427worker2 # [ 0.035059] [mem 0x60000000-0xafffffff] available for PCI devices428client # [ 0.035077] [mem 0x60000000-0xafffffff] available for PCI devices429worker2 # [ 0.035061] Booting paravirtualized kernel on KVM430worker1 # [ 0.035334] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)431lb # [ 0.005463] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]432client # [ 0.035079] Booting paravirtualized kernel on KVM433worker1 # [ 0.035336] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)434lb # [ 0.005464] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]435worker2 # [ 0.035064] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns436client # [ 0.035082] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns437worker1 # [ 0.035337] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)438lb # [ 0.005485] On node 0, zone DMA: 1 pages in unavailable ranges439worker2 # [ 0.039550] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1440worker1 # [ 0.035338] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)441client # [ 0.039565] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1442lb # [ 0.005765] On node 0, zone DMA: 97 pages in unavailable ranges443worker2 # [ 0.041845] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152444client # [ 0.041880] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152445lb # [ 0.034077] On node 0, zone DMA32: 40 pages in unavailable ranges446worker1 # [ 0.035339] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)447worker2 # [ 0.041886] kvm-guest: PV spinlocks disabled, single CPU448lb # [ 0.034539] ACPI: PM-Timer IO Port: 0x608449client # [ 0.041924] kvm-guest: PV spinlocks disabled, single CPU450worker1 # [ 0.035341] ACPI: Using ACPI (MADT) for SMP configuration information451lb # [ 0.034551] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])452worker1 # [ 0.035342] ACPI: HPET id: 0x8086a201 base: 0xfed00000453worker1 # [ 0.035346] TSC deadline timer available454lb # [ 0.034576] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23455worker1 # [ 0.035350] CPU topo: Max. logical packages: 1456lb # [ 0.034579] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)457worker1 # [ 0.035351] CPU topo: Max. logical dies: 1458lb # [ 0.034580] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)459worker1 # [ 0.035352] CPU topo: Max. dies per package: 1460worker2 # [ 0.041887] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/v52vz29636q5v9vkbg5mvds1sg0spc18-nixos-system-worker2-test/init regInfo=/nix/store/09f5rg1zlf2xj73cixpi2zq4w4970in7-closure-info/registration console=ttyS0,115200n8 console=tty0461worker1 # [ 0.035355] CPU topo: Max. threads per core: 1462client # [ 0.041925] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test/init regInfo=/nix/store/rnw9wiiddpcs8mxc1hyrq4v8z6kvsy0c-closure-info/registration console=ttyS0,115200n8 console=tty0463lb # [ 0.034582] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)464worker1 # [ 0.035356] CPU topo: Num. cores per package: 1465lb # [ 0.034583] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)466worker1 # [ 0.035356] CPU topo: Num. threads per package: 1467worker2 # [ 0.041982] Unknown kernel command line parameters "regInfo=/nix/store/09f5rg1zlf2xj73cixpi2zq4w4970in7-closure-info/registration", will be passed to user space.468lb # [ 0.034583] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)469client # [ 0.042020] Unknown kernel command line parameters "regInfo=/nix/store/rnw9wiiddpcs8mxc1hyrq4v8z6kvsy0c-closure-info/registration", will be passed to user space.470worker1 # [ 0.035357] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs471worker2 # [ 0.041995] random: crng init done472client # [ 0.042033] random: crng init done473lb # [ 0.034586] ACPI: Using ACPI (MADT) for SMP configuration information474worker1 # [ 0.035379] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()475worker2 # [ 0.041996] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes476lb # [ 0.034587] ACPI: HPET id: 0x8086a201 base: 0xfed00000477client # [ 0.042034] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes478lb # [ 0.034591] TSC deadline timer available479worker2 # [ 0.044538] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)480worker1 # [ 0.035417] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]481client # [ 0.044300] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)482lb # [ 0.034596] CPU topo: Max. logical packages: 1483lb # [ 0.034597] CPU topo: Max. logical dies: 1484worker2 # [ 0.045681] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)485client # [ 0.045767] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)486worker1 # [ 0.035418] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]487lb # [ 0.034597] CPU topo: Max. dies per package: 1488worker2 # [ 0.045712] Fallback order for Node 0: 0489client # [ 0.045801] Fallback order for Node 0: 0490lb # [ 0.034601] CPU topo: Max. threads per core: 1491worker1 # [ 0.035420] [mem 0x60000000-0xafffffff] available for PCI devices492worker2 # [ 0.045715] Built 1 zonelists, mobility grouping on. Total pages: 393078493client # [ 0.045804] Built 1 zonelists, mobility grouping on. Total pages: 393078494lb # [ 0.034601] CPU topo: Num. cores per package: 1495worker2 # [ 0.045716] Policy zone: DMA32496client # [ 0.045805] Policy zone: DMA32497worker1 # [ 0.035422] Booting paravirtualized kernel on KVM498lb # [ 0.034602] CPU topo: Num. threads per package: 1499worker2 # [ 0.048353] mem auto-init: stack:all(zero), heap alloc:on, heap free:off500client # [ 0.048577] mem auto-init: stack:all(zero), heap alloc:on, heap free:off501lb # [ 0.034602] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs502worker2 # [ 0.051727] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1503worker1 # [ 0.035426] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns504client # [ 0.052454] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1505lb # [ 0.034624] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()506worker2 # [ 0.055571] allocated 3145728 bytes of page_ext507client # [ 0.056373] allocated 3145728 bytes of page_ext508worker1 # [ 0.039901] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1509worker2 # [ 0.065995] ftrace: allocating 48731 entries in 192 pages510lb # [ 0.034659] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]511client # [ 0.066928] ftrace: allocating 48731 entries in 192 pages512worker2 # [ 0.065997] ftrace: allocated 192 pages with 2 groups513worker1 # [ 0.042204] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152514client # [ 0.066931] ftrace: allocated 192 pages with 2 groups515worker2 # [ 0.066907] Dynamic Preempt: lazy516lb # [ 0.034661] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]517client # [ 0.067903] Dynamic Preempt: lazy518worker1 # [ 0.042252] kvm-guest: PV spinlocks disabled, single CPU519worker2 # [ 0.067031] rcu: Preemptible hierarchical RCU implementation.520lb # [ 0.034662] [mem 0x60000000-0xafffffff] available for PCI devices521client # [ 0.068098] rcu: Preemptible hierarchical RCU implementation.522worker2 # [ 0.067032] rcu: RCU event tracing is enabled.523lb # [ 0.034664] Booting paravirtualized kernel on KVM524client # [ 0.068099] rcu: RCU event tracing is enabled.525worker2 # [ 0.067032] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.526client # [ 0.068100] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.527lb # [ 0.034667] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns528worker2 # [ 0.067034] Trampoline variant of Tasks RCU enabled.529client # [ 0.068102] Trampoline variant of Tasks RCU enabled.530worker2 # [ 0.067035] Rude variant of Tasks RCU enabled.531client # [ 0.068102] Rude variant of Tasks RCU enabled.532lb # [ 0.039144] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1533worker2 # [ 0.067035] Tracing variant of Tasks RCU enabled.534client # [ 0.068102] Tracing variant of Tasks RCU enabled.535worker1 # [ 0.042253] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/32z47cdh4wsgk78pfxg163gygb7hgis3-nixos-system-worker1-test/init regInfo=/nix/store/hnvzgpjwyv1a6wsajpyr3idwpr3v1603-closure-info/registration console=ttyS0,115200n8 console=tty0536lb # [ 0.042105] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152537worker2 # [ 0.067036] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.538client # [ 0.068103] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.539lb # [ 0.042148] kvm-guest: PV spinlocks disabled, single CPU540worker2 # [ 0.067036] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1541client # [ 0.068104] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1542worker1 # [ 0.042353] Unknown kernel command line parameters "regInfo=/nix/store/hnvzgpjwyv1a6wsajpyr3idwpr3v1603-closure-info/registration", will be passed to user space.543worker1 # [ 0.042366] random: crng init done544worker2 # [ 0.067089] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.545client # [ 0.068121] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.546worker1 # [ 0.042367] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes547worker2 # [ 0.067091] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.548client # [ 0.068123] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.549worker1 # [ 0.044899] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)550worker2 # [ 0.067092] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.551lb # [ 0.042149] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0552client # [ 0.068124] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.553worker1 # [ 0.046020] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)554worker2 # [ 0.071598] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16555worker1 # [ 0.046054] Fallback order for Node 0: 0556client # [ 0.072888] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16557worker1 # [ 0.046058] Built 1 zonelists, mobility grouping on. Total pages: 393078558worker2 # [ 0.071893] rcu: srcu_init: Setting srcu_struct sizes based on contention.559lb # [ 0.042251] Unknown kernel command line parameters "regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration", will be passed to user space.560client # [ 0.073178] rcu: srcu_init: Setting srcu_struct sizes based on contention.561worker1 # [ 0.046059] Policy zone: DMA32562lb # [ 0.042264] random: crng init done563worker2 # [ 0.071899] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns564worker1 # [ 0.048718] mem auto-init: stack:all(zero), heap alloc:on, heap free:off565client # [ 0.073184] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns566lb # [ 0.042265] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes567worker1 # [ 0.052238] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1568worker2 # [ 0.072011] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)569lb # [ 0.044722] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)570worker1 # [ 0.056121] allocated 3145728 bytes of page_ext571client # [ 0.073295] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)572worker2 # [ 0.075563] Console: colour VGA+ 80x25573client # [ 0.076889] Console: colour VGA+ 80x25574worker1 # [ 0.066663] ftrace: allocating 48731 entries in 192 pages575lb # [ 0.045941] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)576worker2 # [ 0.075566] printk: legacy console [tty0] enabled577client # [ 0.076893] printk: legacy console [tty0] enabled578worker1 # [ 0.066665] ftrace: allocated 192 pages with 2 groups579lb # [ 0.045987] Fallback order for Node 0: 0580worker2 # [ 0.105047] printk: legacy console [ttyS0] enabled581worker1 # [ 0.067572] Dynamic Preempt: lazy582client # [ 0.106381] printk: legacy console [ttyS0] enabled583lb # [ 0.045990] Built 1 zonelists, mobility grouping on. Total pages: 393078584worker2 # [ 0.202634] ACPI: Core revision 20250807585worker1 # [ 0.067750] rcu: Preemptible hierarchical RCU implementation.586client # [ 0.203679] ACPI: Core revision 20250807587lb # [ 0.045991] Policy zone: DMA32588worker1 # [ 0.067750] rcu: RCU event tracing is enabled.589lb # [ 0.048773] mem auto-init: stack:all(zero), heap alloc:on, heap free:off590worker1 # [ 0.067751] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.591worker2 # [ 0.203512] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns592lb # [ 0.052346] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1593worker1 # [ 0.067752] Trampoline variant of Tasks RCU enabled.594client # [ 0.204565] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns595lb # [ 0.056173] allocated 3145728 bytes of page_ext596worker2 # [ 0.205030] APIC: Switch to symmetric I/O mode setup597worker1 # [ 0.067753] Rude variant of Tasks RCU enabled.598client # [ 0.206140] APIC: Switch to symmetric I/O mode setup599lb # [ 0.066601] ftrace: allocating 48731 entries in 192 pages600worker1 # [ 0.067753] Tracing variant of Tasks RCU enabled.601worker2 # [ 0.205982] x2apic enabled602client # [ 0.207092] x2apic enabled603lb # [ 0.066604] ftrace: allocated 192 pages with 2 groups604worker1 # [ 0.067754] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.605lb # [ 0.067478] Dynamic Preempt: lazy606worker2 # [ 0.206743] APIC: Switched APIC routing to: physical x2apic607client # [ 0.207868] APIC: Switched APIC routing to: physical x2apic608lb # [ 0.067607] rcu: Preemptible hierarchical RCU implementation.609worker1 # [ 0.067755] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1610lb # [ 0.067608] rcu: RCU event tracing is enabled.611worker1 # [ 0.067782] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.612lb # [ 0.067608] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.613worker2 # [ 0.208557] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1614client # [ 0.209678] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1615lb # [ 0.067610] Trampoline variant of Tasks RCU enabled.616worker1 # [ 0.067784] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.617lb # [ 0.067610] Rude variant of Tasks RCU enabled.618lb # [ 0.067611] Tracing variant of Tasks RCU enabled.619worker2 # [ 0.209516] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns620worker1 # [ 0.067785] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.621client # [ 0.210640] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns622lb # [ 0.067612] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.623worker1 # [ 0.072331] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16624worker2 # [ 0.211191] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)625lb # [ 0.067612] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1626client # [ 0.212270] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)627worker1 # [ 0.072625] rcu: srcu_init: Setting srcu_struct sizes based on contention.628worker2 # [ 0.212284] x86/cpu: User Mode Instruction Prevention (UMIP) activated629lb # [ 0.067674] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.630client # [ 0.213357] x86/cpu: User Mode Instruction Prevention (UMIP) activated631worker1 # [ 0.072641] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns632worker2 # [ 0.213383] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127633lb # [ 0.067676] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.634client # [ 0.214384] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127635worker1 # [ 0.072756] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)636worker1 # [ 0.076367] Console: colour VGA+ 80x25637worker2 # [ 0.214863] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0638client # [ 0.215268] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0639lb # [ 0.067677] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.640worker1 # [ 0.076370] printk: legacy console [tty0] enabled641lb # [ 0.072137] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16642worker1 # [ 0.106160] printk: legacy console [ttyS0] enabled643worker2 # [ 0.215192] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto644lb # [ 0.072415] rcu: srcu_init: Setting srcu_struct sizes based on contention.645worker1 # [ 0.204044] ACPI: Core revision 20250807646client # [ 0.216271] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto647lb # [ 0.072420] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns648worker2 # [ 0.217188] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl649client # [ 0.217268] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl650worker1 # [ 0.204894] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns651worker2 # [ 0.218188] Transient Scheduler Attacks: Vulnerable: No microcode652lb # [ 0.072533] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)653client # [ 0.218268] Transient Scheduler Attacks: Vulnerable: No microcode654worker1 # [ 0.206401] APIC: Switch to symmetric I/O mode setup655lb # [ 0.076081] Console: colour VGA+ 80x25656worker1 # [ 0.207330] x2apic enabled657worker2 # [ 0.219187] Spectre V2 : Mitigation: Enhanced / Automatic IBRS658client # [ 0.219267] Spectre V2 : Mitigation: Enhanced / Automatic IBRS659lb # [ 0.076084] printk: legacy console [tty0] enabled660lb # [ 0.105599] printk: legacy console [ttyS0] enabled661worker1 # [ 0.208063] APIC: Switched APIC routing to: physical x2apic662worker2 # [ 0.220188] Speculative Return Stack Overflow: Mitigation: Safe RET663client # [ 0.220267] Speculative Return Stack Overflow: Mitigation: Safe RET664lb # [ 0.201833] ACPI: Core revision 20250807665worker1 # [ 0.209905] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1666lb # [ 0.202737] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns667lb # [ 0.204362] APIC: Switch to symmetric I/O mode setup668worker1 # [ 0.210941] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns669lb # [ 0.205342] x2apic enabled670worker2 # [ 0.221187] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization671client # [ 0.221267] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization672client # [ 0.223274] Spectre V2 : Enabling IBPB for BPF673worker2 # [ 0.223195] Spectre V2 : Enabling IBPB for BPF674lb # [ 0.206113] APIC: Switched APIC routing to: physical x2apic675worker1 # [ 0.212659] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)676worker2 # [ 0.224188] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier677client # [ 0.224268] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier678worker1 # [ 0.213744] x86/cpu: User Mode Instruction Prevention (UMIP) activated679lb # [ 0.207899] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1680client # [ 0.225268] active return thunk: srso_alias_return_thunk681worker2 # [ 0.225188] active return thunk: srso_alias_return_thunk682worker1 # [ 0.214821] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127683client # [ 0.226289] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'684worker2 # [ 0.226208] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'685worker1 # [ 0.216340] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0686lb # [ 0.208873] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns687client # [ 0.227267] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'688worker2 # [ 0.227187] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'689lb # [ 0.210535] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)690worker1 # [ 0.217401] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto691client # [ 0.228267] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'692worker2 # [ 0.228928] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'693lb # [ 0.211619] x86/cpu: User Mode Instruction Prevention (UMIP) activated694client # [ 0.229267] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'695worker2 # [ 0.229918] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'696worker1 # [ 0.218655] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl697lb # [ 0.212675] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127698client # [ 0.230267] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'699worker2 # [ 0.230929] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'700worker1 # [ 0.219656] Transient Scheduler Attacks: Vulnerable: No microcode701lb # [ 0.213539] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0702client # [ 0.231267] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'703worker2 # [ 0.231903] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'704worker1 # [ 0.221359] Spectre V2 : Mitigation: Enhanced / Automatic IBRS705worker1 # [ 0.221656] Speculative Return Stack Overflow: Mitigation: Safe RET706worker2 # [ 0.232187] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'707client # [ 0.232267] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'708lb # [ 0.214536] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto709worker2 # [ 0.234084] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256710client # [ 0.233268] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256711lb # [ 0.216532] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl712worker2 # [ 0.234923] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64713client # [ 0.234268] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64714lb # [ 0.217533] Transient Scheduler Attacks: Vulnerable: No microcode715worker2 # [ 0.235928] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512716client # [ 0.236009] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512717lb # [ 0.219258] Spectre V2 : Mitigation: Enhanced / Automatic IBRS718worker1 # [ 0.222655] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization719worker2 # [ 0.236907] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024720client # [ 0.236976] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024721worker1 # [ 0.224662] Spectre V2 : Enabling IBPB for BPF722lb # [ 0.220223] Speculative Return Stack Overflow: Mitigation: Safe RET723worker2 # [ 0.237897] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8724client # [ 0.237267] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8725worker1 # [ 0.225656] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier726worker2 # [ 0.238905] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.727client # [ 0.238267] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.728worker1 # [ 0.226656] active return thunk: srso_alias_return_thunk729worker1 # [ 0.227677] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'730lb # [ 0.220532] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization731worker1 # [ 0.228656] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'732lb # [ 0.222539] Spectre V2 : Enabling IBPB for BPF733worker1 # [ 0.229655] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'734lb # [ 0.223533] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier735worker1 # [ 0.230655] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'736lb # [ 0.224533] active return thunk: srso_alias_return_thunk737worker1 # [ 0.231654] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'738lb # [ 0.226232] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'739worker1 # [ 0.232655] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'740lb # [ 0.227532] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'741worker1 # [ 0.233655] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'742lb # [ 0.228532] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'743worker1 # [ 0.234656] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256744lb # [ 0.229532] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'745worker1 # [ 0.235655] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64746lb # [ 0.230532] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'747worker1 # [ 0.236655] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512748lb # [ 0.231532] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'749worker1 # [ 0.237655] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024750lb # [ 0.232532] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'751worker1 # [ 0.239446] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8752lb # [ 0.233532] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256753worker1 # [ 0.240443] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.754lb # [ 0.234532] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755lb # [ 0.235534] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756lb # [ 0.237303] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757lb # [ 0.238328] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758lb # [ 0.239328] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759worker2 # [ 0.274162] Freeing SMP alternatives memory: 44K760worker2 # [ 0.274782] pid_max: default: 32768 minimum: 301761client # [ 0.274942] Freeing SMP alternatives memory: 44K762client # [ 0.275270] pid_max: default: 32768 minimum: 301763worker2 # [ 0.275862] LSM: initializing lsm=capability,landlock,yama,bpf,ima764worker2 # [ 0.276297] landlock: Up and running.765client # [ 0.276389] LSM: initializing lsm=capability,landlock,yama,bpf,ima766worker2 # [ 0.277660] Yama: becoming mindful.767client # [ 0.277365] landlock: Up and running.768client # [ 0.278268] Yama: becoming mindful.769worker2 # [ 0.278419] LSM support for eBPF active770client # [ 0.279312] LSM support for eBPF active771worker2 # [ 0.279340] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)772client # [ 0.280091] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)773worker2 # [ 0.280229] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)774client # [ 0.281301] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)775worker2 # [ 0.283230] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)776client # [ 0.283745] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)777worker2 # [ 0.284791] Performance Events: Fam17h+ core perfctr, AMD PMU driver.778client # [ 0.284863] Performance Events: Fam17h+ core perfctr, AMD PMU driver.779worker2 # [ 0.285199] ... version: 2780client # [ 0.285277] ... version: 2781worker2 # [ 0.285946] ... bit width: 48782worker2 # [ 0.286191] ... generic counters: 6783client # [ 0.286012] ... bit width: 48784client # [ 0.286270] ... generic counters: 6785worker2 # [ 0.286961] ... generic bitmap: 000000000000003f786client # [ 0.286999] ... generic bitmap: 000000000000003f787worker2 # [ 0.287191] ... fixed-purpose counters: 0788worker1 # [ 0.276246] Freeing SMP alternatives memory: 44K789client # [ 0.287269] ... fixed-purpose counters: 0790worker2 # [ 0.287926] ... fixed-purpose bitmap: 0000000000000000791worker1 # [ 0.276658] pid_max: default: 32768 minimum: 301792client # [ 0.287994] ... fixed-purpose bitmap: 0000000000000000793worker2 # [ 0.288190] ... value mask: 0000ffffffffffff794worker1 # [ 0.277771] LSM: initializing lsm=capability,landlock,yama,bpf,ima795client # [ 0.288270] ... value mask: 0000ffffffffffff796worker2 # [ 0.289115] ... max period: 00007fffffffffff797worker1 # [ 0.278779] landlock: Up and running.798client # [ 0.289174] ... max period: 00007fffffffffff799worker1 # [ 0.279656] Yama: becoming mindful.800worker2 # [ 0.289913] ... global_ctrl mask: 000000000000003f801lb # [ 0.274471] Freeing SMP alternatives memory: 44K802client # [ 0.289966] ... global_ctrl mask: 000000000000003f803worker1 # [ 0.280461] LSM support for eBPF active804worker2 # [ 0.290305] signal: max sigframe size: 3376805lb # [ 0.275077] pid_max: default: 32768 minimum: 301806client # [ 0.290382] signal: max sigframe size: 3376807worker2 # [ 0.291056] rcu: Hierarchical SRCU implementation.808worker1 # [ 0.281233] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)809client # [ 0.291173] rcu: Hierarchical SRCU implementation.810lb # [ 0.275627] LSM: initializing lsm=capability,landlock,yama,bpf,ima811worker2 # [ 0.291754] rcu: Max phase no-delay instances is 400.812client # [ 0.291863] rcu: Max phase no-delay instances is 400.813lb # [ 0.276644] landlock: Up and running.814worker1 # [ 0.282558] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)815lb # [ 0.277533] Yama: becoming mindful.816lb # [ 0.278655] LSM support for eBPF active817worker1 # [ 0.284987] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)818lb # [ 0.279465] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)819lb # [ 0.280571] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)820worker1 # [ 0.286262] Performance Events: Fam17h+ core perfctr, AMD PMU driver.821worker2 # [ 0.296831] smp: Bringing up secondary CPUs ...822worker1 # [ 0.286665] ... version: 2823worker2 # [ 0.297207] smp: Brought up 1 node, 1 CPU824client # [ 0.296851] smp: Bringing up secondary CPUs ...825worker1 # [ 0.287405] ... bit width: 48826client # [ 0.297285] smp: Brought up 1 node, 1 CPU827worker2 # [ 0.297915] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)828worker1 # [ 0.287657] ... generic counters: 6829lb # [ 0.283132] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)830client # [ 0.297974] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)831worker1 # [ 0.288343] ... generic bitmap: 000000000000003f832worker1 # [ 0.288658] ... fixed-purpose counters: 0833lb # [ 0.284109] Performance Events: Fam17h+ core perfctr, AMD PMU driver.834worker1 # [ 0.289368] ... fixed-purpose bitmap: 0000000000000000835lb # [ 0.284537] ... version: 2836client # [ 0.298524] Memory: 1454536K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)837lb # [ 0.285229] ... bit width: 48838worker1 # [ 0.289658] ... value mask: 0000ffffffffffff839worker2 # [ 0.298352] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)840lb # [ 0.285535] ... generic counters: 6841client # [ 0.299541] devtmpfs: initialized842worker1 # [ 0.290510] ... max period: 00007fffffffffff843lb # [ 0.286222] ... generic bitmap: 000000000000003f844worker2 # [ 0.300736] devtmpfs: initialized845client # [ 0.300292] x86/mm: Memory block size: 128MB846worker1 # [ 0.291314] ... global_ctrl mask: 000000000000003f847lb # [ 0.286547] ... fixed-purpose counters: 0848worker1 # [ 0.291775] signal: max sigframe size: 3376849worker2 # [ 0.301454] x86/mm: Memory block size: 128MB850lb # [ 0.287242] ... fixed-purpose bitmap: 0000000000000000851worker1 # [ 0.292579] rcu: Hierarchical SRCU implementation.852client # [ 0.302057] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)853lb # [ 0.287535] ... value mask: 0000ffffffffffff854worker1 # [ 0.293245] rcu: Max phase no-delay instances is 400.855lb # [ 0.288446] ... max period: 00007fffffffffff856client # [ 0.303159] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).857worker2 # [ 0.303558] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)858lb # [ 0.289219] ... global_ctrl mask: 000000000000003f859client # [ 0.304351] pinctrl core: initialized pinctrl subsystem860lb # [ 0.289659] signal: max sigframe size: 3376861worker2 # [ 0.304232] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).862client # [ 0.305439] PM: RTC time: 12:21:36, date: 2026-09-20863lb # [ 0.290441] rcu: Hierarchical SRCU implementation.864worker2 # [ 0.305346] pinctrl core: initialized pinctrl subsystem865lb # [ 0.291147] rcu: Max phase no-delay instances is 400.866worker2 # [ 0.306495] PM: RTC time: 12:21:36, date: 2026-09-20867worker1 # [ 0.298361] smp: Bringing up secondary CPUs ...868worker1 # [ 0.298672] smp: Brought up 1 node, 1 CPU869client # [ 0.309118] NET: Registered PF_NETLINK/PF_ROUTE protocol family870worker1 # [ 0.299326] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)871client # [ 0.310514] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations872lb # [ 0.296091] smp: Bringing up secondary CPUs ...873worker1 # [ 0.299836] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)874worker2 # [ 0.310629] NET: Registered PF_NETLINK/PF_ROUTE protocol family875client # [ 0.311297] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations876lb # [ 0.296549] smp: Brought up 1 node, 1 CPU877worker1 # [ 0.300921] devtmpfs: initialized878client # [ 0.312562] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations879lb # [ 0.297199] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)880worker1 # [ 0.301768] x86/mm: Memory block size: 128MB881worker2 # [ 0.311844] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations882client # [ 0.313281] audit: initializing netlink subsys (disabled)883worker2 # [ 0.312219] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations884client # [ 0.314409] thermal_sys: Registered thermal governor 'fair_share'885lb # [ 0.297706] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)886worker1 # [ 0.303526] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)887client # [ 0.314412] thermal_sys: Registered thermal governor 'bang_bang'888lb # [ 0.298793] devtmpfs: initialized889worker2 # [ 0.313515] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations890worker1 # [ 0.304508] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).891client # [ 0.315271] thermal_sys: Registered thermal governor 'step_wise'892lb # [ 0.299562] x86/mm: Memory block size: 128MB893worker2 # [ 0.314204] audit: initializing netlink subsys (disabled)894worker1 # [ 0.305751] pinctrl core: initialized pinctrl subsystem895client # [ 0.316190] thermal_sys: Registered thermal governor 'user_space'896worker2 # [ 0.315490] thermal_sys: Registered thermal governor 'fair_share'897worker1 # [ 0.306862] PM: RTC time: 12:21:36, date: 2026-09-20898client # [ 0.316975] audit: type=2000 audit(1789906897.173:1): state=initialized audit_enabled=0 res=1899lb # [ 0.301368] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)900worker2 # [ 0.315493] thermal_sys: Registered thermal governor 'bang_bang'901client # [ 0.318273] thermal_sys: Registered thermal governor 'power_allocator'902lb # [ 0.302395] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).903client # [ 0.318296] cpuidle: using governor menu904worker2 # [ 0.316192] thermal_sys: Registered thermal governor 'step_wise'905lb # [ 0.303642] pinctrl core: initialized pinctrl subsystem906worker2 # [ 0.317195] audit: type=2000 audit(1789906897.175:1): state=initialized audit_enabled=0 res=1907client # [ 0.320466] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5908worker1 # [ 0.310539] NET: Registered PF_NETLINK/PF_ROUTE protocol family909lb # [ 0.304745] PM: RTC time: 12:21:36, date: 2026-09-20910worker2 # [ 0.319192] thermal_sys: Registered thermal governor 'user_space'911client # [ 0.321499] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]912worker1 # [ 0.311921] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations913worker2 # [ 0.319195] thermal_sys: Registered thermal governor 'power_allocator'914client # [ 0.322273] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry915worker2 # [ 0.320217] cpuidle: using governor menu916worker1 # [ 0.312688] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations917client # [ 0.323282] PCI: Using configuration type 1 for base access918lb # [ 0.308817] NET: Registered PF_NETLINK/PF_ROUTE protocol family919worker1 # [ 0.313948] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations920worker2 # [ 0.322625] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5921client # [ 0.324380] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.922worker1 # [ 0.314671] audit: initializing netlink subsys (disabled)923lb # [ 0.310081] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations924worker2 # [ 0.323471] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]925worker1 # [ 0.315799] thermal_sys: Registered thermal governor 'fair_share'926lb # [ 0.310563] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations927worker1 # [ 0.315802] thermal_sys: Registered thermal governor 'bang_bang'928worker2 # [ 0.324195] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry929client # [ 0.327538] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages930worker1 # [ 0.316659] thermal_sys: Registered thermal governor 'step_wise'931worker2 # [ 0.325209] PCI: Using configuration type 1 for base access932lb # [ 0.311839] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations933client # [ 0.328272] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page934worker1 # [ 0.317591] thermal_sys: Registered thermal governor 'user_space'935lb # [ 0.312546] audit: initializing netlink subsys (disabled)936worker2 # [ 0.326430] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.937worker1 # [ 0.318400] audit: type=2000 audit(1789906897.187:1): state=initialized audit_enabled=0 res=1938lb # [ 0.313680] thermal_sys: Registered thermal governor 'fair_share'939worker1 # [ 0.319661] thermal_sys: Registered thermal governor 'power_allocator'940lb # [ 0.313683] thermal_sys: Registered thermal governor 'bang_bang'941worker1 # [ 0.319678] cpuidle: using governor menu942lb # [ 0.314536] thermal_sys: Registered thermal governor 'step_wise'943lb # [ 0.315457] thermal_sys: Registered thermal governor 'user_space'944worker1 # [ 0.321936] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5945client # [ 0.333271] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages946lb # [ 0.316253] audit: type=2000 audit(1789906897.193:1): state=initialized audit_enabled=0 res=1947client # [ 0.334270] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page948lb # [ 0.317537] thermal_sys: Registered thermal governor 'power_allocator'949worker2 # [ 0.331566] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages950worker1 # [ 0.323216] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]951lb # [ 0.317553] cpuidle: using governor menu952worker1 # [ 0.323661] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry953worker2 # [ 0.332192] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page954worker1 # [ 0.324671] PCI: Using configuration type 1 for base access955lb # [ 0.319774] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5956worker2 # [ 0.333191] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages957worker1 # [ 0.325803] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.958lb # [ 0.320783] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]959lb # [ 0.321538] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry960lb # [ 0.322547] PCI: Using configuration type 1 for base access961lb # [ 0.323632] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.962worker1 # [ 0.330761] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages963client # [ 0.344609] ACPI: Added _OSI(Module Device)964worker2 # [ 0.340195] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page965worker1 # [ 0.331660] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page966client # [ 0.345272] ACPI: Added _OSI(Processor Device)967client # [ 0.346027] ACPI: Added _OSI(Processor Aggregator Device)968lb # [ 0.330807] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages969worker1 # [ 0.336659] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages970lb # [ 0.331536] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page971worker1 # [ 0.337658] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page972client # [ 0.354467] ACPI: 1 ACPI AML tables successfully acquired and loaded973worker2 # [ 0.351510] ACPI: Added _OSI(Module Device)974lb # [ 0.336536] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages975worker2 # [ 0.352193] ACPI: Added _OSI(Processor Device)976lb # [ 0.337535] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page977worker2 # [ 0.352920] ACPI: Added _OSI(Processor Aggregator Device)978client # [ 0.358721] ACPI: Interpreter enabled979client # [ 0.359287] ACPI: PM: (supports S0 S3 S4 S5)980client # [ 0.359964] ACPI: Using IOAPIC for interrupt routing981worker1 # [ 0.348059] ACPI: Added _OSI(Module Device)982worker1 # [ 0.348659] ACPI: Added _OSI(Processor Device)983worker1 # [ 0.349371] ACPI: Added _OSI(Processor Aggregator Device)984client # [ 0.362306] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug985lb # [ 0.346180] ACPI: Added _OSI(Module Device)986client # [ 0.363279] PCI: Using E820 reservations for host bridge windows987lb # [ 0.346537] ACPI: Added _OSI(Processor Device)988lb # [ 0.347274] ACPI: Added _OSI(Processor Aggregator Device)989client # [ 0.366350] ACPI: Enabled 2 GPEs in block 00 to 3F990worker2 # [ 0.363766] ACPI: 1 ACPI AML tables successfully acquired and loaded991worker2 # [ 0.365151] ACPI: Interpreter enabled992worker2 # [ 0.365699] ACPI: PM: (supports S0 S3 S4 S5)993worker1 # [ 0.357930] ACPI: 1 ACPI AML tables successfully acquired and loaded994worker2 # [ 0.366191] ACPI: Using IOAPIC for interrupt routing995worker2 # [ 0.367083] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug996lb # [ 0.354121] ACPI: 1 ACPI AML tables successfully acquired and loaded997worker1 # [ 0.362098] ACPI: Interpreter enabled998worker1 # [ 0.362675] ACPI: PM: (supports S0 S3 S4 S5)999client # [ 0.375033] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1000worker1 # [ 0.363380] ACPI: Using IOAPIC for interrupt routing1001lb # [ 0.357491] ACPI: Interpreter enabled1002client # [ 0.375991] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1003lb # [ 0.357995] ACPI: PM: (supports S0 S3 S4 S5)1004worker2 # [ 0.372191] PCI: Using E820 reservations for host bridge windows1005lb # [ 0.358536] ACPI: Using IOAPIC for interrupt routing1006worker2 # [ 0.373281] ACPI: Enabled 2 GPEs in block 00 to 3F1007client # [ 0.378170] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1008lb # [ 0.359394] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1009worker1 # [ 0.365734] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1010client # [ 0.379250] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1011worker1 # [ 0.366659] PCI: Using E820 reservations for host bridge windows1012client # [ 0.380476] PCI host bridge to bus 0000:001013client # [ 0.381146] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1014client # [ 0.382077] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1015worker1 # [ 0.369766] ACPI: Enabled 2 GPEs in block 00 to 3F1016lb # [ 0.364536] PCI: Using E820 reservations for host bridge windows1017client # [ 0.383058] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1018lb # [ 0.365608] ACPI: Enabled 2 GPEs in block 00 to 3F1019client # [ 0.384154] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1020client # [ 0.385156] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1021worker2 # [ 0.381995] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1022client # [ 0.386160] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1023worker2 # [ 0.383399] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1024client # [ 0.387179] pci_bus 0000:00: root bus resource [bus 00-ff]1025worker2 # [ 0.384271] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1026client # [ 0.388005] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1027worker2 # [ 0.385316] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1028worker1 # [ 0.377574] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1029client # [ 0.389726] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1030worker2 # [ 0.386603] PCI host bridge to bus 0000:001031worker1 # [ 0.378395] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1032worker2 # [ 0.387195] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1033lb # [ 0.374243] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1034worker1 # [ 0.379736] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1035worker2 # [ 0.388191] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1036worker1 # [ 0.380781] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1037worker2 # [ 0.389191] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1038lb # [ 0.375220] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1039worker1 # [ 0.382054] PCI host bridge to bus 0000:001040worker2 # [ 0.390190] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1041lb # [ 0.376612] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1042worker1 # [ 0.382663] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1043worker2 # [ 0.391198] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1044lb # [ 0.377657] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1045worker1 # [ 0.383658] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1046lb # [ 0.378882] PCI host bridge to bus 0000:001047worker2 # [ 0.392226] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1048worker1 # [ 0.384658] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1049worker2 # [ 0.393191] pci_bus 0000:00: root bus resource [bus 00-ff]1050lb # [ 0.379540] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1051worker1 # [ 0.385659] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1052client # [ 0.392462] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1053lb # [ 0.380535] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1054worker2 # [ 0.394224] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1055client # [ 0.393326] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1056worker1 # [ 0.386658] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1057lb # [ 0.381535] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1058client # [ 0.394257] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1059worker1 # [ 0.387658] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1060worker2 # [ 0.395657] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1061lb # [ 0.382535] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1062worker1 # [ 0.388658] pci_bus 0000:00: root bus resource [bus 00-ff]1063client # [ 0.395448] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1064lb # [ 0.383535] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1065worker1 # [ 0.389581] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1066lb # [ 0.384535] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1067client # [ 0.396995] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1068lb # [ 0.385535] pci_bus 0000:00: root bus resource [bus 00-ff]1069worker1 # [ 0.391096] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1070lb # [ 0.386511] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1071client # [ 0.399301] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1072lb # [ 0.388002] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1073client # [ 0.400144] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1074client # [ 0.400999] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1075client # [ 0.401276] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1076client # [ 0.402950] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1077worker2 # [ 0.398262] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1078worker2 # [ 0.399203] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1079worker1 # [ 0.393731] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1080client # [ 0.405297] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1081worker2 # [ 0.400181] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1082client # [ 0.406130] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1083worker1 # [ 0.394717] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1084client # [ 0.406991] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1085worker1 # [ 0.395680] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1086worker2 # [ 0.401340] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1087lb # [ 0.390734] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1088worker1 # [ 0.397014] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1089client # [ 0.407887] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1090worker2 # [ 0.402954] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1091lb # [ 0.391646] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1092lb # [ 0.392567] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1093worker1 # [ 0.398475] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1094worker2 # [ 0.406210] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1095lb # [ 0.393995] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1096client # [ 0.410370] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1097client # [ 0.411277] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1098worker1 # [ 0.400668] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1099worker2 # [ 0.407517] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1100worker1 # [ 0.401500] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1101client # [ 0.412188] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1102worker2 # [ 0.408213] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1103lb # [ 0.395522] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1104worker1 # [ 0.402368] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1105worker2 # [ 0.409196] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1106client # [ 0.413621] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1107worker1 # [ 0.403072] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1108worker2 # [ 0.410750] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1109worker1 # [ 0.404243] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1110client # [ 0.415298] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1111lb # [ 0.398548] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1112client # [ 0.416144] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1113lb # [ 0.399546] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1114worker2 # [ 0.413210] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1115client # [ 0.417000] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1116lb # [ 0.400563] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1117worker1 # [ 0.405667] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1118worker2 # [ 0.414064] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1119lb # [ 0.401544] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1120worker1 # [ 0.406505] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1121worker2 # [ 0.414930] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1122client # [ 0.417806] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1123worker1 # [ 0.407413] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1124lb # [ 0.403228] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1125worker2 # [ 0.416276] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1126client # [ 0.420278] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1127worker1 # [ 0.408237] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1128client # [ 0.421098] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1129client # [ 0.422013] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1130worker2 # [ 0.418211] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1131lb # [ 0.406547] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1132worker2 # [ 0.419064] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1133worker1 # [ 0.410666] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1134lb # [ 0.407496] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1135client # [ 0.422942] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1136worker1 # [ 0.411496] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1137worker2 # [ 0.419904] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1138lb # [ 0.408334] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1139worker1 # [ 0.412371] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1140worker2 # [ 0.420736] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1141lb # [ 0.410145] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1142worker1 # [ 0.413254] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143client # [ 0.425281] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1144client # [ 0.426280] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1145client # [ 0.427230] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1146worker1 # [ 0.415675] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1147lb # [ 0.412511] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1148worker1 # [ 0.416494] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1149worker2 # [ 0.423455] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1150lb # [ 0.413243] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1151client # [ 0.428641] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1152worker2 # [ 0.424795] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1153lb # [ 0.413564] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1154worker1 # [ 0.417354] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1155worker2 # [ 0.425212] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1156client # [ 0.430297] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1157client # [ 0.431120] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1158worker1 # [ 0.418241] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1159lb # [ 0.415236] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1160worker2 # [ 0.426771] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1161client # [ 0.431977] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1162client # [ 0.432276] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1163worker1 # [ 0.419676] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1164worker1 # [ 0.420513] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1165lb # [ 0.417545] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1166worker2 # [ 0.428978] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1167worker1 # [ 0.421368] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1168lb # [ 0.418484] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1169worker2 # [ 0.429843] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1170client # [ 0.433799] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1171lb # [ 0.419323] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1172worker2 # [ 0.430212] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1173worker1 # [ 0.422283] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1174client # [ 0.435136] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1175client # [ 0.436008] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1176lb # [ 0.420941] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1177worker2 # [ 0.432652] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1178client # [ 0.436851] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1179worker1 # [ 0.424804] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1180worker1 # [ 0.425666] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1181worker2 # [ 0.435170] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1182lb # [ 0.423545] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1183client # [ 0.438321] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1184worker1 # [ 0.426602] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1185worker2 # [ 0.435843] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1186lb # [ 0.424542] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1187client # [ 0.439214] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1188worker2 # [ 0.436212] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1189lb # [ 0.425464] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1190worker1 # [ 0.428046] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1191client # [ 0.440013] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1192worker2 # [ 0.437854] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1193lb # [ 0.426987] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1194worker1 # [ 0.429665] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1195client # [ 0.440827] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1196worker1 # [ 0.430504] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1197lb # [ 0.428554] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1198worker1 # [ 0.431426] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1199client # [ 0.442299] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1200lb # [ 0.429385] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1201worker1 # [ 0.431664] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1202client # [ 0.443149] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1203worker2 # [ 0.440130] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1204lb # [ 0.430259] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1205worker2 # [ 0.440848] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1206client # [ 0.443991] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1207worker1 # [ 0.433411] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1208worker2 # [ 0.441215] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1209lb # [ 0.431092] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1210client # [ 0.444829] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1211worker2 # [ 0.442197] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1212worker1 # [ 0.435564] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1213client # [ 0.445825] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1214worker1 # [ 0.436379] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1215lb # [ 0.432542] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1216worker2 # [ 0.443783] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1217lb # [ 0.433411] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1218client # [ 0.446467] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1219worker1 # [ 0.437221] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1220lb # [ 0.434252] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1221worker2 # [ 0.445204] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1222client # [ 0.447816] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1223lb # [ 0.434541] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1224worker2 # [ 0.446156] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1225worker1 # [ 0.438666] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1226lb # [ 0.436041] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1227worker1 # [ 0.439494] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1228worker2 # [ 0.447595] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1229worker1 # [ 0.440394] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1230lb # [ 0.437558] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1231worker1 # [ 0.442026] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1232lb # [ 0.438508] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1233worker2 # [ 0.450965] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1234worker2 # [ 0.451838] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1235worker1 # [ 0.443665] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1236lb # [ 0.439910] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1237worker1 # [ 0.444496] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1238worker2 # [ 0.452213] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1239worker1 # [ 0.445371] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1240lb # [ 0.441553] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1241worker2 # [ 0.453753] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1242lb # [ 0.442411] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1243worker1 # [ 0.446228] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1244lb # [ 0.443292] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1245client # [ 0.448481] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1246worker1 # [ 0.447237] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1247lb # [ 0.444088] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1248worker2 # [ 0.455226] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1249client # [ 0.450810] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1250worker1 # [ 0.447992] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1251worker2 # [ 0.456199] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1252client # [ 0.451539] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1253worker1 # [ 0.449194] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1254worker2 # [ 0.457155] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1255client # [ 0.452775] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1256lb # [ 0.445797] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1257worker2 # [ 0.458587] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1258lb # [ 0.446542] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1259client # [ 0.453486] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1260lb # [ 0.447468] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1261worker2 # [ 0.460010] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1262client # [ 0.454553] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1263lb # [ 0.448970] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1264worker2 # [ 0.461011] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1265client # [ 0.455549] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1266lb # [ 0.450072] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1267worker2 # [ 0.462908] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1268client # [ 0.457097] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1269lb # [ 0.450740] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1270client # [ 0.457916] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1271lb # [ 0.452087] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1272client # [ 0.458584] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1273client # [ 0.459892] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1274worker1 # [ 0.449875] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1275worker1 # [ 0.452169] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1276worker1 # [ 0.452933] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1277client # [ 0.463442] ACPI: PCI: Interrupt link LNKA configured for IRQ 101278worker1 # [ 0.454194] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1279client # [ 0.464380] ACPI: PCI: Interrupt link LNKB configured for IRQ 101280client # [ 0.465371] ACPI: PCI: Interrupt link LNKC configured for IRQ 111281worker1 # [ 0.454874] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1282client # [ 0.466370] ACPI: PCI: Interrupt link LNKD configured for IRQ 111283client # [ 0.467365] ACPI: PCI: Interrupt link LNKE configured for IRQ 101284worker2 # [ 0.463387] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1285worker1 # [ 0.455963] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1286client # [ 0.468368] ACPI: PCI: Interrupt link LNKF configured for IRQ 101287worker1 # [ 0.456916] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1288client # [ 0.469369] ACPI: PCI: Interrupt link LNKG configured for IRQ 111289lb # [ 0.452739] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1290client # [ 0.470368] ACPI: PCI: Interrupt link LNKH configured for IRQ 111291worker1 # [ 0.458484] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1292client # [ 0.471310] ACPI: PCI: Interrupt link GSIA configured for IRQ 161293worker1 # [ 0.459307] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1294client # [ 0.472283] ACPI: PCI: Interrupt link GSIB configured for IRQ 171295worker2 # [ 0.466865] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1296client # [ 0.473247] ACPI: PCI: Interrupt link GSIC configured for IRQ 181297worker1 # [ 0.459979] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1298lb # [ 0.456162] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1299worker2 # [ 0.467457] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1300client # [ 0.473980] ACPI: PCI: Interrupt link GSID configured for IRQ 191301worker1 # [ 0.461264] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1302client # [ 0.474282] ACPI: PCI: Interrupt link GSIE configured for IRQ 201303lb # [ 0.456848] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1304worker2 # [ 0.469229] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1305client # [ 0.475194] ACPI: PCI: Interrupt link GSIF configured for IRQ 211306client # [ 0.475978] ACPI: PCI: Interrupt link GSIG configured for IRQ 221307lb # [ 0.458544] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1308worker2 # [ 0.470460] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1309client # [ 0.476282] ACPI: PCI: Interrupt link GSIH configured for IRQ 231310worker1 # [ 0.464944] ACPI: PCI: Interrupt link LNKA configured for IRQ 101311lb # [ 0.459731] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1312worker2 # [ 0.471486] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1313client # [ 0.478247] iommu: Default domain type: Translated1314worker1 # [ 0.465763] ACPI: PCI: Interrupt link LNKB configured for IRQ 101315lb # [ 0.460820] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1316client # [ 0.478857] iommu: DMA domain TLB invalidation policy: lazy mode1317worker2 # [ 0.472447] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1318worker1 # [ 0.466757] ACPI: PCI: Interrupt link LNKC configured for IRQ 111319client # [ 0.479561] ACPI: bus type USB registered1320worker1 # [ 0.467759] ACPI: PCI: Interrupt link LNKD configured for IRQ 111321lb # [ 0.461863] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1322client # [ 0.480312] usbcore: registered new interface driver usbfs1323worker1 # [ 0.468756] ACPI: PCI: Interrupt link LNKE configured for IRQ 101324client # [ 0.481193] usbcore: registered new interface driver hub1325worker2 # [ 0.474961] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1326client # [ 0.481906] usbcore: registered new device driver usb1327worker1 # [ 0.469755] ACPI: PCI: Interrupt link LNKF configured for IRQ 101328worker2 # [ 0.475198] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1329lb # [ 0.463583] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1330worker1 # [ 0.470766] ACPI: PCI: Interrupt link LNKG configured for IRQ 111331client # [ 0.483145] NetLabel: Initializing1332lb # [ 0.464429] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1333worker2 # [ 0.476563] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1334client # [ 0.483679] NetLabel: domain hash size = 1281335worker1 # [ 0.471894] ACPI: PCI: Interrupt link LNKH configured for IRQ 111336client # [ 0.484270] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1337lb # [ 0.465604] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1338worker1 # [ 0.472698] ACPI: PCI: Interrupt link GSIA configured for IRQ 161339worker2 # [ 0.478067] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1340client # [ 0.485326] NetLabel: unlabeled traffic allowed by default1341worker1 # [ 0.473675] ACPI: PCI: Interrupt link GSIB configured for IRQ 171342client # [ 0.486223] PCI: Using ACPI for IRQ routing1343lb # [ 0.467564] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1344worker1 # [ 0.474674] ACPI: PCI: Interrupt link GSIC configured for IRQ 181345worker1 # [ 0.475671] ACPI: PCI: Interrupt link GSID configured for IRQ 191346worker1 # [ 0.476671] ACPI: PCI: Interrupt link GSIE configured for IRQ 201347worker1 # [ 0.477639] ACPI: PCI: Interrupt link GSIF configured for IRQ 211348worker2 # [ 0.481970] ACPI: PCI: Interrupt link LNKA configured for IRQ 101349worker1 # [ 0.478449] ACPI: PCI: Interrupt link GSIG configured for IRQ 221350lb # [ 0.471524] ACPI: PCI: Interrupt link LNKA configured for IRQ 101351worker2 # [ 0.483306] ACPI: PCI: Interrupt link LNKB configured for IRQ 101352worker1 # [ 0.479388] ACPI: PCI: Interrupt link GSIH configured for IRQ 231353lb # [ 0.472378] ACPI: PCI: Interrupt link LNKB configured for IRQ 101354worker2 # [ 0.484298] ACPI: PCI: Interrupt link LNKC configured for IRQ 111355lb # [ 0.473389] ACPI: PCI: Interrupt link LNKC configured for IRQ 111356worker2 # [ 0.485295] ACPI: PCI: Interrupt link LNKD configured for IRQ 111357worker1 # [ 0.480753] iommu: Default domain type: Translated1358lb # [ 0.474407] ACPI: PCI: Interrupt link LNKD configured for IRQ 111359worker2 # [ 0.486296] ACPI: PCI: Interrupt link LNKE configured for IRQ 101360worker1 # [ 0.481553] iommu: DMA domain TLB invalidation policy: lazy mode1361lb # [ 0.475386] ACPI: PCI: Interrupt link LNKE configured for IRQ 101362worker2 # [ 0.487290] ACPI: PCI: Interrupt link LNKF configured for IRQ 101363worker1 # [ 0.482691] ACPI: bus type USB registered1364lb # [ 0.476379] ACPI: PCI: Interrupt link LNKF configured for IRQ 101365worker2 # [ 0.488302] ACPI: PCI: Interrupt link LNKG configured for IRQ 111366worker1 # [ 0.483423] usbcore: registered new interface driver usbfs1367lb # [ 0.477366] ACPI: PCI: Interrupt link LNKG configured for IRQ 111368worker1 # [ 0.483675] usbcore: registered new interface driver hub1369worker2 # [ 0.489291] ACPI: PCI: Interrupt link LNKH configured for IRQ 111370worker1 # [ 0.484529] usbcore: registered new device driver usb1371lb # [ 0.478373] ACPI: PCI: Interrupt link LNKH configured for IRQ 111372worker2 # [ 0.490227] ACPI: PCI: Interrupt link GSIA configured for IRQ 161373lb # [ 0.479327] ACPI: PCI: Interrupt link GSIA configured for IRQ 161374worker2 # [ 0.491201] ACPI: PCI: Interrupt link GSIB configured for IRQ 171375worker1 # [ 0.486218] NetLabel: Initializing1376worker1 # [ 0.486659] NetLabel: domain hash size = 1281377lb # [ 0.480315] ACPI: PCI: Interrupt link GSIB configured for IRQ 171378worker2 # [ 0.492211] ACPI: PCI: Interrupt link GSIC configured for IRQ 181379worker1 # [ 0.487388] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1380lb # [ 0.480551] ACPI: PCI: Interrupt link GSIC configured for IRQ 181381worker2 # [ 0.493208] ACPI: PCI: Interrupt link GSID configured for IRQ 191382worker1 # [ 0.487724] NetLabel: unlabeled traffic allowed by default1383lb # [ 0.481515] ACPI: PCI: Interrupt link GSID configured for IRQ 191384worker1 # [ 0.488638] PCI: Using ACPI for IRQ routing1385lb # [ 0.482288] ACPI: PCI: Interrupt link GSIE configured for IRQ 201386lb # [ 0.482551] ACPI: PCI: Interrupt link GSIF configured for IRQ 211387worker2 # [ 0.494205] ACPI: PCI: Interrupt link GSIE configured for IRQ 201388worker2 # [ 0.495285] ACPI: PCI: Interrupt link GSIF configured for IRQ 211389lb # [ 0.483547] ACPI: PCI: Interrupt link GSIG configured for IRQ 221390worker2 # [ 0.496436] ACPI: PCI: Interrupt link GSIG configured for IRQ 221391lb # [ 0.484553] ACPI: PCI: Interrupt link GSIH configured for IRQ 231392worker2 # [ 0.497206] ACPI: PCI: Interrupt link GSIH configured for IRQ 231393lb # [ 0.486567] iommu: Default domain type: Translated1394worker2 # [ 0.499669] iommu: Default domain type: Translated1395lb # [ 0.487396] iommu: DMA domain TLB invalidation policy: lazy mode1396worker2 # [ 0.500198] iommu: DMA domain TLB invalidation policy: lazy mode1397lb # [ 0.488565] ACPI: bus type USB registered1398lb # [ 0.489294] usbcore: registered new interface driver usbfs1399worker2 # [ 0.501512] ACPI: bus type USB registered1400lb # [ 0.489548] usbcore: registered new interface driver hub1401worker2 # [ 0.502257] usbcore: registered new interface driver usbfs1402lb # [ 0.490423] usbcore: registered new device driver usb1403worker2 # [ 0.503190] usbcore: registered new interface driver hub1404worker2 # [ 0.504085] usbcore: registered new device driver usb1405lb # [ 0.492130] NetLabel: Initializing1406lb # [ 0.492536] NetLabel: domain hash size = 1281407worker2 # [ 0.505901] NetLabel: Initializing1408lb # [ 0.493304] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1409worker2 # [ 0.506191] NetLabel: domain hash size = 1281410lb # [ 0.493602] NetLabel: unlabeled traffic allowed by default1411worker2 # [ 0.506932] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1412lb # [ 0.494526] PCI: Using ACPI for IRQ routing1413worker2 # [ 0.507230] NetLabel: unlabeled traffic allowed by default1414worker2 # [ 0.508166] PCI: Using ACPI for IRQ routing1415client # [ 0.530033] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416client # [ 0.530266] pci 0000:00:01.0: vgaarb: bridge control possible1417client # [ 0.530266] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418client # [ 0.530274] vgaarb: loaded1419client # [ 0.531011] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420client # [ 0.531272] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421client # [ 0.534360] clocksource: Switched to clocksource kvm-clock1422client # [ 0.536045] VFS: Disk quotas dquot_6.6.01423client # [ 0.538692] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424client # [ 0.540070] pnp: PnP ACPI init1425client # [ 0.540877] ACPI: IRQ 4 override to edge(!), high(!)1426client # [ 0.541894] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1427worker1 # [ 0.532456] pci 0000:00:01.0: vgaarb: setting as boot VGA device1428client # [ 0.543401] pnp: PnP ACPI: found 6 devices1429worker1 # [ 0.532654] pci 0000:00:01.0: vgaarb: bridge control possible1430worker1 # [ 0.532654] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1431worker1 # [ 0.532663] vgaarb: loaded1432worker1 # [ 0.533485] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01433worker1 # [ 0.534311] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1434client # [ 0.551056] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1435client # [ 0.552487] clocksource: Switched to clocksource acpi_pm1436client # [ 0.553434] NET: Registered PF_INET protocol family1437client # [ 0.554617] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1438worker1 # [ 0.541760] clocksource: Switched to clocksource kvm-clock1439worker1 # [ 0.545507] VFS: Disk quotas dquot_6.6.01440lb # [ 0.540140] pci 0000:00:01.0: vgaarb: setting as boot VGA device1441worker2 # [ 0.553124] pci 0000:00:01.0: vgaarb: setting as boot VGA device1442lb # [ 0.540531] pci 0000:00:01.0: vgaarb: bridge control possible1443worker1 # [ 0.546207] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1444worker2 # [ 0.553186] pci 0000:00:01.0: vgaarb: bridge control possible1445worker1 # [ 0.547591] pnp: PnP ACPI init1446worker2 # [ 0.553186] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1447lb # [ 0.540531] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1448worker2 # [ 0.553195] vgaarb: loaded1449lb # [ 0.540541] vgaarb: loaded1450worker1 # [ 0.548392] ACPI: IRQ 4 override to edge(!), high(!)1451worker2 # [ 0.553940] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01452lb # [ 0.541294] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01453worker1 # [ 0.549379] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1454worker2 # [ 0.554191] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1455lb # [ 0.541537] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1456worker1 # [ 0.550917] pnp: PnP ACPI: found 6 devices1457lb # [ 0.544638] clocksource: Switched to clocksource kvm-clock1458worker2 # [ 0.560303] clocksource: Switched to clocksource kvm-clock1459client # [ 0.571657] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1460lb # [ 0.548301] VFS: Disk quotas dquot_6.6.01461client # [ 0.573162] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1462lb # [ 0.549018] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1463worker1 # [ 0.558668] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1464lb # [ 0.550459] pnp: PnP ACPI init1465worker1 # [ 0.560126] clocksource: Switched to clocksource acpi_pm1466client # [ 0.574428] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1467lb # [ 0.551291] ACPI: IRQ 4 override to edge(!), high(!)1468worker2 # [ 0.564124] VFS: Disk quotas dquot_6.6.01469worker1 # [ 0.561092] NET: Registered PF_INET protocol family1470client # [ 0.575708] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1471worker2 # [ 0.564824] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1472lb # [ 0.552291] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1473client # [ 0.576917] TCP: Hash tables configured (established 16384 bind 16384)1474worker1 # [ 0.562363] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1475worker2 # [ 0.566193] pnp: PnP ACPI init1476lb # [ 0.553779] pnp: PnP ACPI: found 6 devices1477client # [ 0.577964] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1478worker2 # [ 0.567041] ACPI: IRQ 4 override to edge(!), high(!)1479client # [ 0.579195] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1480worker2 # [ 0.568053] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1481client # [ 0.580236] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1482worker2 # [ 0.569558] pnp: PnP ACPI: found 6 devices1483client # [ 0.581443] NET: Registered PF_UNIX/PF_LOCAL protocol family1484client # [ 0.582391] NET: Registered PF_XDP protocol family1485client # [ 0.583218] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1486client # [ 0.584211] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1487client # [ 0.585182] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1488lb # [ 0.561463] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1489client # [ 0.586242] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1490lb # [ 0.562910] clocksource: Switched to clocksource acpi_pm1491client # [ 0.587297] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1492lb # [ 0.563917] NET: Registered PF_INET protocol family1493client # [ 0.588359] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1494worker2 # [ 0.577302] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1495lb # [ 0.565220] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1496client # [ 0.590003] ACPI: \_SB_.GSIA: Enabled at IRQ 161497worker2 # [ 0.578774] clocksource: Switched to clocksource acpi_pm1498worker2 # [ 0.579799] NET: Registered PF_INET protocol family1499client # [ 0.592200] ACPI: \_SB_.GSIB: Enabled at IRQ 171500worker2 # [ 0.580982] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1501client # [ 0.594070] ACPI: \_SB_.GSIC: Enabled at IRQ 181502worker1 # [ 0.579450] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1503worker1 # [ 0.581077] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1504client # [ 0.596027] ACPI: \_SB_.GSID: Enabled at IRQ 191505worker1 # [ 0.582429] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1506client # [ 0.597688] PCI: CLS 0 bytes, default 641507worker1 # [ 0.583838] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1508client # [ 0.598557] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1509worker1 # [ 0.585227] TCP: Hash tables configured (established 16384 bind 16384)1510client # [ 0.600321] Trying to unpack rootfs image as initramfs...1511worker1 # [ 0.586478] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1512worker1 # [ 0.587947] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1513worker1 # [ 0.589196] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1514worker1 # [ 0.590460] NET: Registered PF_UNIX/PF_LOCAL protocol family1515worker1 # [ 0.591492] NET: Registered PF_XDP protocol family1516worker1 # [ 0.592372] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1517lb # [ 0.582260] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1518worker1 # [ 0.593424] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1519lb # [ 0.584132] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1520worker1 # [ 0.594474] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1521worker1 # [ 0.595646] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1522lb # [ 0.585485] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1523worker2 # [ 0.598557] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1524worker1 # [ 0.596769] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1525lb # [ 0.587154] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1526worker2 # [ 0.600183] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1527worker1 # [ 0.597912] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1528lb # [ 0.588413] TCP: Hash tables configured (established 16384 bind 16384)1529worker2 # [ 0.601475] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1530worker1 # [ 0.599709] ACPI: \_SB_.GSIA: Enabled at IRQ 161531lb # [ 0.589539] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1532worker2 # [ 0.602792] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1533lb # [ 0.590814] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1534worker2 # [ 0.604009] TCP: Hash tables configured (established 16384 bind 16384)1535worker1 # [ 0.601993] ACPI: \_SB_.GSIB: Enabled at IRQ 171536lb # [ 0.591904] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1537worker2 # [ 0.605123] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1538lb # [ 0.593179] NET: Registered PF_UNIX/PF_LOCAL protocol family1539worker2 # [ 0.606424] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1540lb # [ 0.594173] NET: Registered PF_XDP protocol family1541worker1 # [ 0.604747] ACPI: \_SB_.GSIC: Enabled at IRQ 181542worker2 # [ 0.607501] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1543lb # [ 0.594997] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1544worker2 # [ 0.608724] NET: Registered PF_UNIX/PF_LOCAL protocol family1545lb # [ 0.596005] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1546worker2 # [ 0.609689] NET: Registered PF_XDP protocol family1547worker1 # [ 0.606928] ACPI: \_SB_.GSID: Enabled at IRQ 191548lb # [ 0.596986] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1549worker2 # [ 0.610537] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1550lb # [ 0.598075] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1551worker1 # [ 0.608734] PCI: CLS 0 bytes, default 641552worker2 # [ 0.611569] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1553lb # [ 0.599211] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1554worker2 # [ 0.612590] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1555lb # [ 0.600329] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1556worker1 # [ 0.609703] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1557worker2 # [ 0.613669] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1558worker1 # [ 0.611465] Trying to unpack rootfs image as initramfs...1559lb # [ 0.602042] ACPI: \_SB_.GSIA: Enabled at IRQ 161560worker2 # [ 0.614734] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1561worker2 # [ 0.615814] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1562lb # [ 0.604344] ACPI: \_SB_.GSIB: Enabled at IRQ 171563worker2 # [ 0.617538] ACPI: \_SB_.GSIA: Enabled at IRQ 161564lb # [ 0.606425] ACPI: \_SB_.GSIC: Enabled at IRQ 181565worker2 # [ 0.620359] ACPI: \_SB_.GSIB: Enabled at IRQ 171566lb # [ 0.608472] ACPI: \_SB_.GSID: Enabled at IRQ 191567worker2 # [ 0.622221] ACPI: \_SB_.GSIC: Enabled at IRQ 181568lb # [ 0.610250] PCI: CLS 0 bytes, default 641569lb # [ 0.611246] Trying to unpack rootfs image as initramfs...1570worker2 # [ 0.624140] ACPI: \_SB_.GSID: Enabled at IRQ 191571worker2 # [ 0.625800] PCI: CLS 0 bytes, default 641572worker2 # [ 0.626722] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1573worker2 # [ 0.628495] Trying to unpack rootfs image as initramfs...1574lb # [ 0.615310] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1575client # [ 0.647547] Initialise system trusted keyrings1576client # [ 0.648494] workingset: timestamp_bits=40 max_order=19 bucket_order=01577client # [ 0.670145] Key type asymmetric registered1578worker1 # [ 0.656471] Initialise system trusted keyrings1579client # [ 0.671165] Asymmetric key parser 'x509' registered1580client # [ 0.671977] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1581worker1 # [ 0.660252] workingset: timestamp_bits=40 max_order=19 bucket_order=01582client # [ 0.677273] io scheduler mq-deadline registered1583client # [ 0.678041] io scheduler kyber registered1584lb # [ 0.657490] Initialise system trusted keyrings1585client # [ 0.681767] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1586client # [ 0.683148] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1587lb # [ 0.661179] workingset: timestamp_bits=40 max_order=19 bucket_order=01588worker2 # [ 0.674806] Initialise system trusted keyrings1589client # [ 0.686734] Linux agpgart interface v0.1031590client # [ 0.687534] ACPI: bus type drm_connector registered1591worker2 # [ 0.675807] workingset: timestamp_bits=40 max_order=19 bucket_order=01592client # [ 0.690678] usbcore: registered new interface driver usbserial_generic1593client # [ 0.691779] usbserial: USB Serial support registered for generic1594worker1 # [ 0.679822] Key type asymmetric registered1595client # [ 0.695118] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1596client # [ 0.695118] Please enable it if your BIOS has the CPPC option.1597worker1 # [ 0.683039] Asymmetric key parser 'x509' registered1598client # [ 0.697421] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1599worker1 # [ 0.683888] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1600client # [ 0.701236] drop_monitor: Initializing network drop monitor service1601worker1 # [ 0.687161] io scheduler mq-deadline registered1602worker1 # [ 0.687956] io scheduler kyber registered1603client # [ 0.702407] NET: Registered PF_INET6 protocol family1604client # [ 0.705567] Segment Routing with IPv61605worker1 # [ 0.691767] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1606lb # [ 0.682487] Key type asymmetric registered1607client # [ 0.708284] In-situ OAM (IOAM) with IPv61608client # [ 0.709378] IPI shorthand broadcast: enabled1609lb # [ 0.685165] Asymmetric key parser 'x509' registered1610worker1 # [ 0.695054] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1611lb # [ 0.686060] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1612worker2 # [ 0.699621] Key type asymmetric registered1613worker2 # [ 0.700385] Asymmetric key parser 'x509' registered1614worker1 # [ 0.698720] Linux agpgart interface v0.1031615worker2 # [ 0.701191] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1616lb # [ 0.689270] io scheduler mq-deadline registered1617worker1 # [ 0.699513] ACPI: bus type drm_connector registered1618lb # [ 0.690048] io scheduler kyber registered1619lb # [ 0.692732] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1620client # [ 0.717689] sched_clock: Marking stable (582015025, 135082305)->(791128534, -74031204)1621worker2 # [ 0.706715] io scheduler mq-deadline registered1622worker1 # [ 0.703573] usbcore: registered new interface driver usbserial_generic1623lb # [ 0.694062] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1624worker2 # [ 0.707508] io scheduler kyber registered1625worker1 # [ 0.704680] usbserial: USB Serial support registered for generic1626worker1 # [ 0.707184] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1627worker1 # [ 0.707184] Please enable it if your BIOS has the CPPC option.1628client # [ 0.723302] registered taskstats version 11629worker2 # [ 0.711512] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1630lb # [ 0.699768] Linux agpgart interface v0.1031631client # [ 0.724231] Loading compiled-in X.509 certificates1632worker1 # [ 0.709393] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1633worker2 # [ 0.712788] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1634lb # [ 0.700653] ACPI: bus type drm_connector registered1635worker1 # [ 0.712208] drop_monitor: Initializing network drop monitor service1636worker1 # [ 0.713447] NET: Registered PF_INET6 protocol family1637lb # [ 0.703689] usbcore: registered new interface driver usbserial_generic1638worker2 # [ 0.717492] Linux agpgart interface v0.1031639lb # [ 0.704833] usbserial: USB Serial support registered for generic1640worker2 # [ 0.718227] ACPI: bus type drm_connector registered1641worker1 # [ 0.718634] Segment Routing with IPv61642lb # [ 0.708156] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1643worker2 # [ 0.721459] usbcore: registered new interface driver usbserial_generic1644worker1 # [ 0.719349] In-situ OAM (IOAM) with IPv61645lb # [ 0.708156] Please enable it if your BIOS has the CPPC option.1646worker2 # [ 0.722520] usbserial: USB Serial support registered for generic1647lb # [ 0.710483] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1648worker1 # [ 0.722480] IPI shorthand broadcast: enabled1649worker2 # [ 0.725315] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1650worker2 # [ 0.725315] Please enable it if your BIOS has the CPPC option.1651lb # [ 0.714281] drop_monitor: Initializing network drop monitor service1652worker2 # [ 0.727539] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1653lb # [ 0.715534] NET: Registered PF_INET6 protocol family1654client # [ 0.740681] Demotion targets for Node 0: null1655worker2 # [ 0.730468] drop_monitor: Initializing network drop monitor service1656worker2 # [ 0.731676] NET: Registered PF_INET6 protocol family1657lb # [ 0.719611] Segment Routing with IPv61658worker1 # [ 0.728856] sched_clock: Marking stable (592014187, 136013390)->(802927175, -74899598)1659client # [ 0.744146] Key type .fscrypt registered1660client # [ 0.744792] Key type fscrypt-provisioning registered1661client # [ 0.745792] ima: No TPM chip found, activating TPM-bypass!1662lb # [ 0.723161] In-situ OAM (IOAM) with IPv61663client # [ 0.748128] ima: Allocated hash algorithm: sha11664worker2 # [ 0.736663] Segment Routing with IPv61665lb # [ 0.724308] IPI shorthand broadcast: enabled1666worker2 # [ 0.737384] In-situ OAM (IOAM) with IPv61667client # [ 0.748915] ima: No architecture policies found1668worker1 # [ 0.735300] registered taskstats version 11669worker1 # [ 0.736319] Loading compiled-in X.509 certificates1670client # [ 0.751113] PM: Magic number: 10:616:3801671worker2 # [ 0.739608] IPI shorthand broadcast: enabled1672client # [ 0.752813] RAS: Correctable Errors collector initialized.1673lb # [ 0.732638] sched_clock: Marking stable (598016008, 134111200)->(809993030, -77865822)1674worker2 # [ 0.747908] sched_clock: Marking stable (612017498, 135287363)->(832092150, -84787289)1675lb # [ 0.737294] registered taskstats version 11676lb # [ 0.738339] Loading compiled-in X.509 certificates1677client # [ 0.762913] clk: Disabling unused clocks1678worker2 # [ 0.752419] registered taskstats version 11679worker2 # [ 0.753387] Loading compiled-in X.509 certificates1680client # [ 0.767120] PM: genpd: Disabling unused power domains1681worker1 # [ 0.755781] Demotion targets for Node 0: null1682worker1 # [ 0.758106] Key type .fscrypt registered1683worker1 # [ 0.758790] Key type fscrypt-provisioning registered1684worker1 # [ 0.759764] ima: No TPM chip found, activating TPM-bypass!1685worker1 # [ 0.764050] ima: Allocated hash algorithm: sha11686worker1 # [ 0.764859] ima: No architecture policies found1687worker1 # [ 0.767051] PM: Magic number: 10:616:3801688lb # [ 0.757162] Demotion targets for Node 0: null1689lb # [ 0.758158] Key type .fscrypt registered1690lb # [ 0.758898] Key type fscrypt-provisioning registered1691worker1 # [ 0.768859] RAS: Correctable Errors collector initialized.1692worker2 # [ 0.772319] Demotion targets for Node 0: null1693lb # [ 0.759924] ima: No TPM chip found, activating TPM-bypass!1694worker2 # [ 0.773191] Key type .fscrypt registered1695worker2 # [ 0.773894] Key type fscrypt-provisioning registered1696worker2 # [ 0.774847] ima: No TPM chip found, activating TPM-bypass!1697lb # [ 0.763153] ima: Allocated hash algorithm: sha11698lb # [ 0.764045] ima: No architecture policies found1699worker2 # [ 0.777324] ima: Allocated hash algorithm: sha11700worker2 # [ 0.778088] ima: No architecture policies found1701worker1 # [ 0.776748] clk: Disabling unused clocks1702lb # [ 0.768149] PM: Magic number: 10:616:3801703worker2 # [ 0.782324] PM: Magic number: 10:616:3801704lb # [ 0.769877] RAS: Correctable Errors collector initialized.1705worker1 # [ 0.781041] PM: genpd: Disabling unused power domains1706worker2 # [ 0.784024] RAS: Correctable Errors collector initialized.1707lb # [ 0.778901] clk: Disabling unused clocks1708worker2 # [ 0.792043] clk: Disabling unused clocks1709lb # [ 0.783151] PM: genpd: Disabling unused power domains1710worker2 # [ 0.796322] PM: genpd: Disabling unused power domains1711client # [ 0.941632] Freeing initrd memory: 29096K1712client # [ 0.944874] Freeing unused decrypted memory: 2028K1713client # [ 0.947607] Freeing unused kernel image (initmem) memory: 3644K1714client # [ 0.948669] Write protecting the kernel read-only data: 32768k1715client # [ 0.950556] Freeing unused kernel image (text/rodata gap) memory: 1208K1716client # [ 0.952037] Freeing unused kernel image (rodata/data gap) memory: 752K1717lb # [ 0.952947] Freeing initrd memory: 29092K1718worker2 # [ 0.968183] Freeing initrd memory: 29092K1719lb # [ 0.956301] Freeing unused decrypted memory: 2028K1720worker2 # [ 0.971672] Freeing unused decrypted memory: 2028K1721lb # [ 0.959021] Freeing unused kernel image (initmem) memory: 3644K1722lb # [ 0.960168] Write protecting the kernel read-only data: 32768k1723worker2 # [ 0.974612] Freeing unused kernel image (initmem) memory: 3644K1724lb # [ 0.962103] Freeing unused kernel image (text/rodata gap) memory: 1208K1725worker2 # [ 0.975843] Write protecting the kernel read-only data: 32768k1726lb # [ 0.963716] Freeing unused kernel image (rodata/data gap) memory: 752K1727worker2 # [ 0.977887] Freeing unused kernel image (text/rodata gap) memory: 1208K1728worker2 # [ 0.979519] Freeing unused kernel image (rodata/data gap) memory: 752K1729client # [ 1.003340] x86/mm: Checked W+X mappings: passed, no W+X pages found.1730client # [ 1.004375] Run /init as init process1731client # [ 1.014796] systemd[1]: Inserted module 'autofs4'1732worker1 # [ 1.006529] Freeing initrd memory: 29092K1733worker1 # [ 1.010086] Freeing unused decrypted memory: 2028K1734worker1 # [ 1.013087] Freeing unused kernel image (initmem) memory: 3644K1735worker1 # [ 1.014172] Write protecting the kernel read-only data: 32768k1736worker1 # [ 1.016158] Freeing unused kernel image (text/rodata gap) memory: 1208K1737client # [ 1.031675] fuse: init (API version 7.45)1738worker1 # [ 1.017707] Freeing unused kernel image (rodata/data gap) memory: 752K1739client # [ 1.037489] ACPI: \_SB_.GSIG: Enabled at IRQ 221740lb # [ 1.015031] x86/mm: Checked W+X mappings: passed, no W+X pages found.1741client # [ 1.039909] ACPI: \_SB_.GSIH: Enabled at IRQ 231742lb # [ 1.016206] Run /init as init process1743client # [ 1.042807] ACPI: \_SB_.GSIE: Enabled at IRQ 201744worker2 # [ 1.031464] x86/mm: Checked W+X mappings: passed, no W+X pages found.1745worker2 # [ 1.032586] Run /init as init process1746client # [ 1.045020] ACPI: \_SB_.GSIF: Enabled at IRQ 211747lb # [ 1.026996] systemd[1]: Inserted module 'autofs4'1748worker2 # [ 1.043788] systemd[1]: Inserted module 'autofs4'1749lb # [ 1.043461] fuse: init (API version 7.45)1750worker2 # [ 1.060969] fuse: init (API version 7.45)1751client # [ 1.072929] systemd[1]: Successfully made /usr/ read-only.1752lb # [ 1.049443] ACPI: \_SB_.GSIG: Enabled at IRQ 221753lb # [ 1.051912] ACPI: \_SB_.GSIH: Enabled at IRQ 231754worker2 # [ 1.067003] ACPI: \_SB_.GSIG: Enabled at IRQ 221755lb # [ 1.054851] ACPI: \_SB_.GSIE: Enabled at IRQ 201756worker2 # [ 1.069739] ACPI: \_SB_.GSIH: Enabled at IRQ 231757lb # [ 1.057165] ACPI: \_SB_.GSIF: Enabled at IRQ 211758worker1 # [ 1.069194] x86/mm: Checked W+X mappings: passed, no W+X pages found.1759worker2 # [ 1.072958] ACPI: \_SB_.GSIE: Enabled at IRQ 201760worker1 # [ 1.070307] Run /init as init process1761worker2 # [ 1.075425] ACPI: \_SB_.GSIF: Enabled at IRQ 211762worker1 # [ 1.081682] systemd[1]: Inserted module 'autofs4'1763lb # [ 1.085938] systemd[1]: Successfully made /usr/ read-only.1764worker1 # [ 1.099081] fuse: init (API version 7.45)1765worker2 # [ 1.105374] systemd[1]: Successfully made /usr/ read-only.1766worker1 # [ 1.105367] ACPI: \_SB_.GSIG: Enabled at IRQ 221767worker1 # [ 1.108152] ACPI: \_SB_.GSIH: Enabled at IRQ 231768worker1 # [ 1.112110] ACPI: \_SB_.GSIE: Enabled at IRQ 201769worker1 # [ 1.114587] ACPI: \_SB_.GSIF: Enabled at IRQ 211770worker1 # [ 1.143103] systemd[1]: Successfully made /usr/ read-only.1771client # [ 1.408482] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772client # [ 1.413229] systemd[1]: Detected virtualization kvm.1773client # [ 1.414044] systemd[1]: Detected architecture x86-64.1774client # [ 1.414891] systemd[1]: Running in initrd.1775client # [ 1.415989] systemd[1]: Initializing machine ID from random generator.1776client # [ 1.417172] systemd[1]: Hostname set to <client>.1777lb # [ 1.421672] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778lb # [ 1.427690] systemd[1]: Detected virtualization kvm.1779lb # [ 1.428611] systemd[1]: Detected architecture x86-64.1780lb # [ 1.430007] systemd[1]: Running in initrd.1781worker2 # [ 1.441080] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1782worker2 # [ 1.446466] systemd[1]: Detected virtualization kvm.1783lb # [ 1.432922] systemd[1]: Initializing machine ID from random generator.1784worker2 # [ 1.447414] systemd[1]: Detected architecture x86-64.1785worker2 # [ 1.448367] systemd[1]: Running in initrd.1786lb # [ 1.435874] systemd[1]: Hostname set to <lb>.1787worker2 # [ 1.449716] systemd[1]: Initializing machine ID from random generator.1788worker2 # [ 1.451034] systemd[1]: Hostname set to <worker2>.1789worker1 # [ 1.479806] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790worker1 # [ 1.492340] systemd[1]: Detected virtualization kvm.1791worker1 # [ 1.494564] systemd[1]: Detected architecture x86-64.1792worker1 # [ 1.496846] systemd[1]: Running in initrd.1793worker1 # [ 1.499551] systemd[1]: Initializing machine ID from random generator.1794worker1 # [ 1.502604] systemd[1]: Hostname set to <worker1>.1795client # [ 1.611401] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796client # [ 1.649695] systemd[1]: Queued start job for default target Initrd Default Target.1797client # [ 1.653441] systemd[1]: Created slice Slice /system/modprobe.1798client # [ 1.654598] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1799client # [ 1.655930] systemd[1]: Expecting device /dev/disk/by-label/nixos...1800client # [ 1.656973] systemd[1]: Reached target Path Units.1801client # [ 1.657796] systemd[1]: Reached target Slice Units.1802client # [ 1.658641] systemd[1]: Reached target Swaps.1803client # [ 1.659416] systemd[1]: Reached target Timer Units.1804client # [ 1.660347] systemd[1]: Listening on D-Bus System Message Bus Socket.1805worker2 # [ 1.649667] systemd[1]: bpf-restrict-fs: LSM BPF program attached1806client # [ 1.661498] systemd[1]: Listening on Journal Socket (/dev/log).1807client # [ 1.662614] systemd[1]: Listening on Journal Sockets.1808client # [ 1.663586] systemd[1]: Listening on udev Control Socket.1809client # [ 1.664567] systemd[1]: Listening on udev Kernel Socket.1810client # [ 1.665533] systemd[1]: Reached target Socket Units.1811client # [ 1.667282] systemd[1]: Starting Create List of Static Device Nodes...1812client # [ 1.670934] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1813client # [ 1.678181] systemd[1]: Starting Load Kernel Module configfs...1814lb # [ 1.664181] systemd[1]: bpf-restrict-fs: LSM BPF program attached1815client # [ 1.693308] systemd[1]: Starting Journal Service...1816worker2 # [ 1.690084] systemd[1]: Queued start job for default target Initrd Default Target.1817client # [ 1.705174] systemd[1]: Starting Load Kernel Modules...1818worker2 # [ 1.694669] systemd[1]: Created slice Slice /system/modprobe.1819worker2 # [ 1.695904] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1820worker2 # [ 1.697396] systemd[1]: Expecting device /dev/disk/by-label/nixos...1821worker2 # [ 1.698608] systemd[1]: Reached target Path Units.1822worker2 # [ 1.699527] systemd[1]: Reached target Slice Units.1823worker2 # [ 1.700464] systemd[1]: Reached target Swaps.1824worker2 # [ 1.701312] systemd[1]: Reached target Timer Units.1825worker2 # [ 1.702339] systemd[1]: Listening on D-Bus System Message Bus Socket.1826worker2 # [ 1.703635] systemd[1]: Listening on Journal Socket (/dev/log).1827worker2 # [ 1.704835] systemd[1]: Listening on Journal Sockets.1828worker2 # [ 1.705876] systemd[1]: Listening on udev Control Socket.1829worker2 # [ 1.706948] systemd[1]: Listening on udev Kernel Socket.1830worker2 # [ 1.707951] systemd[1]: Reached target Socket Units.1831worker2 # [ 1.709876] systemd[1]: Starting Create List of Static Device Nodes...1832client # [ 1.711174] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1833worker2 # [ 1.714372] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1834client # [ 1.728536] netfs: FS-Cache loaded1835worker2 # [ 1.719555] systemd[1]: Starting Load Kernel Module configfs...1836client # [ 1.733246] 9pnet: Installing 9P2000 support1837worker2 # [ 1.732944] systemd[1]: Starting Journal Service...1838worker1 # [ 1.730289] systemd[1]: bpf-restrict-fs: LSM BPF program attached1839client # [ 1.746450] systemd[1]: Starting Coldplug All udev Devices...1840lb # [ 1.727449] systemd[1]: Queued start job for default target Initrd Default Target.1841lb # [ 1.731999] systemd[1]: Created slice Slice /system/modprobe.1842lb # [ 1.733499] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1843worker2 # [ 1.747394] systemd[1]: Starting Load Kernel Modules...1844lb # [ 1.735268] systemd[1]: Expecting device /dev/disk/by-label/nixos...1845lb # [ 1.736736] systemd[1]: Reached target Path Units.1846lb # [ 1.737873] systemd[1]: Reached target Slice Units.1847lb # [ 1.739007] systemd[1]: Reached target Swaps.1848lb # [ 1.740056] systemd[1]: Reached target Timer Units.1849lb # [ 1.741453] systemd[1]: Listening on D-Bus System Message Bus Socket.1850lb # [ 1.743011] systemd[1]: Listening on Journal Socket (/dev/log).1851client # [ 1.768217] systemd[1]: Finished Create List of Static Device Nodes.1852lb # [ 1.744713] systemd[1]: Listening on Journal Sockets.1853lb # [ 1.745978] systemd[1]: Listening on udev Control Socket.1854lb # [ 1.747405] systemd[1]: Listening on udev Kernel Socket.1855lb # [ 1.748578] systemd[1]: Reached target Socket Units.1856lb # [ 1.751220] systemd[1]: Starting Create List of Static Device Nodes...1857worker2 # [ 1.754387] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1858client # [ 1.778148] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1859lb # [ 1.757220] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1860worker2 # [ 1.772926] netfs: FS-Cache loaded1861client # [ 1.787187] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1862worker2 # [ 1.778077] 9pnet: Installing 9P2000 support1863lb # [ 1.768376] systemd[1]: Starting Load Kernel Module configfs...1864worker2 # [ 1.783373] systemd[1]: Starting Coldplug All udev Devices...1865client # [ 1.794751] systemd[1]: modprobe@configfs.service: Deactivated successfully.1866worker1 # [ 1.782126] systemd[1]: Queued start job for default target Initrd Default Target.1867client # [ 1.796692] systemd-journald[67]: Collecting audit messages is disabled.1868worker1 # [ 1.785560] systemd[1]: Created slice Slice /system/modprobe.1869worker1 # [ 1.786875] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1870client # [ 1.802631] systemd[1]: Finished Load Kernel Module configfs.1871worker1 # [ 1.788420] systemd[1]: Expecting device /dev/disk/by-label/nixos...1872worker1 # [ 1.789533] systemd[1]: Reached target Path Units.1873worker1 # [ 1.790444] systemd[1]: Reached target Slice Units.1874worker1 # [ 1.791379] systemd[1]: Reached target Swaps.1875worker1 # [ 1.792289] systemd[1]: Reached target Timer Units.1876worker1 # [ 1.793356] systemd[1]: Listening on D-Bus System Message Bus Socket.1877client # [ 1.807733] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1878worker1 # [ 1.794594] systemd[1]: Listening on Journal Socket (/dev/log).1879lb # [ 1.785710] systemd[1]: Starting Journal Service...1880worker1 # [ 1.795809] systemd[1]: Listening on Journal Sockets.1881worker1 # [ 1.796892] systemd[1]: Listening on udev Control Socket.1882client # [ 1.810330] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1883worker1 # [ 1.797931] systemd[1]: Listening on udev Kernel Socket.1884worker1 # [ 1.798965] systemd[1]: Reached target Socket Units.1885worker2 # [ 1.803569] systemd[1]: Finished Create List of Static Device Nodes.1886worker1 # [ 1.800929] systemd[1]: Starting Create List of Static Device Nodes...1887worker2 # [ 1.806972] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1888worker1 # [ 1.804929] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1889client # [ 1.820151] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1890client # [ 1.822178] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1891lb # [ 1.801255] systemd[1]: Starting Load Kernel Modules...1892worker1 # [ 1.811612] systemd[1]: Starting Load Kernel Module configfs...1893worker2 # [ 1.817039] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1894worker2 # [ 1.823270] systemd-journald[67]: Collecting audit messages is disabled.1895worker2 # [ 1.825148] systemd[1]: modprobe@configfs.service: Deactivated successfully.1896worker1 # [ 1.825952] systemd[1]: Starting Journal Service...1897worker2 # [ 1.830720] systemd[1]: Finished Load Kernel Module configfs.1898lb # [ 1.808356] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1899lb # [ 1.824608] netfs: FS-Cache loaded1900worker2 # [ 1.837812] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1901lb # [ 1.829960] 9pnet: Installing 9P2000 support1902client # [ 1.854191] systemd[1]: Finished Load Kernel Modules.1903worker2 # [ 1.842796] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1904worker1 # [ 1.841106] systemd[1]: Starting Load Kernel Modules...1905worker2 # [ 1.850566] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1906worker2 # [ 1.851954] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1907client # [ 1.864361] systemd[1]: Starting Apply Kernel Variables...1908lb # [ 1.842442] systemd[1]: Starting Coldplug All udev Devices...1909worker1 # [ 1.846122] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1910client # [ 1.876964] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1911worker1 # [ 1.865355] netfs: FS-Cache loaded1912lb # [ 1.860204] systemd[1]: Finished Create List of Static Device Nodes.1913worker1 # [ 1.870457] 9pnet: Installing 9P2000 support1914lb # [ 1.865711] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1915client # [ 1.890401] systemd[1]: Starting Create Static Device Nodes in /dev...1916worker1 # [ 1.878880] systemd[1]: Starting Coldplug All udev Devices...1917worker2 # [ 1.885485] systemd[1]: Finished Load Kernel Modules.1918lb # [ 1.873549] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1919worker2 # [ 1.892508] systemd[1]: Starting Apply Kernel Variables...1920lb # [ 1.880541] systemd[1]: modprobe@configfs.service: Deactivated successfully.1921lb # [ 1.882197] systemd-journald[67]: Collecting audit messages is disabled.1922lb # [ 1.886195] systemd[1]: Finished Load Kernel Module configfs.1923worker1 # [ 1.898340] systemd[1]: Finished Create List of Static Device Nodes.1924worker2 # [ 1.902426] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1925client # [ 1.915248] systemd[1]: Finished Apply Kernel Variables.1926lb # [ 1.891584] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1927worker1 # [ 1.903674] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1928lb # [ 1.896469] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1929client # [ 1.922711] systemd[1]: Started Journal Service.1930worker2 # [ 1.913035] systemd[1]: Starting Create Static Device Nodes in /dev...1931worker1 # [ 1.911467] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1932client # [ 1.789280] systemd-modules-load[68]: Inserted module 'dm_mod'1933worker1 # [ 1.913489] systemd-journald[67]: Collecting audit messages is disabled.1934lb # [ 1.904149] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1935client # [ 1.794133] systemd-modules-load[68]: Inserted module 'virtio_balloon'1936client # [ 1.795484] systemd-modules-load[68]: Inserted module 'virtio_gpu'1937lb # [ 1.905856] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1938worker1 # [ 1.919470] systemd[1]: modprobe@configfs.service: Deactivated successfully.1939worker1 # [ 1.926397] systemd[1]: Finished Load Kernel Module configfs.1940worker2 # [ 1.933243] systemd[1]: Finished Apply Kernel Variables.1941worker1 # [ 1.929622] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1942client # [ 1.810256] systemd[1]: Finished Create Static Device Nodes in /dev.1943client # [ 1.811288] systemd[1]: Reached target Preparation for Local File Systems.1944client # [ 1.812344] systemd[1]: Reached target Local File Systems.1945worker1 # [ 1.931919] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1946client # [ 1.817089] systemd[1]: Starting Create System Files and Directories...1947worker1 # [ 1.940926] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1948client # [ 1.822082] systemd[1]: Starting Rule-based Manager for Device Events and Files...1949worker1 # [ 1.942832] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1950worker2 # [ 1.947200] systemd[1]: Started Journal Service.1951lb # [ 1.934663] systemd[1]: Finished Load Kernel Modules.1952worker2 # [ 1.814627] systemd-modules-load[68]: Inserted module 'dm_mod'1953worker2 # [ 1.816534] systemd-modules-load[68]: Inserted module 'virtio_balloon'1954lb # [ 1.941357] systemd[1]: Starting Apply Kernel Variables...1955worker2 # [ 1.820329] systemd-modules-load[68]: Inserted module 'virtio_gpu'1956worker2 # [ 1.821375] systemd[1]: Finished Create Static Device Nodes in /dev.1957worker2 # [ 1.822537] systemd[1]: Reached target Preparation for Local File Systems.1958worker2 # [ 1.824925] systemd[1]: Reached target Local File Systems.1959worker2 # [ 1.829079] systemd[1]: Starting Create System Files and Directories...1960worker2 # [ 1.831830] systemd[1]: Starting Rule-based Manager for Device Events and Files...1961lb # [ 1.954256] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1962worker1 # [ 1.973586] systemd[1]: Finished Load Kernel Modules.1963lb # [ 1.964339] systemd[1]: Starting Create Static Device Nodes in /dev...1964client # [ 1.857242] systemd[1]: Finished Create System Files and Directories.1965worker1 # [ 1.981253] systemd[1]: Starting Apply Kernel Variables...1966lb # [ 1.980287] systemd[1]: Finished Apply Kernel Variables.1967worker2 # [ 1.864196] systemd[1]: Finished Create System Files and Directories.1968worker1 # [ 1.996349] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1969worker1 # [ 2.006277] systemd[1]: Starting Create Static Device Nodes in /dev...1970client # [ 1.886335] systemd-udevd[83]: Using default interface naming scheme 'v261'.1971lb # [ 1.998795] systemd[1]: Finished Create Static Device Nodes in /dev.1972lb # [ 1.867491] systemd-modules-load[68]: Inserted module 'dm_mod'1973lb # [ 1.869375] systemd-modules-load[68]: Inserted module 'virtio_balloon'1974lb # [ 1.871276] systemd-modules-load[68]: Inserted module 'virtio_gpu'1975lb # [ 2.006459] systemd[1]: Started Journal Service.1976worker2 # [ 1.888207] systemd-udevd[77]: Using default interface naming scheme 'v261'.1977worker1 # [ 2.020657] systemd[1]: Finished Apply Kernel Variables.1978lb # [ 1.881915] systemd[1]: Reached target Preparation for Local File Systems.1979lb # [ 1.884894] systemd[1]: Reached target Local File Systems.1980lb # [ 1.886123] systemd[1]: Starting Create System Files and Directories...1981client # [ 1.911096] systemd[1]: Started Rule-based Manager for Device Events and Files.1982worker1 # [ 2.036159] systemd[1]: Started Journal Service.1983lb # [ 1.893375] systemd[1]: Starting Rule-based Manager for Device Events and Files...1984worker1 # [ 1.903445] systemd-modules-load[68]: Inserted module 'dm_mod'1985worker1 # [ 1.907582] systemd-modules-load[68]: Inserted module 'virtio_balloon'1986worker1 # [ 1.908709] systemd-modules-load[68]: Inserted module 'virtio_gpu'1987worker2 # [ 1.915449] systemd[1]: Started Rule-based Manager for Device Events and Files.1988worker1 # [ 1.915861] systemd[1]: Finished Create Static Device Nodes in /dev.1989worker1 # [ 1.922084] systemd[1]: Reached target Preparation for Local File Systems.1990worker1 # [ 1.923946] systemd[1]: Reached target Local File Systems.1991worker1 # [ 1.925289] systemd[1]: Starting Create System Files and Directories...1992lb # [ 1.922470] systemd[1]: Finished Create System Files and Directories.1993worker1 # [ 1.930368] systemd[1]: Starting Rule-based Manager for Device Events and Files...1994client # [ 1.950841] systemd[1]: Finished Coldplug All udev Devices.1995client # [ 1.951985] systemd[1]: Reached target System Initialization.1996client # [ 1.952817] systemd[1]: Reached target Basic System.1997lb # [ 1.943242] systemd-udevd[83]: Using default interface naming scheme 'v261'.1998worker2 # [ 1.961585] systemd[1]: Finished Coldplug All udev Devices.1999worker1 # [ 1.958582] systemd[1]: Finished Create System Files and Directories.2000worker2 # [ 1.962930] systemd[1]: Reached target System Initialization.
loading 2,073 hidden lines…
4074worker2 # [ 18.066473] dhcpcd[701]: eth0: adding route to 10.0.2.0/244075lb # [ 18.054713] envoy[910]: [2026-09-20 12:21:55.008][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4076worker2 # [ 18.067484] dhcpcd[701]: eth0: adding default route via 10.0.2.24077lb # [ 18.057044] envoy[910]: [2026-09-20 12:21:55.008][910][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4078lb # [ 18.059485] envoy[910]: [2026-09-20 12:21:55.008][910][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4079lb # [ 18.062078] envoy[910]: [2026-09-20 12:21:55.008][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4080lb # [ 18.064362] envoy[910]: [2026-09-20 12:21:55.008][910][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4081lb # [ 18.065857] envoy[910]: [2026-09-20 12:21:55.008][910][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4082lb # [ 18.068850] envoy[910]: [2026-09-20 12:21:55.010][910][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4083lb # [ 18.074765] envoy[910]: [2026-09-20 12:21:55.010][910][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4084lb # [ 18.076470] envoy[910]: [2026-09-20 12:21:55.010][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4085lb # [ 18.078285] envoy[910]: [2026-09-20 12:21:55.010][910][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4086lb # [ 18.082786] envoy[910]: [2026-09-20 12:21:55.010][910][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4087lb # [ 18.084640] envoy[910]: [2026-09-20 12:21:55.092][910][info][main] [source/server/server.cc:531] HTTP header map info:4088lb # [ 18.085879] envoy[910]: [2026-09-20 12:21:55.149][910][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4089lb # [ 18.098123] envoy[910]: [2026-09-20 12:21:55.149][910][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4090lb # [ 18.099656] envoy[910]: [2026-09-20 12:21:55.149][910][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4091lb # [ 18.107123] envoy[910]: [2026-09-20 12:21:55.149][910][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4092lb # [ 18.132808] envoy[910]: [2026-09-20 12:21:55.341][910][info][main] [source/server/server.cc:968] runtime: {}4093lb # [ 18.137587] envoy[910]: [2026-09-20 12:21:55.346][910][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4094lb # [ 18.139500] envoy[910]: [2026-09-20 12:21:55.348][910][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014095worker2 # [ 18.152762] systemd[1]: Started DHCP Client.4096lb # [ 18.141727] envoy[910]: [2026-09-20 12:21:55.350][910][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014097worker2 # [ 18.154732] systemd[1]: Reached target Multi-User System.4098worker2 # [ 18.155541] systemd[1]: Startup finished in 901ms (kernel) + 5.046s (initrd) + 12.207s (userspace) = 18.154s.4099lb # [ 18.144112] envoy[910]: [2026-09-20 12:21:55.352][910][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4100lb # [ 18.145668] envoy[910]: [2026-09-20 12:21:55.354][910][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4101lb # [ 18.147159] envoy[910]: [2026-09-20 12:21:55.354][910][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4102lb # [ 18.187756] envoy[910]: [2026-09-20 12:21:55.396][910][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4103worker1 # [ 18.196320] systemd[1]: Starting Nix worker-protocol over gRPC...4104worker2 # [ 18.200281] systemd[1]: Reached target Network is Online.4105worker2 # [ 18.204044] systemd[1]: Starting scheduler-token.service...4106lb # [ 18.204152] envoy[910]: [2026-09-20 12:21:55.412][910][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4107lb # [ 18.206360] envoy[910]: [2026-09-20 12:21:55.415][910][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4108lb # [ 18.209207] envoy[910]: [2026-09-20 12:21:55.415][910][info][main] [source/server/server.cc:1077] starting main dispatch loop4109worker2 # [ 18.284725] systemd[1]: scheduler-token.service: Deactivated successfully.4110worker2 # [ 18.287042] systemd[1]: Finished scheduler-token.service.4111worker2 # [ 18.288495] systemd[1]: scheduler-token.service: Consumed 25ms CPU time over 82ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4112worker2 # [ 18.296696] systemd[1]: Starting Nix worker-protocol over gRPC...4113worker1 # [ 18.343843] nix-grpc-daemon[783]: ts=2026-09-20T12:21:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4114worker1 # [ 18.351914] nix-grpc-daemon[783]: ts=2026-09-20T12:21:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4115worker1 # [ 18.356746] nix-grpc-daemon[783]: ts=2026-09-20T12:21:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14116worker1 # [ 18.398157] nix-grpc-daemon[783]: ts=2026-09-20T12:21:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4117worker1 # [ 18.401130] systemd[1]: Started Nix worker-protocol over gRPC.4118worker1 # [ 18.449162] nix-grpc-daemon[783]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4119lb # [ 18.443794] envoy[910]: [2026-09-20 12:21:55.652][910][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4120lb # [ 18.447726] envoy[910]: [2026-09-20 12:21:55.652][910][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4121lb # [ 18.451665] envoy[910]: [2026-09-20 12:21:55.652][910][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4122lb # [ 18.455710] envoy[910]: [2026-09-20 12:21:55.664][910][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4123worker2 # [ 18.509369] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4124worker2 # [ 18.518144] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4125worker2 # [ 18.523175] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14126worker2 # [ 18.563195] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4127worker2 # [ 18.565920] systemd[1]: Started Nix worker-protocol over gRPC.4128worker2 # [ 18.621670] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500514129worker2 # [ 18.633303] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4130worker1 # [ 18.650257] nix-grpc-daemon[783]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4131worker2 # [ 18.834989] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500514132worker2 # [ 18.836872] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4133worker2 # [ 19.037683] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 19.040319] nix-grpc-daemon[798]: ts=2026-09-20T12:21:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4135worker1 # [ 19.050659] nix-grpc-daemon[783]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4136worker2 # [ 19.241874] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500514137worker2 # [ 19.245831] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4138worker2 # [ 19.447122] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500514139worker2 # [ 19.450996] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4140worker2 # [ 19.653421] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500514141worker2 # [ 19.656560] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4142worker2 # [ 19.854634] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500514143worker1 # [ 19.855915] nix-grpc-daemon[783]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500514144worker2 # [ 19.858703] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4145worker1 # [ 19.859260] nix-grpc-daemon[783]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4146worker2 # [ 20.059831] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_connected addr=lb:500514147worker1 # [ 20.056980] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514148worker2 # [ 20.062232] nix-grpc-daemon[798]: ts=2026-09-20T12:21:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4149worker1 # [ 20.061079] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4150worker2 # [ 20.263042] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514151worker2 # [ 20.264811] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4152worker1 # [ 20.262878] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 20.266668] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4154worker2 # [ 20.466250] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514155worker1 # [ 20.463752] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514156worker2 # [ 20.470221] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4157worker1 # [ 20.467633] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4158worker2 # [ 20.671054] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514159worker1 # [ 20.668055] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514160worker2 # [ 20.672767] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4161worker1 # [ 20.669818] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4162worker2 # [ 20.873672] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514163worker2 # [ 20.875545] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4164worker1 # [ 20.872388] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 20.875569] nix-grpc-daemon[783]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4166worker1 # [ 21.072745] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514167worker2 # [ 21.076782] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_connected addr=lb:500514168worker1 # [ 21.074728] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4169worker2 # [ 21.080283] nix-grpc-daemon[798]: ts=2026-09-20T12:21:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4170worker1 # [ 21.275548] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514171worker1 # [ 21.277360] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4172worker2 # [ 21.281291] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514173worker2 # [ 21.282610] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4174worker1 # [ 21.477841] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514175worker2 # [ 21.482169] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514176worker1 # [ 21.479604] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4177worker2 # [ 21.483909] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4178worker1 # [ 21.680403] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514179worker2 # [ 21.684917] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514180worker1 # [ 21.682348] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4181worker2 # [ 21.686718] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4182worker1 # [ 21.883380] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514183worker1 # [ 21.885388] nix-grpc-daemon[783]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4184worker2 # [ 21.888353] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514185worker2 # [ 21.892181] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4186worker1 # [ 22.086369] nix-grpc-daemon[783]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514187worker2 # [ 22.090264] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_connected addr=lb:500514188worker1 # [ 22.090324] nix-grpc-daemon[783]: ts=2026-09-20T12:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4189worker2 # [ 22.094451] nix-grpc-daemon[798]: ts=2026-09-20T12:21:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4190worker1 # [ 22.291152] nix-grpc-daemon[783]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514191worker2 # [ 22.295805] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514192worker1 # [ 22.295209] nix-grpc-daemon[783]: ts=2026-09-20T12:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4193worker2 # [ 22.299510] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4194worker2 # [ 22.497332] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514195worker1 # [ 22.495470] nix-grpc-daemon[783]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514196worker2 # [ 22.499092] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4197worker1 # [ 22.497151] nix-grpc-daemon[783]: ts=2026-09-20T12:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4198worker1 # [ 22.697818] nix-grpc-daemon[783]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514199worker2 # [ 22.701581] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514200worker1 # [ 22.699591] nix-grpc-daemon[783]: ts=2026-09-20T12:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4201worker2 # [ 22.704668] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4202worker2 # [ 22.902150] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514203worker2 # [ 22.903957] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4204worker1 # [ 22.899425] nix-grpc-daemon[783]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 22.902310] nix-grpc-daemon[783]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4206worker2 # [ 23.104835] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_connected addr=lb:500514207worker1 # [ 23.102844] nix-grpc-daemon[783]: ts=2026-09-20T12:22:00Z level=info event=scheduler_connected addr=lb:500514208worker1 # [ 23.104701] nix-grpc-daemon[783]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4209worker2 # [ 23.107441] nix-grpc-daemon[798]: ts=2026-09-20T12:21:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4210worker2 # [ 23.308656] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_connected addr=lb:500514211worker1 # [ 23.305721] nix-grpc-daemon[783]: ts=2026-09-20T12:22:00Z level=info event=scheduler_connected addr=lb:500514212worker2 # [ 23.312554] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4213worker1 # [ 23.309647] nix-grpc-daemon[783]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4214worker1 # [ 23.507662] nix-grpc-daemon[783]: ts=2026-09-20T12:22:00Z level=info event=scheduler_connected addr=lb:500514215worker2 # [ 23.513714] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_connected addr=lb:500514216worker1 # [ 23.511707] nix-grpc-daemon[783]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4217worker2 # [ 23.517451] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4218worker1 # [ 23.712692] nix-grpc-daemon[783]: ts=2026-09-20T12:22:00Z level=info event=scheduler_connected addr=lb:500514219worker2 # [ 23.719921] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_connected addr=lb:500514220worker1 # [ 23.716610] nix-grpc-daemon[783]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4221worker2 # [ 23.723169] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4222worker2 # [ 23.921285] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_connected addr=lb:500514223worker1 # [ 23.918366] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_connected addr=lb:500514224worker2 # [ 23.925360] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4225worker1 # [ 23.922233] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4226worker1 # [ 24.122570] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_connected addr=lb:500514227worker1 # [ 24.124530] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4228worker2 # [ 24.126515] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_connected addr=lb:500514229worker2 # [ 24.130383] nix-grpc-daemon[798]: ts=2026-09-20T12:22:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4230worker2 # [ 24.331060] nix-grpc-daemon[798]: ts=2026-09-20T12:22:01Z level=info event=scheduler_connected addr=lb:500514231worker1 # [ 24.325644] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_connected addr=lb:500514232worker2 # [ 24.332855] nix-grpc-daemon[798]: ts=2026-09-20T12:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4233worker1 # [ 24.329947] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4234worker1 # [ 24.530440] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_connected addr=lb:500514235worker2 # [ 24.534403] nix-grpc-daemon[798]: ts=2026-09-20T12:22:01Z level=info event=scheduler_connected addr=lb:500514236worker1 # [ 24.532562] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4237worker2 # [ 24.538521] nix-grpc-daemon[798]: ts=2026-09-20T12:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4238worker1 # [ 24.733268] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_connected addr=lb:500514239worker1 # [ 24.735151] nix-grpc-daemon[783]: ts=2026-09-20T12:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4240worker2 # [ 24.740892] nix-grpc-daemon[798]: ts=2026-09-20T12:22:01Z level=info event=scheduler_connected addr=lb:500514241worker2 # [ 24.743942] nix-grpc-daemon[798]: ts=2026-09-20T12:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4242worker1 # [ 24.937666] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514243worker2 # [ 24.941878] nix-grpc-daemon[798]: ts=2026-09-20T12:22:01Z level=info event=scheduler_connected addr=lb:500514244worker1 # [ 24.940920] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4245worker2 # [ 24.945202] nix-grpc-daemon[798]: ts=2026-09-20T12:22:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4246worker1 # [ 25.138449] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514247worker1 # [ 25.140566] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4248worker2 # [ 25.146663] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514249worker2 # [ 25.150923] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4250worker1 # [ 25.341090] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514251worker1 # [ 25.342835] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4252worker2 # [ 25.352237] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514253worker2 # [ 25.356592] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4254worker1 # [ 25.543370] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514255worker1 # [ 25.545313] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4256worker2 # [ 25.557849] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514257worker2 # [ 25.562411] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4258worker1 # [ 25.745784] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514259worker1 # [ 25.749570] nix-grpc-daemon[783]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4260worker2 # [ 25.765669] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514261worker2 # [ 25.769288] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4262worker1 # [ 25.952147] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514263worker1 # [ 25.955291] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4264worker2 # [ 25.967162] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_connected addr=lb:500514265worker2 # [ 25.971628] nix-grpc-daemon[798]: ts=2026-09-20T12:22:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4266worker1 # [ 26.152897] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514267worker1 # [ 26.156116] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4268worker2 # [ 26.173597] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514269worker2 # [ 26.176789] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4270worker1 # [ 26.356627] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514271worker1 # [ 26.358495] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4272worker2 # [ 26.374532] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514273worker2 # [ 26.376353] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4274worker1 # [ 26.559335] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514275worker1 # [ 26.563332] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4276worker2 # [ 26.577654] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514277worker2 # [ 26.581562] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4278worker1 # [ 26.764251] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514279worker1 # [ 26.768228] nix-grpc-daemon[783]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4280worker2 # [ 26.783057] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514281worker2 # [ 26.785219] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4282worker1 # [ 26.970406] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514283worker1 # [ 26.973670] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4284worker2 # [ 26.986308] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_connected addr=lb:500514285worker2 # [ 26.988147] nix-grpc-daemon[798]: ts=2026-09-20T12:22:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4286worker1 # [ 27.171404] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514287worker1 # [ 27.175455] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4288worker2 # [ 27.189632] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514289worker2 # [ 27.193529] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4290worker1 # [ 27.375844] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514291worker1 # [ 27.377987] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4292worker2 # [ 27.394522] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514293worker2 # [ 27.396671] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4294worker1 # [ 27.578862] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514295worker1 # [ 27.582854] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4296worker2 # [ 27.596379] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514297worker2 # [ 27.600228] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4298worker1 # [ 27.783702] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514299worker1 # [ 27.787610] nix-grpc-daemon[783]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4300worker2 # [ 27.803071] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514301worker2 # [ 27.806287] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4302worker1 # [ 27.988625] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514303worker1 # [ 27.990297] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4304worker2 # [ 28.004672] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_connected addr=lb:500514305worker2 # [ 28.007789] nix-grpc-daemon[798]: ts=2026-09-20T12:22:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4306worker1 # [ 28.191319] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514307worker1 # [ 28.195439] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4308worker2 # [ 28.206174] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514309worker2 # [ 28.210219] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4310worker1 # [ 28.396132] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514311worker1 # [ 28.400183] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4312worker2 # [ 28.411353] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514313worker2 # [ 28.415191] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4314worker1 # [ 28.600853] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514315worker1 # [ 28.605091] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4316worker2 # [ 28.615526] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514317worker2 # [ 28.617438] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4318worker1 # [ 28.805782] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514319worker1 # [ 28.809914] nix-grpc-daemon[783]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4320worker2 # [ 28.820266] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514321worker2 # [ 28.823448] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4322worker1 # [ 29.011640] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514323worker1 # [ 29.015642] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4324worker2 # [ 29.021424] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_connected addr=lb:500514325worker2 # [ 29.025252] nix-grpc-daemon[798]: ts=2026-09-20T12:22:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4326worker1 # [ 29.213606] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514327worker1 # [ 29.217575] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4328worker2 # [ 29.226038] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514329worker2 # [ 29.227875] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4330worker1 # [ 29.418114] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514331worker1 # [ 29.421258] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4332worker2 # [ 29.429335] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514333worker2 # [ 29.433299] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4334worker1 # [ 29.622190] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514335worker1 # [ 29.626340] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4336worker2 # [ 29.633575] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514337worker2 # [ 29.635309] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4338worker1 # [ 29.827178] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514339worker1 # [ 29.831210] nix-grpc-daemon[783]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4340worker2 # [ 29.837766] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514341worker2 # [ 29.840862] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4342worker1 # [ 30.032740] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514343worker2 # [ 30.038669] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_connected addr=lb:500514344worker1 # [ 30.036838] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4345worker2 # [ 30.042591] nix-grpc-daemon[798]: ts=2026-09-20T12:22:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4346worker1 # [ 30.237381] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514347worker1 # [ 30.239467] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4348worker2 # [ 30.243372] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514349worker2 # [ 30.247922] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4350lb # [ 30.282916] rustfs-bucket-start[1040]: mb s3://farm4351lb # [ 30.287528] systemd[1]: Finished rustfs-bucket.service.4352lb # [ 30.293723] systemd[1]: Starting niks3 server...4353worker1 # [ 30.440490] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514354worker1 # [ 30.444308] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4355worker2 # [ 30.450226] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514356worker2 # [ 30.453380] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4357lb # [ 30.467599] postgres[1057]: [1057] ERROR: relation "goose_db_version" does not exist at character 364358lb # [ 30.469064] postgres[1057]: [1057] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4359worker1 # [ 30.645177] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514360worker2 # [ 30.650881] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514361worker2 # [ 30.652753] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4362worker1 # [ 30.649139] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4363lb # [ 30.650591] niks3-server[1051]: 2026/09/20 12:22:07 OK 20241026095416_initial_model.sql (22.02ms)4364lb # [ 30.655065] niks3-server[1051]: 2026/09/20 12:22:07 OK 20251210153512_drop_unused_gin_index.sql (4.84ms)4365lb # [ 30.661275] niks3-server[1051]: 2026/09/20 12:22:07 OK 20251218171726_add_pins.sql (6.22ms)4366lb # [ 30.667828] niks3-server[1051]: 2026/09/20 12:22:07 OK 20260628120000_add_object_size_and_stats.sql (5.22ms)4367lb # [ 30.673853] niks3-server[1051]: 2026/09/20 12:22:07 OK 20260905000000_add_claims.sql (6.08ms)4368lb # [ 30.678934] niks3-server[1051]: 2026/09/20 12:22:07 OK 20260920000000_drop_claims.sql (3.63ms)4369lb # [ 30.680725] niks3-server[1051]: 2026/09/20 12:22:07 goose: successfully migrated database to version: 202609200000004370lb # [ 30.687553] niks3-server[1051]: 2026/09/20 12:22:07 OK 1_commit_pending_closure.sql (8.54ms)4371lb # [ 30.691042] niks3-server[1051]: 2026/09/20 12:22:07 OK 2_object_stats_trigger.sql (3.38ms)4372lb # [ 30.692056] niks3-server[1051]: 2026/09/20 12:22:07 goose: up to current file version: 24373lb # [ 30.699907] niks3-server[1051]: 2026/09/20 12:22:07 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4374lb # [ 30.766147] niks3-server[1051]: 2026/09/20 12:22:07 INFO Read proxy enabled — serving cache objects from S34375lb # [ 30.768135] niks3-server[1051]: 2026/09/20 12:22:07 INFO Using socket-activated listener address=0.0.0.0:57514376lb # [ 30.772475] niks3-server[1051]: 2026/09/20 12:22:07 INFO systemd watchdog enabled interval=15s4377lb # [ 30.774882] systemd[1]: Started niks3 server.4378lb # [ 30.775905] systemd[1]: Reached target Multi-User System.4379lb # [ 30.777995] niks3-server[1051]: 2026/09/20 12:22:07 INFO Starting HTTP server address=0.0.0.0:57514380lb # [ 30.779539] systemd[1]: Startup finished in 885ms (kernel) + 5.020s (initrd) + 24.871s (userspace) = 30.777s.4381lb # [ 30.785418] niks3-server[1051]: 2026/09/20 12:22:07 INFO lead: acquired remote=192.168.1.4:414864382worker2 # [ 30.802294] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_take_over4383worker1 # [ 30.850132] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514384worker2 # [ 30.855348] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514385worker1 # [ 30.854241] nix-grpc-daemon[783]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4386worker2 # [ 30.858944] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4387worker1 # [ 31.056486] nix-grpc-daemon[783]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500514388worker2 # [ 31.060309] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_connected addr=lb:500514389worker2 # [ 31.064255] nix-grpc-daemon[798]: ts=2026-09-20T12:22:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4390worker1 # [ 31.061404] nix-grpc-daemon[783]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4391worker2 # [ 31.261879] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500514392worker2 # [ 31.263862] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4393worker1 # [ 31.262807] nix-grpc-daemon[783]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500514394worker1 # [ 31.266894] nix-grpc-daemon[783]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4395worker2 # [ 31.465144] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500514396worker1 # [ 31.467293] nix-grpc-daemon[783]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500514397worker2 # [ 31.469199] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4398worker1 # [ 31.469425] nix-grpc-daemon[783]: ts=2026-09-20T12:22:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4399lb: (finished: waiting for unit niks3.service, in 19.51 seconds)4400worker1 # [ 31.669574] nix-grpc-daemon[783]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500514401lb: waiting for TCP port 5751 on localhost4402worker2 # [ 31.670093] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=scheduler_connected addr=lb:500514403worker2 # [ 31.684330] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:551764404worker2 # [ 31.689616] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04405worker2 # [ 31.710270] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=oidc_jwks provider=mock keys=14406worker2 # [ 31.714685] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:551764407worker2 # [ 31.718633] nix-grpc-daemon[798]: ts=2026-09-20T12:22:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04408lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4409lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4410lb: waiting for unit envoy.service4411lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4412lb: waiting for TCP port 50051 on localhost4413lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4414lb # [ 31.818490] envoy[910]: conn peer=[::1]:53332 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24415lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4416worker2 # [ 31.967717] systemd[1]: Starting scheduler-token.service...4417worker2 # [ 32.035401] systemd[1]: scheduler-token.service: Deactivated successfully.4418worker2 # [ 32.036651] systemd[1]: Finished scheduler-token.service.4419worker2 # [ 32.038252] systemd[1]: scheduler-token.service: Consumed 21ms CPU time over 69ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4420lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4421??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4422 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284423lb: must succeed: curl -sf localhost:9901/clusters4424lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4425lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds)4426subtest: one node schedules and both builders hold a WorkerSession on it4427lb: must succeed: curl -sf localhost:9901/clusters4428lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4429worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4430worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4431lb: must succeed: curl -sf localhost:9901/clusters4432lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4433lb: must succeed: curl -sf localhost:9901/clusters4434lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4435worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'4436worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.05 seconds)4437(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.22 seconds)4438subtest: balancer auth: client cert, bearer token, nothing, unknown CN4439worker1 # [ 32.604535] nix-grpc-daemon[783]: ts=2026-09-20T12:22:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:374004440worker1 # [ 32.610320] systemd[1]: Started Nix Daemon.4441worker1 # [ 32.804601] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4442worker1 # [ 32.855661] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5)4443worker1 # [ 32.875244] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 2/5)4444worker1 # [ 33.075064] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 3/5)4445worker1 # [ 33.105963] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 500 ms (attempt 4/5)4446worker1 # [ 33.617567] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4447worker1 # [ 33.653874] nix-grpc-daemon[783]: ts=2026-09-20T12:22:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:374004448worker1 # [ 33.673397] nix-grpc-daemon[783]: ts=2026-09-20T12:22:10Z level=debug event=path_info_miss path=pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test error="error: path '/nix/store/pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test' is required, but there is no substituter that can build it"4449worker2 # [ 33.695829] nix-grpc-daemon[798]: ts=2026-09-20T12:22:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:412604450worker2 # [ 33.709812] systemd[1]: Started Nix Daemon.4451worker2 # [ 33.944875] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4452worker2 # [ 33.972683] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5)4453worker2 # [ 34.071624] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 2/5)4454worker2 # [ 34.268757] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 200 ms (attempt 3/5)4455worker2 # [ 34.474707] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 780 ms (attempt 4/5)4456worker2 # [ 35.267349] nix-grpc-daemon[798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4457worker2 # [ 35.287983] nix-grpc-daemon[798]: ts=2026-09-20T12:22:12Z level=debug event=path_info_miss path=pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test error="error: path '/nix/store/pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test' is required, but there is no substituter that can build it"4458client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4459client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4460client: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4461client: (finished: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4462worker1 # [ 35.664925] nix-grpc-daemon[783]: ts=2026-09-20T12:22:12Z level=info event=oidc_jwks provider=mock keys=14463worker1 # [ 35.668983] nix-grpc-daemon[783]: ts=2026-09-20T12:22:12Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:374004464worker1 # [ 35.679793] nix-grpc-daemon[783]: ts=2026-09-20T12:22:12Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:374004465worker2 # [ 35.693949] nix-grpc-daemon[798]: ts=2026-09-20T12:22:12Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:412604466worker1 # [ 35.687716] nix-grpc-daemon[783]: ts=2026-09-20T12:22:12Z level=debug event=path_info_miss path=pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test error="error: path '/nix/store/pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test' is required, but there is no substituter that can build it"4467worker2 # [ 35.698495] nix-grpc-daemon[798]: ts=2026-09-20T12:22:12Z level=debug event=path_info_miss path=pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test error="error: path '/nix/store/pkcfs2fq5qbmc2kdc7ycd0sahbqlk3sb-nixos-system-client-test' is required, but there is no substituter that can build it"4468client: must succeed: rm -r /var/lib/nix-grpc-store4469client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4470worker1 # [ 35.957630] nix-grpc-daemon[783]: ts=2026-09-20T12:22:13Z level=info event=denied method=QueryMissing cn=- role=none4471worker2 # [ 36.159991] nix-grpc-daemon[798]: ts=2026-09-20T12:22:13Z level=info event=denied method=QueryMissing cn=stranger role=none4472(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.86 seconds)4473subtest: DAG build is scheduled across workers and lands in the cache4474client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24475worker2 # [ 36.410117] nix-grpc-daemon[798]: ts=2026-09-20T12:22:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:412604476client # don't know how to build these paths:4477client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4478worker2 # [ 36.427146] nix-grpc-daemon[798]: ts=2026-09-20T12:22:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:412604479worker2 # [ 36.467694] nix-grpc-daemon[798]: ts=2026-09-20T12:22:13Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04480worker2 # [ 36.472455] nix-grpc-daemon[798]: ts=2026-09-20T12:22:13Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14481worker1 # [ 36.517203] nix-grpc-daemon[783]: ts=2026-09-20T12:22:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004482worker1 # [ 36.535035] nix-grpc-daemon[783]: ts=2026-09-20T12:22:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004483client # copying 1 paths to 'lb:50051'...4484worker1 # [ 36.542177] nix-grpc-daemon[783]: ts=2026-09-20T12:22:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:374004485client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4486worker1 # [ 36.556295] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4487worker1 # [ 36.571335] nix-grpc-daemon[783]: ts=2026-09-20T12:22:13Z level=info event=niks3_push_started pid=8524488worker1 # [ 36.825311] nix-grpc-daemon[852]: time=2026-09-20T12:22:13.922Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""4489worker1 # [ 37.005361] nix-daemon[842]: accepted connection from pid 864, user nix-grpc-daemon (trusted)4490worker1 # [ 37.023532] nix-daemon[842]: reaped child process 867, status = succeeded4491worker1 # [ 37.163708] nix-daemon[842]: accepted connection from pid 869, user nix-grpc-daemon (trusted)4492worker1 # [ 37.179481] nix-daemon[842]: reaped child process 872, status = succeeded4493lb # [ 37.182311] niks3-server[1051]: 2026/09/20 12:22:14 INFO Received uploads request method=POST path=/api/pending_closures4494worker1 # [ 37.215392] nix-grpc-daemon[852]: time=2026-09-20T12:22:14.315Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4495worker1 # [ 37.217625] nix-grpc-daemon[852]: time=2026-09-20T12:22:14.317Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4496lb # [ 37.257704] niks3-server[1051]: 2026/09/20 12:22:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4497lb # [ 37.271086] niks3-server[1051]: 2026/09/20 12:22:14 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4498lb # [ 37.282643] niks3-server[1051]: 2026/09/20 12:22:14 INFO Signed narinfos id=1 count=14499worker1 # [ 37.292661] nix-grpc-daemon[852]: time=2026-09-20T12:22:14.392Z level=INFO msg="Uploading 1 narinfos"4500lb # [ 37.292625] niks3-server[1051]: 2026/09/20 12:22:14 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4501lb # [ 37.300066] niks3-server[1051]: 2026/09/20 12:22:14 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4502lb # [ 37.310185] niks3-server[1051]: 2026/09/20 12:22:14 INFO Completed upload id=14503worker1 # [ 37.319886] nix-grpc-daemon[852]: time=2026-09-20T12:22:14.419Z level=INFO msg="Upload complete. (480ms)"4504lb # [ 37.315646] niks3-server[1051]: 2026/09/20 12:22:14 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4505worker1 # [ 37.327245] nix-grpc-daemon[783]: ts=2026-09-20T12:22:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_in=5044506worker1 # [ 37.336135] nix-grpc-daemon[783]: ts=2026-09-20T12:22:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004507worker1 # [ 37.346921] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4508worker1 # [ 37.359215] nix-daemon[842]: reaped child process 850, status = succeeded4509client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4510worker1 # [ 37.368461] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4511client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4512client # farm-a> LOG-farm-a-t14513worker1 # [ 37.984812] nix-daemon[842]: reaped child process 876, status = succeeded4514worker1 # [ 38.110497] nix-daemon[842]: accepted connection from pid 891, user nix-grpc-daemon (trusted)4515worker1 # [ 38.123402] nix-daemon[842]: reaped child process 894, status = succeeded4516lb # [ 38.128557] niks3-server[1051]: 2026/09/20 12:22:15 INFO Received uploads request method=POST path=/api/pending_closures4517worker1 # [ 38.142495] nix-grpc-daemon[852]: time=2026-09-20T12:22:15.242Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4518worker1 # [ 38.144049] nix-grpc-daemon[852]: time=2026-09-20T12:22:15.244Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4519lb # [ 38.154785] niks3-server[1051]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4520lb # [ 38.161802] niks3-server[1051]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4521lb # [ 38.164727] niks3-server[1051]: 2026/09/20 12:22:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4522lb # [ 38.166315] niks3-server[1051]: 2026/09/20 12:22:15 INFO Signed narinfos id=2 count=14523worker1 # [ 38.176090] nix-grpc-daemon[852]: time=2026-09-20T12:22:15.275Z level=INFO msg="Uploading 1 narinfos"4524lb # [ 38.173911] niks3-server[1051]: 2026/09/20 12:22:15 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4525lb # [ 38.176560] niks3-server[1051]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4526lb # [ 38.179348] niks3-server[1051]: 2026/09/20 12:22:15 INFO Completed upload id=24527worker1 # [ 38.187389] nix-grpc-daemon[852]: time=2026-09-20T12:22:15.287Z level=INFO msg="Upload complete. (209ms)"4528lb # [ 38.180678] niks3-server[1051]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4529worker1 # [ 38.190340] nix-grpc-daemon[783]: ts=2026-09-20T12:22:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14530worker1 # [ 38.196915] nix-daemon[842]: reaped child process 874, status = succeeded4531lb # [ 38.194054] envoy[910]: conn peer=[2001:db8:1::1]:57004 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=27304532lb # [ 38.195449] envoy[910]: conn peer=[2001:db8:1::1]:40066 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=362 ms=554533lb # [ 38.196722] envoy[910]: conn peer=[2001:db8:1::1]:40078 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=134534lb # [ 38.197983] envoy[910]: conn peer=[2001:db8:1::1]:40092 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=134535worker2 # [ 38.215857] nix-grpc-daemon[798]: ts=2026-09-20T12:22:15Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04536worker2 # [ 38.220347] nix-grpc-daemon[798]: ts=2026-09-20T12:22:15Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14537worker1 # [ 38.261907] nix-grpc-daemon[783]: ts=2026-09-20T12:22:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004538worker1 # [ 38.274337] nix-grpc-daemon[783]: ts=2026-09-20T12:22:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004539worker1 # [ 38.287279] nix-grpc-daemon[852]: time=2026-09-20T12:22:15.387Z level=INFO msg="All 1 paths already cached"4540client # copying 1 paths to 'lb:50051'...4541worker1 # [ 38.295304] nix-grpc-daemon[783]: ts=2026-09-20T12:22:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:374004542client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4543worker1 # [ 38.318190] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4544worker1 # [ 38.487504] nix-daemon[842]: accepted connection from pid 898, user nix-grpc-daemon (trusted)4545worker1 # [ 38.501666] nix-daemon[842]: reaped child process 901, status = succeeded4546worker1 # [ 38.658089] nix-daemon[842]: accepted connection from pid 904, user nix-grpc-daemon (trusted)4547worker1 # [ 38.671578] nix-daemon[842]: reaped child process 907, status = succeeded4548lb # [ 38.676750] niks3-server[1051]: 2026/09/20 12:22:15 INFO Received uploads request method=POST path=/api/pending_closures4549worker1 # [ 38.694741] nix-grpc-daemon[852]: time=2026-09-20T12:22:15.794Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4550worker1 # [ 38.696183] nix-grpc-daemon[852]: time=2026-09-20T12:22:15.794Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4551lb # [ 38.708509] niks3-server[1051]: 2026/09/20 12:22:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4552lb # [ 38.713231] niks3-server[1051]: 2026/09/20 12:22:15 INFO Signed narinfos id=3 count=14553worker1 # [ 38.724348] nix-grpc-daemon[852]: time=2026-09-20T12:22:15.824Z level=INFO msg="Uploading 1 narinfos"4554lb # [ 38.718350] niks3-server[1051]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4555lb # [ 38.729803] niks3-server[1051]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4556lb # [ 38.735451] niks3-server[1051]: 2026/09/20 12:22:15 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4557lb # [ 38.741914] niks3-server[1051]: 2026/09/20 12:22:15 INFO Completed upload id=34558worker1 # [ 38.750052] nix-grpc-daemon[852]: time=2026-09-20T12:22:15.850Z level=INFO msg="Upload complete. (416ms)"4559lb # [ 38.746968] niks3-server[1051]: 2026/09/20 12:22:15 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4560worker1 # [ 38.755336] nix-grpc-daemon[783]: ts=2026-09-20T12:22:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_in=6244561worker1 # [ 38.759869] nix-grpc-daemon[783]: ts=2026-09-20T12:22:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004562worker1 # [ 38.769699] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4563worker1 # [ 38.775956] nix-daemon[842]: reaped child process 896, status = succeeded4564worker1 # [ 38.778732] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4565client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4566client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4567client # farm-b> LOG-farm-b-t14568worker1 # [ 39.601759] nix-daemon[842]: reaped child process 911, status = succeeded4569worker1 # [ 39.743422] nix-daemon[842]: accepted connection from pid 927, user nix-grpc-daemon (trusted)4570worker1 # [ 39.757266] nix-daemon[842]: reaped child process 930, status = succeeded4571lb # [ 39.761795] niks3-server[1051]: 2026/09/20 12:22:16 INFO Received uploads request method=POST path=/api/pending_closures4572worker1 # [ 39.777593] nix-grpc-daemon[852]: time=2026-09-20T12:22:16.877Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4573worker1 # [ 39.779641] nix-grpc-daemon[852]: time=2026-09-20T12:22:16.879Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4574lb # [ 39.782840] niks3-server[1051]: 2026/09/20 12:22:16 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4575lb # [ 39.787020] niks3-server[1051]: 2026/09/20 12:22:16 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4576lb # [ 39.791147] niks3-server[1051]: 2026/09/20 12:22:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4577lb # [ 39.794581] niks3-server[1051]: 2026/09/20 12:22:17 INFO Signed narinfos id=4 count=14578worker1 # [ 39.802650] nix-grpc-daemon[852]: time=2026-09-20T12:22:16.902Z level=INFO msg="Uploading 1 narinfos"4579lb # [ 39.796942] niks3-server[1051]: 2026/09/20 12:22:17 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4580lb # [ 39.801056] niks3-server[1051]: 2026/09/20 12:22:17 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4581lb # [ 39.804829] niks3-server[1051]: 2026/09/20 12:22:17 INFO Completed upload id=44582worker1 # [ 39.812901] nix-grpc-daemon[852]: time=2026-09-20T12:22:16.912Z level=INFO msg="Upload complete. (225ms)"4583lb # [ 39.806878] niks3-server[1051]: 2026/09/20 12:22:17 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4584worker1 # [ 39.816068] nix-grpc-daemon[783]: ts=2026-09-20T12:22:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14585worker1 # [ 39.822989] nix-daemon[842]: reaped child process 909, status = succeeded4586worker2 # [ 39.826375] nix-grpc-daemon[798]: ts=2026-09-20T12:22:16Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04587worker2 # [ 39.828702] nix-grpc-daemon[798]: ts=2026-09-20T12:22:16Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14588worker1 # [ 39.867242] nix-grpc-daemon[783]: ts=2026-09-20T12:22:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004589worker1 # [ 39.877137] nix-grpc-daemon[783]: ts=2026-09-20T12:22:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004590worker1 # [ 39.886541] nix-grpc-daemon[852]: time=2026-09-20T12:22:16.986Z level=INFO msg="All 2 paths already cached"4591client # copying 1 paths to 'lb:50051'...4592client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4593worker1 # [ 39.893068] nix-grpc-daemon[783]: ts=2026-09-20T12:22:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:374004594worker1 # [ 39.906128] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4595worker1 # [ 40.056112] nix-daemon[842]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4596worker1 # [ 40.069581] nix-daemon[842]: reaped child process 937, status = succeeded4597worker1 # [ 40.212741] nix-daemon[842]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4598worker1 # [ 40.225471] nix-daemon[842]: reaped child process 942, status = succeeded4599lb # [ 40.230903] niks3-server[1051]: 2026/09/20 12:22:17 INFO Received uploads request method=POST path=/api/pending_closures4600worker1 # [ 40.249498] nix-grpc-daemon[852]: time=2026-09-20T12:22:17.349Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4601worker1 # [ 40.250971] nix-grpc-daemon[852]: time=2026-09-20T12:22:17.349Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4602lb # [ 40.259074] niks3-server[1051]: 2026/09/20 12:22:17 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4603lb # [ 40.271807] niks3-server[1051]: 2026/09/20 12:22:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4604worker1 # [ 40.284654] nix-grpc-daemon[852]: time=2026-09-20T12:22:17.384Z level=INFO msg="Uploading 1 narinfos"4605lb # [ 40.276879] niks3-server[1051]: 2026/09/20 12:22:17 INFO Signed narinfos id=5 count=14606lb # [ 40.283464] niks3-server[1051]: 2026/09/20 12:22:17 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4607lb # [ 40.293391] niks3-server[1051]: 2026/09/20 12:22:17 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4608lb # [ 40.300800] niks3-server[1051]: 2026/09/20 12:22:17 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4609lb # [ 40.303819] niks3-server[1051]: 2026/09/20 12:22:17 INFO Completed upload id=54610worker1 # [ 40.313280] nix-grpc-daemon[852]: time=2026-09-20T12:22:17.413Z level=INFO msg="Upload complete. (396ms)"4611worker1 # [ 40.318126] nix-grpc-daemon[783]: ts=2026-09-20T12:22:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_in=7524612worker1 # [ 40.322797] nix-grpc-daemon[783]: ts=2026-09-20T12:22:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004613worker1 # [ 40.331705] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4614worker1 # [ 40.339310] nix-daemon[842]: reaped child process 932, status = succeeded4615client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4616worker1 # [ 40.343435] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4617client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4618client # farm-top> LOG-farm-top-t14619worker1 # [ 41.759863] nix-daemon[842]: reaped child process 946, status = succeeded4620worker1 # [ 41.910171] nix-daemon[842]: accepted connection from pid 961, user nix-grpc-daemon (trusted)4621worker1 # [ 41.925041] nix-daemon[842]: reaped child process 964, status = succeeded4622lb # [ 41.932480] niks3-server[1051]: 2026/09/20 12:22:19 INFO Received uploads request method=POST path=/api/pending_closures4623worker1 # [ 41.953261] nix-grpc-daemon[852]: time=2026-09-20T12:22:19.052Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4624worker1 # [ 41.955183] nix-grpc-daemon[852]: time=2026-09-20T12:22:19.054Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4625lb # [ 41.973555] niks3-server[1051]: 2026/09/20 12:22:19 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4626lb # [ 41.982837] niks3-server[1051]: 2026/09/20 12:22:19 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4627lb # [ 41.989850] niks3-server[1051]: 2026/09/20 12:22:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4628worker1 # [ 42.005350] nix-grpc-daemon[852]: time=2026-09-20T12:22:19.105Z level=INFO msg="Uploading 1 narinfos"4629lb # [ 41.996904] niks3-server[1051]: 2026/09/20 12:22:19 INFO Signed narinfos id=6 count=14630lb # [ 42.003107] niks3-server[1051]: 2026/09/20 12:22:19 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4631lb # [ 42.013218] niks3-server[1051]: 2026/09/20 12:22:19 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4632worker1 # [ 42.027683] nix-grpc-daemon[852]: time=2026-09-20T12:22:19.127Z level=INFO msg="Upload complete. (276ms)"4633lb # [ 42.019623] niks3-server[1051]: 2026/09/20 12:22:19 INFO Completed upload id=64634lb # [ 42.023461] niks3-server[1051]: 2026/09/20 12:22:19 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4635worker1 # [ 42.030551] nix-grpc-daemon[783]: ts=2026-09-20T12:22:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14636worker1 # [ 42.038138] nix-daemon[842]: reaped child process 944, status = succeeded4637client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 5.89 seconds)4638client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4639client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.18 seconds)4640client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4641client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4642client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4643client # copying 3 paths...4644client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4645client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4646client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4647client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4648(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.39 seconds)4649subtest: repeat is answered Cached by the scheduler without building4650worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4651worker1 # finding garbage collector roots...4652worker1 # deleting specified paths...4653worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4654worker1 # deleting unused links...4655worker1 # note: hard linking is currently saving 0.0 KiB4656worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4657worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4658worker2 # finding garbage collector roots...4659worker2 # deleting specified paths...4660worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4661worker2 # deleting unused links...4662worker2 # note: hard linking is currently saving 0.0 KiB4663worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4664client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24665worker2 # [ 43.300900] nix-grpc-daemon[798]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:412604666client # don't know how to build these paths:4667client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4668worker1 # [ 43.304337] nix-grpc-daemon[783]: ts=2026-09-20T12:22:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004669worker1 # [ 43.310060] nix-grpc-daemon[852]: time=2026-09-20T12:22:20.409Z level=INFO msg="All 2 paths already cached"4670worker2 # [ 43.321529] nix-grpc-daemon[798]: ts=2026-09-20T12:22:20Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14671client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.25 seconds)4672client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4673client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.19 seconds)4674lb: must succeed: curl -sf localhost:9901/clusters4675lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4676lb: must succeed: curl -sf localhost:9901/clusters4677lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4678worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4679worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4680(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.19 seconds)4681subtest: inputs already in the cache are not sent to the scheduler4682lb: must succeed: curl -sf localhost:9901/clusters4683lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4684lb: must succeed: curl -sf localhost:9901/clusters4685lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4686worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4687worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4688client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24689worker1 # [ 44.078829] nix-grpc-daemon[783]: ts=2026-09-20T12:22:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:374004690client # don't know how to build these paths:4691client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4692worker1 # [ 44.086748] nix-grpc-daemon[783]: ts=2026-09-20T12:22:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004693worker1 # [ 44.092514] nix-grpc-daemon[852]: time=2026-09-20T12:22:21.192Z level=INFO msg="All 2 paths already cached"4694worker2 # [ 44.106828] nix-grpc-daemon[798]: ts=2026-09-20T12:22:20Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04695worker2 # [ 44.111436] nix-grpc-daemon[798]: ts=2026-09-20T12:22:20Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14696worker1 # [ 44.148162] nix-grpc-daemon[783]: ts=2026-09-20T12:22:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004697worker1 # [ 44.161423] nix-grpc-daemon[783]: ts=2026-09-20T12:22:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004698worker1 # [ 44.174727] nix-grpc-daemon[852]: time=2026-09-20T12:22:21.274Z level=INFO msg="All 2 paths already cached"4699client # copying 1 paths to 'lb:50051'...4700client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4701worker1 # [ 44.182872] nix-grpc-daemon[783]: ts=2026-09-20T12:22:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:374004702worker1 # [ 44.194158] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4703worker1 # [ 44.372294] nix-daemon[842]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4704worker1 # [ 44.387069] nix-daemon[842]: reaped child process 985, status = succeeded4705worker1 # [ 44.521566] nix-daemon[842]: accepted connection from pid 987, user nix-grpc-daemon (trusted)4706worker1 # [ 44.535596] nix-daemon[842]: reaped child process 990, status = succeeded4707lb # [ 44.538618] niks3-server[1051]: 2026/09/20 12:22:21 INFO Received uploads request method=POST path=/api/pending_closures4708worker1 # [ 44.551799] nix-grpc-daemon[852]: time=2026-09-20T12:22:21.651Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4709worker1 # [ 44.553312] nix-grpc-daemon[852]: time=2026-09-20T12:22:21.651Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4710lb # [ 44.563166] niks3-server[1051]: 2026/09/20 12:22:21 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4711lb # [ 44.575125] niks3-server[1051]: 2026/09/20 12:22:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4712lb # [ 44.580244] niks3-server[1051]: 2026/09/20 12:22:21 INFO Signed narinfos id=7 count=14713worker1 # [ 44.591367] nix-grpc-daemon[852]: time=2026-09-20T12:22:21.691Z level=INFO msg="Uploading 1 narinfos"4714lb # [ 44.587835] niks3-server[1051]: 2026/09/20 12:22:21 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4715lb # [ 44.596687] niks3-server[1051]: 2026/09/20 12:22:21 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4716worker1 # [ 44.611846] nix-grpc-daemon[852]: time=2026-09-20T12:22:21.711Z level=INFO msg="Upload complete. (405ms)"4717lb # [ 44.604142] niks3-server[1051]: 2026/09/20 12:22:21 INFO Completed upload id=74718lb # [ 44.607644] niks3-server[1051]: 2026/09/20 12:22:21 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4719worker1 # [ 44.614508] nix-grpc-daemon[783]: ts=2026-09-20T12:22:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_in=7524720worker1 # [ 44.619951] nix-grpc-daemon[783]: ts=2026-09-20T12:22:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004721worker1 # [ 44.629655] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4722worker1 # [ 44.633111] nix-daemon[842]: reaped child process 980, status = succeeded4723worker1 # [ 44.638440] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4724client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4725client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4726client # farm-top> LOG-farm-top-t1b4727worker1 # [ 45.464326] nix-daemon[842]: reaped child process 994, status = succeeded4728worker1 # [ 45.618503] nix-daemon[842]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)4729worker1 # [ 45.633493] nix-daemon[842]: reaped child process 1012, status = succeeded4730lb # [ 45.641069] niks3-server[1051]: 2026/09/20 12:22:22 INFO Received uploads request method=POST path=/api/pending_closures4731worker1 # [ 45.658400] nix-grpc-daemon[852]: time=2026-09-20T12:22:22.758Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4732worker1 # [ 45.660943] nix-grpc-daemon[852]: time=2026-09-20T12:22:22.760Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4733lb # [ 45.680349] niks3-server[1051]: 2026/09/20 12:22:22 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4734lb # [ 45.690560] niks3-server[1051]: 2026/09/20 12:22:22 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4735lb # [ 45.697108] niks3-server[1051]: 2026/09/20 12:22:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4736lb # [ 45.701214] niks3-server[1051]: 2026/09/20 12:22:22 INFO Signed narinfos id=8 count=14737worker1 # [ 45.712210] nix-grpc-daemon[852]: time=2026-09-20T12:22:22.812Z level=INFO msg="Uploading 1 narinfos"4738lb # [ 45.709603] niks3-server[1051]: 2026/09/20 12:22:22 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4739lb # [ 45.717111] niks3-server[1051]: 2026/09/20 12:22:22 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4740lb # [ 45.724215] niks3-server[1051]: 2026/09/20 12:22:22 INFO Completed upload id=84741worker1 # [ 45.732489] nix-grpc-daemon[852]: time=2026-09-20T12:22:22.832Z level=INFO msg="Upload complete. (287ms)"4742lb # [ 45.726901] niks3-server[1051]: 2026/09/20 12:22:22 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4743worker1 # [ 45.736304] nix-grpc-daemon[783]: ts=2026-09-20T12:22:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14744worker1 # [ 45.742423] nix-daemon[842]: reaped child process 992, status = succeeded4745client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.93 seconds)4746client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4747client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.20 seconds)4748lb: must succeed: curl -sf localhost:9901/clusters4749lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4750lb: must succeed: curl -sf localhost:9901/clusters4751lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4752worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4753worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4754(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.41 seconds)4755subtest: two clients wanting the same drv build it once4756client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4757client # [ 46.237836] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4758client # Running as unit: dedup1.service; invocation ID: 8b72d6f5f423446abf0046723a2e14df4759client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.06 seconds)4760client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4761worker2 # [ 46.425551] nix-grpc-daemon[798]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:412604762client # [ 46.443075] nix[884]: don't know how to build these paths:4763client # [ 46.443971] nix[884]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4764worker2 # [ 46.437551] nix-grpc-daemon[798]: ts=2026-09-20T12:22:23Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04765worker2 # [ 46.443255] nix-grpc-daemon[798]: ts=2026-09-20T12:22:23Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14766worker2 # [ 46.448443] nix-grpc-daemon[798]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:412604767worker2 # [ 46.463551] nix-grpc-daemon[798]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:412604768client # [ 46.485025] nix[884]: copying 1 paths to 'lb:50051'...4769client # [ 46.485855] nix[884]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4770worker2 # [ 46.473917] nix-grpc-daemon[798]: ts=2026-09-20T12:22:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:412604771worker2 # [ 46.485238] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4772worker2 # [ 46.505222] nix-grpc-daemon[798]: ts=2026-09-20T12:22:23Z level=info event=niks3_push_started pid=9184773worker2 # [ 46.784919] nix-grpc-daemon[918]: time=2026-09-20T12:22:23.642Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""4774worker2 # [ 46.990630] nix-daemon[867]: accepted connection from pid 930, user nix-grpc-daemon (trusted)4775worker2 # [ 47.006058] nix-daemon[867]: reaped child process 933, status = succeeded4776worker2 # [ 47.171405] nix-daemon[867]: accepted connection from pid 935, user nix-grpc-daemon (trusted)4777worker2 # [ 47.183881] nix-daemon[867]: reaped child process 938, status = succeeded4778lb # [ 47.188894] niks3-server[1051]: 2026/09/20 12:22:24 INFO Received uploads request method=POST path=/api/pending_closures4779worker2 # [ 47.211274] nix-grpc-daemon[918]: time=2026-09-20T12:22:24.071Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4780worker2 # [ 47.213763] nix-grpc-daemon[918]: time=2026-09-20T12:22:24.074Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4781lb # [ 47.226851] niks3-server[1051]: 2026/09/20 12:22:24 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4782lb # [ 47.235710] niks3-server[1051]: 2026/09/20 12:22:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4783lb # [ 47.240946] niks3-server[1051]: 2026/09/20 12:22:24 INFO Signed narinfos id=9 count=14784worker2 # [ 47.255136] nix-grpc-daemon[918]: time=2026-09-20T12:22:24.115Z level=INFO msg="Uploading 1 narinfos"4785lb # [ 47.249255] niks3-server[1051]: 2026/09/20 12:22:24 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4786lb # [ 47.259211] niks3-server[1051]: 2026/09/20 12:22:24 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4787lb # [ 47.264108] niks3-server[1051]: 2026/09/20 12:22:24 INFO Completed upload id=94788worker2 # [ 47.278457] nix-grpc-daemon[918]: time=2026-09-20T12:22:24.139Z level=INFO msg="Upload complete. (466ms)"4789worker2 # [ 47.281037] nix-grpc-daemon[798]: ts=2026-09-20T12:22:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=0 paths=1 nar_bytes_in=4324790lb # [ 47.268585] niks3-server[1051]: 2026/09/20 12:22:24 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4791worker2 # [ 47.287485] nix-grpc-daemon[798]: ts=2026-09-20T12:22:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:412604792worker2 # [ 47.289594] nix-daemon[867]: reaped child process 916, status = succeeded4793worker2 # [ 47.292370] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4794worker2 # [ 47.298947] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)4795client # [ 47.310188] nix[884]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4796client # [ 47.315972] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4797client # Running as unit: dedup2.service; invocation ID: b56a4c7485e84d24b55bd2ffcbdd40a34798client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.09 seconds)4799worker1 # [ 47.560759] nix-grpc-daemon[783]: ts=2026-09-20T12:22:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:374004800client # [ 47.579916] nix[899]: don't know how to build these paths:4801client # [ 47.580886] nix[899]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4802worker2 # [ 47.573807] nix-grpc-daemon[798]: ts=2026-09-20T12:22:24Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04803worker2 # [ 47.580572] nix-grpc-daemon[798]: ts=2026-09-20T12:22:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:412604804client # [ 47.594836] nix[899]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4805lb # [ 48.194837] envoy[910]: conn peer=[2001:db8:1::1]:40096 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=3817 ms=56764806lb # [ 48.198709] envoy[910]: conn peer=[2001:db8:1::1]:33216 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=479 ms=294807lb # [ 48.202147] envoy[910]: conn peer=[2001:db8:1::1]:33224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4169 tx=1723 ms=17114808client: must succeed: sleep 24809client: (finished: must succeed: sleep 2, in 2.03 seconds)4810??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4811 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394812client: waiting for success: ! systemctl is-active dedup1 dedup24813??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4814 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394815worker2 # [ 50.713713] nix-daemon[867]: reaped child process 942, status = succeeded4816worker2 # [ 50.852439] nix-daemon[867]: accepted connection from pid 973, user nix-grpc-daemon (trusted)4817worker2 # [ 50.865219] nix-daemon[867]: reaped child process 976, status = succeeded4818lb # [ 50.864625] niks3-server[1051]: 2026/09/20 12:22:28 INFO Received uploads request method=POST path=/api/pending_closures4819worker2 # [ 50.886544] nix-grpc-daemon[918]: time=2026-09-20T12:22:27.746Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4820worker2 # [ 50.888182] nix-grpc-daemon[918]: time=2026-09-20T12:22:27.748Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4821lb # [ 50.902371] niks3-server[1051]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4822lb # [ 50.906480] niks3-server[1051]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4823lb # [ 50.908876] niks3-server[1051]: 2026/09/20 12:22:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4824lb # [ 50.911700] niks3-server[1051]: 2026/09/20 12:22:28 INFO Signed narinfos id=10 count=14825worker2 # [ 50.923690] nix-grpc-daemon[918]: time=2026-09-20T12:22:27.783Z level=INFO msg="Uploading 1 narinfos"4826lb # [ 50.913836] niks3-server[1051]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4827lb # [ 50.919883] niks3-server[1051]: 2026/09/20 12:22:28 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4828lb # [ 50.922477] niks3-server[1051]: 2026/09/20 12:22:28 INFO Completed upload id=104829worker2 # [ 50.935210] nix-grpc-daemon[918]: time=2026-09-20T12:22:27.795Z level=INFO msg="Upload complete. (227ms)"4830lb # [ 50.924349] niks3-server[1051]: 2026/09/20 12:22:28 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4831worker2 # [ 50.940155] nix-grpc-daemon[798]: ts=2026-09-20T12:22:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14832worker2 # [ 50.942624] nix-grpc-daemon[798]: ts=2026-09-20T12:22:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14833worker2 # [ 50.948140] nix-daemon[867]: reaped child process 940, status = succeeded4834client # [ 50.995159] systemd[1]: dedup2.service: Deactivated successfully.4835client # [ 51.000766] systemd[1]: dedup2.service: Consumed 135ms CPU time over 3.682s wall clock time, 31.2M memory peak, 7.4K incoming IP traffic, 6.4K outgoing IP traffic.4836client # [ 51.034354] systemd[1]: dedup1.service: Deactivated successfully.4837client # [ 51.035767] systemd[1]: dedup1.service: Consumed 106ms CPU time over 4.797s wall clock time, 39.3M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.4838client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4839client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4840client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4841worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4842worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4843worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4844worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4845worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4846worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4847worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4848worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4849(finished: subtest: two clients wanting the same drv build it once, in 5.82 seconds)4850subtest: build hook: nix-daemon with builders = grpc://lb4851client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4852client # [ 52.179753] systemd[1]: Started Nix Daemon.4853client # [ 52.357678] nix-daemon[940]: accepted connection from pid 937, user root (trusted)4854worker1 # [ 52.522896] nix-grpc-daemon[783]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:374004855worker2 # [ 52.533587] nix-grpc-daemon[798]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:412604856worker2 # [ 52.549232] nix-grpc-daemon[798]: ts=2026-09-20T12:22:29Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04857worker2 # [ 52.553113] nix-grpc-daemon[798]: ts=2026-09-20T12:22:29Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14858worker1 # [ 52.599265] nix-grpc-daemon[783]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004859worker1 # [ 52.612360] nix-grpc-daemon[783]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004860worker1 # [ 52.624758] nix-grpc-daemon[783]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:374004861worker1 # [ 52.636571] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4862worker1 # [ 52.828718] nix-daemon[842]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)4863worker1 # [ 52.843704] nix-daemon[842]: reaped child process 1040, status = succeeded4864worker1 # [ 53.009217] nix-daemon[842]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4865worker1 # [ 53.023063] nix-daemon[842]: reaped child process 1045, status = succeeded4866lb # [ 53.025835] niks3-server[1051]: 2026/09/20 12:22:30 INFO Received uploads request method=POST path=/api/pending_closures4867worker1 # [ 53.042140] nix-grpc-daemon[852]: time=2026-09-20T12:22:30.141Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4868worker1 # [ 53.043693] nix-grpc-daemon[852]: time=2026-09-20T12:22:30.143Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4869lb # [ 53.052745] niks3-server[1051]: 2026/09/20 12:22:30 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4870lb # [ 53.064816] niks3-server[1051]: 2026/09/20 12:22:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4871lb # [ 53.070066] niks3-server[1051]: 2026/09/20 12:22:30 INFO Signed narinfos id=11 count=14872worker1 # [ 53.081216] nix-grpc-daemon[852]: time=2026-09-20T12:22:30.181Z level=INFO msg="Uploading 1 narinfos"4873lb # [ 53.082434] niks3-server[1051]: 2026/09/20 12:22:30 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4874lb # [ 53.188870] niks3-server[1051]: 2026/09/20 12:22:30 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4875lb # [ 53.194377] niks3-server[1051]: 2026/09/20 12:22:30 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4876worker1 # [ 53.212022] nix-grpc-daemon[852]: time=2026-09-20T12:22:30.311Z level=INFO msg="Upload complete. (564ms)"4877lb # [ 53.203936] niks3-server[1051]: 2026/09/20 12:22:30 INFO Completed upload id=114878worker1 # [ 53.214315] nix-grpc-daemon[783]: ts=2026-09-20T12:22:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_in=5124879worker1 # [ 53.218108] nix-grpc-daemon[783]: ts=2026-09-20T12:22:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004880worker1 # [ 53.224886] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4881worker1 # [ 53.227371] nix-daemon[842]: reaped child process 1035, status = succeeded4882worker1 # [ 53.232596] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4883worker1 # [ 54.459830] nix-daemon[842]: reaped child process 1049, status = succeeded4884worker1 # [ 54.622826] nix-daemon[842]: accepted connection from pid 1064, user nix-grpc-daemon (trusted)4885worker1 # [ 54.636128] nix-daemon[842]: reaped child process 1067, status = succeeded4886lb # [ 54.646351] niks3-server[1051]: 2026/09/20 12:22:31 INFO Received uploads request method=POST path=/api/pending_closures4887worker1 # [ 54.663441] nix-grpc-daemon[852]: time=2026-09-20T12:22:31.763Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4888worker1 # [ 54.665242] nix-grpc-daemon[852]: time=2026-09-20T12:22:31.765Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4889lb # [ 54.686297] niks3-server[1051]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4890lb # [ 54.695853] niks3-server[1051]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4891lb # [ 54.707776] niks3-server[1051]: 2026/09/20 12:22:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4892worker1 # [ 54.720586] nix-grpc-daemon[852]: time=2026-09-20T12:22:31.820Z level=INFO msg="Uploading 1 narinfos"4893lb # [ 54.712626] niks3-server[1051]: 2026/09/20 12:22:31 INFO Signed narinfos id=12 count=14894lb # [ 54.717949] niks3-server[1051]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4895lb # [ 54.726468] niks3-server[1051]: 2026/09/20 12:22:31 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4896lb # [ 54.731306] niks3-server[1051]: 2026/09/20 12:22:31 INFO Completed upload id=124897worker1 # [ 54.739575] nix-grpc-daemon[852]: time=2026-09-20T12:22:31.839Z level=INFO msg="Upload complete. (299ms)"4898lb # [ 54.733824] niks3-server[1051]: 2026/09/20 12:22:31 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4899worker1 # [ 54.746350] nix-grpc-daemon[783]: ts=2026-09-20T12:22:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14900worker1 # [ 54.752799] nix-grpc-daemon[783]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:374004901worker1 # [ 54.763380] nix-daemon[842]: reaped child process 1047, status = succeeded4902worker1 # [ 54.770117] nix-grpc-daemon[783]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:374004903worker1 # [ 54.774856] nix-grpc-daemon[783]: ts=2026-09-20T12:22:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_out=1284904worker2 # [ 55.023362] nix-grpc-daemon[798]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:412604905worker2 # [ 55.031173] nix-grpc-daemon[798]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:412604906worker2 # [ 55.058147] nix-grpc-daemon[798]: ts=2026-09-20T12:22:31Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04907worker2 # [ 55.062368] nix-grpc-daemon[798]: ts=2026-09-20T12:22:31Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14908worker1 # [ 55.066057] nix-grpc-daemon[783]: ts=2026-09-20T12:22:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004909worker1 # [ 55.077683] nix-grpc-daemon[783]: ts=2026-09-20T12:22:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004910worker1 # [ 55.090642] nix-grpc-daemon[852]: time=2026-09-20T12:22:32.190Z level=INFO msg="All 1 paths already cached"4911worker1 # [ 55.097605] nix-grpc-daemon[783]: ts=2026-09-20T12:22:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:374004912worker1 # [ 55.108342] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4913worker1 # [ 55.293853] nix-daemon[842]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)4914worker1 # [ 55.308622] nix-daemon[842]: reaped child process 1074, status = succeeded4915worker1 # [ 55.471706] nix-daemon[842]: accepted connection from pid 1076, user nix-grpc-daemon (trusted)4916worker1 # [ 55.484648] nix-daemon[842]: reaped child process 1079, status = succeeded4917lb # [ 55.492460] niks3-server[1051]: 2026/09/20 12:22:32 INFO Received uploads request method=POST path=/api/pending_closures4918worker1 # [ 55.518595] nix-grpc-daemon[852]: time=2026-09-20T12:22:32.618Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4919worker1 # [ 55.520537] nix-grpc-daemon[852]: time=2026-09-20T12:22:32.620Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4920lb # [ 55.532763] niks3-server[1051]: 2026/09/20 12:22:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4921lb # [ 55.537703] niks3-server[1051]: 2026/09/20 12:22:32 INFO Signed narinfos id=13 count=14922worker1 # [ 55.548801] nix-grpc-daemon[852]: time=2026-09-20T12:22:32.648Z level=INFO msg="Uploading 1 narinfos"4923lb # [ 55.541250] niks3-server[1051]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4924lb # [ 55.554052] niks3-server[1051]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4925lb # [ 55.561722] niks3-server[1051]: 2026/09/20 12:22:32 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4926lb # [ 55.569547] niks3-server[1051]: 2026/09/20 12:22:32 INFO Completed upload id=134927worker1 # [ 55.577788] nix-grpc-daemon[852]: time=2026-09-20T12:22:32.677Z level=INFO msg="Upload complete. (457ms)"4928worker1 # [ 55.582141] nix-grpc-daemon[783]: ts=2026-09-20T12:22:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_in=6244929lb # [ 55.575263] niks3-server[1051]: 2026/09/20 12:22:32 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4930worker1 # [ 55.587910] nix-grpc-daemon[783]: ts=2026-09-20T12:22:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004931worker1 # [ 55.597516] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4932worker1 # [ 55.605775] nix-daemon[842]: reaped child process 1069, status = succeeded4933worker1 # [ 55.611080] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4934worker1 # [ 56.625548] nix-daemon[842]: reaped child process 1083, status = succeeded4935worker1 # [ 56.781330] nix-daemon[842]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)4936worker1 # [ 56.794836] nix-daemon[842]: reaped child process 1101, status = succeeded4937lb # [ 56.803610] niks3-server[1051]: 2026/09/20 12:22:34 INFO Received uploads request method=POST path=/api/pending_closures4938worker1 # [ 56.820803] nix-grpc-daemon[852]: time=2026-09-20T12:22:33.919Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4939worker1 # [ 56.822235] nix-grpc-daemon[852]: time=2026-09-20T12:22:33.919Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4940lb # [ 56.834437] niks3-server[1051]: 2026/09/20 12:22:34 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4941lb # [ 56.850150] niks3-server[1051]: 2026/09/20 12:22:34 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4942lb # [ 56.858178] niks3-server[1051]: 2026/09/20 12:22:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4943worker1 # [ 56.870950] nix-grpc-daemon[852]: time=2026-09-20T12:22:33.970Z level=INFO msg="Uploading 1 narinfos"4944lb # [ 56.862776] niks3-server[1051]: 2026/09/20 12:22:34 INFO Signed narinfos id=14 count=14945lb # [ 56.867526] niks3-server[1051]: 2026/09/20 12:22:34 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4946lb # [ 56.877064] niks3-server[1051]: 2026/09/20 12:22:34 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4947lb # [ 56.880054] niks3-server[1051]: 2026/09/20 12:22:34 INFO Completed upload id=144948worker1 # [ 56.888297] nix-grpc-daemon[852]: time=2026-09-20T12:22:33.988Z level=INFO msg="Upload complete. (270ms)"4949lb # [ 56.882639] niks3-server[1051]: 2026/09/20 12:22:34 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4950worker1 # [ 56.892083] nix-grpc-daemon[783]: ts=2026-09-20T12:22:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14951worker1 # [ 56.897773] nix-daemon[842]: reaped child process 1081, status = succeeded4952worker2 # [ 56.941900] nix-grpc-daemon[798]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:412604953worker2 # [ 56.957395] nix-grpc-daemon[798]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4954worker2 # [ 56.974960] nix-grpc-daemon[798]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4955worker1 # [ 57.001502] nix-grpc-daemon[783]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:374004956worker1 # [ 57.006588] nix-grpc-daemon[783]: ts=2026-09-20T12:22:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_out=1764957worker2 # [ 57.227079] nix-grpc-daemon[798]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:412604958worker1 # [ 57.231941] nix-grpc-daemon[783]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004959worker1 # [ 57.243392] nix-grpc-daemon[852]: time=2026-09-20T12:22:34.343Z level=INFO msg="All 2 paths already cached"4960worker2 # [ 57.264257] nix-grpc-daemon[798]: ts=2026-09-20T12:22:34Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04961worker2 # [ 57.268823] nix-grpc-daemon[798]: ts=2026-09-20T12:22:34Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14962worker1 # [ 57.310421] nix-grpc-daemon[783]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004963worker1 # [ 57.322162] nix-grpc-daemon[783]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374004964worker1 # [ 57.334487] nix-grpc-daemon[852]: time=2026-09-20T12:22:34.434Z level=INFO msg="All 2 paths already cached"4965worker1 # [ 57.341722] nix-grpc-daemon[783]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:374004966worker1 # [ 57.350226] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4967worker1 # [ 57.524088] nix-daemon[842]: accepted connection from pid 1105, user nix-grpc-daemon (trusted)4968worker1 # [ 57.537660] nix-daemon[842]: reaped child process 1108, status = succeeded4969worker1 # [ 57.708556] nix-daemon[842]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4970worker1 # [ 57.722079] nix-daemon[842]: reaped child process 1113, status = succeeded4971lb # [ 57.723873] niks3-server[1051]: 2026/09/20 12:22:34 INFO Received uploads request method=POST path=/api/pending_closures4972worker1 # [ 57.739542] nix-grpc-daemon[852]: time=2026-09-20T12:22:34.839Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4973worker1 # [ 57.741689] nix-grpc-daemon[852]: time=2026-09-20T12:22:34.841Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4974lb # [ 57.751212] niks3-server[1051]: 2026/09/20 12:22:34 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4975lb # [ 57.761168] niks3-server[1051]: 2026/09/20 12:22:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4976lb # [ 57.765227] niks3-server[1051]: 2026/09/20 12:22:34 INFO Signed narinfos id=15 count=14977worker1 # [ 57.776389] nix-grpc-daemon[852]: time=2026-09-20T12:22:34.876Z level=INFO msg="Uploading 1 narinfos"4978lb # [ 57.777581] niks3-server[1051]: 2026/09/20 12:22:34 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4979lb # [ 57.783387] niks3-server[1051]: 2026/09/20 12:22:34 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4980lb # [ 58.092298] niks3-server[1051]: 2026/09/20 12:22:35 INFO Completed upload id=154981lb # [ 58.096459] niks3-server[1051]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4982worker1 # [ 58.104684] nix-grpc-daemon[852]: time=2026-09-20T12:22:35.200Z level=INFO msg="Upload complete. (736ms)"4983worker1 # [ 58.111462] nix-grpc-daemon[783]: ts=2026-09-20T12:22:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_in=7524984worker1 # [ 58.118220] nix-grpc-daemon[783]: ts=2026-09-20T12:22:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374004985worker1 # [ 58.128668] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4986worker1 # [ 58.143742] nix-daemon[842]: reaped child process 1103, status = succeeded4987worker1 # [ 58.154661] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)4988lb # [ 58.196222] envoy[910]: conn peer=[2001:db8:1::1]:33244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=33914989lb # [ 58.199988] envoy[910]: conn peer=[2001:db8:1::1]:33234 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1355 ms=45824990lb # [ 58.203661] envoy[910]: conn peer=[2001:db8:1::1]:33250 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3425 tx=1634 ms=23054991lb # [ 58.207139] envoy[910]: conn peer=[2001:db8:1::1]:39286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=564992lb # [ 58.210451] envoy[910]: conn peer=[2001:db8:1::1]:39296 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1971 ms=20004993lb # [ 58.213809] envoy[910]: conn peer=[2001:db8:1::1]:39298 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=194994worker1 # [ 59.385414] nix-daemon[842]: reaped child process 1117, status = succeeded4995worker1 # [ 59.543099] nix-daemon[842]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)4996worker1 # [ 59.558836] nix-daemon[842]: reaped child process 1135, status = succeeded4997lb # [ 59.565933] niks3-server[1051]: 2026/09/20 12:22:36 INFO Received uploads request method=POST path=/api/pending_closures4998worker1 # [ 59.582435] nix-grpc-daemon[852]: time=2026-09-20T12:22:36.682Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4999worker1 # [ 59.586255] nix-grpc-daemon[852]: time=2026-09-20T12:22:36.683Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"5000lb # [ 59.599517] niks3-server[1051]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv5001lb # [ 59.611723] niks3-server[1051]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst5002lb # [ 59.621762] niks3-server[1051]: 2026/09/20 12:22:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign5003lb # [ 59.626502] niks3-server[1051]: 2026/09/20 12:22:36 INFO Signed narinfos id=16 count=15004worker1 # [ 59.637876] nix-grpc-daemon[852]: time=2026-09-20T12:22:36.737Z level=INFO msg="Uploading 1 narinfos"5005lb # [ 59.638317] niks3-server[1051]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls5006lb # [ 59.644655] niks3-server[1051]: 2026/09/20 12:22:36 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete5007lb # [ 59.648972] niks3-server[1051]: 2026/09/20 12:22:36 INFO Completed upload id=165008worker1 # [ 59.657211] nix-grpc-daemon[852]: time=2026-09-20T12:22:36.757Z level=INFO msg="Upload complete. (287ms)"5009lb # [ 59.652383] niks3-server[1051]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo5010worker1 # [ 59.662608] nix-grpc-daemon[783]: ts=2026-09-20T12:22:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=15011worker1 # [ 59.676358] nix-daemon[842]: reaped child process 1115, status = succeeded5012worker2 # [ 59.677904] nix-grpc-daemon[798]: ts=2026-09-20T12:22:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:412605013worker2 # [ 59.690213] nix-grpc-daemon[798]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...5014worker2 # [ 59.715864] nix-grpc-daemon[798]: ts=2026-09-20T12:22:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:412605015worker2 # [ 59.721147] nix-grpc-daemon[798]: ts=2026-09-20T12:22:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=0 paths=1 nar_bytes_out=2325016client # [ 59.845151] nix-daemon[940]: reaped child process 942, status = succeeded5017client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.86 seconds)5018client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top5019client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)5020client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5021client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)5022client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5023client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)5024(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.95 seconds)5025subtest: an input only one worker has still reaches the builder5026client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only5027client # this derivation will be built:5028client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv5029client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...5030client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.39 seconds)5031client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure5032client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.19 seconds)5033worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5034worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds)5035worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only5036worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)5037client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&25038client # [ 60.942335] nix-daemon[940]: accepted connection from pid 1020, user root (trusted)5039client # this derivation will be built:5040client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5041client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...5042worker1 # [ 61.118825] nix-grpc-daemon[783]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:374005043worker1 # [ 61.125280] nix-grpc-daemon[783]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374005044worker1 # [ 61.297944] nix-daemon[842]: accepted connection from pid 1142, user nix-grpc-daemon (trusted)5045worker1 # [ 61.309607] nix-daemon[842]: reaped child process 1145, status = succeeded5046lb # [ 61.312668] niks3-server[1051]: 2026/09/20 12:22:38 INFO Received uploads request method=POST path=/api/pending_closures5047worker1 # [ 61.328642] nix-grpc-daemon[852]: time=2026-09-20T12:22:38.428Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5048worker1 # [ 61.330065] nix-grpc-daemon[852]: time=2026-09-20T12:22:38.428Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5049lb # [ 61.335628] niks3-server[1051]: 2026/09/20 12:22:38 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5050lb # [ 61.347271] niks3-server[1051]: 2026/09/20 12:22:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign5051lb # [ 61.351052] niks3-server[1051]: 2026/09/20 12:22:38 INFO Signed narinfos id=17 count=15052worker1 # [ 61.361998] nix-grpc-daemon[852]: time=2026-09-20T12:22:38.461Z level=INFO msg="Uploading 1 narinfos"5053lb # [ 61.357130] niks3-server[1051]: 2026/09/20 12:22:38 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5054lb # [ 61.369343] niks3-server[1051]: 2026/09/20 12:22:38 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5055lb # [ 61.374710] niks3-server[1051]: 2026/09/20 12:22:38 INFO Completed upload id=175056worker1 # [ 61.383073] nix-grpc-daemon[852]: time=2026-09-20T12:22:38.482Z level=INFO msg="Upload complete. (258ms)"5057lb # [ 61.379420] niks3-server[1051]: 2026/09/20 12:22:38 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5058worker2 # [ 61.408152] nix-grpc-daemon[798]: ts=2026-09-20T12:22:38Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05059worker2 # [ 61.412569] nix-grpc-daemon[798]: ts=2026-09-20T12:22:38Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=15060worker2 # [ 61.457668] nix-grpc-daemon[798]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:412605061worker2 # [ 61.470627] nix-grpc-daemon[798]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:412605062client # copying 2 paths to 'lb:50051'...5063client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5064worker2 # [ 61.486860] nix-grpc-daemon[798]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:412605065client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5066worker2 # [ 61.500254] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5067worker2 # [ 61.679770] nix-daemon[867]: accepted connection from pid 1003, user nix-grpc-daemon (trusted)5068worker2 # [ 61.695642] nix-daemon[867]: reaped child process 1006, status = succeeded5069worker2 # [ 61.856188] nix-daemon[867]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)5070worker2 # [ 61.870143] nix-daemon[867]: reaped child process 1012, status = succeeded5071lb # [ 61.874199] niks3-server[1051]: 2026/09/20 12:22:39 INFO Received uploads request method=POST path=/api/pending_closures5072lb # [ 61.882533] niks3-server[1051]: 2026/09/20 12:22:39 INFO Received uploads request method=POST path=/api/pending_closures5073worker2 # [ 61.901790] nix-grpc-daemon[918]: time=2026-09-20T12:22:38.762Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5074worker2 # [ 61.904171] nix-grpc-daemon[918]: time=2026-09-20T12:22:38.764Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5075worker2 # [ 61.905938] nix-grpc-daemon[918]: time=2026-09-20T12:22:38.764Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5076lb # [ 61.927941] niks3-server[1051]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5077lb # [ 61.935770] niks3-server[1051]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5078lb # [ 61.939884] niks3-server[1051]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5079lb # [ 61.944330] niks3-server[1051]: 2026/09/20 12:22:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5080lb # [ 61.948399] niks3-server[1051]: 2026/09/20 12:22:39 INFO Signed narinfos id=18 count=15081lb # [ 61.952651] niks3-server[1051]: 2026/09/20 12:22:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5082lb # [ 61.955042] niks3-server[1051]: 2026/09/20 12:22:39 INFO Signed narinfos id=19 count=25083lb # [ 61.957197] niks3-server[1051]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5084worker2 # [ 61.967841] nix-grpc-daemon[918]: time=2026-09-20T12:22:38.827Z level=INFO msg="Uploading 3 narinfos"5085lb # [ 61.969589] niks3-server[1051]: 2026/09/20 12:22:39 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5086lb # [ 61.973066] niks3-server[1051]: 2026/09/20 12:22:39 INFO Completed upload id=185087lb # [ 61.974550] niks3-server[1051]: 2026/09/20 12:22:39 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5088lb # [ 61.976935] niks3-server[1051]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5089lb # [ 61.979240] niks3-server[1051]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5090lb # [ 61.981492] niks3-server[1051]: 2026/09/20 12:22:39 INFO Completed upload id=195091lb # [ 61.982969] niks3-server[1051]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5092worker2 # [ 61.994423] nix-grpc-daemon[918]: time=2026-09-20T12:22:38.854Z level=INFO msg="Upload complete. (477ms)"5093worker2 # [ 61.999287] nix-grpc-daemon[798]: ts=2026-09-20T12:22:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=0 paths=2 nar_bytes_in=9765094worker2 # [ 62.006387] nix-grpc-daemon[798]: ts=2026-09-20T12:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:412605095worker2 # [ 62.017237] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5096worker2 # [ 62.025328] nix-daemon[867]: reaped child process 1001, status = succeeded5097worker2 # [ 62.031309] nix-grpc-daemon[798]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5098worker2 # [ 62.038277] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5099client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5100client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5101worker2 # [ 62.663408] nix-daemon[867]: reaped child process 1017, status = succeeded5102worker2 # [ 62.822543] nix-daemon[867]: accepted connection from pid 1032, user nix-grpc-daemon (trusted)5103worker2 # [ 62.835916] nix-daemon[867]: reaped child process 1035, status = succeeded5104lb # [ 62.839605] niks3-server[1051]: 2026/09/20 12:22:40 INFO Received uploads request method=POST path=/api/pending_closures5105worker2 # [ 62.859533] nix-grpc-daemon[918]: time=2026-09-20T12:22:39.720Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5106lb # [ 62.876940] niks3-server[1051]: 2026/09/20 12:22:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5107worker2 # [ 62.895054] nix-grpc-daemon[918]: time=2026-09-20T12:22:39.755Z level=INFO msg="Uploading 1 narinfos"5108lb # [ 62.883750] niks3-server[1051]: 2026/09/20 12:22:40 INFO Signed narinfos id=20 count=15109lb # [ 62.887425] niks3-server[1051]: 2026/09/20 12:22:40 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5110lb # [ 62.890714] niks3-server[1051]: 2026/09/20 12:22:40 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5111lb # [ 62.901718] niks3-server[1051]: 2026/09/20 12:22:40 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5112lb # [ 62.904169] niks3-server[1051]: 2026/09/20 12:22:40 INFO Completed upload id=205113worker2 # [ 62.917462] nix-grpc-daemon[918]: time=2026-09-20T12:22:39.777Z level=INFO msg="Upload complete. (269ms)"5114lb # [ 62.906830] niks3-server[1051]: 2026/09/20 12:22:40 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5115worker2 # [ 62.920287] nix-grpc-daemon[798]: ts=2026-09-20T12:22:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=0 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=15116client # copying 1 paths...5117worker2 # [ 62.927973] nix-daemon[867]: reaped child process 1014, status = succeeded5118worker1 # [ 62.923590] nix-grpc-daemon[783]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:374005119worker1 # [ 62.935805] nix-grpc-daemon[783]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5120client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5121worker2 # [ 62.969299] nix-grpc-daemon[798]: ts=2026-09-20T12:22:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:412605122worker2 # [ 62.975242] nix-grpc-daemon[798]: ts=2026-09-20T12:22:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=0 paths=1 nar_bytes_out=1205123client # [ 63.036738] nix-daemon[940]: reaped child process 1023, status = succeeded5124client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.27 seconds)5125client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25126client # [ 63.203275] nix-daemon[940]: accepted connection from pid 1041, user root (trusted)5127client # this derivation will be built:5128client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5129worker1 # [ 63.364801] nix-grpc-daemon[783]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:374005130client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...5131worker2 # [ 63.371153] nix-grpc-daemon[798]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:412605132worker2 # [ 63.379623] nix-grpc-daemon[918]: time=2026-09-20T12:22:40.240Z level=INFO msg="All 1 paths already cached"5133worker2 # [ 63.392202] nix-grpc-daemon[798]: ts=2026-09-20T12:22:40Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05134worker2 # [ 63.397105] nix-grpc-daemon[798]: ts=2026-09-20T12:22:40Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15135worker1 # [ 63.436880] nix-grpc-daemon[783]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374005136worker1 # [ 63.447417] nix-grpc-daemon[783]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:374005137client # copying 1 paths to 'lb:50051'...5138client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5139worker1 # [ 63.466127] nix-grpc-daemon[783]: ts=2026-09-20T12:22:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:374005140worker1 # [ 63.478207] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5141worker1 # [ 63.494416] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 1/5)5142worker1 # [ 63.548025] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 2/5)5143worker1 # [ 63.648814] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 102 ms (attempt 3/5)5144worker1 # [ 63.751069] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 652 ms (attempt 4/5)5145worker1 # [ 64.404660] nix-grpc-daemon[783]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5146worker1 # [ 64.410732] nix-grpc-daemon[783]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5147worker1 # [ 64.609126] nix-daemon[842]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5148worker1 # [ 64.621966] nix-daemon[842]: reaped child process 1157, status = succeeded5149worker1 # [ 64.778957] nix-daemon[842]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)5150worker1 # [ 64.791321] nix-daemon[842]: reaped child process 1162, status = succeeded5151lb # [ 64.799080] niks3-server[1051]: 2026/09/20 12:22:42 INFO Received uploads request method=POST path=/api/pending_closures5152worker1 # [ 64.812448] nix-grpc-daemon[852]: time=2026-09-20T12:22:41.912Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5153worker1 # [ 64.814328] nix-grpc-daemon[852]: time=2026-09-20T12:22:41.913Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5154lb # [ 64.823431] niks3-server[1051]: 2026/09/20 12:22:42 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5155lb # [ 64.833995] niks3-server[1051]: 2026/09/20 12:22:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5156worker1 # [ 64.846835] nix-grpc-daemon[852]: time=2026-09-20T12:22:41.946Z level=INFO msg="Uploading 1 narinfos"5157lb # [ 64.838713] niks3-server[1051]: 2026/09/20 12:22:42 INFO Signed narinfos id=21 count=15158lb # [ 64.845259] niks3-server[1051]: 2026/09/20 12:22:42 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5159lb # [ 64.855623] niks3-server[1051]: 2026/09/20 12:22:42 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5160lb # [ 64.862242] niks3-server[1051]: 2026/09/20 12:22:42 INFO Completed upload id=215161worker1 # [ 64.872532] nix-grpc-daemon[852]: time=2026-09-20T12:22:41.972Z level=INFO msg="Upload complete. (443ms)"5162lb # [ 64.864777] niks3-server[1051]: 2026/09/20 12:22:42 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5163worker1 # [ 64.876310] nix-grpc-daemon[783]: ts=2026-09-20T12:22:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=1 paths=1 nar_bytes_in=5605164worker1 # [ 64.881286] nix-grpc-daemon[783]: ts=2026-09-20T12:22:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:374005165worker1 # [ 64.889278] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5166worker1 # [ 64.895230] nix-daemon[842]: reaped child process 1148, status = succeeded5167worker1 # [ 64.900348] nix-daemon[842]: accepted connection from pid 783, user nix-grpc-daemon (trusted)5168client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5169client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5170worker1 # [ 66.327646] nix-daemon[842]: reaped child process 1166, status = succeeded5171worker1 # [ 66.462420] nix-daemon[842]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5172worker1 # [ 66.475301] nix-daemon[842]: reaped child process 1184, status = succeeded5173lb # [ 66.478737] niks3-server[1051]: 2026/09/20 12:22:43 INFO Received uploads request method=POST path=/api/pending_closures5174worker1 # [ 66.495209] nix-grpc-daemon[852]: time=2026-09-20T12:22:43.595Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5175lb # [ 66.507501] niks3-server[1051]: 2026/09/20 12:22:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5176lb # [ 66.513358] niks3-server[1051]: 2026/09/20 12:22:43 INFO Signed narinfos id=22 count=15177worker1 # [ 66.524205] nix-grpc-daemon[852]: time=2026-09-20T12:22:43.624Z level=INFO msg="Uploading 1 narinfos"5178lb # [ 66.520193] niks3-server[1051]: 2026/09/20 12:22:43 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5179lb # [ 66.528406] niks3-server[1051]: 2026/09/20 12:22:43 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5180lb # [ 66.540116] niks3-server[1051]: 2026/09/20 12:22:43 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5181worker1 # [ 66.553167] nix-grpc-daemon[852]: time=2026-09-20T12:22:43.653Z level=INFO msg="Upload complete. (244ms)"5182lb # [ 66.545233] niks3-server[1051]: 2026/09/20 12:22:43 INFO Completed upload id=225183lb # [ 66.548729] niks3-server[1051]: 2026/09/20 12:22:43 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5184client # copying 1 paths...5185worker1 # [ 66.557352] nix-grpc-daemon[783]: ts=2026-09-20T12:22:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15186worker2 # [ 66.566585] nix-grpc-daemon[798]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:412605187worker1 # [ 66.568620] nix-daemon[842]: reaped child process 1164, status = succeeded5188worker2 # [ 66.572762] nix-grpc-daemon[798]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5189client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5190worker2 # [ 66.593823] nix-grpc-daemon[798]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:412605191worker2 # [ 66.595897] nix-grpc-daemon[798]: ts=2026-09-20T12:22:43Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=0 paths=1 nar_bytes_out=1205192client # [ 66.714373] nix-daemon[940]: reaped child process 1044, status = succeeded5193client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.68 seconds)5194client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25195client # [ 66.893162] nix-daemon[940]: accepted connection from pid 1062, user root (trusted)5196client # this derivation will be built:5197client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5198worker1 # [ 67.049439] nix-grpc-daemon[783]: ts=2026-09-20T12:22:44Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:374005199client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...5200worker2 # [ 67.059738] nix-grpc-daemon[798]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:412605201worker2 # [ 67.069661] nix-grpc-daemon[918]: time=2026-09-20T12:22:43.929Z level=INFO msg="All 1 paths already cached"5202worker2 # [ 67.083231] nix-grpc-daemon[798]: ts=2026-09-20T12:22:43Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05203worker2 # [ 67.087373] nix-grpc-daemon[798]: ts=2026-09-20T12:22:43Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15204worker2 # [ 67.094760] nix-grpc-daemon[798]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:412605205worker2 # [ 67.106117] nix-grpc-daemon[798]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:412605206worker2 # [ 67.117658] nix-grpc-daemon[918]: time=2026-09-20T12:22:43.978Z level=INFO msg="All 1 paths already cached"5207client # copying 1 paths to 'lb:50051'...5208client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5209worker2 # [ 67.125644] nix-grpc-daemon[798]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:412605210worker2 # [ 67.136817] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5211worker2 # [ 67.290158] nix-daemon[867]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)5212worker2 # [ 67.303857] nix-daemon[867]: reaped child process 1047, status = succeeded5213worker2 # [ 67.468461] nix-daemon[867]: accepted connection from pid 1049, user nix-grpc-daemon (trusted)5214worker2 # [ 67.481239] nix-daemon[867]: reaped child process 1052, status = succeeded5215lb # [ 67.484681] niks3-server[1051]: 2026/09/20 12:22:44 INFO Received uploads request method=POST path=/api/pending_closures5216worker2 # [ 67.500400] nix-grpc-daemon[918]: time=2026-09-20T12:22:44.361Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5217worker2 # [ 67.501885] nix-grpc-daemon[918]: time=2026-09-20T12:22:44.362Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5218lb # [ 67.512328] niks3-server[1051]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5219lb # [ 67.520784] niks3-server[1051]: 2026/09/20 12:22:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5220lb # [ 67.528504] niks3-server[1051]: 2026/09/20 12:22:44 INFO Signed narinfos id=23 count=15221worker2 # [ 67.543052] nix-grpc-daemon[918]: time=2026-09-20T12:22:44.403Z level=INFO msg="Uploading 1 narinfos"5222lb # [ 67.531481] niks3-server[1051]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5223lb # [ 67.544740] niks3-server[1051]: 2026/09/20 12:22:44 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5224lb # [ 67.550832] niks3-server[1051]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5225lb # [ 67.554481] niks3-server[1051]: 2026/09/20 12:22:44 INFO Completed upload id=235226worker2 # [ 67.568272] nix-grpc-daemon[918]: time=2026-09-20T12:22:44.428Z level=INFO msg="Upload complete. (420ms)"5227worker2 # [ 67.573582] nix-grpc-daemon[798]: ts=2026-09-20T12:22:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=0 paths=1 nar_bytes_in=5605228worker2 # [ 67.578386] nix-grpc-daemon[798]: ts=2026-09-20T12:22:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:412605229worker2 # [ 67.589108] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5230worker2 # [ 67.593302] nix-daemon[867]: reaped child process 1042, status = succeeded5231worker2 # [ 67.598378] nix-daemon[867]: accepted connection from pid 798, user nix-grpc-daemon (trusted)5232client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5233client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5234lb # [ 68.196265] envoy[910]: conn peer=[2001:db8:1::1]:39306 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2221 ms=25505235lb # [ 68.198065] envoy[910]: conn peer=[2001:db8:1::1]:39308 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=585236lb # [ 68.199382] envoy[910]: conn peer=[2001:db8:1::1]:47620 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=125237lb # [ 68.200752] envoy[910]: conn peer=[2001:db8:1::1]:39310 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3826 tx=1878 ms=18655238lb # [ 68.202146] envoy[910]: conn peer=[2001:db8:1::1]:47632 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3699 tx=1916 ms=32805239lb # [ 68.203843] envoy[910]: conn peer=[2001:db8:1::1]:47648 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=535240worker2 # [ 69.025499] nix-daemon[867]: reaped child process 1056, status = succeeded5241worker2 # [ 69.190629] nix-daemon[867]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)5242worker2 # [ 69.203903] nix-daemon[867]: reaped child process 1074, status = succeeded5243lb # [ 69.208297] niks3-server[1051]: 2026/09/20 12:22:46 INFO Received uploads request method=POST path=/api/pending_closures5244worker2 # [ 69.227974] nix-grpc-daemon[918]: time=2026-09-20T12:22:46.088Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5245lb # [ 69.237741] niks3-server[1051]: 2026/09/20 12:22:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5246worker2 # [ 69.256156] nix-grpc-daemon[918]: time=2026-09-20T12:22:46.116Z level=INFO msg="Uploading 1 narinfos"5247lb # [ 69.244511] niks3-server[1051]: 2026/09/20 12:22:46 INFO Signed narinfos id=24 count=15248lb # [ 69.253221] niks3-server[1051]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5249lb # [ 69.260395] niks3-server[1051]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5250lb # [ 69.271932] niks3-server[1051]: 2026/09/20 12:22:46 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5251worker2 # [ 69.288452] nix-grpc-daemon[918]: time=2026-09-20T12:22:46.149Z level=INFO msg="Upload complete. (280ms)"5252lb # [ 69.276893] niks3-server[1051]: 2026/09/20 12:22:46 INFO Completed upload id=245253lb # [ 69.282100] niks3-server[1051]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5254worker2 # [ 69.293140] nix-grpc-daemon[798]: ts=2026-09-20T12:22:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41260 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15255worker2 # [ 69.304267] nix-daemon[867]: reaped child process 1054, status = succeeded5256client # copying 1 paths...5257worker2 # [ 69.337374] nix-grpc-daemon[798]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:412605258client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5259worker1 # [ 69.356733] nix-grpc-daemon[783]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:374005260worker1 # [ 69.375475] nix-grpc-daemon[783]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5261worker1 # [ 69.388711] nix-grpc-daemon[783]: ts=2026-09-20T12:22:46Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37400 duration_s=0 paths=1 nar_bytes_out=1205262client # [ 69.506560] nix-daemon[940]: reaped child process 1065, status = succeeded5263client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.79 seconds)5264(finished: subtest: an input only one worker has still reaches the builder, in 9.56 seconds)5265subtest: upload whose reference the worker lacks is completed from the cache5266client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5267client # this derivation will be built:5268client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5269client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5270client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.34 seconds)5271client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5272client # this derivation will be built:5273client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5274client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5275client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.39 seconds)5276client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5277client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)5278worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5279worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds)5280worker2 # [ 70.669716] systemd[1]: Stopping Nix worker-protocol over gRPC...5281worker2 # [ 71.588378] nix-grpc-daemon[798]: ts=2026-09-20T12:22:48Z level=info event=signal_exit5282worker2 # [ 71.837089] nix-grpc-daemon[798]: ts=2026-09-20T12:22:48Z level=info event=scheduler_yield5283lb # [ 71.827442] niks3-server[1051]: 2026/09/20 12:22:49 INFO lead: released remote=192.168.1.4:414865284worker2 # [ 71.841745] nix-grpc-daemon[798]: ts=2026-09-20T12:22:48Z level=info event=scheduler_restarting addr=lb:500515285worker2 # [ 71.845940] nix-grpc-daemon[798]: ts=2026-09-20T12:22:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:551765286worker1 # [ 71.843949] nix-grpc-daemon[783]: ts=2026-09-20T12:22:48Z level=info event=scheduler_restarting addr=lb:500515287worker2 # [ 71.850627] nix-grpc-daemon[798]: ts=2026-09-20T12:22:48Z level=info event=worker_gone addr=192.168.1.4:500515288worker2 # [ 71.853688] nix-grpc-daemon[798]: ts=2026-09-20T12:22:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:551765289worker2 # [ 71.856973] nix-grpc-daemon[798]: ts=2026-09-20T12:22:48Z level=info event=worker_gone addr=192.168.1.3:500515290worker2 # [ 72.042595] nix-grpc-daemon[798]: ts=2026-09-20T12:22:48Z level=info event=scheduler_connected addr=lb:500515291worker2 # [ 72.046433] nix-grpc-daemon[798]: ts=2026-09-20T12:22:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5292worker1 # [ 72.044157] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500515293worker1 # [ 72.047972] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5294worker2 # [ 72.247645] nix-grpc-daemon[798]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500515295worker2 # [ 72.251480] nix-grpc-daemon[798]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5296worker1 # [ 72.248849] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500515297worker1 # [ 72.252784] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5298worker2 # [ 72.452280] nix-grpc-daemon[798]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500515299worker2 # [ 72.456098] nix-grpc-daemon[798]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5300worker1 # [ 72.453523] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500515301worker1 # [ 72.457384] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5302worker2 # [ 72.657947] nix-grpc-daemon[798]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500515303worker1 # [ 72.658442] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500515304worker2 # [ 72.661710] nix-grpc-daemon[798]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5305worker1 # [ 72.662595] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5306worker2 # [ 72.841702] nix-grpc-daemon[798]: ts=2026-09-20T12:22:49Z level=info event=scheduler_restarting5307worker1 # [ 72.865119] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_connected addr=lb:500515308worker1 # [ 72.868963] nix-grpc-daemon[783]: ts=2026-09-20T12:22:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5309worker2 # [ 72.874693] nix-grpc-daemon[798]: ts=2026-09-20T12:22:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5310worker2 # [ 72.879262] nix-daemon[867]: reaped child process 870, status = succeeded5311worker1 # [ 73.065828] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500515312worker1 # [ 73.069812] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5313worker1 # [ 73.270660] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500515314worker1 # [ 73.274805] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5315worker1 # [ 73.475337] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500515316worker1 # [ 73.477245] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5317worker1 # [ 73.677839] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500515318worker1 # [ 73.679971] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5319worker2 # [ 73.717266] nix-grpc-daemon[798]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5320worker2 # [ 73.718743] nix-grpc-daemon[798]: E0000 00:00:1789906970.577073 841 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5321worker2 # [ 73.720675] nix-grpc-daemon[798]: E0000 00:00:1789906970.577479 841 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5322worker1 # [ 73.881043] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_connected addr=lb:500515323worker1 # [ 73.882873] nix-grpc-daemon[783]: ts=2026-09-20T12:22:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5324worker2 # [ 74.050895] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5325worker2 # [ 74.055431] systemd[1]: Stopped Nix worker-protocol over gRPC.5326worker2 # [ 74.058411] systemd[1]: nix-grpc-daemon.service: Consumed 1.485s CPU time over 55.753s wall clock time, 50.3M memory peak, 56.2K incoming IP traffic, 152.7K outgoing IP traffic.5327worker2 # [ 74.068939] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5328worker2 # [ 74.073292] systemd[1]: Closed Nix worker-protocol over gRPC.5329worker2 # [ 74.077171] systemd[1]: nix-grpc-daemon.socket: Consumed 312us CPU time over 1min 3.461s wall clock time, 256K memory peak, 74.2K incoming IP traffic, 63.1K outgoing IP traffic.5330lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5331lb: must succeed: curl -sf localhost:9901/clusters5332worker1 # [ 74.084058] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=info event=scheduler_connected addr=lb:500515333worker1 # [ 74.087877] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5334lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5335lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5336client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25337worker1 # [ 74.288634] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=info event=scheduler_connected addr=lb:500515338worker1 # [ 74.292839] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5339worker1 # [ 74.323122] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:374005340worker1 # [ 74.329987] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:374005341client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5342client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.20 seconds)5343worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5344worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5345worker2 # [ 74.435845] systemd[1]: Listening on Nix worker-protocol over gRPC.5346worker1 # [ 74.485841] systemd[1]: Stopping Nix worker-protocol over gRPC...5347worker1 # [ 74.493700] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=info event=scheduler_connected addr=lb:500515348worker1 # [ 74.497102] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5349worker1 # [ 74.697823] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=info event=scheduler_connected addr=lb:500515350worker1 # [ 74.701865] nix-grpc-daemon[783]: ts=2026-09-20T12:22:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5351worker1 # [ 74.904237] nix-grpc-daemon[783]: ts=2026-09-20T12:22:52Z level=info event=scheduler_connected addr=lb:500515352worker1 # [ 74.907503] nix-grpc-daemon[783]: ts=2026-09-20T12:22:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5353worker2 # [ 75.041872] systemd[1]: Starting scheduler-token.service...5354worker1 # [ 75.105304] nix-grpc-daemon[783]: ts=2026-09-20T12:22:52Z level=info event=scheduler_connected addr=lb:500515355worker1 # [ 75.109266] nix-grpc-daemon[783]: ts=2026-09-20T12:22:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5356worker2 # [ 75.118216] systemd[1]: scheduler-token.service: Deactivated successfully.5357worker2 # [ 75.120817] systemd[1]: Finished scheduler-token.service.5358worker2 # [ 75.122132] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 77ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5359worker2 # [ 75.126330] systemd[1]: Starting Nix worker-protocol over gRPC...5360worker2 # [ 75.254449] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5361worker2 # [ 75.256791] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5362worker2 # [ 75.260343] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15363worker2 # [ 75.267058] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5364worker2 # [ 75.270310] systemd[1]: Started Nix worker-protocol over gRPC.5365worker2 # [ 75.279488] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=scheduler_take_over5366lb # [ 75.268689] niks3-server[1051]: 2026/09/20 12:22:52 INFO lead: acquired remote=192.168.1.4:531485367worker2 # [ 75.293123] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=scheduler_connected addr=lb:500515368worker2 # [ 75.300697] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=oidc_jwks provider=mock keys=15369worker2 # [ 75.302000] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:521425370worker2 # [ 75.303563] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05371worker2 # [ 75.314394] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:521425372worker1 # [ 75.309949] nix-grpc-daemon[783]: ts=2026-09-20T12:22:52Z level=info event=scheduler_connected addr=lb:500515373worker2 # [ 75.315952] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05374worker1 # [ 75.421481] nix-grpc-daemon[783]: ts=2026-09-20T12:22:52Z level=info event=signal_exit5375worker1 # [ 76.694615] nix-grpc-daemon[783]: ts=2026-09-20T12:22:53Z level=info event=scheduler_restarting5376worker2 # [ 76.703317] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:521425377worker1 # [ 76.703375] nix-grpc-daemon[783]: ts=2026-09-20T12:22:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5378worker2 # [ 76.707125] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:53Z level=info event=worker_gone addr=192.168.1.3:500515379worker1 # [ 76.715591] nix-daemon[842]: reaped child process 844, status = succeeded5380worker1 # [ 77.551900] nix-grpc-daemon[783]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5381worker1 # [ 77.553388] nix-grpc-daemon[783]: E0000 00:00:1789906974.651533 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5382worker1 # [ 77.555210] nix-grpc-daemon[783]: E0000 00:00:1789906974.651930 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5383worker1 # [ 78.004908] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5384worker1 # [ 78.009597] systemd[1]: Stopped Nix worker-protocol over gRPC.5385worker1 # [ 78.012368] systemd[1]: nix-grpc-daemon.service: Consumed 2.661s CPU time over 59.808s wall clock time, 58.4M memory peak, 92.4K incoming IP traffic, 171.8K outgoing IP traffic.5386worker1 # [ 78.023963] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5387worker1 # [ 78.027584] systemd[1]: Closed Nix worker-protocol over gRPC.5388worker1 # [ 78.030264] systemd[1]: nix-grpc-daemon.socket: Consumed 302us CPU time over 1min 8.649s wall clock time, 256K memory peak, 77.6K incoming IP traffic, 62.4K outgoing IP traffic.5389lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5390lb: must succeed: curl -sf localhost:9901/clusters5391lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5392lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5393client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25394lb # [ 78.196319] envoy[910]: conn peer=[2001:db8:1::1]:47662 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3701 tx=1805 ms=23905395lb # [ 78.200511] envoy[910]: conn peer=[2001:db8:1::1]:47668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=865396lb # [ 78.203917] envoy[910]: conn peer=[2001:db8:1::4]:47378 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=57949 tx=2852 ms=542695397lb # [ 78.207616] envoy[910]: conn peer=[2001:db8:1::1]:39970 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=205398lb # [ 78.211186] envoy[910]: conn peer=[2001:db8:1::3]:57778 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=17054 tx=3351 ms=574425399worker2 # [ 78.299815] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:521445400worker2 # [ 78.311884] nix-daemon[867]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)5401worker2 # [ 78.328087] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5)5402worker2 # [ 78.409088] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 2/5)5403worker2 # [ 78.545268] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 293 ms (attempt 3/5)5404worker2 # [ 78.844138] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 727 ms (attempt 4/5)5405worker2 # [ 79.572265] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5406client # copying 2 paths...5407worker2 # [ 79.589538] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:521445408client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5409client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5410worker2 # [ 79.600042] nix-daemon[867]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)5411worker2 # [ 79.611282] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:56Z level=info event=niks3_push_started pid=11545412worker2 # [ 79.789224] nix-grpc-daemon[1154]: time=2026-09-20T12:22:56.649Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5413worker2 # [ 79.952413] nix-daemon[867]: accepted connection from pid 1167, user nix-grpc-daemon (trusted)5414worker2 # [ 79.965210] nix-daemon[867]: reaped child process 1170, status = succeeded5415lb # [ 79.971584] niks3-server[1051]: 2026/09/20 12:22:57 INFO Received uploads request method=POST path=/api/pending_closures5416lb # [ 79.981858] niks3-server[1051]: 2026/09/20 12:22:57 INFO Received uploads request method=POST path=/api/pending_closures5417worker2 # [ 80.000723] nix-grpc-daemon[1154]: time=2026-09-20T12:22:56.861Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5418worker2 # [ 80.002274] nix-grpc-daemon[1154]: time=2026-09-20T12:22:56.862Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5419worker2 # [ 80.004128] nix-grpc-daemon[1154]: time=2026-09-20T12:22:56.864Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5420lb # [ 80.037417] niks3-server[1051]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5421lb # [ 80.043598] niks3-server[1051]: 2026/09/20 12:22:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5422lb # [ 80.047955] niks3-server[1051]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5423lb # [ 80.054334] niks3-server[1051]: 2026/09/20 12:22:57 INFO Signed narinfos id=26 count=25424lb # [ 80.055680] niks3-server[1051]: 2026/09/20 12:22:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5425lb # [ 80.057584] niks3-server[1051]: 2026/09/20 12:22:57 INFO Signed narinfos id=25 count=15426worker2 # [ 80.070169] nix-grpc-daemon[1154]: time=2026-09-20T12:22:56.930Z level=INFO msg="Uploading 3 narinfos"5427lb # [ 80.060763] niks3-server[1051]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5428lb # [ 80.077307] niks3-server[1051]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5429lb # [ 80.080122] niks3-server[1051]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5430lb # [ 80.081849] niks3-server[1051]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5431lb # [ 80.087055] niks3-server[1051]: 2026/09/20 12:22:57 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5432lb # [ 80.142598] niks3-server[1051]: 2026/09/20 12:22:57 INFO Completed upload id=255433lb # [ 80.145575] niks3-server[1051]: 2026/09/20 12:22:57 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5434lb # [ 80.150218] niks3-server[1051]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5435lb # [ 80.154397] niks3-server[1051]: 2026/09/20 12:22:57 INFO Completed upload id=265436worker2 # [ 80.168500] nix-grpc-daemon[1154]: time=2026-09-20T12:22:57.028Z level=INFO msg="Upload complete. (374ms)"5437worker2 # [ 80.174176] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52144 duration_s=0 paths=2 nar_bytes_in=3125438worker2 # [ 80.186592] nix-daemon[867]: reaped child process 1152, status = succeeded5439client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 2.11 seconds)5440worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5441worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.03 seconds)5442worker1 # [ 80.293775] systemd[1]: Listening on Nix worker-protocol over gRPC.5443worker1 # [ 80.300404] systemd[1]: Starting Nix worker-protocol over gRPC...5444worker1 # [ 80.457973] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:57Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5445worker1 # [ 80.460154] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:57Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5446worker1 # [ 80.463591] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:57Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15447worker1 # [ 80.469852] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:57Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5448worker1 # [ 80.474577] systemd[1]: Started Nix worker-protocol over gRPC.5449lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5450lb: must succeed: curl -sf localhost:9901/clusters5451worker1 # [ 80.492029] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:57Z level=info event=scheduler_connected addr=lb:500515452worker2 # [ 80.497812] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:521425453worker2 # [ 80.501688] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05454lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5455lb: must succeed: curl -sf localhost:9901/clusters5456lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5457lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.14 seconds)5458(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.12 seconds)5459subtest: scheduler down: the other node takes the lock and keeps it5460lb: must succeed: curl -sf localhost:9901/clusters5461lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5462lb: must succeed: curl -sf localhost:9901/clusters5463lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5464lb: must succeed: curl -sf localhost:9901/clusters5465lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5466lb: must succeed: curl -sf localhost:9901/clusters5467lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5468worker2 # [ 81.829650] systemd[1]: Stopping Nix worker-protocol over gRPC...5469worker2 # [ 82.271096] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=signal_exit5470worker2 # [ 82.484724] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=scheduler_yield5471worker1 # [ 82.484501] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:59Z level=info event=scheduler_restarting addr=lb:500515472lb # [ 82.477568] niks3-server[1051]: 2026/09/20 12:22:59 INFO lead: released remote=192.168.1.4:531485473worker2 # [ 82.489105] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:521425474worker2 # [ 82.493749] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=worker_gone addr=192.168.1.3:500515475worker2 # [ 82.498590] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=scheduler_restarting addr=lb:500515476worker2 # [ 82.501850] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:521425477worker2 # [ 82.505448] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=worker_gone addr=192.168.1.4:500515478worker1 # [ 82.684590] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500515479worker1 # [ 82.688473] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5480worker2 # [ 82.695175] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500515481worker2 # [ 82.699207] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5482worker1 # [ 82.889331] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500515483worker1 # [ 82.893142] nix-grpc-daemon[1208]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5484worker2 # [ 82.900412] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500515485worker2 # [ 82.904347] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5486worker1 # [ 83.093893] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:500515487worker1 # [ 83.097902] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5488worker2 # [ 83.105400] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=scheduler_connected addr=lb:500515489worker2 # [ 83.109403] nix-grpc-daemon[1098]: ts=2026-09-20T12:22:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5490worker1 # [ 83.298551] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:500515491worker1 # [ 83.302623] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5492worker2 # [ 83.311295] nix-grpc-daemon[1098]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:500515493worker2 # [ 83.314565] nix-grpc-daemon[1098]: ts=2026-09-20T12:23:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5494worker2 # [ 83.489297] nix-grpc-daemon[1098]: ts=2026-09-20T12:23:00Z level=info event=scheduler_restarting5495worker1 # [ 83.504400] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:500515496worker2 # [ 83.510350] nix-daemon[867]: reaped child process 1147, status = succeeded5497worker1 # [ 83.508159] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5498worker2 # [ 83.522234] nix-grpc-daemon[1098]: ts=2026-09-20T12:23:00Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5499worker1 # [ 83.709122] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:00Z level=info event=scheduler_connected addr=lb:500515500worker1 # [ 83.713161] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5501worker1 # [ 83.913911] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500515502worker1 # [ 83.918461] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5503worker1 # [ 84.119168] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500515504worker1 # [ 84.123239] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5505worker2 # [ 84.309382] nix-grpc-daemon[1098]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5506worker2 # [ 84.313601] nix-grpc-daemon[1098]: E0000 00:00:1789906981.169425 1141 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5507worker2 # [ 84.318406] nix-grpc-daemon[1098]: E0000 00:00:1789906981.169986 1141 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5508worker1 # [ 84.323968] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500515509worker1 # [ 84.327893] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5510worker1 # [ 84.529417] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500515511worker1 # [ 84.533195] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5512worker1 # [ 84.733586] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_connected addr=lb:500515513worker1 # [ 84.735409] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5514worker1 # [ 84.936500] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500515515worker1 # [ 84.940400] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5516worker1 # [ 85.141234] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500515517worker1 # [ 85.145152] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5518worker2 # [ 85.299851] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5519worker2 # [ 85.305563] systemd[1]: Stopped Nix worker-protocol over gRPC.5520worker2 # [ 85.307632] systemd[1]: nix-grpc-daemon.service: Consumed 323ms CPU time over 10.172s wall clock time, 30.6M memory peak, 19.5K incoming IP traffic, 26.4K outgoing IP traffic.5521worker2 # [ 85.317490] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5522worker2 # [ 85.321714] systemd[1]: Closed Nix worker-protocol over gRPC.5523worker2 # [ 85.325854] systemd[1]: nix-grpc-daemon.socket: Consumed 303us CPU time over 10.889s wall clock time, 256K memory peak, 21.4K incoming IP traffic, 16K outgoing IP traffic.5524worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5525worker1 # [ 85.346984] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500515526worker1 # [ 85.350719] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5527worker1 # [ 85.480311] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_take_over5528lb # [ 85.472566] niks3-server[1051]: 2026/09/20 12:23:02 INFO lead: acquired remote=192.168.1.3:374305529worker1 # [ 85.548535] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500515530worker1 # [ 85.552214] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5531worker1 # [ 85.750608] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_connected addr=lb:500515532worker1 # [ 85.754961] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5533worker1 # [ 85.955855] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:03Z level=info event=scheduler_connected addr=lb:500515534worker1 # [ 85.960690] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5535worker1 # [ 86.161456] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:03Z level=info event=scheduler_connected addr=lb:500515536worker1 # [ 86.169765] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:03Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:441585537worker1 # [ 86.174101] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05538worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.14 seconds)5539worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5540worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5541client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25542worker1 # [ 86.703506] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:441745543worker1 # [ 86.709634] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5544client # don't know how to build these paths:5545client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5546worker1 # [ 86.718632] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441745547worker1 # [ 86.724661] nix-grpc-daemon[1208]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5)5548worker1 # [ 86.780484] nix-grpc-daemon[1208]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 102 ms (attempt 2/5)5549worker1 # [ 86.883157] nix-grpc-daemon[1208]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 116 ms (attempt 3/5)5550worker1 # [ 87.005349] nix-grpc-daemon[1208]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 393 ms (attempt 4/5)5551worker1 # [ 87.399095] nix-grpc-daemon[1208]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5552worker1 # [ 87.427842] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:04Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05553worker1 # [ 87.433635] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:04Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15554worker1 # [ 87.472868] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441745555worker1 # [ 87.486183] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441745556client # copying 1 paths to 'lb:50051'...5557client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5558worker1 # [ 87.499158] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441745559worker1 # [ 87.509158] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5560worker1 # [ 87.530624] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:04Z level=info event=niks3_push_started pid=12815561worker1 # [ 87.700650] nix-grpc-daemon[1281]: time=2026-09-20T12:23:04.799Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5562worker1 # [ 87.846142] nix-daemon[842]: accepted connection from pid 1294, user nix-grpc-daemon (trusted)5563worker1 # [ 87.857744] nix-daemon[842]: reaped child process 1297, status = succeeded5564worker1 # [ 88.002784] nix-daemon[842]: accepted connection from pid 1299, user nix-grpc-daemon (trusted)5565worker1 # [ 88.015367] nix-daemon[842]: reaped child process 1302, status = succeeded5566lb # [ 88.022370] niks3-server[1051]: 2026/09/20 12:23:05 INFO Received uploads request method=POST path=/api/pending_closures5567worker1 # [ 88.041791] nix-grpc-daemon[1281]: time=2026-09-20T12:23:05.141Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5568worker1 # [ 88.045232] nix-grpc-daemon[1281]: time=2026-09-20T12:23:05.143Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5569lb # [ 88.060801] niks3-server[1051]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5570lb # [ 88.070183] niks3-server[1051]: 2026/09/20 12:23:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5571worker1 # [ 88.086064] nix-grpc-daemon[1281]: time=2026-09-20T12:23:05.185Z level=INFO msg="Uploading 1 narinfos"5572lb # [ 88.078250] niks3-server[1051]: 2026/09/20 12:23:05 INFO Signed narinfos id=27 count=15573lb # [ 88.085167] niks3-server[1051]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5574lb # [ 88.093703] niks3-server[1051]: 2026/09/20 12:23:05 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5575lb # [ 88.104105] niks3-server[1051]: 2026/09/20 12:23:05 INFO Completed upload id=275576worker1 # [ 88.112294] nix-grpc-daemon[1281]: time=2026-09-20T12:23:05.212Z level=INFO msg="Upload complete. (408ms)"5577lb # [ 88.107937] niks3-server[1051]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5578worker1 # [ 88.118203] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44174 duration_s=0 paths=1 nar_bytes_in=5205579worker1 # [ 88.123480] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441745580worker1 # [ 88.134974] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5581worker1 # [ 88.140721] nix-daemon[842]: reaped child process 1279, status = succeeded5582worker1 # [ 88.143854] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5583client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5584client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5585lb # [ 88.197361] envoy[910]: conn peer=[2001:db8:1::1]:39976 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1006 tx=282 ms=18895586lb # [ 88.202723] envoy[910]: conn peer=[2001:db8:1::4]:60264 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4478 tx=349 ms=82275587client # farm-a> LOG-farm-a-on-standby5588worker1 # [ 89.171648] nix-daemon[842]: reaped child process 1306, status = succeeded5589worker1 # [ 89.329579] nix-daemon[842]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5590worker1 # [ 89.342437] nix-daemon[842]: reaped child process 1324, status = succeeded5591lb # [ 89.348993] niks3-server[1051]: 2026/09/20 12:23:06 INFO Received uploads request method=POST path=/api/pending_closures5592worker1 # [ 89.365303] nix-grpc-daemon[1281]: time=2026-09-20T12:23:06.464Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5593worker1 # [ 89.366747] nix-grpc-daemon[1281]: time=2026-09-20T12:23:06.464Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5594lb # [ 89.383880] niks3-server[1051]: 2026/09/20 12:23:06 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5595lb # [ 89.394139] niks3-server[1051]: 2026/09/20 12:23:06 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5596lb # [ 89.407169] niks3-server[1051]: 2026/09/20 12:23:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5597lb # [ 89.412633] niks3-server[1051]: 2026/09/20 12:23:06 INFO Signed narinfos id=28 count=15598worker1 # [ 89.424088] nix-grpc-daemon[1281]: time=2026-09-20T12:23:06.523Z level=INFO msg="Uploading 1 narinfos"5599lb # [ 89.417131] niks3-server[1051]: 2026/09/20 12:23:06 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5600lb # [ 89.425643] niks3-server[1051]: 2026/09/20 12:23:06 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5601lb # [ 89.429942] niks3-server[1051]: 2026/09/20 12:23:06 INFO Completed upload id=285602worker1 # [ 89.438300] nix-grpc-daemon[1281]: time=2026-09-20T12:23:06.538Z level=INFO msg="Upload complete. (286ms)"5603lb # [ 89.431588] niks3-server[1051]: 2026/09/20 12:23:06 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5604worker1 # [ 89.450888] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44174 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15605worker1 # [ 89.462978] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:06Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05606worker1 # [ 89.467201] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:06Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15607worker1 # [ 89.469412] nix-daemon[842]: reaped child process 1304, status = succeeded5608worker1 # [ 89.506822] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441745609worker1 # [ 89.519823] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441745610worker1 # [ 89.531815] nix-grpc-daemon[1281]: time=2026-09-20T12:23:06.631Z level=INFO msg="All 1 paths already cached"5611client # copying 1 paths to 'lb:50051'...5612client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5613worker1 # [ 89.539658] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441745614worker1 # [ 89.547963] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5615worker1 # [ 89.705790] nix-daemon[842]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)5616worker1 # [ 89.719237] nix-daemon[842]: reaped child process 1333, status = succeeded5617worker1 # [ 89.873187] nix-daemon[842]: accepted connection from pid 1335, user nix-grpc-daemon (trusted)5618worker1 # [ 89.885878] nix-daemon[842]: reaped child process 1338, status = succeeded5619lb # [ 89.891959] niks3-server[1051]: 2026/09/20 12:23:07 INFO Received uploads request method=POST path=/api/pending_closures5620worker1 # [ 89.907939] nix-grpc-daemon[1281]: time=2026-09-20T12:23:07.007Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5621worker1 # [ 89.909411] nix-grpc-daemon[1281]: time=2026-09-20T12:23:07.007Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5622lb # [ 89.917261] niks3-server[1051]: 2026/09/20 12:23:07 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5623lb # [ 89.928330] niks3-server[1051]: 2026/09/20 12:23:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5624lb # [ 89.933862] niks3-server[1051]: 2026/09/20 12:23:07 INFO Signed narinfos id=29 count=15625worker1 # [ 89.945337] nix-grpc-daemon[1281]: time=2026-09-20T12:23:07.045Z level=INFO msg="Uploading 1 narinfos"5626lb # [ 89.941501] niks3-server[1051]: 2026/09/20 12:23:07 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5627lb # [ 89.951111] niks3-server[1051]: 2026/09/20 12:23:07 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5628worker1 # [ 89.966269] nix-grpc-daemon[1281]: time=2026-09-20T12:23:07.066Z level=INFO msg="Upload complete. (405ms)"5629lb # [ 89.958164] niks3-server[1051]: 2026/09/20 12:23:07 INFO Completed upload id=295630worker1 # [ 89.969363] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44174 duration_s=0 paths=1 nar_bytes_in=6405631lb # [ 89.963946] niks3-server[1051]: 2026/09/20 12:23:07 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5632worker1 # [ 89.975272] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441745633worker1 # [ 89.982251] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5634worker1 # [ 89.990148] nix-daemon[842]: reaped child process 1328, status = succeeded5635client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5636worker1 # [ 89.993266] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5637client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5638client # farm-b> LOG-farm-b-on-standby5639worker1 # [ 90.820858] nix-daemon[842]: reaped child process 1342, status = succeeded5640worker1 # [ 90.975093] nix-daemon[842]: accepted connection from pid 1357, user nix-grpc-daemon (trusted)5641worker1 # [ 90.986939] nix-daemon[842]: reaped child process 1360, status = succeeded5642lb # [ 90.994776] niks3-server[1051]: 2026/09/20 12:23:08 INFO Received uploads request method=POST path=/api/pending_closures5643worker1 # [ 91.083540] nix-grpc-daemon[1281]: time=2026-09-20T12:23:08.182Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5644worker1 # [ 91.089654] nix-grpc-daemon[1281]: time=2026-09-20T12:23:08.187Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5645lb # [ 91.101938] niks3-server[1051]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5646lb # [ 91.115506] niks3-server[1051]: 2026/09/20 12:23:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5647lb # [ 91.120275] niks3-server[1051]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5648lb # [ 91.124909] niks3-server[1051]: 2026/09/20 12:23:08 INFO Signed narinfos id=30 count=15649worker1 # [ 91.136565] nix-grpc-daemon[1281]: time=2026-09-20T12:23:08.236Z level=INFO msg="Uploading 1 narinfos"5650lb # [ 91.137251] niks3-server[1051]: 2026/09/20 12:23:08 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5651lb # [ 91.144218] niks3-server[1051]: 2026/09/20 12:23:08 INFO Completed upload id=305652worker1 # [ 91.152277] nix-grpc-daemon[1281]: time=2026-09-20T12:23:08.252Z level=INFO msg="Upload complete. (352ms)"5653lb # [ 91.149938] niks3-server[1051]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5654worker1 # [ 91.160150] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44174 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15655lb # [ 91.156407] niks3-server[1051]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5656worker1 # [ 91.173248] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:08Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05657worker1 # [ 91.179135] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:08Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15658worker1 # [ 91.187893] nix-daemon[842]: reaped child process 1340, status = succeeded5659worker1 # [ 91.217472] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441745660worker1 # [ 91.228405] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441745661worker1 # [ 91.251344] nix-grpc-daemon[1281]: time=2026-09-20T12:23:08.351Z level=INFO msg="All 2 paths already cached"5662client # copying 1 paths to 'lb:50051'...5663client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5664worker1 # [ 91.259916] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441745665worker1 # [ 91.268301] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5666worker1 # [ 91.436093] nix-daemon[842]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5667worker1 # [ 91.449145] nix-daemon[842]: reaped child process 1369, status = succeeded5668worker1 # [ 91.601317] nix-daemon[842]: accepted connection from pid 1371, user nix-grpc-daemon (trusted)5669worker1 # [ 91.614284] nix-daemon[842]: reaped child process 1374, status = succeeded5670lb # [ 91.618961] niks3-server[1051]: 2026/09/20 12:23:08 INFO Received uploads request method=POST path=/api/pending_closures5671worker1 # [ 91.634074] nix-grpc-daemon[1281]: time=2026-09-20T12:23:08.734Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5672worker1 # [ 91.635562] nix-grpc-daemon[1281]: time=2026-09-20T12:23:08.735Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5673lb # [ 91.646617] niks3-server[1051]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5674lb # [ 91.657508] niks3-server[1051]: 2026/09/20 12:23:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5675lb # [ 91.664103] niks3-server[1051]: 2026/09/20 12:23:08 INFO Signed narinfos id=31 count=15676worker1 # [ 91.675049] nix-grpc-daemon[1281]: time=2026-09-20T12:23:08.775Z level=INFO msg="Uploading 1 narinfos"5677lb # [ 91.667472] niks3-server[1051]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5678lb # [ 91.683152] niks3-server[1051]: 2026/09/20 12:23:08 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5679lb # [ 91.688203] niks3-server[1051]: 2026/09/20 12:23:08 INFO Completed upload id=315680worker1 # [ 91.699687] nix-grpc-daemon[1281]: time=2026-09-20T12:23:08.799Z level=INFO msg="Upload complete. (416ms)"5681lb # [ 91.691700] niks3-server[1051]: 2026/09/20 12:23:08 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5682worker1 # [ 91.703628] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44174 duration_s=0 paths=1 nar_bytes_in=7685683worker1 # [ 91.709264] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441745684worker1 # [ 91.717121] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5685worker1 # [ 91.725200] nix-daemon[842]: reaped child process 1364, status = succeeded5686client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5687worker1 # [ 91.731529] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5688client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5689client # farm-top> LOG-farm-top-on-standby5690worker1 # [ 93.147112] nix-daemon[842]: reaped child process 1378, status = succeeded5691worker1 # [ 93.285025] nix-daemon[842]: accepted connection from pid 1393, user nix-grpc-daemon (trusted)5692worker1 # [ 93.298630] nix-daemon[842]: reaped child process 1396, status = succeeded5693lb # [ 93.303945] niks3-server[1051]: 2026/09/20 12:23:10 INFO Received uploads request method=POST path=/api/pending_closures5694worker1 # [ 93.321433] nix-grpc-daemon[1281]: time=2026-09-20T12:23:10.421Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5695worker1 # [ 93.322936] nix-grpc-daemon[1281]: time=2026-09-20T12:23:10.422Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5696lb # [ 93.346892] niks3-server[1051]: 2026/09/20 12:23:10 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5697lb # [ 93.351926] niks3-server[1051]: 2026/09/20 12:23:10 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5698lb # [ 93.360353] niks3-server[1051]: 2026/09/20 12:23:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5699lb # [ 93.364548] niks3-server[1051]: 2026/09/20 12:23:10 INFO Signed narinfos id=32 count=15700worker1 # [ 93.376597] nix-grpc-daemon[1281]: time=2026-09-20T12:23:10.476Z level=INFO msg="Uploading 1 narinfos"5701lb # [ 93.376108] niks3-server[1051]: 2026/09/20 12:23:10 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5702lb # [ 93.381459] niks3-server[1051]: 2026/09/20 12:23:10 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5703lb # [ 93.387148] niks3-server[1051]: 2026/09/20 12:23:10 INFO Completed upload id=325704worker1 # [ 93.395334] nix-grpc-daemon[1281]: time=2026-09-20T12:23:10.495Z level=INFO msg="Upload complete. (256ms)"5705lb # [ 93.389860] niks3-server[1051]: 2026/09/20 12:23:10 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5706worker1 # [ 93.403694] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44174 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15707worker1 # [ 93.416689] nix-daemon[842]: reaped child process 1376, status = succeeded5708client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 6.92 seconds)5709client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5710client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.18 seconds)5711worker2 # [ 93.679730] systemd[1]: Listening on Nix worker-protocol over gRPC.5712worker2 # [ 93.686188] systemd[1]: Starting scheduler-token.service...5713worker2 # [ 93.753603] systemd[1]: scheduler-token.service: Deactivated successfully.5714worker2 # [ 93.754799] systemd[1]: Finished scheduler-token.service.5715worker2 # [ 93.756258] systemd[1]: scheduler-token.service: Consumed 20ms CPU time over 67ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5716worker2 # [ 93.761807] systemd[1]: Starting Nix worker-protocol over gRPC...5717worker2 # [ 93.917080] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:10Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5718worker2 # [ 93.918874] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5719worker2 # [ 93.922338] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15720worker2 # [ 93.928718] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5721worker2 # [ 93.934728] systemd[1]: Started Nix worker-protocol over gRPC.5722lb: must succeed: curl -sf localhost:9901/clusters5723worker2 # [ 93.952846] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:10Z level=info event=scheduler_connected addr=lb:500515724worker1 # [ 93.959175] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:11Z level=info event=oidc_jwks provider=mock keys=15725worker1 # [ 93.962946] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:11Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:441585726worker1 # [ 93.966863] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05727lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5728worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5729worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5730lb: must succeed: curl -sf localhost:9901/clusters5731lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5732lb: must succeed: curl -sf localhost:9901/clusters5733lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5734worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5735worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5736(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.60 seconds)5737subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5738client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5739client # [ 94.286754] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5740client # Running as unit: rs.service; invocation ID: bb6026d62b73472587ce6000d4251fed5741client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5742worker2 # [ 94.480190] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417285743worker2 # [ 94.491960] nix-daemon[867]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5744client # [ 94.516356] nix[1163]: don't know how to build these paths:5745client # [ 94.517310] nix[1163]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5746worker1 # [ 94.511520] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:11Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05747worker1 # [ 94.515553] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:11Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15748worker1 # [ 94.554742] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441745749worker1 # [ 94.568135] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441745750client # [ 94.594428] nix[1163]: copying 1 paths to 'lb:50051'...5751worker1 # [ 94.580307] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441745752client # [ 94.597164] nix[1163]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5753worker1 # [ 94.593639] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5754worker1 # [ 94.755576] nix-daemon[842]: accepted connection from pid 1409, user nix-grpc-daemon (trusted)5755worker1 # [ 94.768818] nix-daemon[842]: reaped child process 1412, status = succeeded5756worker1 # [ 94.918145] nix-daemon[842]: accepted connection from pid 1414, user nix-grpc-daemon (trusted)5757worker1 # [ 94.930704] nix-daemon[842]: reaped child process 1417, status = succeeded5758lb # [ 94.938695] niks3-server[1051]: 2026/09/20 12:23:12 INFO Received uploads request method=POST path=/api/pending_closures5759worker1 # [ 94.956420] nix-grpc-daemon[1281]: time=2026-09-20T12:23:12.055Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5760worker1 # [ 94.957872] nix-grpc-daemon[1281]: time=2026-09-20T12:23:12.055Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5761lb # [ 94.970670] niks3-server[1051]: 2026/09/20 12:23:12 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5762lb # [ 94.981782] niks3-server[1051]: 2026/09/20 12:23:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5763lb # [ 94.985672] niks3-server[1051]: 2026/09/20 12:23:12 INFO Signed narinfos id=33 count=15764worker1 # [ 94.997394] nix-grpc-daemon[1281]: time=2026-09-20T12:23:12.097Z level=INFO msg="Uploading 1 narinfos"5765lb # [ 94.992507] niks3-server[1051]: 2026/09/20 12:23:12 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5766lb # [ 95.001554] niks3-server[1051]: 2026/09/20 12:23:12 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5767worker1 # [ 95.017496] nix-grpc-daemon[1281]: time=2026-09-20T12:23:12.117Z level=INFO msg="Upload complete. (412ms)"5768lb # [ 95.009410] niks3-server[1051]: 2026/09/20 12:23:12 INFO Completed upload id=335769lb # [ 95.013090] niks3-server[1051]: 2026/09/20 12:23:12 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5770worker1 # [ 95.019707] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44174 duration_s=0 paths=1 nar_bytes_in=4165771worker1 # [ 95.025301] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441745772worker1 # [ 95.034596] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5773worker1 # [ 95.039985] nix-daemon[842]: reaped child process 1407, status = succeeded5774worker1 # [ 95.044849] nix-daemon[842]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)5775client # [ 95.059853] nix[1163]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5776lb: must succeed: curl -sf localhost:9901/clusters5777lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5778lb: must succeed: curl -sf localhost:9901/clusters5779lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5780lb: must succeed: curl -sf localhost:9901/clusters5781lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5782lb: must succeed: curl -sf localhost:9901/clusters5783lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5784worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5785worker2 # [ 97.097416] systemd-journald[286]: Received client request to rotate journal, rotating.5786worker2 # [ 97.115393] systemd-journald[286]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ad954885770b4513a48bfd02af0b0475.5787worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)5788worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5789worker1 # [ 97.028959] systemd[1]: Stopping Nix worker-protocol over gRPC...5790worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5791??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5792 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735793client: must succeed: sleep 5.05794worker1 # [ 97.476676] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:14Z level=info event=draining5795lb # [ 98.197883] envoy[910]: conn peer=[2001:db8:1::1]:60962 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9607 tx=3858 ms=67135796client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5797worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5798worker1 # [ 102.480074] nix-daemon[842]: reaped child process 1421, status = succeeded5799worker1 # [ 102.634683] nix-daemon[842]: accepted connection from pid 1461, user nix-grpc-daemon (trusted)5800worker1 # [ 102.646974] nix-daemon[842]: reaped child process 1464, status = succeeded5801lb # [ 102.652403] niks3-server[1051]: 2026/09/20 12:23:19 INFO Received uploads request method=POST path=/api/pending_closures5802worker1 # [ 102.669440] nix-grpc-daemon[1281]: time=2026-09-20T12:23:19.769Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5803worker1 # [ 102.671055] nix-grpc-daemon[1281]: time=2026-09-20T12:23:19.771Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5804lb # [ 102.699731] niks3-server[1051]: 2026/09/20 12:23:19 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5805lb # [ 102.705394] niks3-server[1051]: 2026/09/20 12:23:19 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5806lb # [ 102.713442] niks3-server[1051]: 2026/09/20 12:23:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5807worker1 # [ 102.726839] nix-grpc-daemon[1281]: time=2026-09-20T12:23:19.826Z level=INFO msg="Uploading 1 narinfos"5808lb # [ 102.718343] niks3-server[1051]: 2026/09/20 12:23:19 INFO Signed narinfos id=34 count=15809lb # [ 102.724338] niks3-server[1051]: 2026/09/20 12:23:19 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5810lb # [ 102.732626] niks3-server[1051]: 2026/09/20 12:23:19 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5811lb # [ 102.735743] niks3-server[1051]: 2026/09/20 12:23:19 INFO Completed upload id=345812worker1 # [ 102.744188] nix-grpc-daemon[1281]: time=2026-09-20T12:23:19.844Z level=INFO msg="Upload complete. (285ms)"5813lb # [ 102.737996] niks3-server[1051]: 2026/09/20 12:23:19 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5814worker1 # [ 102.751821] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44174 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15815worker1 # [ 102.764793] nix-daemon[842]: reaped child process 1419, status = succeeded5816client # [ 102.793902] systemd[1]: rs.service: Deactivated successfully.5817client # [ 102.795183] systemd[1]: rs.service: Consumed 107ms CPU time over 8.507s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.5818worker1 # [ 103.478646] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:20Z level=info event=signal_exit5819worker1 # [ 103.701198] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:20Z level=info event=scheduler_yield5820lb # [ 103.695884] niks3-server[1051]: 2026/09/20 12:23:20 INFO lead: released remote=192.168.1.3:374305821worker1 # [ 103.709410] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:20Z level=info event=scheduler_restarting addr=lb:500515822worker2 # [ 103.715206] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:20Z level=info event=scheduler_restarting addr=lb:500515823worker1 # [ 103.713734] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:441585824worker1 # [ 103.717639] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:20Z level=info event=worker_gone addr=192.168.1.3:500515825worker1 # [ 103.720733] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:441585826worker1 # [ 103.724070] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:20Z level=info event=worker_gone addr=192.168.1.4:500515827worker1 # [ 103.911382] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=scheduler_connected addr=lb:500515828worker2 # [ 103.915093] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:20Z level=info event=scheduler_connected addr=lb:500515829worker1 # [ 103.917127] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5830worker2 # [ 103.921157] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5831lb # [ 103.928451] niks3-server[1051]: 2026/09/20 12:23:21 INFO lead: acquired remote=192.168.1.4:347845832worker2 # [ 103.940432] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:20Z level=info event=scheduler_take_over5833worker2 # [ 104.122080] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:20Z level=info event=scheduler_connected addr=lb:500515834worker1 # [ 104.118059] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=scheduler_connected addr=lb:500515835worker2 # [ 104.123947] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5836worker1 # [ 104.122171] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5837worker2 # [ 104.324937] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:21Z level=info event=scheduler_connected addr=lb:500515838worker1 # [ 104.322458] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=scheduler_connected addr=lb:500515839worker2 # [ 104.326822] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5840worker1 # [ 104.324648] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5841worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.13 seconds)5842client: waiting for success: ! systemctl is-active rs5843client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5844client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5845worker1 # [ 104.525241] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=scheduler_connected addr=lb:500515846worker2 # [ 104.528532] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:21Z level=info event=scheduler_connected addr=lb:500515847worker1 # [ 104.527172] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5848worker2 # [ 104.532549] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5849client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5850client: must fail: journalctl -u rs | grep -q 'reconnecting'5851client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5852lb: must succeed: curl -sf localhost:9901/clusters5853lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5854worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5855worker1 # [ 104.706331] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=scheduler_restarting5856worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5857worker2 # [ 104.734526] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:21Z level=info event=scheduler_connected addr=lb:500515858worker2 # [ 104.737178] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5859worker1 # [ 104.739623] nix-grpc-daemon[1208]: ts=2026-09-20T12:23:21Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5860worker1 # [ 104.744108] nix-daemon[842]: reaped child process 1272, status = succeeded5861worker2 # [ 104.936277] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:21Z level=info event=scheduler_connected addr=lb:500515862worker2 # [ 104.940153] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5863worker1 # [ 105.049640] nix-grpc-daemon[1208]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5864worker1 # [ 105.052982] nix-grpc-daemon[1208]: E0000 00:00:1789907002.148587 1251 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5865worker1 # [ 105.057733] nix-grpc-daemon[1208]: E0000 00:00:1789907002.148878 1251 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5866worker2 # [ 105.141524] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:22Z level=info event=scheduler_connected addr=lb:500515867worker2 # [ 105.145359] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5868worker2 # [ 105.346314] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:22Z level=info event=scheduler_connected addr=lb:500515869worker2 # [ 105.359790] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:22Z level=info event=oidc_jwks provider=mock keys=15870worker2 # [ 105.364286] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:22Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:442345871worker2 # [ 105.368166] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:22Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05872lb: must succeed: curl -sf localhost:9901/clusters5873lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5874worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5875worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5876worker1 # [ 106.105571] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5877worker1 # [ 106.109680] systemd[1]: Stopped Nix worker-protocol over gRPC.5878worker1 # [ 106.111874] systemd[1]: nix-grpc-daemon.service: Consumed 1.335s CPU time over 25.804s wall clock time, 33.3M memory peak, 48.6K incoming IP traffic, 88.4K outgoing IP traffic.5879worker1 # [ 106.127681] systemd[1]: Starting Nix worker-protocol over gRPC...5880worker1 # [ 106.257309] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:23Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5881worker1 # [ 106.259070] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5882worker1 # [ 106.262316] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15883worker1 # [ 106.267996] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5884worker1 # [ 106.271604] systemd[1]: Started Nix worker-protocol over gRPC.5885worker1 # [ 106.285067] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:23Z level=info event=scheduler_connected addr=lb:500515886worker2 # [ 106.291496] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:23Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:442345887worker2 # [ 106.295820] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05888lb: must succeed: curl -sf localhost:9901/clusters5889lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5890worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5891worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5892(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.73 seconds)5893subtest: scheduler restart mid-build: build finishes, no double build5894client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5895client # [ 107.017287] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5896client # Running as unit: mid.service; invocation ID: d17d2293e5884cf7b6218bd53e3b5fa35897client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5898worker1 # [ 107.225603] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483025899worker1 # [ 107.237566] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5900client # [ 107.264910] nix[1198]: don't know how to build these paths:5901client # [ 107.266400] nix[1198]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5902worker2 # [ 107.262791] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:24Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05903worker2 # [ 107.267415] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:24Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15904worker2 # [ 107.308759] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417285905worker2 # [ 107.318856] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5)5906worker2 # [ 107.403051] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 135 ms (attempt 2/5)5907worker2 # [ 107.543149] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 3/5)5908worker2 # [ 107.732101] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 551 ms (attempt 4/5)5909lb # [ 108.199071] envoy[910]: conn peer=[2001:db8:1::1]:43194 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2934 tx=1325 ms=82855910lb # [ 108.202857] envoy[910]: conn peer=[2001:db8:1::3]:40928 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5767 tx=1349 ms=242445911worker2 # [ 108.289462] nix-grpc-daemon[1194]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5912worker2 # [ 108.306734] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417285913client # [ 108.329772] nix[1198]: copying 1 paths to 'lb:50051'...5914worker2 # [ 108.318960] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417285915client # [ 108.333158] nix[1198]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5916worker2 # [ 108.330129] nix-daemon[867]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5917worker2 # [ 108.348851] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:25Z level=info event=niks3_push_started pid=13195918worker2 # [ 108.523553] nix-grpc-daemon[1319]: time=2026-09-20T12:23:25.382Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5919worker2 # [ 108.655099] nix-daemon[867]: accepted connection from pid 1332, user nix-grpc-daemon (trusted)5920worker2 # [ 108.667856] nix-daemon[867]: reaped child process 1335, status = succeeded5921worker2 # [ 108.800511] nix-daemon[867]: accepted connection from pid 1337, user nix-grpc-daemon (trusted)5922worker2 # [ 108.813127] nix-daemon[867]: reaped child process 1340, status = succeeded5923lb # [ 108.813225] niks3-server[1051]: 2026/09/20 12:23:26 INFO Received uploads request method=POST path=/api/pending_closures5924worker2 # [ 108.834213] nix-grpc-daemon[1319]: time=2026-09-20T12:23:25.694Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5925worker2 # [ 108.836943] nix-grpc-daemon[1319]: time=2026-09-20T12:23:25.696Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5926lb # [ 108.849248] niks3-server[1051]: 2026/09/20 12:23:26 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5927lb # [ 108.854857] niks3-server[1051]: 2026/09/20 12:23:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5928lb # [ 108.860367] niks3-server[1051]: 2026/09/20 12:23:26 INFO Signed narinfos id=35 count=15929worker2 # [ 108.874832] nix-grpc-daemon[1319]: time=2026-09-20T12:23:25.735Z level=INFO msg="Uploading 1 narinfos"5930lb # [ 108.869973] niks3-server[1051]: 2026/09/20 12:23:26 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5931lb # [ 108.877509] niks3-server[1051]: 2026/09/20 12:23:26 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5932lb # [ 108.886202] niks3-server[1051]: 2026/09/20 12:23:26 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5933lb # [ 108.894742] niks3-server[1051]: 2026/09/20 12:23:26 INFO Completed upload id=355934worker2 # [ 108.907513] nix-grpc-daemon[1319]: time=2026-09-20T12:23:25.767Z level=INFO msg="Upload complete. (380ms)"5935worker2 # [ 108.911391] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41728 duration_s=0 paths=1 nar_bytes_in=4245936worker2 # [ 108.915215] nix-grpc-daemon[1194]: ts=2026-09-20T12:23:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417285937worker2 # [ 108.924486] nix-daemon[867]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5938worker2 # [ 108.929802] nix-daemon[867]: reaped child process 1317, status = succeeded5939worker2 # [ 108.935527] nix-daemon[867]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)5940client # [ 108.946089] nix[1198]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5941lb: must succeed: curl -sf localhost:9901/clusters5942lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5943lb: must succeed: curl -sf localhost:9901/clusters5944lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5945worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5946worker2 # [ 110.694327] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1194 (nix-grpc-daemon) on client request.5947worker2 # [ 110.696890] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5948lb # [ 110.690159] niks3-server[1051]: 2026/09/20 12:23:27 INFO lead: released remote=192.168.1.4:347845949worker1 # [ 110.705976] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5950client # [ 110.722708] nix[1198]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5951worker2 # [ 110.715495] systemd[1]: Starting scheduler-token.service...5952client # [ 110.727364] nix[1198]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5953worker2 # [ 110.726979] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5954worker2 # [ 110.728511] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5955worker2 # [ 110.731164] systemd[1]: nix-grpc-daemon.service: Consumed 434ms CPU time over 16.962s wall clock time, 31M memory peak, 16.6K incoming IP traffic, 30.6K outgoing IP traffic.5956worker2 # [ 110.741808] nix-daemon[867]: reaped child process 1342, status = succeeded5957worker2 # [ 110.742855] nix-daemon[867]: reaped child process 1250, status = succeeded5958worker2 # [ 110.750352] nix-daemon[1344]: unexpected Nix daemon error: error: interrupted by the user5959worker2 # [ 110.755676] nix-daemon[867]: reaped child process 1344, status = failed with exit code 15960worker2 # [ 110.801088] systemd[1]: scheduler-token.service: Deactivated successfully.5961worker2 # [ 110.802209] systemd[1]: Finished scheduler-token.service.5962worker2 # [ 110.803549] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 85ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5963worker2 # [ 110.806436] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.5964worker2 # [ 110.811082] systemd[1]: Starting scheduler-token.service...5965worker2 # [ 110.870786] systemd[1]: scheduler-token.service: Deactivated successfully.5966worker2 # [ 110.871931] systemd[1]: Finished scheduler-token.service.5967worker2 # [ 110.873595] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 59ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5968worker2 # [ 110.878659] systemd[1]: Starting Nix worker-protocol over gRPC...5969worker1 # [ 110.906836] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:28Z level=info event=scheduler_connected addr=lb:500515970worker2 # [ 111.023412] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:27Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5971worker2 # [ 111.025299] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5972worker2 # [ 111.028720] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15973worker2 # [ 111.034813] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5974worker2 # [ 111.039187] systemd[1]: Started Nix worker-protocol over gRPC.5975worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.39 seconds)5976client: must succeed: sleep 5.05977lb # [ 111.037520] niks3-server[1051]: 2026/09/20 12:23:28 INFO lead: acquired remote=192.168.1.4:429865978worker2 # [ 111.052034] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:27Z level=info event=scheduler_take_over5979worker2 # [ 111.058350] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:27Z level=info event=scheduler_connected addr=lb:500515980worker1 # [ 111.052581] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5981worker2 # [ 111.063944] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:27Z level=info event=oidc_jwks provider=mock keys=15982worker2 # [ 111.065304] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:27Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:442405983worker2 # [ 111.066965] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05984worker2 # [ 111.224182] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:28Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05985worker2 # [ 111.229603] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:28Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15986worker1 # [ 111.253812] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:28Z level=info event=scheduler_connected addr=lb:500515987worker2 # [ 111.258787] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:28Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:442405988worker2 # [ 111.265681] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05989worker2 # [ 111.275148] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:442505990worker2 # [ 111.285339] nix-daemon[867]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)5991worker2 # [ 111.299936] nix-daemon[867]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)5992client # [ 111.322830] nix[1198]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5993worker2 # [ 111.312856] nix-daemon[867]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)5994client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5995client: waiting for success: ! systemctl is-active mid5996worker2 # [ 116.535802] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:33Z level=info event=niks3_push_started pid=14655997worker2 # [ 116.555160] nix-daemon[867]: reaped child process 1441, status = succeeded5998worker2 # [ 116.733869] nix-grpc-daemon[1465]: time=2026-09-20T12:23:33.593Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5999worker2 # [ 116.897358] nix-daemon[867]: accepted connection from pid 1478, user nix-grpc-daemon (trusted)6000worker2 # [ 116.909571] nix-daemon[867]: reaped child process 1481, status = succeeded6001lb # [ 116.913912] niks3-server[1051]: 2026/09/20 12:23:34 INFO Received uploads request method=POST path=/api/pending_closures6002worker2 # [ 116.933610] nix-grpc-daemon[1465]: time=2026-09-20T12:23:33.794Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6003worker2 # [ 116.935235] nix-grpc-daemon[1465]: time=2026-09-20T12:23:33.795Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"6004lb # [ 116.965393] niks3-server[1051]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv6005lb # [ 116.970820] niks3-server[1051]: 2026/09/20 12:23:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign6006worker2 # [ 116.987558] nix-grpc-daemon[1465]: time=2026-09-20T12:23:33.847Z level=INFO msg="Uploading 1 narinfos"6007lb # [ 116.975410] niks3-server[1051]: 2026/09/20 12:23:34 INFO Signed narinfos id=36 count=16008lb # [ 116.990063] niks3-server[1051]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls6009lb # [ 116.993913] niks3-server[1051]: 2026/09/20 12:23:34 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete6010lb # [ 116.996422] niks3-server[1051]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6011lb # [ 117.000047] niks3-server[1051]: 2026/09/20 12:23:34 INFO Completed upload id=366012worker2 # [ 117.011886] nix-grpc-daemon[1465]: time=2026-09-20T12:23:33.872Z level=INFO msg="Upload complete. (274ms)"6013worker2 # [ 117.018223] nix-grpc-daemon[1465]: time=2026-09-20T12:23:33.875Z level=WARN msg="Failed to register uploaded object" key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo error="server returned 404: object is not pending upload\n"6014worker2 # [ 117.024043] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44250 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=16015worker2 # [ 117.034564] nix-daemon[867]: reaped child process 1439, status = succeeded6016client # [ 117.072652] systemd[1]: mid.service: Deactivated successfully.6017client # [ 117.076685] systemd[1]: mid.service: Consumed 129ms CPU time over 10.058s wall clock time, 39.1M memory peak, 9.6K incoming IP traffic, 10.7K outgoing IP traffic.6018client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds)6019client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6020client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)6021(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.53 seconds)6022subtest: interrupting the client stops the build on the worker6023client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr6024client # [ 117.527463] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.6025client # Running as unit: intr.service; invocation ID: 2df62038f3a44c5baa9499c6390f9bf16026client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)6027client # [ 117.726097] nix[1233]: don't know how to build these paths:6028client # [ 117.726930] nix[1233]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6029worker2 # [ 117.713851] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:442506030worker2 # [ 117.727779] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:34Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=06031worker2 # [ 117.731957] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:34Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=16032worker1 # [ 117.769836] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026033worker1 # [ 117.782433] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5)6034worker1 # [ 117.819149] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 2/5)6035worker1 # [ 117.909081] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 216 ms (attempt 3/5)6036worker1 # [ 118.132171] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 4/5)6037worker1 # [ 118.171303] nix-grpc-daemon[1471]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6038worker1 # [ 118.187354] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026039client # [ 118.209168] nix[1233]: copying 1 paths to 'lb:50051'...6040worker1 # [ 118.197413] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026041client # [ 118.213165] nix[1233]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...6042worker1 # [ 118.203160] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6043lb # [ 118.198464] envoy[910]: conn peer=[2001:db8:1::4]:48298 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7821 tx=595 ms=167636044lb # [ 118.202375] envoy[910]: conn peer=[2001:db8:1::1]:33242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3848 tx=1685 ms=98106045worker1 # [ 118.213408] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:35Z level=info event=niks3_push_started pid=15596046worker1 # [ 118.384065] nix-grpc-daemon[1559]: time=2026-09-20T12:23:35.483Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""6047worker1 # [ 118.510905] nix-daemon[842]: accepted connection from pid 1572, user nix-grpc-daemon (trusted)6048worker1 # [ 118.524410] nix-daemon[842]: reaped child process 1575, status = succeeded6049worker1 # [ 118.645553] nix-daemon[842]: accepted connection from pid 1577, user nix-grpc-daemon (trusted)6050worker1 # [ 118.661806] nix-daemon[842]: reaped child process 1580, status = succeeded6051lb # [ 118.663720] niks3-server[1051]: 2026/09/20 12:23:35 INFO Received uploads request method=POST path=/api/pending_closures6052worker1 # [ 118.683634] nix-grpc-daemon[1559]: time=2026-09-20T12:23:35.783Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6053worker1 # [ 118.685329] nix-grpc-daemon[1559]: time=2026-09-20T12:23:35.785Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6054lb # [ 118.707260] niks3-server[1051]: 2026/09/20 12:23:35 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6055lb # [ 118.712774] niks3-server[1051]: 2026/09/20 12:23:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6056lb # [ 118.718674] niks3-server[1051]: 2026/09/20 12:23:35 INFO Signed narinfos id=37 count=16057worker1 # [ 118.729180] nix-grpc-daemon[1559]: time=2026-09-20T12:23:35.829Z level=INFO msg="Uploading 1 narinfos"6058lb # [ 118.726072] niks3-server[1051]: 2026/09/20 12:23:35 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6059lb # [ 118.735045] niks3-server[1051]: 2026/09/20 12:23:35 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6060lb # [ 118.737918] niks3-server[1051]: 2026/09/20 12:23:35 INFO Completed upload id=376061worker1 # [ 118.746129] nix-grpc-daemon[1559]: time=2026-09-20T12:23:35.846Z level=INFO msg="Upload complete. (358ms)"6062lb # [ 118.739931] niks3-server[1051]: 2026/09/20 12:23:35 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6063worker1 # [ 118.748438] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=4246064worker1 # [ 118.752256] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026065worker1 # [ 118.758883] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6066worker1 # [ 118.761390] nix-daemon[842]: reaped child process 1557, status = succeeded6067worker1 # [ 118.766733] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6068client # [ 118.782227] nix[1233]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6069client: must succeed: systemctl kill -s INT intr6070client # [ 119.941188] systemd[1]: intr.service: Sent signal SIGINT to main process 1233 (nix) on client request.6071client # [ 119.947923] nix[1233]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6072client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)6073client # [ 119.955468] nix[1233]: error: interrupted by the user6074client # [ 119.988636] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6075client # [ 119.990134] systemd[1]: intr.service: Failed with result 'exit-code'.6076client # [ 119.992143] systemd[1]: intr.service: Consumed 104ms CPU time over 2.464s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.6077worker1 # [ 119.990750] nix-daemon[842]: reaped child process 1586, status = succeeded6078worker1 # [ 119.996700] nix-daemon[1588]: unexpected Nix daemon error: error: interrupted by the user6079worker1 # [ 120.001113] nix-daemon[842]: reaped child process 1588, status = failed with exit code 16080(finished: subtest: interrupting the client stops the build on the worker, in 2.56 seconds)6081subtest: a deploy mid-build drains: the build finishes, the new generation takes over6082client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw6083client # [ 120.096782] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.6084client # Running as unit: sw.service; invocation ID: 4b8be4458b87446da174a1d6c197d7bb6085client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.05 seconds)6086client # [ 120.293263] nix[1253]: don't know how to build these paths:6087client # [ 120.294675] nix[1253]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6088worker2 # [ 120.281609] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:442506089worker2 # [ 120.293232] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:37Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06090worker2 # [ 120.297898] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:37Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=16091worker2 # [ 120.343224] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:442506092worker2 # [ 120.356846] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5)6093worker2 # [ 120.369505] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 2/5)6094worker2 # [ 120.420453] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 228 ms (attempt 3/5)6095worker2 # [ 120.654579] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 4/5)6096worker2 # [ 120.689763] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6097worker2 # [ 120.706932] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:442506098client # [ 120.727945] nix[1253]: copying 1 paths to 'lb:50051'...6099client # [ 120.730060] nix[1253]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6100worker2 # [ 120.718743] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:442506101worker2 # [ 120.730719] nix-daemon[867]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)6102worker2 # [ 120.904191] nix-daemon[867]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)6103worker2 # [ 120.918323] nix-daemon[867]: reaped child process 1515, status = succeeded6104worker2 # [ 121.068757] nix-daemon[867]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)6105worker2 # [ 121.081410] nix-daemon[867]: reaped child process 1520, status = succeeded6106lb # [ 121.081252] niks3-server[1051]: 2026/09/20 12:23:38 INFO Received uploads request method=POST path=/api/pending_closures6107worker2 # [ 121.102735] nix-grpc-daemon[1465]: time=2026-09-20T12:23:37.963Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6108worker2 # [ 121.105379] nix-grpc-daemon[1465]: time=2026-09-20T12:23:37.965Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6109lb # [ 121.116761] niks3-server[1051]: 2026/09/20 12:23:38 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6110lb # [ 121.128270] niks3-server[1051]: 2026/09/20 12:23:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6111worker2 # [ 121.144873] nix-grpc-daemon[1465]: time=2026-09-20T12:23:38.005Z level=INFO msg="Uploading 1 narinfos"6112lb # [ 121.134126] niks3-server[1051]: 2026/09/20 12:23:38 INFO Signed narinfos id=38 count=16113lb # [ 121.139768] niks3-server[1051]: 2026/09/20 12:23:38 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6114lb # [ 121.149685] niks3-server[1051]: 2026/09/20 12:23:38 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6115lb # [ 121.158642] niks3-server[1051]: 2026/09/20 12:23:38 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6116lb # [ 121.160832] niks3-server[1051]: 2026/09/20 12:23:38 INFO Completed upload id=386117worker2 # [ 121.172785] nix-grpc-daemon[1465]: time=2026-09-20T12:23:38.033Z level=INFO msg="Upload complete. (429ms)"6118worker2 # [ 121.177249] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44250 duration_s=0 paths=1 nar_bytes_in=4166119worker2 # [ 121.184345] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:442506120worker2 # [ 121.193158] nix-daemon[867]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)6121worker2 # [ 121.203770] nix-daemon[867]: reaped child process 1510, status = succeeded6122worker2 # [ 121.207832] nix-daemon[867]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)6123client # [ 121.218233] nix[1253]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6124worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26125worker2 # Checking switch inhibitors... done6126worker2 # [ 123.219947] nixos[1555]: switching to system configuration /nix/store/v7pprh8spnv469hmav7hzb2gmpsjbzi5-nixos-system-worker2-test6127worker2 # [ 123.223860] systemd[1]: Stopped target Remote File Systems.6128worker2 # [ 123.225178] systemd[1]: Stopped target Local File Systems.6129worker2 # activating the configuration...6130worker2 # setting up /etc...6131worker2 # [ 123.887354] systemd[1]: Reload requested from client PID 1555 ('.switch-to-conf') (unit backdoor.service)...6132worker2 # [ 123.890267] systemd[1]: Reloading...6133worker2 # [ 124.558407] systemd[1]: Reloading finished in 665 ms.6134worker2 # restarting sysinit-reactivation.target6135worker2 # [ 124.616578] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6136worker2 # [ 124.754300] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6137worker2 # [ 124.758070] systemd[1]: Reached target Reactivate sysinit units.6138worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6139worker2 # [ 124.763076] systemd[1]: Reloading D-Bus System Message Bus...6140worker2 # [ 124.766175] dbus-broker-launch[533]: Caught SIGHUP, trigger reload.6141worker2 # [ 124.768270] systemd[1]: Reloading Nix worker-protocol over gRPC...6142worker2 # [ 124.800421] dbus-broker-launch[533]: Looking up NSS user entry for 'systemd-timesync'...6143worker2 # [ 124.802379] dbus-broker-launch[533]: NSS returned no entry for 'systemd-timesync'6144worker2 # [ 124.803528] dbus-broker-launch[533]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6145worker2 # [ 124.811298] systemd[1]: Reloaded Nix worker-protocol over gRPC.6146worker2 # [ 124.830352] systemd[1]: Reloaded D-Bus System Message Bus.6147worker2 # [ 124.837118] systemd[1]: Reached target Remote File Systems.6148worker2 # [ 124.841657] systemd[1]: Starting linger-users.service...6149worker2 # [ 124.844137] systemd[1]: Reached target Local File Systems.6150worker2 # [ 124.847099] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6151worker2 # [ 124.850439] systemd[1]: Starting Create SUID/SGID Wrappers...6152worker2 # [ 124.851989] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6153worker2 # [ 124.853188] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676154worker2 # [ 124.855110] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6155worker2 # [ 124.858788] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6156worker2 # [ 124.861353] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6157worker2 # [ 124.870249] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6158worker2 # [ 124.871453] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6159worker2 # [ 124.912770] systemd[1]: linger-users.service: Deactivated successfully.6160worker2 # [ 124.913825] systemd[1]: Finished linger-users.service.6161worker2 # [ 125.046391] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:41Z level=info event=draining6162worker2 # [ 125.230978] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6163worker2 # [ 125.233260] systemd[1]: Finished Create SUID/SGID Wrappers.6164worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6165worker2 # [ 125.489029] nixos[1555]: finished switching to system configuration /nix/store/v7pprh8spnv469hmav7hzb2gmpsjbzi5-nixos-system-worker2-test6166worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.92 seconds)6167worker2: must succeed: pgrep -f 'read -t [9]0 x'6168worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6169client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&26170worker1 # [ 125.704842] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483026171client # don't know how to build these paths:6172client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6173worker1 # [ 125.712607] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026174worker2 # [ 125.731143] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:42Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06175worker2 # [ 125.732917] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:42Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=16176worker1 # [ 125.773236] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026177worker1 # [ 125.782980] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026178client # copying 1 paths to 'lb:50051'...6179worker1 # [ 125.791976] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026180client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6181worker1 # [ 125.805207] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6182worker1 # [ 125.969326] nix-daemon[842]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)6183worker1 # [ 125.981976] nix-daemon[842]: reaped child process 1633, status = succeeded6184worker1 # [ 126.138244] nix-daemon[842]: accepted connection from pid 1635, user nix-grpc-daemon (trusted)6185worker1 # [ 126.151952] nix-daemon[842]: reaped child process 1638, status = succeeded6186lb # [ 126.158537] niks3-server[1051]: 2026/09/20 12:23:43 INFO Received uploads request method=POST path=/api/pending_closures6187worker1 # [ 126.172687] nix-grpc-daemon[1559]: time=2026-09-20T12:23:43.272Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6188worker1 # [ 126.174158] nix-grpc-daemon[1559]: time=2026-09-20T12:23:43.272Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6189lb # [ 126.173234] niks3-server[1051]: 2026/09/20 12:23:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6190lb # [ 126.175546] niks3-server[1051]: 2026/09/20 12:23:43 INFO Signed narinfos id=39 count=16191worker1 # [ 126.183636] nix-grpc-daemon[1559]: time=2026-09-20T12:23:43.283Z level=INFO msg="Uploading 1 narinfos"6192lb # [ 126.177961] niks3-server[1051]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6193lb # [ 126.182939] niks3-server[1051]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6194lb # [ 126.185471] niks3-server[1051]: 2026/09/20 12:23:43 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6195lb # [ 126.189041] niks3-server[1051]: 2026/09/20 12:23:43 INFO Completed upload id=396196worker1 # [ 126.197124] nix-grpc-daemon[1559]: time=2026-09-20T12:23:43.297Z level=INFO msg="Upload complete. (380ms)"6197lb # [ 126.190720] niks3-server[1051]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6198worker1 # [ 126.199296] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=5286199worker1 # [ 126.202860] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026200worker1 # [ 126.208994] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6201worker1 # [ 126.211211] nix-daemon[842]: reaped child process 1628, status = succeeded6202worker1 # [ 126.216494] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6203client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6204client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6205client # farm-a> LOG-farm-a-during-drain6206worker1 # [ 127.443771] nix-daemon[842]: reaped child process 1642, status = succeeded6207worker1 # [ 127.608300] nix-daemon[842]: accepted connection from pid 1657, user nix-grpc-daemon (trusted)6208worker1 # [ 127.621223] nix-daemon[842]: reaped child process 1660, status = succeeded6209lb # [ 127.630392] niks3-server[1051]: 2026/09/20 12:23:44 INFO Received uploads request method=POST path=/api/pending_closures6210worker1 # [ 127.646785] nix-grpc-daemon[1559]: time=2026-09-20T12:23:44.746Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6211worker1 # [ 127.648313] nix-grpc-daemon[1559]: time=2026-09-20T12:23:44.748Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6212lb # [ 127.669126] niks3-server[1051]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6213lb # [ 127.679586] niks3-server[1051]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6214lb # [ 127.688579] niks3-server[1051]: 2026/09/20 12:23:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6215worker1 # [ 127.703687] nix-grpc-daemon[1559]: time=2026-09-20T12:23:44.802Z level=INFO msg="Uploading 1 narinfos"6216lb # [ 127.695181] niks3-server[1051]: 2026/09/20 12:23:44 INFO Signed narinfos id=40 count=16217lb # [ 127.699398] niks3-server[1051]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6218lb # [ 127.708862] niks3-server[1051]: 2026/09/20 12:23:44 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6219lb # [ 127.715792] niks3-server[1051]: 2026/09/20 12:23:44 INFO Completed upload id=406220lb # [ 127.717549] niks3-server[1051]: 2026/09/20 12:23:44 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6221worker1 # [ 127.726958] nix-grpc-daemon[1559]: time=2026-09-20T12:23:44.825Z level=INFO msg="Upload complete. (301ms)"6222worker2 # [ 127.738523] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:44Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06223worker1 # [ 127.732501] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16224worker2 # [ 127.741312] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:44Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16225worker1 # [ 127.746630] nix-daemon[842]: reaped child process 1640, status = succeeded6226worker1 # [ 127.787148] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026227worker1 # [ 127.800533] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026228worker1 # [ 127.809444] nix-grpc-daemon[1559]: time=2026-09-20T12:23:44.909Z level=INFO msg="All 1 paths already cached"6229client # copying 1 paths to 'lb:50051'...6230worker1 # [ 127.817384] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026231client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6232worker1 # [ 127.837179] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6233worker1 # [ 128.014108] nix-daemon[842]: accepted connection from pid 1664, user nix-grpc-daemon (trusted)6234worker1 # [ 128.027090] nix-daemon[842]: reaped child process 1667, status = succeeded6235worker1 # [ 128.188103] nix-daemon[842]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6236worker1 # [ 128.201183] nix-daemon[842]: reaped child process 1672, status = succeeded6237lb # [ 128.199695] envoy[910]: conn peer=[2001:db8:1::1]:46348 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=730 ms=22436238lb # [ 128.206822] niks3-server[1051]: 2026/09/20 12:23:45 INFO Received uploads request method=POST path=/api/pending_closures6239worker1 # [ 128.222054] nix-grpc-daemon[1559]: time=2026-09-20T12:23:45.322Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6240worker1 # [ 128.224047] nix-grpc-daemon[1559]: time=2026-09-20T12:23:45.323Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6241lb # [ 128.232593] niks3-server[1051]: 2026/09/20 12:23:45 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6242lb # [ 128.244319] niks3-server[1051]: 2026/09/20 12:23:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6243lb # [ 128.250163] niks3-server[1051]: 2026/09/20 12:23:45 INFO Signed narinfos id=41 count=16244worker1 # [ 128.261293] nix-grpc-daemon[1559]: time=2026-09-20T12:23:45.361Z level=INFO msg="Uploading 1 narinfos"6245lb # [ 128.254958] niks3-server[1051]: 2026/09/20 12:23:45 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6246lb # [ 128.265464] niks3-server[1051]: 2026/09/20 12:23:45 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6247lb # [ 128.269844] niks3-server[1051]: 2026/09/20 12:23:45 INFO Completed upload id=416248worker1 # [ 128.280310] nix-grpc-daemon[1559]: time=2026-09-20T12:23:45.380Z level=INFO msg="Upload complete. (430ms)"6249lb # [ 128.273488] niks3-server[1051]: 2026/09/20 12:23:45 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6250worker1 # [ 128.282302] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=6406251worker1 # [ 128.285658] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026252worker1 # [ 128.295050] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6253worker1 # [ 128.298303] nix-daemon[842]: reaped child process 1662, status = succeeded6254worker1 # [ 128.303500] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6255client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6256client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6257client # farm-b> LOG-farm-b-during-drain6258worker1 # [ 129.527624] nix-daemon[842]: reaped child process 1676, status = succeeded6259worker1 # [ 129.671073] nix-daemon[842]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)6260worker1 # [ 129.683789] nix-daemon[842]: reaped child process 1694, status = succeeded6261lb # [ 129.691805] niks3-server[1051]: 2026/09/20 12:23:46 INFO Received uploads request method=POST path=/api/pending_closures6262worker1 # [ 129.705053] nix-grpc-daemon[1559]: time=2026-09-20T12:23:46.804Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6263worker1 # [ 129.706502] nix-grpc-daemon[1559]: time=2026-09-20T12:23:46.806Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6264lb # [ 129.709089] niks3-server[1051]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6265lb # [ 129.714884] niks3-server[1051]: 2026/09/20 12:23:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6266lb # [ 129.716537] niks3-server[1051]: 2026/09/20 12:23:46 INFO Signed narinfos id=42 count=16267worker1 # [ 129.724726] nix-grpc-daemon[1559]: time=2026-09-20T12:23:46.824Z level=INFO msg="Uploading 1 narinfos"6268lb # [ 129.719445] niks3-server[1051]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6269lb # [ 129.723067] niks3-server[1051]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6270lb # [ 129.727845] niks3-server[1051]: 2026/09/20 12:23:46 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6271lb # [ 129.731138] niks3-server[1051]: 2026/09/20 12:23:46 INFO Completed upload id=426272worker1 # [ 129.739278] nix-grpc-daemon[1559]: time=2026-09-20T12:23:46.839Z level=INFO msg="Upload complete. (226ms)"6273lb # [ 129.732702] niks3-server[1051]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6274worker1 # [ 129.741820] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16275worker1 # [ 129.748595] nix-daemon[842]: reaped child process 1674, status = succeeded6276worker2 # [ 129.753183] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:46Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06277worker2 # [ 129.755291] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:46Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16278worker1 # [ 129.793096] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026279worker1 # [ 129.808245] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026280worker1 # [ 129.818305] nix-grpc-daemon[1559]: time=2026-09-20T12:23:46.918Z level=INFO msg="All 2 paths already cached"6281client # copying 1 paths to 'lb:50051'...6282worker1 # [ 129.825772] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026283client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6284worker1 # [ 129.846164] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6285worker1 # [ 130.020973] nix-daemon[842]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)6286worker1 # [ 130.034095] nix-daemon[842]: reaped child process 1701, status = succeeded6287worker1 # [ 130.195581] nix-daemon[842]: accepted connection from pid 1703, user nix-grpc-daemon (trusted)6288worker1 # [ 130.208201] nix-daemon[842]: reaped child process 1706, status = succeeded6289lb # [ 130.215782] niks3-server[1051]: 2026/09/20 12:23:47 INFO Received uploads request method=POST path=/api/pending_closures6290worker1 # [ 130.230471] nix-grpc-daemon[1559]: time=2026-09-20T12:23:47.330Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6291worker1 # [ 130.231837] nix-grpc-daemon[1559]: time=2026-09-20T12:23:47.330Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6292lb # [ 130.240292] niks3-server[1051]: 2026/09/20 12:23:47 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6293lb # [ 130.250099] niks3-server[1051]: 2026/09/20 12:23:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6294lb # [ 130.255276] niks3-server[1051]: 2026/09/20 12:23:47 INFO Signed narinfos id=43 count=16295worker1 # [ 130.266390] nix-grpc-daemon[1559]: time=2026-09-20T12:23:47.366Z level=INFO msg="Uploading 1 narinfos"6296lb # [ 130.261332] niks3-server[1051]: 2026/09/20 12:23:47 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6297lb # [ 130.273145] niks3-server[1051]: 2026/09/20 12:23:47 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6298worker1 # [ 130.287333] nix-grpc-daemon[1559]: time=2026-09-20T12:23:47.387Z level=INFO msg="Upload complete. (428ms)"6299lb # [ 130.279321] niks3-server[1051]: 2026/09/20 12:23:47 INFO Completed upload id=436300lb # [ 130.282588] niks3-server[1051]: 2026/09/20 12:23:47 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6301worker1 # [ 130.289874] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=7686302worker1 # [ 130.295234] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026303worker1 # [ 130.304062] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6304worker1 # [ 130.308202] nix-daemon[842]: reaped child process 1696, status = succeeded6305worker1 # [ 130.313075] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6306client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6307client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6308client # farm-top> LOG-farm-top-during-drain6309worker1 # [ 131.526407] nix-daemon[842]: reaped child process 1710, status = succeeded6310worker1 # [ 131.650229] nix-daemon[842]: accepted connection from pid 1725, user nix-grpc-daemon (trusted)6311worker1 # [ 131.663148] nix-daemon[842]: reaped child process 1728, status = succeeded6312lb # [ 131.666687] niks3-server[1051]: 2026/09/20 12:23:48 INFO Received uploads request method=POST path=/api/pending_closures6313worker1 # [ 131.684456] nix-grpc-daemon[1559]: time=2026-09-20T12:23:48.784Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6314worker1 # [ 131.686135] nix-grpc-daemon[1559]: time=2026-09-20T12:23:48.786Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6315lb # [ 131.699140] niks3-server[1051]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6316lb # [ 131.712731] niks3-server[1051]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6317lb # [ 131.723122] niks3-server[1051]: 2026/09/20 12:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6318lb # [ 131.728364] niks3-server[1051]: 2026/09/20 12:23:48 INFO Signed narinfos id=44 count=16319worker1 # [ 131.738924] nix-grpc-daemon[1559]: time=2026-09-20T12:23:48.838Z level=INFO msg="Uploading 1 narinfos"6320lb # [ 131.732344] niks3-server[1051]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6321lb # [ 131.743671] niks3-server[1051]: 2026/09/20 12:23:48 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6322lb # [ 131.750255] niks3-server[1051]: 2026/09/20 12:23:48 INFO Completed upload id=446323worker1 # [ 131.758557] nix-grpc-daemon[1559]: time=2026-09-20T12:23:48.858Z level=INFO msg="Upload complete. (237ms)"6324lb # [ 131.752185] niks3-server[1051]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6325worker1 # [ 131.763737] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16326worker1 # [ 131.777436] nix-daemon[842]: reaped child process 1708, status = succeeded6327client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.26 seconds)6328client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6329client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.19 seconds)6330worker2: must succeed: pkill -f 'read -t [9]0 x'6331worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6332client: waiting for success: ! systemctl is-active sw6333worker2 # [ 132.249666] nix-daemon[867]: reaped child process 1524, status = succeeded6334worker2 # [ 132.409729] nix-daemon[867]: accepted connection from pid 1701, user nix-grpc-daemon (trusted)6335worker2 # [ 132.422675] nix-daemon[867]: reaped child process 1704, status = succeeded6336lb # [ 132.425923] niks3-server[1051]: 2026/09/20 12:23:49 INFO Received uploads request method=POST path=/api/pending_closures6337worker2 # [ 132.445901] nix-grpc-daemon[1465]: time=2026-09-20T12:23:49.306Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6338worker2 # [ 132.448445] nix-grpc-daemon[1465]: time=2026-09-20T12:23:49.308Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6339lb # [ 132.453687] niks3-server[1051]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6340lb # [ 132.466097] niks3-server[1051]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6341lb # [ 132.476592] niks3-server[1051]: 2026/09/20 12:23:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6342lb # [ 132.480810] niks3-server[1051]: 2026/09/20 12:23:49 INFO Signed narinfos id=45 count=16343worker2 # [ 132.495817] nix-grpc-daemon[1465]: time=2026-09-20T12:23:49.355Z level=INFO msg="Uploading 1 narinfos"6344lb # [ 132.489594] niks3-server[1051]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6345lb # [ 132.498090] niks3-server[1051]: 2026/09/20 12:23:49 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6346lb # [ 132.502797] niks3-server[1051]: 2026/09/20 12:23:49 INFO Completed upload id=456347worker2 # [ 132.514594] nix-grpc-daemon[1465]: time=2026-09-20T12:23:49.375Z level=INFO msg="Upload complete. (287ms)"6348lb # [ 132.506316] niks3-server[1051]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6349worker2 # [ 132.522623] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44250 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16350worker2 # [ 132.533692] nix-daemon[867]: reaped child process 1522, status = succeeded6351client # [ 132.568342] systemd[1]: sw.service: Deactivated successfully.6352client # [ 132.572179] systemd[1]: sw.service: Consumed 111ms CPU time over 12.473s wall clock time, 39.1M memory peak, 8.8K incoming IP traffic, 9K outgoing IP traffic.6353worker2 # [ 133.048395] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:49Z level=info event=signal_exit6354worker2 # [ 133.067458] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:49Z level=info event=scheduler_yield6355worker1 # [ 133.068811] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:50Z level=info event=scheduler_restarting addr=lb:500516356lb # [ 133.061636] niks3-server[1051]: 2026/09/20 12:23:50 INFO lead: released remote=192.168.1.4:429866357worker2 # [ 133.072904] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:442406358worker2 # [ 133.077313] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:49Z level=info event=worker_gone addr=192.168.1.3:500516359worker2 # [ 133.080423] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:49Z level=info event=scheduler_restarting addr=lb:500516360worker2 # [ 133.083424] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:442406361worker2 # [ 133.086703] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:49Z level=info event=worker_gone addr=192.168.1.4:500516362client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)6363client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6364client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6365worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6366worker2 # [ 133.253902] systemd[1]: Starting scheduler-token.service...6367worker2 # [ 133.273903] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=scheduler_connected addr=lb:500516368worker1 # [ 133.268986] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:50Z level=info event=scheduler_connected addr=lb:500516369worker2 # [ 133.276483] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6370worker1 # [ 133.273314] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6371worker2 # [ 133.329427] systemd[1]: scheduler-token.service: Deactivated successfully.6372worker2 # [ 133.331204] systemd[1]: Finished scheduler-token.service.6373worker2 # [ 133.332609] systemd[1]: scheduler-token.service: Consumed 19ms CPU time over 77ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6374worker2 # [ 133.477891] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=scheduler_connected addr=lb:500516375worker1 # [ 133.474097] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:50Z level=info event=scheduler_connected addr=lb:500516376worker1 # [ 133.477998] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6377worker2 # [ 133.482097] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6378worker1 # [ 133.678655] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:50Z level=info event=scheduler_connected addr=lb:500516379worker2 # [ 133.684928] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=scheduler_connected addr=lb:500516380worker1 # [ 133.682644] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6381worker2 # [ 133.688236] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6382worker2 # [ 133.885771] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=scheduler_connected addr=lb:500516383worker1 # [ 133.883522] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:50Z level=info event=scheduler_connected addr=lb:500516384worker2 # [ 133.889799] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6385worker1 # [ 133.887457] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6386worker2 # [ 134.071198] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=scheduler_restarting6387worker1 # [ 134.089851] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:51Z level=info event=scheduler_connected addr=lb:500516388worker1 # [ 134.093248] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6389worker2 # [ 134.104894] nix-grpc-daemon[1386]: ts=2026-09-20T12:23:50Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6390worker2 # [ 134.109546] nix-daemon[867]: reaped child process 1437, status = succeeded6391worker1 # [ 134.293512] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:51Z level=info event=scheduler_connected addr=lb:500516392worker1 # [ 134.295511] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6393worker2 # [ 134.382057] nix-grpc-daemon[1386]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6394worker2 # [ 134.383904] nix-grpc-daemon[1386]: E0000 00:00:1789907031.242410 1429 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true6395worker2 # [ 134.386244] nix-grpc-daemon[1386]: E0000 00:00:1789907031.244560 1429 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6396worker1 # [ 134.496338] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:51Z level=info event=scheduler_connected addr=lb:500516397worker1 # [ 134.498079] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6398worker1 # [ 134.698686] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:51Z level=info event=scheduler_connected addr=lb:500516399worker1 # [ 134.702659] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6400worker1 # [ 134.903378] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516401worker1 # [ 134.907390] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6402worker2 # [ 135.070478] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6403worker2 # [ 135.071620] systemd[1]: nix-grpc-daemon.service: Consumed 689ms CPU time over 24.344s wall clock time, 31.1M memory peak, 25.7K incoming IP traffic, 36.4K outgoing IP traffic.6404worker2 # [ 135.078639] systemd[1]: Starting Nix worker-protocol over gRPC...6405worker1 # [ 135.109518] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516406worker1 # [ 135.112673] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6407worker2 # [ 135.239378] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6408worker2 # [ 135.241293] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6409worker2 # [ 135.244697] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16410worker2 # [ 135.251066] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6411worker2 # [ 135.257261] systemd[1]: Started Nix worker-protocol over gRPC.6412worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.08 seconds)6413lb # [ 135.249602] niks3-server[1051]: 2026/09/20 12:23:52 INFO lead: acquired remote=192.168.1.4:377686414lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6415lb: must succeed: curl -sf localhost:9901/clusters6416worker2 # [ 135.264098] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_take_over6417worker2 # [ 135.274512] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516418worker2 # [ 135.277232] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6419worker1 # [ 135.310552] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516420worker1 # [ 135.314547] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6421lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6422worker2 # [ 135.478883] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516423worker2 # [ 135.482796] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6424worker1 # [ 135.515496] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516425worker1 # [ 135.519301] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6426worker2 # [ 135.684093] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516427worker2 # [ 135.687896] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6428worker1 # [ 135.720115] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516429worker1 # [ 135.724382] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6430worker2 # [ 135.889154] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516431worker2 # [ 135.893157] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6432worker1 # [ 135.925311] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:53Z level=info event=scheduler_connected addr=lb:500516433worker1 # [ 135.929242] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6434worker2 # [ 136.093448] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:500516435worker2 # [ 136.100064] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=oidc_jwks provider=mock keys=16436worker2 # [ 136.101578] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:376646437worker2 # [ 136.103172] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06438worker2 # [ 136.134812] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:376646439worker1 # [ 136.130777] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:53Z level=info event=scheduler_connected addr=lb:500516440worker2 # [ 136.136383] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06441lb: must succeed: curl -sf localhost:9901/clusters6442lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6443lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.15 seconds)6444lb: must succeed: curl -sf localhost:9901/clusters6445lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6446worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6447worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6448(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.45 seconds)6449subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6450client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16451worker2 # [ 136.715651] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:376766452worker2 # [ 136.727300] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6453worker2 # [ 136.740916] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376766454worker2 # [ 136.754070] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 1/5)6455worker2 # [ 136.775527] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 200 ms (attempt 2/5)6456worker2 # [ 136.981509] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 190 ms (attempt 3/5)6457worker2 # [ 137.177701] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 4/5)6458worker2 # [ 137.269159] nix-grpc-daemon[1721]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6459worker2 # [ 137.300168] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:54Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06460worker2 # [ 137.304567] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:54Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16461worker2 # [ 137.308850] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:54Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06462worker2 # [ 137.312642] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:54Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06463worker1 # [ 137.343404] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026464worker1 # [ 137.357118] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026465worker1 # [ 137.369230] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026466worker1 # [ 137.381506] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6467worker1 # [ 137.539685] nix-daemon[842]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)6468worker1 # [ 137.552635] nix-daemon[842]: reaped child process 1735, status = succeeded6469worker1 # [ 137.685606] nix-daemon[842]: accepted connection from pid 1737, user nix-grpc-daemon (trusted)6470worker1 # [ 137.698502] nix-daemon[842]: reaped child process 1740, status = succeeded6471lb # [ 137.703723] niks3-server[1051]: 2026/09/20 12:23:54 INFO Received uploads request method=POST path=/api/pending_closures6472worker1 # [ 137.716621] nix-grpc-daemon[1559]: time=2026-09-20T12:23:54.816Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6473worker1 # [ 137.718138] nix-grpc-daemon[1559]: time=2026-09-20T12:23:54.818Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6474lb # [ 137.720906] niks3-server[1051]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6475lb # [ 137.724926] niks3-server[1051]: 2026/09/20 12:23:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6476lb # [ 137.727841] niks3-server[1051]: 2026/09/20 12:23:54 INFO Signed narinfos id=46 count=16477worker1 # [ 137.736116] nix-grpc-daemon[1559]: time=2026-09-20T12:23:54.836Z level=INFO msg="Uploading 1 narinfos"6478lb # [ 137.734672] niks3-server[1051]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6479lb # [ 137.738182] niks3-server[1051]: 2026/09/20 12:23:54 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6480lb # [ 137.742874] niks3-server[1051]: 2026/09/20 12:23:54 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6481lb # [ 137.744934] niks3-server[1051]: 2026/09/20 12:23:54 INFO Completed upload id=466482worker1 # [ 137.753047] nix-grpc-daemon[1559]: time=2026-09-20T12:23:54.853Z level=INFO msg="Upload complete. (359ms)"6483worker1 # [ 137.755068] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=5046484worker1 # [ 137.757528] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026485worker1 # [ 137.764061] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6486worker1 # [ 137.768783] nix-daemon[842]: reaped child process 1730, status = succeeded6487worker1 # [ 137.772864] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6488lb # [ 138.200507] envoy[910]: conn peer=[2001:db8:1::1]:48726 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9585 tx=3846 ms=60726489lb # [ 138.202099] envoy[910]: conn peer=[2001:db8:1::1]:46364 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1352 ms=122526490lb # [ 138.203466] envoy[910]: conn peer=[2001:db8:1::4]:53074 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4876 tx=568 ms=230426491worker1 # [ 138.987843] nix-daemon[842]: reaped child process 1744, status = succeeded6492worker1 # [ 139.135309] nix-daemon[842]: accepted connection from pid 1759, user nix-grpc-daemon (trusted)6493worker1 # [ 139.148032] nix-daemon[842]: reaped child process 1762, status = succeeded6494lb # [ 139.155439] niks3-server[1051]: 2026/09/20 12:23:56 INFO Received uploads request method=POST path=/api/pending_closures6495worker1 # [ 139.174290] nix-grpc-daemon[1559]: time=2026-09-20T12:23:56.274Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6496worker1 # [ 139.175967] nix-grpc-daemon[1559]: time=2026-09-20T12:23:56.275Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6497lb # [ 139.192699] niks3-server[1051]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6498lb # [ 139.206703] niks3-server[1051]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6499lb # [ 139.217250] niks3-server[1051]: 2026/09/20 12:23:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6500lb # [ 139.222253] niks3-server[1051]: 2026/09/20 12:23:56 INFO Signed narinfos id=47 count=16501worker1 # [ 139.232899] nix-grpc-daemon[1559]: time=2026-09-20T12:23:56.332Z level=INFO msg="Uploading 1 narinfos"6502lb # [ 139.227322] niks3-server[1051]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6503lb # [ 139.237103] niks3-server[1051]: 2026/09/20 12:23:56 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6504lb # [ 139.241192] niks3-server[1051]: 2026/09/20 12:23:56 INFO Completed upload id=476505lb # [ 139.242895] niks3-server[1051]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6506worker1 # [ 139.250712] nix-grpc-daemon[1559]: time=2026-09-20T12:23:56.350Z level=INFO msg="Upload complete. (270ms)"6507worker1 # [ 139.257352] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16508worker2 # [ 139.265941] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:56Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16509worker2 # [ 139.271625] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:56Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06510worker1 # [ 139.271166] nix-daemon[842]: reaped child process 1742, status = succeeded6511worker1 # [ 139.306282] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026512worker1 # [ 139.318492] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026513worker1 # [ 139.329964] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026514worker1 # [ 139.338380] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6515worker1 # [ 139.505165] nix-daemon[842]: accepted connection from pid 1766, user nix-grpc-daemon (trusted)6516worker1 # [ 139.518276] nix-daemon[842]: reaped child process 1769, status = succeeded6517worker1 # [ 139.669086] nix-daemon[842]: accepted connection from pid 1771, user nix-grpc-daemon (trusted)6518worker1 # [ 139.681650] nix-daemon[842]: reaped child process 1774, status = succeeded6519lb # [ 139.687320] niks3-server[1051]: 2026/09/20 12:23:56 INFO Received uploads request method=POST path=/api/pending_closures6520worker1 # [ 139.705457] nix-grpc-daemon[1559]: time=2026-09-20T12:23:56.805Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6521worker1 # [ 139.707164] nix-grpc-daemon[1559]: time=2026-09-20T12:23:56.807Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6522lb # [ 139.721964] niks3-server[1051]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6523lb # [ 139.728571] niks3-server[1051]: 2026/09/20 12:23:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6524worker1 # [ 139.741903] nix-grpc-daemon[1559]: time=2026-09-20T12:23:56.841Z level=INFO msg="Uploading 1 narinfos"6525lb # [ 139.733950] niks3-server[1051]: 2026/09/20 12:23:56 INFO Signed narinfos id=48 count=16526lb # [ 139.737466] niks3-server[1051]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6527lb # [ 139.749718] niks3-server[1051]: 2026/09/20 12:23:56 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6528lb # [ 139.752662] niks3-server[1051]: 2026/09/20 12:23:56 INFO Completed upload id=486529worker1 # [ 139.762059] nix-grpc-daemon[1559]: time=2026-09-20T12:23:56.862Z level=INFO msg="Upload complete. (410ms)"6530lb # [ 139.754500] niks3-server[1051]: 2026/09/20 12:23:56 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6531worker1 # [ 139.765858] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=5046532worker1 # [ 139.771283] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026533worker1 # [ 139.779426] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6534worker1 # [ 139.784566] nix-daemon[842]: reaped child process 1764, status = succeeded6535worker1 # [ 139.789945] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6536worker1 # [ 140.816223] nix-daemon[842]: reaped child process 1778, status = succeeded6537worker1 # [ 140.969607] nix-daemon[842]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)6538worker1 # [ 140.980823] nix-daemon[842]: reaped child process 1796, status = succeeded6539lb # [ 140.987447] niks3-server[1051]: 2026/09/20 12:23:58 INFO Received uploads request method=POST path=/api/pending_closures6540worker1 # [ 141.003860] nix-grpc-daemon[1559]: time=2026-09-20T12:23:58.103Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6541worker1 # [ 141.005405] nix-grpc-daemon[1559]: time=2026-09-20T12:23:58.105Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6542lb # [ 141.027741] niks3-server[1051]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6543lb # [ 141.034335] niks3-server[1051]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6544lb # [ 141.046201] niks3-server[1051]: 2026/09/20 12:23:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6545lb # [ 141.050681] niks3-server[1051]: 2026/09/20 12:23:58 INFO Signed narinfos id=49 count=16546worker1 # [ 141.061545] nix-grpc-daemon[1559]: time=2026-09-20T12:23:58.161Z level=INFO msg="Uploading 1 narinfos"6547lb # [ 141.055411] niks3-server[1051]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6548lb # [ 141.067708] niks3-server[1051]: 2026/09/20 12:23:58 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6549lb # [ 141.070383] niks3-server[1051]: 2026/09/20 12:23:58 INFO Completed upload id=496550lb # [ 141.071853] niks3-server[1051]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6551worker1 # [ 141.079960] nix-grpc-daemon[1559]: time=2026-09-20T12:23:58.179Z level=INFO msg="Upload complete. (282ms)"6552worker1 # [ 141.084955] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16553worker2 # [ 141.089853] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:57Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16554worker1 # [ 141.097595] nix-daemon[842]: reaped child process 1776, status = succeeded6555worker2 # [ 141.135045] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:57Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06556worker1 # [ 141.129421] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026557worker1 # [ 141.141527] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026558worker1 # [ 141.153248] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026559worker1 # [ 141.161315] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6560worker1 # [ 141.303958] nix-daemon[842]: accepted connection from pid 1800, user nix-grpc-daemon (trusted)6561worker1 # [ 141.317605] nix-daemon[842]: reaped child process 1803, status = succeeded6562worker1 # [ 141.457604] nix-daemon[842]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6563worker1 # [ 141.470429] nix-daemon[842]: reaped child process 1808, status = succeeded6564lb # [ 141.473956] niks3-server[1051]: 2026/09/20 12:23:58 INFO Received uploads request method=POST path=/api/pending_closures6565worker1 # [ 141.491971] nix-grpc-daemon[1559]: time=2026-09-20T12:23:58.592Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6566worker1 # [ 141.493482] nix-grpc-daemon[1559]: time=2026-09-20T12:23:58.593Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6567lb # [ 141.502931] niks3-server[1051]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6568lb # [ 141.512929] niks3-server[1051]: 2026/09/20 12:23:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6569lb # [ 141.517082] niks3-server[1051]: 2026/09/20 12:23:58 INFO Signed narinfos id=50 count=16570worker1 # [ 141.527970] nix-grpc-daemon[1559]: time=2026-09-20T12:23:58.628Z level=INFO msg="Uploading 1 narinfos"6571lb # [ 141.526806] niks3-server[1051]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6572lb # [ 141.534564] niks3-server[1051]: 2026/09/20 12:23:58 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6573worker1 # [ 141.549450] nix-grpc-daemon[1559]: time=2026-09-20T12:23:58.649Z level=INFO msg="Upload complete. (374ms)"6574lb # [ 141.541714] niks3-server[1051]: 2026/09/20 12:23:58 INFO Completed upload id=506575worker1 # [ 141.551744] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=5046576lb # [ 141.544945] niks3-server[1051]: 2026/09/20 12:23:58 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6577worker1 # [ 141.557302] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026578worker1 # [ 141.566950] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6579worker1 # [ 141.573174] nix-daemon[842]: reaped child process 1798, status = succeeded6580worker1 # [ 141.576097] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6581worker1 # [ 142.601534] nix-daemon[842]: reaped child process 1812, status = succeeded6582worker1 # [ 142.755267] nix-daemon[842]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)6583worker1 # [ 142.768148] nix-daemon[842]: reaped child process 1830, status = succeeded6584lb # [ 142.775889] niks3-server[1051]: 2026/09/20 12:23:59 INFO Received uploads request method=POST path=/api/pending_closures6585worker1 # [ 142.791962] nix-grpc-daemon[1559]: time=2026-09-20T12:23:59.891Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6586worker1 # [ 142.793829] nix-grpc-daemon[1559]: time=2026-09-20T12:23:59.893Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6587lb # [ 142.814695] niks3-server[1051]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6588lb # [ 142.819199] niks3-server[1051]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6589lb # [ 142.833067] niks3-server[1051]: 2026/09/20 12:24:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6590worker1 # [ 142.847032] nix-grpc-daemon[1559]: time=2026-09-20T12:23:59.946Z level=INFO msg="Uploading 1 narinfos"6591lb # [ 142.838793] niks3-server[1051]: 2026/09/20 12:24:00 INFO Signed narinfos id=51 count=16592lb # [ 142.842241] niks3-server[1051]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6593lb # [ 142.852234] niks3-server[1051]: 2026/09/20 12:24:00 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6594lb # [ 142.858696] niks3-server[1051]: 2026/09/20 12:24:00 INFO Completed upload id=516595worker1 # [ 142.866989] nix-grpc-daemon[1559]: time=2026-09-20T12:23:59.966Z level=INFO msg="Upload complete. (284ms)"6596lb # [ 142.860489] niks3-server[1051]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6597worker1 # [ 142.869625] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16598worker2 # [ 142.875308] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:59Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16599worker1 # [ 142.875563] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026600worker2 # [ 142.880742] nix-grpc-daemon[1721]: ts=2026-09-20T12:23:59Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06601worker1 # [ 142.880369] nix-daemon[842]: reaped child process 1810, status = succeeded6602worker1 # [ 142.883639] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026603worker1 # [ 142.889068] nix-grpc-daemon[1559]: time=2026-09-20T12:23:59.989Z level=INFO msg="All 1 paths already cached"6604worker1 # [ 142.892833] nix-grpc-daemon[1471]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026605worker1 # [ 142.896732] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6606worker1 # [ 143.059260] nix-daemon[842]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6607worker1 # [ 143.072560] nix-daemon[842]: reaped child process 1837, status = succeeded6608worker1 # [ 143.231843] nix-daemon[842]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)6609worker1 # [ 143.244747] nix-daemon[842]: reaped child process 1842, status = succeeded6610lb # [ 143.249971] niks3-server[1051]: 2026/09/20 12:24:00 INFO Received uploads request method=POST path=/api/pending_closures6611worker1 # [ 143.262055] nix-grpc-daemon[1559]: time=2026-09-20T12:24:00.362Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6612worker1 # [ 143.263534] nix-grpc-daemon[1559]: time=2026-09-20T12:24:00.363Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6613lb # [ 143.264730] niks3-server[1051]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6614lb # [ 143.268585] niks3-server[1051]: 2026/09/20 12:24:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6615lb # [ 143.270430] niks3-server[1051]: 2026/09/20 12:24:00 INFO Signed narinfos id=52 count=16616worker1 # [ 143.278605] nix-grpc-daemon[1559]: time=2026-09-20T12:24:00.378Z level=INFO msg="Uploading 1 narinfos"6617lb # [ 143.273722] niks3-server[1051]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6618lb # [ 143.278718] niks3-server[1051]: 2026/09/20 12:24:00 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6619lb # [ 143.282131] niks3-server[1051]: 2026/09/20 12:24:00 INFO Completed upload id=526620worker1 # [ 143.290249] nix-grpc-daemon[1559]: time=2026-09-20T12:24:00.390Z level=INFO msg="Upload complete. (387ms)"6621lb # [ 143.283771] niks3-server[1051]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6622worker1 # [ 143.291793] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=6246623worker1 # [ 143.296970] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026624worker1 # [ 143.302514] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6625worker1 # [ 143.304841] nix-daemon[842]: reaped child process 1832, status = succeeded6626worker1 # [ 143.310201] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6627worker1 # [ 144.336728] nix-daemon[842]: reaped child process 1846, status = succeeded6628worker1 # [ 144.496953] nix-daemon[842]: accepted connection from pid 1861, user nix-grpc-daemon (trusted)6629worker1 # [ 144.508395] nix-daemon[842]: reaped child process 1864, status = succeeded6630lb # [ 144.514116] niks3-server[1051]: 2026/09/20 12:24:01 INFO Received uploads request method=POST path=/api/pending_closures6631worker1 # [ 144.526611] nix-grpc-daemon[1559]: time=2026-09-20T12:24:01.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6632worker1 # [ 144.528160] nix-grpc-daemon[1559]: time=2026-09-20T12:24:01.628Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6633lb # [ 144.538573] niks3-server[1051]: 2026/09/20 12:24:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6634lb # [ 144.541102] niks3-server[1051]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6635lb # [ 144.544439] niks3-server[1051]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6636lb # [ 144.548687] niks3-server[1051]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6637lb # [ 144.553162] niks3-server[1051]: 2026/09/20 12:24:01 INFO Signed narinfos id=53 count=16638worker1 # [ 144.562484] nix-grpc-daemon[1559]: time=2026-09-20T12:24:01.662Z level=INFO msg="Uploading 1 narinfos"6639lb # [ 144.559394] niks3-server[1051]: 2026/09/20 12:24:01 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6640lb # [ 144.565761] niks3-server[1051]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6641lb # [ 144.569926] niks3-server[1051]: 2026/09/20 12:24:01 INFO Completed upload id=536642worker1 # [ 144.578085] nix-grpc-daemon[1559]: time=2026-09-20T12:24:01.678Z level=INFO msg="Upload complete. (260ms)"6643worker1 # [ 144.580557] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16644worker1 # [ 144.587652] nix-daemon[842]: reaped child process 1844, status = succeeded6645worker2 # [ 144.587920] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:01Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16646worker2 # [ 144.597780] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:01Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06647worker1 # [ 144.633171] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026648worker1 # [ 144.643527] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026649worker1 # [ 144.653822] nix-grpc-daemon[1559]: time=2026-09-20T12:24:01.753Z level=INFO msg="All 1 paths already cached"6650worker1 # [ 144.660131] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026651worker1 # [ 144.670155] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6652worker1 # [ 144.823975] nix-daemon[842]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)6653worker1 # [ 144.838325] nix-daemon[842]: reaped child process 1871, status = succeeded6654worker1 # [ 144.985539] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted)6655worker1 # [ 144.998176] nix-daemon[842]: reaped child process 1876, status = succeeded6656lb # [ 145.006628] niks3-server[1051]: 2026/09/20 12:24:02 INFO Received uploads request method=POST path=/api/pending_closures6657worker1 # [ 145.020268] nix-grpc-daemon[1559]: time=2026-09-20T12:24:02.120Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6658worker1 # [ 145.022169] nix-grpc-daemon[1559]: time=2026-09-20T12:24:02.121Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6659lb # [ 145.026054] niks3-server[1051]: 2026/09/20 12:24:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6660worker1 # [ 145.036709] nix-grpc-daemon[1559]: time=2026-09-20T12:24:02.136Z level=INFO msg="Uploading 1 narinfos"6661lb # [ 145.028800] niks3-server[1051]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6662lb # [ 145.030501] niks3-server[1051]: 2026/09/20 12:24:02 INFO Signed narinfos id=54 count=16663lb # [ 145.034152] niks3-server[1051]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6664lb # [ 145.037723] niks3-server[1051]: 2026/09/20 12:24:02 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6665lb # [ 145.040934] niks3-server[1051]: 2026/09/20 12:24:02 INFO Completed upload id=546666worker1 # [ 145.048870] nix-grpc-daemon[1559]: time=2026-09-20T12:24:02.148Z level=INFO msg="Upload complete. (368ms)"6667lb # [ 145.043411] niks3-server[1051]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6668worker1 # [ 145.050876] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=6246669worker1 # [ 145.053742] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026670worker1 # [ 145.060057] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6671worker1 # [ 145.063828] nix-daemon[842]: reaped child process 1866, status = succeeded6672worker1 # [ 145.068982] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6673worker1 # [ 146.685130] nix-daemon[842]: reaped child process 1880, status = succeeded6674worker1 # [ 146.796199] nix-daemon[842]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)6675worker1 # [ 146.808884] nix-daemon[842]: reaped child process 1898, status = succeeded6676lb # [ 146.810653] niks3-server[1051]: 2026/09/20 12:24:04 INFO Received uploads request method=POST path=/api/pending_closures6677worker1 # [ 146.823222] nix-grpc-daemon[1559]: time=2026-09-20T12:24:03.923Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6678worker1 # [ 146.824692] nix-grpc-daemon[1559]: time=2026-09-20T12:24:03.924Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6679lb # [ 146.829833] niks3-server[1051]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6680lb # [ 146.833724] niks3-server[1051]: 2026/09/20 12:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6681lb # [ 146.835735] niks3-server[1051]: 2026/09/20 12:24:04 INFO Signed narinfos id=55 count=16682worker1 # [ 146.843710] nix-grpc-daemon[1559]: time=2026-09-20T12:24:03.943Z level=INFO msg="Uploading 1 narinfos"6683lb # [ 146.837453] niks3-server[1051]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6684lb # [ 146.841117] niks3-server[1051]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6685lb # [ 146.844700] niks3-server[1051]: 2026/09/20 12:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6686lb # [ 146.847660] niks3-server[1051]: 2026/09/20 12:24:04 INFO Completed upload id=556687worker1 # [ 146.855800] nix-grpc-daemon[1559]: time=2026-09-20T12:24:03.955Z level=INFO msg="Upload complete. (179ms)"6688lb # [ 146.850467] niks3-server[1051]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6689worker1 # [ 146.859137] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16690worker1 # [ 146.862246] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026691worker2 # [ 146.865688] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:03Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16692worker1 # [ 146.868583] nix-daemon[842]: reaped child process 1878, status = succeeded6693worker1 # [ 146.869861] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026694worker2 # [ 146.873171] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:03Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06695worker1 # [ 146.875766] nix-grpc-daemon[1559]: time=2026-09-20T12:24:03.975Z level=INFO msg="All 1 paths already cached"6696worker1 # [ 146.878800] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026697worker1 # [ 146.882361] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6698worker1 # [ 147.008855] nix-daemon[842]: accepted connection from pid 1902, user nix-grpc-daemon (trusted)6699worker1 # [ 147.022045] nix-daemon[842]: reaped child process 1905, status = succeeded6700worker1 # [ 147.169083] nix-daemon[842]: accepted connection from pid 1907, user nix-grpc-daemon (trusted)6701worker1 # [ 147.183380] nix-daemon[842]: reaped child process 1910, status = succeeded6702lb # [ 147.187669] niks3-server[1051]: 2026/09/20 12:24:04 INFO Received uploads request method=POST path=/api/pending_closures6703worker1 # [ 147.200573] nix-grpc-daemon[1559]: time=2026-09-20T12:24:04.300Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6704worker1 # [ 147.202046] nix-grpc-daemon[1559]: time=2026-09-20T12:24:04.300Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6705lb # [ 147.199846] niks3-server[1051]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6706lb # [ 147.203504] niks3-server[1051]: 2026/09/20 12:24:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6707lb # [ 147.205138] niks3-server[1051]: 2026/09/20 12:24:04 INFO Signed narinfos id=56 count=16708worker1 # [ 147.214493] nix-grpc-daemon[1559]: time=2026-09-20T12:24:04.314Z level=INFO msg="Uploading 1 narinfos"6709lb # [ 147.209692] niks3-server[1051]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6710lb # [ 147.213483] niks3-server[1051]: 2026/09/20 12:24:04 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6711lb # [ 147.216739] niks3-server[1051]: 2026/09/20 12:24:04 INFO Completed upload id=566712worker1 # [ 147.224693] nix-grpc-daemon[1559]: time=2026-09-20T12:24:04.324Z level=INFO msg="Upload complete. (336ms)"6713lb # [ 147.218324] niks3-server[1051]: 2026/09/20 12:24:04 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6714worker1 # [ 147.226715] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=6246715worker1 # [ 147.231187] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026716worker1 # [ 147.237180] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6717worker1 # [ 147.239503] nix-daemon[842]: reaped child process 1900, status = succeeded6718worker1 # [ 147.245050] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6719worker1 # [ 148.660268] nix-daemon[842]: reaped child process 1914, status = succeeded6720worker1 # [ 148.783674] nix-daemon[842]: accepted connection from pid 1929, user nix-grpc-daemon (trusted)6721worker1 # [ 148.796939] nix-daemon[842]: reaped child process 1932, status = succeeded6722lb # [ 148.806694] niks3-server[1051]: 2026/09/20 12:24:06 INFO Received uploads request method=POST path=/api/pending_closures6723worker1 # [ 148.823691] nix-grpc-daemon[1559]: time=2026-09-20T12:24:05.923Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6724worker1 # [ 148.825175] nix-grpc-daemon[1559]: time=2026-09-20T12:24:05.925Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6725lb # [ 148.840614] niks3-server[1051]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6726lb # [ 148.856611] niks3-server[1051]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6727lb # [ 148.864262] niks3-server[1051]: 2026/09/20 12:24:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6728lb # [ 148.869230] niks3-server[1051]: 2026/09/20 12:24:06 INFO Signed narinfos id=57 count=16729worker1 # [ 148.879978] nix-grpc-daemon[1559]: time=2026-09-20T12:24:05.980Z level=INFO msg="Uploading 1 narinfos"6730lb # [ 148.875141] niks3-server[1051]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6731lb # [ 148.883888] niks3-server[1051]: 2026/09/20 12:24:06 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6732lb # [ 148.890633] niks3-server[1051]: 2026/09/20 12:24:06 INFO Completed upload id=576733worker1 # [ 148.899143] nix-grpc-daemon[1559]: time=2026-09-20T12:24:05.998Z level=INFO msg="Upload complete. (245ms)"6734lb # [ 148.892940] niks3-server[1051]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6735worker2 # [ 148.908683] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:05Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16736worker1 # [ 148.906448] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16737worker2 # [ 148.914879] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:05Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06738worker1 # [ 148.913882] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026739worker1 # [ 148.922559] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026740worker1 # [ 148.932728] nix-grpc-daemon[1559]: time=2026-09-20T12:24:06.032Z level=INFO msg="All 2 paths already cached"6741worker1 # [ 148.934161] nix-daemon[842]: reaped child process 1912, status = succeeded6742worker1 # [ 148.935451] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026743worker1 # [ 148.939249] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6744worker1 # [ 149.086745] nix-daemon[842]: accepted connection from pid 1936, user nix-grpc-daemon (trusted)6745worker1 # [ 149.100238] nix-daemon[842]: reaped child process 1939, status = succeeded6746worker1 # [ 149.251262] nix-daemon[842]: accepted connection from pid 1941, user nix-grpc-daemon (trusted)6747worker1 # [ 149.264044] nix-daemon[842]: reaped child process 1944, status = succeeded6748lb # [ 149.272278] niks3-server[1051]: 2026/09/20 12:24:06 INFO Received uploads request method=POST path=/api/pending_closures6749worker1 # [ 149.289631] nix-grpc-daemon[1559]: time=2026-09-20T12:24:06.389Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6750worker1 # [ 149.291300] nix-grpc-daemon[1559]: time=2026-09-20T12:24:06.391Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6751lb # [ 149.300305] niks3-server[1051]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6752lb # [ 149.311714] niks3-server[1051]: 2026/09/20 12:24:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6753worker1 # [ 149.325291] nix-grpc-daemon[1559]: time=2026-09-20T12:24:06.425Z level=INFO msg="Uploading 1 narinfos"6754lb # [ 149.316941] niks3-server[1051]: 2026/09/20 12:24:06 INFO Signed narinfos id=58 count=16755lb # [ 149.323537] niks3-server[1051]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6756lb # [ 149.334376] niks3-server[1051]: 2026/09/20 12:24:06 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6757lb # [ 149.340478] niks3-server[1051]: 2026/09/20 12:24:06 INFO Completed upload id=586758worker1 # [ 149.348623] nix-grpc-daemon[1559]: time=2026-09-20T12:24:06.448Z level=INFO msg="Upload complete. (403ms)"6759lb # [ 149.343945] niks3-server[1051]: 2026/09/20 12:24:06 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6760worker1 # [ 149.351131] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=7526761worker1 # [ 149.356431] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026762worker1 # [ 149.365476] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6763worker1 # [ 149.370244] nix-daemon[842]: reaped child process 1934, status = succeeded6764worker1 # [ 149.374890] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6765worker1 # [ 150.190168] nix-daemon[842]: reaped child process 1948, status = succeeded6766worker1 # [ 150.340441] nix-daemon[842]: accepted connection from pid 1963, user nix-grpc-daemon (trusted)6767worker1 # [ 150.353368] nix-daemon[842]: reaped child process 1966, status = succeeded6768lb # [ 150.356627] niks3-server[1051]: 2026/09/20 12:24:07 INFO Received uploads request method=POST path=/api/pending_closures6769worker1 # [ 150.372836] nix-grpc-daemon[1559]: time=2026-09-20T12:24:07.472Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6770worker1 # [ 150.374298] nix-grpc-daemon[1559]: time=2026-09-20T12:24:07.474Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6771lb # [ 150.390400] niks3-server[1051]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6772lb # [ 150.405620] niks3-server[1051]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6773lb # [ 150.409371] niks3-server[1051]: 2026/09/20 12:24:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6774lb # [ 150.414103] niks3-server[1051]: 2026/09/20 12:24:07 INFO Signed narinfos id=59 count=16775worker1 # [ 150.425188] nix-grpc-daemon[1559]: time=2026-09-20T12:24:07.525Z level=INFO msg="Uploading 1 narinfos"6776lb # [ 150.421133] niks3-server[1051]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6777lb # [ 150.430121] niks3-server[1051]: 2026/09/20 12:24:07 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6778lb # [ 150.435929] niks3-server[1051]: 2026/09/20 12:24:07 INFO Completed upload id=596779lb # [ 150.438723] niks3-server[1051]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6780worker1 # [ 150.445777] nix-grpc-daemon[1559]: time=2026-09-20T12:24:07.545Z level=INFO msg="Upload complete. (263ms)"6781worker2 # [ 150.455323] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:07Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16782worker1 # [ 150.454061] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16783worker1 # [ 150.460279] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026784worker1 # [ 150.469053] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026785worker1 # [ 150.478633] nix-daemon[842]: reaped child process 1946, status = succeeded6786worker1 # [ 150.480207] nix-grpc-daemon[1559]: time=2026-09-20T12:24:07.580Z level=INFO msg="All 2 paths already cached"6787worker1 # [ 150.484602] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026788worker1 # [ 150.488517] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6789worker1 # [ 150.645641] nix-daemon[842]: accepted connection from pid 1970, user nix-grpc-daemon (trusted)6790worker1 # [ 150.658679] nix-daemon[842]: reaped child process 1973, status = succeeded6791worker1 # [ 150.819251] nix-daemon[842]: accepted connection from pid 1975, user nix-grpc-daemon (trusted)6792worker1 # [ 150.832152] nix-daemon[842]: reaped child process 1978, status = succeeded6793lb # [ 150.840706] niks3-server[1051]: 2026/09/20 12:24:08 INFO Received uploads request method=POST path=/api/pending_closures6794worker1 # [ 150.852701] nix-grpc-daemon[1559]: time=2026-09-20T12:24:07.952Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6795worker1 # [ 150.854266] nix-grpc-daemon[1559]: time=2026-09-20T12:24:07.954Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6796lb # [ 150.855512] niks3-server[1051]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6797lb # [ 150.859954] niks3-server[1051]: 2026/09/20 12:24:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6798lb # [ 150.862413] niks3-server[1051]: 2026/09/20 12:24:08 INFO Signed narinfos id=60 count=16799worker1 # [ 150.871575] nix-grpc-daemon[1559]: time=2026-09-20T12:24:07.971Z level=INFO msg="Uploading 1 narinfos"6800lb # [ 150.863951] niks3-server[1051]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6801lb # [ 150.868849] niks3-server[1051]: 2026/09/20 12:24:08 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6802lb # [ 150.872224] niks3-server[1051]: 2026/09/20 12:24:08 INFO Completed upload id=606803worker1 # [ 150.881551] nix-grpc-daemon[1559]: time=2026-09-20T12:24:07.981Z level=INFO msg="Upload complete. (387ms)"6804lb # [ 150.873732] niks3-server[1051]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6805worker1 # [ 150.883690] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=7526806worker1 # [ 150.886208] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026807worker1 # [ 150.893881] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6808worker1 # [ 150.896505] nix-daemon[842]: reaped child process 1968, status = succeeded6809worker1 # [ 150.901523] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6810worker1 # [ 152.116279] nix-daemon[842]: reaped child process 1982, status = succeeded6811worker1 # [ 152.262559] nix-daemon[842]: accepted connection from pid 1997, user nix-grpc-daemon (trusted)6812worker1 # [ 152.275898] nix-daemon[842]: reaped child process 2000, status = succeeded6813lb # [ 152.282579] niks3-server[1051]: 2026/09/20 12:24:09 INFO Received uploads request method=POST path=/api/pending_closures6814worker1 # [ 152.295271] nix-grpc-daemon[1559]: time=2026-09-20T12:24:09.395Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6815worker1 # [ 152.296793] nix-grpc-daemon[1559]: time=2026-09-20T12:24:09.396Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6816lb # [ 152.305671] niks3-server[1051]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6817lb # [ 152.308915] niks3-server[1051]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6818lb # [ 152.310941] niks3-server[1051]: 2026/09/20 12:24:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6819lb # [ 152.312951] niks3-server[1051]: 2026/09/20 12:24:09 INFO Signed narinfos id=61 count=16820worker1 # [ 152.322477] nix-grpc-daemon[1559]: time=2026-09-20T12:24:09.422Z level=INFO msg="Uploading 1 narinfos"6821lb # [ 152.317111] niks3-server[1051]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6822lb # [ 152.322514] niks3-server[1051]: 2026/09/20 12:24:09 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6823lb # [ 152.326730] niks3-server[1051]: 2026/09/20 12:24:09 INFO Completed upload id=616824worker1 # [ 152.334826] nix-grpc-daemon[1559]: time=2026-09-20T12:24:09.434Z level=INFO msg="Upload complete. (225ms)"6825lb # [ 152.328157] niks3-server[1051]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6826worker1 # [ 152.337422] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16827worker2 # [ 152.344414] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:09Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16828worker1 # [ 152.344917] nix-daemon[842]: reaped child process 1980, status = succeeded6829worker1 # [ 152.382431] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026830worker1 # [ 152.388170] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:483026831worker1 # [ 152.394135] nix-grpc-daemon[1559]: time=2026-09-20T12:24:09.494Z level=INFO msg="All 2 paths already cached"6832worker1 # [ 152.397449] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:483026833worker1 # [ 152.402335] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6834worker1 # [ 152.550443] nix-daemon[842]: accepted connection from pid 2004, user nix-grpc-daemon (trusted)6835worker1 # [ 152.563347] nix-daemon[842]: reaped child process 2007, status = succeeded6836worker1 # [ 152.719721] nix-daemon[842]: accepted connection from pid 2009, user nix-grpc-daemon (trusted)6837worker1 # [ 152.732464] nix-daemon[842]: reaped child process 2012, status = succeeded6838lb # [ 152.740176] niks3-server[1051]: 2026/09/20 12:24:09 INFO Received uploads request method=POST path=/api/pending_closures6839worker1 # [ 152.755569] nix-grpc-daemon[1559]: time=2026-09-20T12:24:09.855Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6840worker1 # [ 152.757366] nix-grpc-daemon[1559]: time=2026-09-20T12:24:09.857Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6841lb # [ 152.758195] niks3-server[1051]: 2026/09/20 12:24:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6842lb # [ 152.760073] niks3-server[1051]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6843lb # [ 152.762491] niks3-server[1051]: 2026/09/20 12:24:09 INFO Signed narinfos id=62 count=16844worker1 # [ 152.771916] nix-grpc-daemon[1559]: time=2026-09-20T12:24:09.871Z level=INFO msg="Uploading 1 narinfos"6845lb # [ 152.765822] niks3-server[1051]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6846lb # [ 152.770145] niks3-server[1051]: 2026/09/20 12:24:09 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6847lb # [ 152.772765] niks3-server[1051]: 2026/09/20 12:24:09 INFO Completed upload id=626848worker1 # [ 152.780920] nix-grpc-daemon[1559]: time=2026-09-20T12:24:09.880Z level=INFO msg="Upload complete. (372ms)"6849lb # [ 152.775445] niks3-server[1051]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6850worker1 # [ 152.782897] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=0 paths=1 nar_bytes_in=7526851worker1 # [ 152.785864] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:483026852worker1 # [ 152.791254] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6853worker1 # [ 152.795724] nix-daemon[842]: reaped child process 2002, status = succeeded6854worker1 # [ 152.800824] nix-daemon[842]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)6855worker1 # [ 153.814886] nix-daemon[842]: reaped child process 2016, status = succeeded6856worker1 # [ 153.956806] nix-daemon[842]: accepted connection from pid 2031, user nix-grpc-daemon (trusted)6857worker1 # [ 153.968311] nix-daemon[842]: reaped child process 2034, status = succeeded6858lb # [ 153.973702] niks3-server[1051]: 2026/09/20 12:24:11 INFO Received uploads request method=POST path=/api/pending_closures6859worker1 # [ 153.988123] nix-grpc-daemon[1559]: time=2026-09-20T12:24:11.087Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6860worker1 # [ 153.989585] nix-grpc-daemon[1559]: time=2026-09-20T12:24:11.089Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6861lb # [ 154.004157] niks3-server[1051]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6862lb # [ 154.021061] niks3-server[1051]: 2026/09/20 12:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6863lb # [ 154.025241] niks3-server[1051]: 2026/09/20 12:24:11 INFO Signed narinfos id=63 count=16864worker1 # [ 154.036128] nix-grpc-daemon[1559]: time=2026-09-20T12:24:11.136Z level=INFO msg="Uploading 1 narinfos"6865lb # [ 154.032140] niks3-server[1051]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6866lb # [ 154.036380] niks3-server[1051]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6867lb # [ 154.049261] niks3-server[1051]: 2026/09/20 12:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6868lb # [ 154.052642] niks3-server[1051]: 2026/09/20 12:24:11 INFO Completed upload id=636869worker1 # [ 154.060780] nix-grpc-daemon[1559]: time=2026-09-20T12:24:11.160Z level=INFO msg="Upload complete. (252ms)"6870lb # [ 154.053826] niks3-server[1051]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6871worker1 # [ 154.063454] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48302 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16872worker1 # [ 154.070506] nix-daemon[842]: reaped child process 2014, status = succeeded6873client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.63 seconds)6874worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6875worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6876client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16877worker1 # [ 154.403280] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:483026878worker2 # [ 154.415409] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376766879worker2 # [ 154.431493] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:11Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06880client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.27 seconds)6881(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 17.96 seconds)6882subtest: low disk drains a worker and builds go to the other6883worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6884worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.01 seconds)6885worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6886worker1 # [ 156.288524] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:13Z level=info event=unhealthy reason=min_free6887worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds)6888client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26889worker2 # [ 156.798516] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:376766890client # don't know how to build these paths:6891client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6892worker2 # [ 156.803670] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376766893worker2 # [ 156.814067] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:13Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06894worker2 # [ 156.816162] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:13Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16895worker2 # [ 156.859609] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376766896worker2 # [ 156.866145] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376766897client # copying 1 paths to 'lb:50051'...6898client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6899worker2 # [ 156.873569] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376766900worker2 # [ 156.886617] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6901worker2 # [ 156.905515] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:13Z level=info event=niks3_push_started pid=17986902worker2 # [ 157.101479] nix-grpc-daemon[1798]: time=2026-09-20T12:24:13.961Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""6903worker2 # [ 157.271024] nix-daemon[867]: accepted connection from pid 1811, user nix-grpc-daemon (trusted)6904worker2 # [ 157.285131] nix-daemon[867]: reaped child process 1814, status = succeeded6905worker2 # [ 157.460505] nix-daemon[867]: accepted connection from pid 1816, user nix-grpc-daemon (trusted)6906worker2 # [ 157.474090] nix-daemon[867]: reaped child process 1819, status = succeeded6907lb # [ 157.479483] niks3-server[1051]: 2026/09/20 12:24:14 INFO Received uploads request method=POST path=/api/pending_closures6908worker2 # [ 157.502810] nix-grpc-daemon[1798]: time=2026-09-20T12:24:14.363Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6909worker2 # [ 157.504385] nix-grpc-daemon[1798]: time=2026-09-20T12:24:14.365Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6910lb # [ 157.517254] niks3-server[1051]: 2026/09/20 12:24:14 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6911lb # [ 157.525410] niks3-server[1051]: 2026/09/20 12:24:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6912worker2 # [ 157.545707] nix-grpc-daemon[1798]: time=2026-09-20T12:24:14.406Z level=INFO msg="Uploading 1 narinfos"6913lb # [ 157.534474] niks3-server[1051]: 2026/09/20 12:24:14 INFO Signed narinfos id=64 count=16914lb # [ 157.541420] niks3-server[1051]: 2026/09/20 12:24:14 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6915lb # [ 157.551319] niks3-server[1051]: 2026/09/20 12:24:14 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6916lb # [ 157.557778] niks3-server[1051]: 2026/09/20 12:24:14 INFO Completed upload id=646917worker2 # [ 157.569595] nix-grpc-daemon[1798]: time=2026-09-20T12:24:14.430Z level=INFO msg="Upload complete. (464ms)"6918lb # [ 157.559826] niks3-server[1051]: 2026/09/20 12:24:14 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6919worker2 # [ 157.571808] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37676 duration_s=0 paths=1 nar_bytes_in=5126920worker2 # [ 157.575559] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376766921worker2 # [ 157.580592] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6922worker2 # [ 157.586360] nix-daemon[867]: reaped child process 1796, status = succeeded6923client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6924client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6925worker2 # [ 157.591705] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6926lb # [ 158.202904] envoy[910]: conn peer=[2001:db8:1::1]:41520 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27154 tx=10626 ms=173756927lb # [ 158.206755] envoy[910]: conn peer=[2001:db8:1::1]:53632 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=878 tx=481 ms=376928client # farm-a> LOG-farm-a-drain6929worker2 # [ 159.220611] nix-daemon[867]: reaped child process 1823, status = succeeded6930worker2 # [ 159.381685] nix-daemon[867]: accepted connection from pid 1838, user nix-grpc-daemon (trusted)6931worker2 # [ 159.395880] nix-daemon[867]: reaped child process 1841, status = succeeded6932lb # [ 159.398480] niks3-server[1051]: 2026/09/20 12:24:16 INFO Received uploads request method=POST path=/api/pending_closures6933worker2 # [ 159.415074] nix-grpc-daemon[1798]: time=2026-09-20T12:24:16.275Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6934worker2 # [ 159.416741] nix-grpc-daemon[1798]: time=2026-09-20T12:24:16.277Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6935lb # [ 159.416569] niks3-server[1051]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6936lb # [ 159.423297] niks3-server[1051]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6937lb # [ 159.426811] niks3-server[1051]: 2026/09/20 12:24:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6938lb # [ 159.428438] niks3-server[1051]: 2026/09/20 12:24:16 INFO Signed narinfos id=65 count=16939worker2 # [ 159.440720] nix-grpc-daemon[1798]: time=2026-09-20T12:24:16.300Z level=INFO msg="Uploading 1 narinfos"6940lb # [ 159.432959] niks3-server[1051]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6941lb # [ 159.436616] niks3-server[1051]: 2026/09/20 12:24:16 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6942lb # [ 159.440363] niks3-server[1051]: 2026/09/20 12:24:16 INFO Completed upload id=656943worker2 # [ 159.451945] nix-grpc-daemon[1798]: time=2026-09-20T12:24:16.312Z level=INFO msg="Upload complete. (251ms)"6944lb # [ 159.441788] niks3-server[1051]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6945worker2 # [ 159.454527] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37676 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16946worker2 # [ 159.461327] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:16Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06947worker2 # [ 159.463277] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:16Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16948worker2 # [ 159.468484] nix-daemon[867]: reaped child process 1821, status = succeeded6949worker2 # [ 159.504659] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376766950worker2 # [ 159.513542] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376766951worker2 # [ 159.524674] nix-grpc-daemon[1798]: time=2026-09-20T12:24:16.385Z level=INFO msg="All 1 paths already cached"6952client # copying 1 paths to 'lb:50051'...6953client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6954worker2 # [ 159.530690] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376766955worker2 # [ 159.537915] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6956worker2 # [ 159.695947] nix-daemon[867]: accepted connection from pid 1847, user nix-grpc-daemon (trusted)6957worker2 # [ 159.710344] nix-daemon[867]: reaped child process 1850, status = succeeded6958worker2 # [ 159.875823] nix-daemon[867]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6959worker2 # [ 159.889654] nix-daemon[867]: reaped child process 1855, status = succeeded6960lb # [ 159.893183] niks3-server[1051]: 2026/09/20 12:24:17 INFO Received uploads request method=POST path=/api/pending_closures6961worker2 # [ 159.912567] nix-grpc-daemon[1798]: time=2026-09-20T12:24:16.773Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6962worker2 # [ 159.914162] nix-grpc-daemon[1798]: time=2026-09-20T12:24:16.774Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6963lb # [ 159.923334] niks3-server[1051]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6964lb # [ 159.932071] niks3-server[1051]: 2026/09/20 12:24:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6965lb # [ 159.937057] niks3-server[1051]: 2026/09/20 12:24:17 INFO Signed narinfos id=66 count=16966worker2 # [ 159.951682] nix-grpc-daemon[1798]: time=2026-09-20T12:24:16.812Z level=INFO msg="Uploading 1 narinfos"6967lb # [ 159.942950] niks3-server[1051]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6968lb # [ 159.954190] niks3-server[1051]: 2026/09/20 12:24:17 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6969worker2 # [ 159.971739] nix-grpc-daemon[1798]: time=2026-09-20T12:24:16.832Z level=INFO msg="Upload complete. (424ms)"6970lb # [ 159.960447] niks3-server[1051]: 2026/09/20 12:24:17 INFO Completed upload id=666971worker2 # [ 159.973955] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37676 duration_s=0 paths=1 nar_bytes_in=6246972lb # [ 159.963700] niks3-server[1051]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6973worker2 # [ 159.979535] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376766974worker2 # [ 159.987281] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6975worker2 # [ 159.993211] nix-daemon[867]: reaped child process 1845, status = succeeded6976worker2 # [ 159.998414] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6977client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6978client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6979client # farm-b> LOG-farm-b-drain6980worker2 # [ 161.020554] nix-daemon[867]: reaped child process 1859, status = succeeded6981worker2 # [ 161.178824] nix-daemon[867]: accepted connection from pid 1874, user nix-grpc-daemon (trusted)6982worker2 # [ 161.193638] nix-daemon[867]: reaped child process 1877, status = succeeded6983lb # [ 161.197683] niks3-server[1051]: 2026/09/20 12:24:18 INFO Received uploads request method=POST path=/api/pending_closures6984worker2 # [ 161.214384] nix-grpc-daemon[1798]: time=2026-09-20T12:24:18.074Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6985worker2 # [ 161.215929] nix-grpc-daemon[1798]: time=2026-09-20T12:24:18.076Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6986lb # [ 161.217681] niks3-server[1051]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6987lb # [ 161.223280] niks3-server[1051]: 2026/09/20 12:24:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6988lb # [ 161.226397] niks3-server[1051]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6989lb # [ 161.228504] niks3-server[1051]: 2026/09/20 12:24:18 INFO Signed narinfos id=67 count=16990worker2 # [ 161.240246] nix-grpc-daemon[1798]: time=2026-09-20T12:24:18.100Z level=INFO msg="Uploading 1 narinfos"6991lb # [ 161.233488] niks3-server[1051]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6992lb # [ 161.238619] niks3-server[1051]: 2026/09/20 12:24:18 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6993lb # [ 161.242043] niks3-server[1051]: 2026/09/20 12:24:18 INFO Completed upload id=676994worker2 # [ 161.255056] nix-grpc-daemon[1798]: time=2026-09-20T12:24:18.115Z level=INFO msg="Upload complete. (248ms)"6995lb # [ 161.243712] niks3-server[1051]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6996worker2 # [ 161.259651] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37676 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16997worker2 # [ 161.263940] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:18Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06998worker2 # [ 161.265897] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:18Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16999worker2 # [ 161.271920] nix-daemon[867]: reaped child process 1857, status = succeeded7000worker2 # [ 161.309247] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376767001worker2 # [ 161.316129] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:376767002worker2 # [ 161.324940] nix-grpc-daemon[1798]: time=2026-09-20T12:24:18.185Z level=INFO msg="All 2 paths already cached"7003client # copying 1 paths to 'lb:50051'...7004client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...7005worker2 # [ 161.331754] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:376767006worker2 # [ 161.338794] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)7007worker2 # [ 161.495053] nix-daemon[867]: accepted connection from pid 1883, user nix-grpc-daemon (trusted)7008worker2 # [ 161.509586] nix-daemon[867]: reaped child process 1886, status = succeeded7009worker2 # [ 161.670087] nix-daemon[867]: accepted connection from pid 1888, user nix-grpc-daemon (trusted)7010worker2 # [ 161.683704] nix-daemon[867]: reaped child process 1891, status = succeeded7011lb # [ 161.687397] niks3-server[1051]: 2026/09/20 12:24:18 INFO Received uploads request method=POST path=/api/pending_closures7012worker2 # [ 161.706958] nix-grpc-daemon[1798]: time=2026-09-20T12:24:18.567Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7013worker2 # [ 161.708385] nix-grpc-daemon[1798]: time=2026-09-20T12:24:18.567Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"7014lb # [ 161.713623] niks3-server[1051]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst7015lb # [ 161.723131] niks3-server[1051]: 2026/09/20 12:24:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign7016worker2 # [ 161.739499] nix-grpc-daemon[1798]: time=2026-09-20T12:24:18.600Z level=INFO msg="Uploading 1 narinfos"7017lb # [ 161.728413] niks3-server[1051]: 2026/09/20 12:24:18 INFO Signed narinfos id=68 count=17018lb # [ 161.733217] niks3-server[1051]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls7019lb # [ 161.743546] niks3-server[1051]: 2026/09/20 12:24:18 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete7020worker2 # [ 161.760204] nix-grpc-daemon[1798]: time=2026-09-20T12:24:18.620Z level=INFO msg="Upload complete. (412ms)"7021lb # [ 161.748773] niks3-server[1051]: 2026/09/20 12:24:18 INFO Completed upload id=687022worker2 # [ 161.763067] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37676 duration_s=0 paths=1 nar_bytes_in=7527023worker2 # [ 161.765876] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:376767024lb # [ 161.753970] niks3-server[1051]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo7025worker2 # [ 161.771279] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)7026worker2 # [ 161.776337] nix-daemon[867]: reaped child process 1881, status = succeeded7027worker2 # [ 161.781866] nix-daemon[867]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)7028client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...7029client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7030worker2 # [ 162.797269] nix-daemon[867]: reaped child process 1895, status = succeeded7031client # farm-top> LOG-farm-top-drain7032worker2 # [ 162.940628] nix-daemon[867]: accepted connection from pid 1910, user nix-grpc-daemon (trusted)7033worker2 # [ 162.954575] nix-daemon[867]: reaped child process 1913, status = succeeded7034lb # [ 162.959521] niks3-server[1051]: 2026/09/20 12:24:20 INFO Received uploads request method=POST path=/api/pending_closures7035worker2 # [ 162.977854] nix-grpc-daemon[1798]: time=2026-09-20T12:24:19.838Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7036worker2 # [ 162.979330] nix-grpc-daemon[1798]: time=2026-09-20T12:24:19.839Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"7037lb # [ 163.006674] niks3-server[1051]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst7038lb # [ 163.011669] niks3-server[1051]: 2026/09/20 12:24:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign7039lb # [ 163.015312] niks3-server[1051]: 2026/09/20 12:24:20 INFO Signed narinfos id=69 count=17040worker2 # [ 163.029186] nix-grpc-daemon[1798]: time=2026-09-20T12:24:19.889Z level=INFO msg="Uploading 1 narinfos"7041lb # [ 163.017737] niks3-server[1051]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv7042lb # [ 163.029447] niks3-server[1051]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls7043lb # [ 163.033750] niks3-server[1051]: 2026/09/20 12:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete7044lb # [ 163.038945] niks3-server[1051]: 2026/09/20 12:24:20 INFO Completed upload id=697045worker2 # [ 163.050862] nix-grpc-daemon[1798]: time=2026-09-20T12:24:19.911Z level=INFO msg="Upload complete. (262ms)"7046lb # [ 163.041924] niks3-server[1051]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo7047worker2 # [ 163.059162] nix-grpc-daemon[1721]: ts=2026-09-20T12:24:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37676 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=17048worker2 # [ 163.071873] nix-daemon[867]: reaped child process 1893, status = succeeded7049client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.52 seconds)7050client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath7051client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.19 seconds)7052worker1: must succeed: rm /nix/.rw-store/fill7053worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.13 seconds)7054worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7055worker1 # [ 164.295628] nix-grpc-daemon[1471]: ts=2026-09-20T12:24:21Z level=info event=healthy reason=min_free7056worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)7057(finished: subtest: low disk drains a worker and builds go to the other, in 10.14 seconds)7058(finished: run the VM test script, in 165.51 seconds)7059test script finished in 165.75s7060cleanup7061kill QemuMachine (pid 50)7062client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7063kill QemuMachine (pid 51)7064lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7065kill QemuMachine (pid 49)7066worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7067kill QemuMachine (pid 52)7068worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7069(finished: cleanup, in 1.11 seconds)7070additionally exposed symbols:7071 client, lb, worker1, worker2,7072 vlan1,7073 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh