vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #254
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1 # Formatting '/build/vm-state-worker1/tmp.OM6jhNelJT', fmt=raw size=107374182414worker1 # mke2fs 1.47.4 (6-Mar-2025)15worker1: QEMU running (pid 52)16worker1 # Discarding device blocks: 0/262144 done17worker2: QEMU running (pid 51)18worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes19lb: QEMU running (pid 49)20lb # Disk image does not exist, creating the virtualisation disk image...21lb # Formatting '/build/vm-state-lb/tmp.GLJUZLyZGS', fmt=raw size=107374182422worker1 # Filesystem UUID: 5778b2ab-43fe-49a0-a5ea-7dbc4ef1dedd23lb # mke2fs 1.47.4 (6-Mar-2025)24worker1 # Superblock backups stored on blocks:25lb # Discarding device blocks: 0/262144 done26worker1 # 32768, 98304, 163840, 22937627lb # Creating filesystem with 262144 4k blocks and 65536 inodes28worker1 # 29lb # Filesystem UUID: 9385023b-a7cc-46d4-a0c8-a0a6a25ba8ab30worker1 # Allocating group tables: 0/8 done31lb # Superblock backups stored on blocks:32worker1 # Writing inode tables: 0/8 done33lb # 32768, 98304, 163840, 22937634worker1 # Creating journal (8192 blocks): done35lb # 36worker1 # Writing superblocks and filesystem accounting information: 0/8 done37lb # Allocating group tables: 0/8 done38worker1 # 39lb # Writing inode tables: 0/8 done40worker1 # Virtualisation disk image created.41lb # Creating journal (8192 blocks): done42client # Disk image does not exist, creating the virtualisation disk image...43worker2 # Disk image does not exist, creating the virtualisation disk image...44client: QEMU running (pid 50)45lb # Writing superblocks and filesystem accounting information: 0/8 done46client # Formatting '/build/vm-state-client/tmp.mi8Gf46HNZ', fmt=raw size=107374182447lb # 48client # mke2fs 1.47.4 (6-Mar-2025)49lb # Virtualisation disk image created.50client # Discarding device blocks: 0/262144 done51client # Creating filesystem with 262144 4k blocks and 65536 inodes52client # Filesystem UUID: a5252226-766c-443b-8bf7-18e15c6a165853(finished: start all VMs, in 0.30 seconds)54worker2 # Formatting '/build/vm-state-worker2/tmp.glVvtBvvoK', fmt=raw size=107374182455client: waiting for unit network-addresses-eth1.service56worker2 # mke2fs 1.47.4 (6-Mar-2025)57worker2 # Discarding device blocks: 0/262144 done58client: waiting for the VM to finish booting59worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes60client # Superblock backups stored on blocks:61worker2 # Filesystem UUID: 73d610b0-cfe2-46a6-a6d5-1e32453ca6eb62client # 32768, 98304, 163840, 22937663worker2 # Superblock backups stored on blocks:64client # 65worker2 # 32768, 98304, 163840, 22937666client # Allocating group tables: 0/8 done67client # Writing inode tables: 0/8 done68worker2 # 69client # Creating journal (8192 blocks): done70worker2 # Allocating group tables: 0/8 done71client # Writing superblocks and filesystem accounting information: 0/8 done72worker2 # Writing inode tables: 0/8 done73client # 74worker2 # Creating journal (8192 blocks): done75client # Virtualisation disk image created.76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker2 # 84worker2 # 85worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086lb # 87lb # 88worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...89worker2 # 90worker2 # 91worker2 # 92worker2 # 93lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0094worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0095lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...96lb # 97lb # 98client # 99client # 100lb # 101lb # 102lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00104worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105worker2 # 106worker2 # 107client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...108client # 109client # 110client # 111client # 112lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...113lb # 114lb # 115client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117client # 118client # 119worker1 # 120worker1 # 121worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123worker1 # 124worker1 # 125worker1 # 126worker1 # 127worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128worker2 # Booting from ROM...129lb # Booting from ROM...130worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...131worker1 # 132worker1 # 133client # Booting from ROM...134worker1 # Booting from ROM...135lb # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026137lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0138worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/g6bjvn1fpihxjl3rkk64li3qwyfil5lr-nixos-system-worker2-test/init regInfo=/nix/store/mddi5sa1bwc5cd417i20xm8sk5njknhg-closure-info/registration console=ttyS0,115200n8 console=tty0139lb # [ 0.000000] BIOS-provided physical RAM map:140worker2 # [ 0.000000] BIOS-provided physical RAM map:141lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable142worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable143lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved144worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved145lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved146worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved147lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable148client # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026149worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable150lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved151worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved152lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved153worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved154lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved155worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved156lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved157worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved158client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test/init regInfo=/nix/store/941m2hwqpcjqiysnxdfsqwdw595s87vk-closure-info/registration console=ttyS0,115200n8 console=tty0159lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved160client # [ 0.000000] BIOS-provided physical RAM map:161worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved162lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved163client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable164worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved165lb # [ 0.000000] NX (Execute Disable) protection: active166worker2 # [ 0.000000] NX (Execute Disable) protection: active167client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved168lb # [ 0.000000] APIC: Static calls initialized169worker2 # [ 0.000000] APIC: Static calls initialized170lb # [ 0.000000] SMBIOS 2.8 present.171worker2 # [ 0.000000] SMBIOS 2.8 present.172client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved173client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable174lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014175worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014176lb # [ 0.000000] DMI: Memory slots populated: 1/1177worker2 # [ 0.000000] DMI: Memory slots populated: 1/1178client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved179lb # [ 0.000000] Hypervisor detected: KVM180worker2 # [ 0.000000] Hypervisor detected: KVM181client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved182lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000183worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000184worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00185lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00186client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved187worker2 # [ 0.000000] kvm-clock: using sched offset of 445357875 cycles188lb # [ 0.000000] kvm-clock: using sched offset of 444377378 cycles189client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved190client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved191worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns192lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns193worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor194lb # [ 0.000006] tsc: Detected 2400.012 MHz processor195client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved196worker2 # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000197client # [ 0.000000] NX (Execute Disable) protection: active198lb # [ 0.000866] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000199client # [ 0.000000] APIC: Static calls initialized200worker2 # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs201client # [ 0.000000] SMBIOS 2.8 present.202lb # [ 0.000894] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs203worker2 # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT204lb # [ 0.000897] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT205client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014206worker2 # [ 0.002736] found SMP MP-table at [mem 0x000f5450-0x000f545f]207lb # [ 0.002788] found SMP MP-table at [mem 0x000f5450-0x000f545f]208client # [ 0.000000] DMI: Memory slots populated: 1/1209worker2 # [ 0.002747] Using GB pages for direct mapping210lb # [ 0.002807] Using GB pages for direct mapping211client # [ 0.000000] Hypervisor detected: KVM212worker2 # [ 0.002817] RAMDISK: [mem 0x5e367000-0x5ffcffff]213lb # [ 0.002921] RAMDISK: [mem 0x5e367000-0x5ffcffff]214client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000215worker2 # [ 0.002826] ACPI: Early table checksum verification disabled216lb # [ 0.002930] ACPI: Early table checksum verification disabled217client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00218worker2 # [ 0.002828] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )219lb # [ 0.002934] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )220client # [ 0.000000] kvm-clock: using sched offset of 473133684 cycles221worker2 # [ 0.002832] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)222lb # [ 0.002938] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)223client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns224worker2 # [ 0.002836] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)225client # [ 0.000005] tsc: Detected 2400.012 MHz processor226lb # [ 0.002943] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)227client # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000228worker2 # [ 0.002843] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)229lb # [ 0.002951] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)230worker2 # [ 0.002845] ACPI: FACS 0x000000005FFE0000 000040231client # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs232lb # [ 0.002953] ACPI: FACS 0x000000005FFE0000 000040233worker2 # [ 0.002846] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)234client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT235lb # [ 0.002955] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)236client # [ 0.002729] found SMP MP-table at [mem 0x000f5450-0x000f545f]237worker2 # [ 0.002848] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)238client # [ 0.002741] Using GB pages for direct mapping239lb # [ 0.002956] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)240client # [ 0.002895] RAMDISK: [mem 0x5e366000-0x5ffcffff]241worker2 # [ 0.002849] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)242lb # [ 0.002958] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)243client # [ 0.002903] ACPI: Early table checksum verification disabled244worker2 # [ 0.002851] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)245client # [ 0.002907] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )246lb # [ 0.002959] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)247worker2 # [ 0.002852] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]248lb # [ 0.002961] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]249client # [ 0.002910] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)250worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026251worker2 # [ 0.002853] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]252lb # [ 0.002962] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]253client # [ 0.002915] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)254worker2 # [ 0.002854] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]255lb # [ 0.002963] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]256worker2 # [ 0.002854] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]257client # [ 0.002922] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)258lb # [ 0.002963] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]259client # [ 0.002924] ACPI: FACS 0x000000005FFE0000 000040260worker2 # [ 0.002855] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]261lb # [ 0.002963] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]262client # [ 0.002926] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)263worker2 # [ 0.002855] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]264worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9vpb52xhb70b1gg4gv26lpf9869r95q7-nixos-system-worker1-test/init regInfo=/nix/store/az75mwmf4lqycv6f4hmfwc0nayrgxhwf-closure-info/registration console=ttyS0,115200n8 console=tty0265worker1 # [ 0.000000] BIOS-provided physical RAM map:266lb # [ 0.002964] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]267worker2 # [ 0.002856] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]268client # [ 0.002927] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)269worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable270worker2 # [ 0.003083] No NUMA configuration found271lb # [ 0.002964] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]272lb # [ 0.003191] No NUMA configuration found273worker2 # [ 0.003084] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]274client # [ 0.002929] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)275worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved276worker2 # [ 0.003086] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]277lb # [ 0.003192] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]278worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved279worker2 # [ 0.005256] Zone ranges:280client # [ 0.002930] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)281lb # [ 0.003195] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]282lb # [ 0.005233] Zone ranges:283worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable284worker2 # [ 0.005256] DMA [mem 0x0000000000001000-0x0000000000ffffff]285client # [ 0.002931] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]286lb # [ 0.005234] DMA [mem 0x0000000000001000-0x0000000000ffffff]287worker2 # [ 0.005258] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]288worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved289client # [ 0.002932] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]290worker2 # [ 0.005259] Normal empty291lb # [ 0.005236] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]292worker2 # [ 0.005260] Device empty293worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved294lb # [ 0.005237] Normal empty295client # [ 0.002933] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]296worker2 # [ 0.005260] Movable zone start for each node297lb # [ 0.005237] Device empty298worker2 # [ 0.005261] Early memory node ranges299worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved300lb # [ 0.005238] Movable zone start for each node301client # [ 0.002933] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]302lb # [ 0.005239] Early memory node ranges303worker2 # [ 0.005261] node 0: [mem 0x0000000000001000-0x000000000009efff]304worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved305client # [ 0.002934] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]306lb # [ 0.005239] node 0: [mem 0x0000000000001000-0x000000000009efff]307worker2 # [ 0.005262] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]308worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved309client # [ 0.002934] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]310lb # [ 0.005240] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]311worker2 # [ 0.005263] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]312worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved313client # [ 0.002935] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]314lb # [ 0.005241] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]315worker2 # [ 0.005283] On node 0, zone DMA: 1 pages in unavailable ranges316worker1 # [ 0.000000] NX (Execute Disable) protection: active317client # [ 0.003158] No NUMA configuration found318lb # [ 0.005261] On node 0, zone DMA: 1 pages in unavailable ranges319worker1 # [ 0.000000] APIC: Static calls initialized320worker2 # [ 0.005533] On node 0, zone DMA: 97 pages in unavailable ranges321client # [ 0.003158] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]322worker1 # [ 0.000000] SMBIOS 2.8 present.323lb # [ 0.005502] On node 0, zone DMA: 97 pages in unavailable ranges324worker2 # [ 0.033326] On node 0, zone DMA32: 40 pages in unavailable ranges325client # [ 0.003161] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]326worker2 # [ 0.033792] ACPI: PM-Timer IO Port: 0x608327client # [ 0.005238] Zone ranges:328lb # [ 0.030220] On node 0, zone DMA32: 40 pages in unavailable ranges329worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014330worker2 # [ 0.033803] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])331lb # [ 0.030685] ACPI: PM-Timer IO Port: 0x608332client # [ 0.005239] DMA [mem 0x0000000000001000-0x0000000000ffffff]333worker1 # [ 0.000000] DMI: Memory slots populated: 1/1334lb # [ 0.030699] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])335worker1 # [ 0.000000] Hypervisor detected: KVM336client # [ 0.005240] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]337worker2 # [ 0.033834] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23338client # [ 0.005241] Normal empty339worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000340lb # [ 0.030725] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23341worker2 # [ 0.033837] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)342client # [ 0.005242] Device empty343worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00344client # [ 0.005243] Movable zone start for each node345worker2 # [ 0.033838] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)346lb # [ 0.030728] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)347client # [ 0.005243] Early memory node ranges348worker1 # [ 0.000000] kvm-clock: using sched offset of 484299068 cycles349lb # [ 0.030730] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)350worker2 # [ 0.033840] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)351client # [ 0.005244] node 0: [mem 0x0000000000001000-0x000000000009efff]352lb # [ 0.030731] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)353worker2 # [ 0.033841] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)354worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns355client # [ 0.005245] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]356worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor357lb # [ 0.030732] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)358worker2 # [ 0.033842] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)359client # [ 0.005246] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]360worker1 # [ 0.000805] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000361worker2 # [ 0.033844] ACPI: Using ACPI (MADT) for SMP configuration information362lb # [ 0.030733] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)363client # [ 0.005264] On node 0, zone DMA: 1 pages in unavailable ranges364worker2 # [ 0.033846] ACPI: HPET id: 0x8086a201 base: 0xfed00000365worker1 # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs366lb # [ 0.030736] ACPI: Using ACPI (MADT) for SMP configuration information367client # [ 0.005511] On node 0, zone DMA: 97 pages in unavailable ranges368worker2 # [ 0.033849] TSC deadline timer available369worker1 # [ 0.000835] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT370lb # [ 0.030737] ACPI: HPET id: 0x8086a201 base: 0xfed00000371worker2 # [ 0.033853] CPU topo: Max. logical packages: 1372client # [ 0.030542] On node 0, zone DMA32: 40 pages in unavailable ranges373lb # [ 0.030742] TSC deadline timer available374client # [ 0.031005] ACPI: PM-Timer IO Port: 0x608375worker1 # [ 0.002741] found SMP MP-table at [mem 0x000f5450-0x000f545f]376worker2 # [ 0.033854] CPU topo: Max. logical dies: 1377lb # [ 0.030746] CPU topo: Max. logical packages: 1378worker1 # [ 0.002754] Using GB pages for direct mapping379worker2 # [ 0.033854] CPU topo: Max. dies per package: 1380client # [ 0.031019] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])381lb # [ 0.030747] CPU topo: Max. logical dies: 1382worker2 # [ 0.033858] CPU topo: Max. threads per core: 1383worker1 # [ 0.002835] RAMDISK: [mem 0x5e367000-0x5ffcffff]384lb # [ 0.030747] CPU topo: Max. dies per package: 1385client # [ 0.031044] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23386worker2 # [ 0.033858] CPU topo: Num. cores per package: 1387worker1 # [ 0.002843] ACPI: Early table checksum verification disabled388lb # [ 0.030751] CPU topo: Max. threads per core: 1389worker2 # [ 0.033859] CPU topo: Num. threads per package: 1390client # [ 0.031047] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)391worker1 # [ 0.002847] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )392lb # [ 0.030752] CPU topo: Num. cores per package: 1393worker2 # [ 0.033859] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs394lb # [ 0.030752] CPU topo: Num. threads per package: 1395client # [ 0.031049] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)396worker1 # [ 0.002851] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)397worker2 # [ 0.033877] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()398lb # [ 0.030753] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs399client # [ 0.031050] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)400worker1 # [ 0.002856] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)401client # [ 0.031052] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)402lb # [ 0.030775] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()403worker2 # [ 0.033909] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]404client # [ 0.031052] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)405worker1 # [ 0.002867] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)406worker2 # [ 0.033910] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]407lb # [ 0.030817] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]408worker1 # [ 0.002869] ACPI: FACS 0x000000005FFE0000 000040409client # [ 0.031055] ACPI: Using ACPI (MADT) for SMP configuration information410worker2 # [ 0.033911] [mem 0x60000000-0xafffffff] available for PCI devices411lb # [ 0.030819] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]412client # [ 0.031056] ACPI: HPET id: 0x8086a201 base: 0xfed00000413worker2 # [ 0.033913] Booting paravirtualized kernel on KVM414worker1 # [ 0.002871] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)415lb # [ 0.030821] [mem 0x60000000-0xafffffff] available for PCI devices416client # [ 0.031061] TSC deadline timer available417lb # [ 0.030822] Booting paravirtualized kernel on KVM418client # [ 0.031065] CPU topo: Max. logical packages: 1419worker2 # [ 0.033916] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns420worker1 # [ 0.002872] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)421client # [ 0.031066] CPU topo: Max. logical dies: 1422client # [ 0.031067] CPU topo: Max. dies per package: 1423worker2 # [ 0.038354] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1424lb # [ 0.030826] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns425worker1 # [ 0.002874] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)426client # [ 0.031070] CPU topo: Max. threads per core: 1427worker2 # [ 0.041223] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152428lb # [ 0.035266] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1429client # [ 0.031071] CPU topo: Num. cores per package: 1430worker1 # [ 0.002875] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)431worker2 # [ 0.041270] kvm-guest: PV spinlocks disabled, single CPU432client # [ 0.031071] CPU topo: Num. threads per package: 1433lb # [ 0.037548] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152434worker1 # [ 0.002877] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]435client # [ 0.031071] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs436lb # [ 0.037591] kvm-guest: PV spinlocks disabled, single CPU437worker1 # [ 0.002878] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]438client # [ 0.031095] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()439worker1 # [ 0.002878] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]440client # [ 0.031130] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]441worker1 # [ 0.002879] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]442client # [ 0.031131] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]443worker2 # [ 0.041271] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/g6bjvn1fpihxjl3rkk64li3qwyfil5lr-nixos-system-worker2-test/init regInfo=/nix/store/mddi5sa1bwc5cd417i20xm8sk5njknhg-closure-info/registration console=ttyS0,115200n8 console=tty0444worker1 # [ 0.002879] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]445client # [ 0.031133] [mem 0x60000000-0xafffffff] available for PCI devices446lb # [ 0.037593] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0447worker1 # [ 0.002880] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]448client # [ 0.031134] Booting paravirtualized kernel on KVM449worker2 # [ 0.041363] Unknown kernel command line parameters "regInfo=/nix/store/mddi5sa1bwc5cd417i20xm8sk5njknhg-closure-info/registration", will be passed to user space.450worker1 # [ 0.002880] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]451worker2 # [ 0.041375] random: crng init done452worker1 # [ 0.003103] No NUMA configuration found453client # [ 0.031138] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns454lb # [ 0.037687] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.455worker2 # [ 0.041376] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes456lb # [ 0.037701] random: crng init done457worker1 # [ 0.003104] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]458client # [ 0.035600] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1459worker1 # [ 0.003107] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]460worker2 # [ 0.043653] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)461lb # [ 0.037701] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes462client # [ 0.037735] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152463worker1 # [ 0.005153] Zone ranges:464worker2 # [ 0.044793] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)465client # [ 0.037783] kvm-guest: PV spinlocks disabled, single CPU466lb # [ 0.039778] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)467worker1 # [ 0.005153] DMA [mem 0x0000000000001000-0x0000000000ffffff]468worker2 # [ 0.044823] Fallback order for Node 0: 0469worker1 # [ 0.005155] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]470lb # [ 0.040769] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)471worker1 # [ 0.005156] Normal empty472worker2 # [ 0.044825] Built 1 zonelists, mobility grouping on. Total pages: 393078473worker1 # [ 0.005157] Device empty474worker2 # [ 0.044826] Policy zone: DMA32475lb # [ 0.040807] Fallback order for Node 0: 0476worker1 # [ 0.005157] Movable zone start for each node477worker2 # [ 0.047481] mem auto-init: stack:all(zero), heap alloc:on, heap free:off478worker1 # [ 0.005158] Early memory node ranges479lb # [ 0.040810] Built 1 zonelists, mobility grouping on. Total pages: 393078480lb # [ 0.040812] Policy zone: DMA32481worker2 # [ 0.050944] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1482worker1 # [ 0.005159] node 0: [mem 0x0000000000001000-0x000000000009efff]483worker2 # [ 0.054526] allocated 3145728 bytes of page_ext484lb # [ 0.043137] mem auto-init: stack:all(zero), heap alloc:on, heap free:off485client # [ 0.037785] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test/init regInfo=/nix/store/941m2hwqpcjqiysnxdfsqwdw595s87vk-closure-info/registration console=ttyS0,115200n8 console=tty0486worker1 # [ 0.005160] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]487worker2 # [ 0.064437] ftrace: allocating 48731 entries in 192 pages488lb # [ 0.046276] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1489worker1 # [ 0.005161] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]490worker2 # [ 0.064439] ftrace: allocated 192 pages with 2 groups491lb # [ 0.049349] allocated 3145728 bytes of page_ext492worker2 # [ 0.065255] Dynamic Preempt: lazy493worker1 # [ 0.005179] On node 0, zone DMA: 1 pages in unavailable ranges494lb # [ 0.059585] ftrace: allocating 48731 entries in 192 pages495client # [ 0.037880] Unknown kernel command line parameters "regInfo=/nix/store/941m2hwqpcjqiysnxdfsqwdw595s87vk-closure-info/registration", will be passed to user space.496client # [ 0.037893] random: crng init done497worker2 # [ 0.065384] rcu: Preemptible hierarchical RCU implementation.498lb # [ 0.059588] ftrace: allocated 192 pages with 2 groups499worker1 # [ 0.005423] On node 0, zone DMA: 97 pages in unavailable ranges500worker2 # [ 0.065384] rcu: RCU event tracing is enabled.501lb # [ 0.060439] Dynamic Preempt: lazy502client # [ 0.037894] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes503worker1 # [ 0.032279] On node 0, zone DMA32: 40 pages in unavailable ranges504lb # [ 0.060576] rcu: Preemptible hierarchical RCU implementation.505worker2 # [ 0.065385] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.506worker1 # [ 0.032739] ACPI: PM-Timer IO Port: 0x608507client # [ 0.039889] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)508worker2 # [ 0.065386] Trampoline variant of Tasks RCU enabled.509lb # [ 0.060577] rcu: RCU event tracing is enabled.510worker1 # [ 0.032753] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])511worker2 # [ 0.065387] Rude variant of Tasks RCU enabled.512client # [ 0.040889] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)513lb # [ 0.060577] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.514worker1 # [ 0.032779] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23515worker2 # [ 0.065387] Tracing variant of Tasks RCU enabled.516client # [ 0.040922] Fallback order for Node 0: 0517lb # [ 0.060579] Trampoline variant of Tasks RCU enabled.518worker1 # [ 0.032782] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)519lb # [ 0.060579] Rude variant of Tasks RCU enabled.520worker2 # [ 0.065388] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.521client # [ 0.040926] Built 1 zonelists, mobility grouping on. Total pages: 393078522lb # [ 0.060579] Tracing variant of Tasks RCU enabled.523client # [ 0.040927] Policy zone: DMA32524worker1 # [ 0.032784] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)525worker2 # [ 0.065389] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1526client # [ 0.043274] mem auto-init: stack:all(zero), heap alloc:on, heap free:off527lb # [ 0.060580] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.528worker1 # [ 0.032785] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)529worker2 # [ 0.065439] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.530client # [ 0.046324] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1531worker1 # [ 0.032786] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)532lb # [ 0.060581] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1533client # [ 0.049557] allocated 3145728 bytes of page_ext534worker2 # [ 0.065441] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.535worker1 # [ 0.032787] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)536lb # [ 0.060596] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.537client # [ 0.059369] ftrace: allocating 48731 entries in 192 pages538worker1 # [ 0.032789] ACPI: Using ACPI (MADT) for SMP configuration information539client # [ 0.059371] ftrace: allocated 192 pages with 2 groups540worker2 # [ 0.065441] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.541client # [ 0.060179] Dynamic Preempt: lazy542lb # [ 0.060597] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.543worker1 # [ 0.032790] ACPI: HPET id: 0x8086a201 base: 0xfed00000544worker2 # [ 0.069790] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16545worker1 # [ 0.032795] TSC deadline timer available546client # [ 0.060330] rcu: Preemptible hierarchical RCU implementation.547worker1 # [ 0.032799] CPU topo: Max. logical packages: 1548worker2 # [ 0.070083] rcu: srcu_init: Setting srcu_struct sizes based on contention.549client # [ 0.060330] rcu: RCU event tracing is enabled.550lb # [ 0.060598] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.551worker1 # [ 0.032800] CPU topo: Max. logical dies: 1552lb # [ 0.064979] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16553client # [ 0.060331] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.554worker1 # [ 0.032801] CPU topo: Max. dies per package: 1555worker2 # [ 0.070092] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns556client # [ 0.060332] Trampoline variant of Tasks RCU enabled.557worker1 # [ 0.032804] CPU topo: Max. threads per core: 1558lb # [ 0.065261] rcu: srcu_init: Setting srcu_struct sizes based on contention.559client # [ 0.060333] Rude variant of Tasks RCU enabled.560worker1 # [ 0.032805] CPU topo: Num. cores per package: 1561worker2 # [ 0.070202] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)562client # [ 0.060333] Tracing variant of Tasks RCU enabled.563lb # [ 0.065267] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns564worker2 # [ 0.073712] Console: colour VGA+ 80x25565worker1 # [ 0.032805] CPU topo: Num. threads per package: 1566worker2 # [ 0.073715] printk: legacy console [tty0] enabled567worker1 # [ 0.032806] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs568client # [ 0.060334] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.569worker2 # [ 0.102901] printk: legacy console [ttyS0] enabled570lb # [ 0.065373] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)571client # [ 0.060334] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1572lb # [ 0.068905] Console: colour VGA+ 80x25573worker1 # [ 0.032829] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()574worker2 # [ 0.196856] ACPI: Core revision 20250807575lb # [ 0.068908] printk: legacy console [tty0] enabled576worker1 # [ 0.032871] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]577client # [ 0.060354] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.578lb # [ 0.099652] printk: legacy console [ttyS0] enabled579worker1 # [ 0.032872] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]580lb # [ 0.195707] ACPI: Core revision 20250807581worker2 # [ 0.197681] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns582client # [ 0.060356] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.583worker1 # [ 0.032874] [mem 0x60000000-0xafffffff] available for PCI devices584worker2 # [ 0.199134] APIC: Switch to symmetric I/O mode setup585worker1 # [ 0.032876] Booting paravirtualized kernel on KVM586client # [ 0.060357] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.587worker2 # [ 0.200077] x2apic enabled588lb # [ 0.196563] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns589client # [ 0.064646] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16590worker1 # [ 0.032879] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns591lb # [ 0.198053] APIC: Switch to symmetric I/O mode setup592worker2 # [ 0.200799] APIC: Switched APIC routing to: physical x2apic593client # [ 0.064914] rcu: srcu_init: Setting srcu_struct sizes based on contention.594lb # [ 0.198983] x2apic enabled595worker1 # [ 0.037309] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1596worker1 # [ 0.039315] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152597client # [ 0.064919] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns598lb # [ 0.199715] APIC: Switched APIC routing to: physical x2apic599worker2 # [ 0.202540] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1600worker1 # [ 0.039355] kvm-guest: PV spinlocks disabled, single CPU601client # [ 0.065020] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)602client # [ 0.068547] Console: colour VGA+ 80x25603worker2 # [ 0.203469] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns604client # [ 0.068550] printk: legacy console [tty0] enabled605lb # [ 0.201552] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1606client # [ 0.098016] printk: legacy console [ttyS0] enabled607worker2 # [ 0.205054] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)608client # [ 0.193713] ACPI: Core revision 20250807609lb # [ 0.202507] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns610worker1 # [ 0.039356] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9vpb52xhb70b1gg4gv26lpf9869r95q7-nixos-system-worker1-test/init regInfo=/nix/store/az75mwmf4lqycv6f4hmfwc0nayrgxhwf-closure-info/registration console=ttyS0,115200n8 console=tty0611worker2 # [ 0.207140] x86/cpu: User Mode Instruction Prevention (UMIP) activated612client # [ 0.194534] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns613lb # [ 0.204140] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)614worker2 # [ 0.208189] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127615client # [ 0.196006] APIC: Switch to symmetric I/O mode setup616worker1 # [ 0.039454] Unknown kernel command line parameters "regInfo=/nix/store/az75mwmf4lqycv6f4hmfwc0nayrgxhwf-closure-info/registration", will be passed to user space.617lb # [ 0.205222] x86/cpu: User Mode Instruction Prevention (UMIP) activated618worker1 # [ 0.039468] random: crng init done619worker2 # [ 0.209052] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0620client # [ 0.196969] x2apic enabled621worker1 # [ 0.039469] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes622lb # [ 0.206252] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127623client # [ 0.197704] APIC: Switched APIC routing to: physical x2apic624worker2 # [ 0.210056] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto625worker1 # [ 0.041440] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)626lb # [ 0.207137] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0627worker1 # [ 0.042554] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)628worker2 # [ 0.211052] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl629client # [ 0.199490] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1630worker1 # [ 0.042588] Fallback order for Node 0: 0631lb # [ 0.208140] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto632worker2 # [ 0.213052] Transient Scheduler Attacks: Vulnerable: No microcode633worker1 # [ 0.042591] Built 1 zonelists, mobility grouping on. Total pages: 393078634worker1 # [ 0.042592] Policy zone: DMA32635worker2 # [ 0.214052] Spectre V2 : Mitigation: Enhanced / Automatic IBRS636client # [ 0.200441] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns637lb # [ 0.209137] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl638worker1 # [ 0.044917] mem auto-init: stack:all(zero), heap alloc:on, heap free:off639worker2 # [ 0.215052] Speculative Return Stack Overflow: Mitigation: Safe RET640worker1 # [ 0.048020] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1641lb # [ 0.210137] Transient Scheduler Attacks: Vulnerable: No microcode642client # [ 0.202059] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)643worker1 # [ 0.051088] allocated 3145728 bytes of page_ext644lb # [ 0.211136] Spectre V2 : Mitigation: Enhanced / Automatic IBRS645worker1 # [ 0.060955] ftrace: allocating 48731 entries in 192 pages646client # [ 0.203147] x86/cpu: User Mode Instruction Prevention (UMIP) activated647worker1 # [ 0.060957] ftrace: allocated 192 pages with 2 groups648lb # [ 0.212137] Speculative Return Stack Overflow: Mitigation: Safe RET649worker1 # [ 0.061759] Dynamic Preempt: lazy650client # [ 0.204187] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127651worker1 # [ 0.061913] rcu: Preemptible hierarchical RCU implementation.652worker1 # [ 0.061914] rcu: RCU event tracing is enabled.653client # [ 0.205057] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0654worker2 # [ 0.215973] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization655worker1 # [ 0.061914] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.656worker2 # [ 0.217058] Spectre V2 : Enabling IBPB for BPF657worker1 # [ 0.061916] Trampoline variant of Tasks RCU enabled.658client # [ 0.206059] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto659worker1 # [ 0.061916] Rude variant of Tasks RCU enabled.660worker2 # [ 0.218053] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier661worker1 # [ 0.061916] Tracing variant of Tasks RCU enabled.662lb # [ 0.213136] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization663client # [ 0.207056] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl664worker2 # [ 0.219052] active return thunk: srso_alias_return_thunk665lb # [ 0.215143] Spectre V2 : Enabling IBPB for BPF666worker1 # [ 0.061917] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.667client # [ 0.208057] Transient Scheduler Attacks: Vulnerable: No microcode668worker1 # [ 0.061918] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1669worker2 # [ 0.220072] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'670lb # [ 0.216137] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier671client # [ 0.209056] Spectre V2 : Mitigation: Enhanced / Automatic IBRS672worker1 # [ 0.061932] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.673worker2 # [ 0.221052] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'674lb # [ 0.217137] active return thunk: srso_alias_return_thunk675client # [ 0.210056] Speculative Return Stack Overflow: Mitigation: Safe RET676worker1 # [ 0.061933] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.677worker2 # [ 0.222760] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'678lb # [ 0.218157] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'679worker2 # [ 0.223052] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'680worker1 # [ 0.061934] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.681lb # [ 0.219137] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'682worker1 # [ 0.066354] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16683worker2 # [ 0.224052] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'684lb # [ 0.220137] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'685worker1 # [ 0.066613] rcu: srcu_init: Setting srcu_struct sizes based on contention.686worker2 # [ 0.225052] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'687lb # [ 0.221136] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'688client # [ 0.211056] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization689worker1 # [ 0.066619] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns690worker2 # [ 0.226052] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'691client # [ 0.213063] Spectre V2 : Enabling IBPB for BPF692lb # [ 0.222136] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'693worker1 # [ 0.066724] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)694worker2 # [ 0.227052] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256695worker1 # [ 0.070291] Console: colour VGA+ 80x25696lb # [ 0.223136] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'697client # [ 0.213764] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier698worker1 # [ 0.070294] printk: legacy console [tty0] enabled699worker2 # [ 0.228750] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64700worker1 # [ 0.099524] printk: legacy console [ttyS0] enabled701client # [ 0.215057] active return thunk: srso_alias_return_thunk702lb # [ 0.224136] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'703worker2 # [ 0.229052] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512704worker1 # [ 0.194511] ACPI: Core revision 20250807705lb # [ 0.225137] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256706client # [ 0.216077] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'707worker2 # [ 0.230052] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024708lb # [ 0.226136] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64709client # [ 0.217056] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'710worker1 # [ 0.195342] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns711worker2 # [ 0.231052] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8712worker1 # [ 0.196825] APIC: Switch to symmetric I/O mode setup713lb # [ 0.227136] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512714client # [ 0.218056] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'715worker1 # [ 0.197787] x2apic enabled716worker2 # [ 0.232052] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.717lb # [ 0.228136] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024718client # [ 0.219056] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'719worker1 # [ 0.198514] APIC: Switched APIC routing to: physical x2apic720lb # [ 0.229136] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8721client # [ 0.220056] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'722client # [ 0.221056] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'723lb # [ 0.230136] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.724worker1 # [ 0.200315] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1725client # [ 0.222056] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'726worker1 # [ 0.201282] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns727client # [ 0.223056] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256728client # [ 0.224056] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64729worker1 # [ 0.202965] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)730client # [ 0.225056] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512731worker1 # [ 0.204048] x86/cpu: User Mode Instruction Prevention (UMIP) activated732client # [ 0.226056] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024733worker1 # [ 0.205074] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127734client # [ 0.227056] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8735worker1 # [ 0.205963] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0736client # [ 0.228056] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.737worker1 # [ 0.206967] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto738worker1 # [ 0.207963] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl739worker1 # [ 0.208963] Transient Scheduler Attacks: Vulnerable: No microcode740worker1 # [ 0.209963] Spectre V2 : Mitigation: Enhanced / Automatic IBRS741worker1 # [ 0.210963] Speculative Return Stack Overflow: Mitigation: Safe RET742worker1 # [ 0.211963] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization743worker1 # [ 0.213970] Spectre V2 : Enabling IBPB for BPF744worker1 # [ 0.214682] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier745worker1 # [ 0.215963] active return thunk: srso_alias_return_thunk746worker1 # [ 0.216984] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747worker1 # [ 0.217963] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748worker1 # [ 0.218963] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749worker1 # [ 0.219963] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750worker1 # [ 0.220963] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751worker1 # [ 0.221963] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752worker1 # [ 0.222963] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753worker1 # [ 0.223963] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256754worker1 # [ 0.224963] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755worker1 # [ 0.225963] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756worker1 # [ 0.226963] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757worker2 # [ 0.266636] Freeing SMP alternatives memory: 44K758worker1 # [ 0.227963] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8759worker2 # [ 0.267055] pid_max: default: 32768 minimum: 301760worker2 # [ 0.268172] LSM: initializing lsm=capability,landlock,yama,bpf,ima761worker1 # [ 0.228963] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.762worker2 # [ 0.269164] landlock: Up and running.763lb # [ 0.264218] Freeing SMP alternatives memory: 44K764worker2 # [ 0.269767] Yama: becoming mindful.765lb # [ 0.265004] pid_max: default: 32768 minimum: 301766worker2 # [ 0.270672] LSM support for eBPF active767lb # [ 0.265794] LSM: initializing lsm=capability,landlock,yama,bpf,ima768worker2 # [ 0.271161] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)769lb # [ 0.266247] landlock: Up and running.770lb # [ 0.267603] Yama: becoming mindful.771worker2 # [ 0.272089] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)772lb # [ 0.268353] LSM support for eBPF active773lb # [ 0.269235] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)774worker2 # [ 0.274934] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)775lb # [ 0.270170] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)776client # [ 0.261930] Freeing SMP alternatives memory: 44K777worker2 # [ 0.275592] Performance Events: Fam17h+ core perfctr, AMD PMU driver.778client # [ 0.262595] pid_max: default: 32768 minimum: 301779worker2 # [ 0.276057] ... version: 2780worker2 # [ 0.276773] ... bit width: 48781client # [ 0.263150] LSM: initializing lsm=capability,landlock,yama,bpf,ima782worker2 # [ 0.277055] ... generic counters: 6783lb # [ 0.272872] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)784client # [ 0.264160] landlock: Up and running.785client # [ 0.265057] Yama: becoming mindful.786worker2 # [ 0.277755] ... generic bitmap: 000000000000003f787worker2 # [ 0.278067] ... fixed-purpose counters: 0788client # [ 0.266083] LSM support for eBPF active789lb # [ 0.273655] Performance Events: Fam17h+ core perfctr, AMD PMU driver.790lb # [ 0.274142] ... version: 2791worker2 # [ 0.278743] ... fixed-purpose bitmap: 0000000000000000792client # [ 0.266811] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)793lb # [ 0.274805] ... bit width: 48794worker2 # [ 0.279054] ... value mask: 0000ffffffffffff795lb # [ 0.275139] ... generic counters: 6796worker2 # [ 0.279919] ... max period: 00007fffffffffff797client # [ 0.267955] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)798lb # [ 0.275853] ... generic bitmap: 000000000000003f799worker2 # [ 0.280711] ... global_ctrl mask: 000000000000003f800lb # [ 0.276181] ... fixed-purpose counters: 0801worker2 # [ 0.281190] signal: max sigframe size: 3376802lb # [ 0.276885] ... fixed-purpose bitmap: 0000000000000000803worker2 # [ 0.281957] rcu: Hierarchical SRCU implementation.804client # [ 0.270334] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)805lb # [ 0.277139] ... value mask: 0000ffffffffffff806worker2 # [ 0.282607] rcu: Max phase no-delay instances is 400.807lb # [ 0.278032] ... max period: 00007fffffffffff808client # [ 0.271575] Performance Events: Fam17h+ core perfctr, AMD PMU driver.809lb # [ 0.278857] ... global_ctrl mask: 000000000000003f810client # [ 0.272065] ... version: 2811client # [ 0.272814] ... bit width: 48812lb # [ 0.279252] signal: max sigframe size: 3376813client # [ 0.273058] ... generic counters: 6814lb # [ 0.280088] rcu: Hierarchical SRCU implementation.815client # [ 0.273790] ... generic bitmap: 000000000000003f816lb # [ 0.280784] rcu: Max phase no-delay instances is 400.817client # [ 0.274058] ... fixed-purpose counters: 0818worker2 # [ 0.287645] smp: Bringing up secondary CPUs ...819client # [ 0.274793] ... fixed-purpose bitmap: 0000000000000000820worker2 # [ 0.288072] smp: Brought up 1 node, 1 CPU821client # [ 0.275058] ... value mask: 0000ffffffffffff822worker2 # [ 0.288733] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)823client # [ 0.275976] ... max period: 00007fffffffffff824client # [ 0.276750] ... global_ctrl mask: 000000000000003f825client # [ 0.277164] signal: max sigframe size: 3376826worker2 # [ 0.289282] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)827lb # [ 0.285587] smp: Bringing up secondary CPUs ...828client # [ 0.277915] rcu: Hierarchical SRCU implementation.829lb # [ 0.286154] smp: Brought up 1 node, 1 CPU830worker2 # [ 0.290352] devtmpfs: initialized831client # [ 0.278674] rcu: Max phase no-delay instances is 400.832worker2 # [ 0.291138] x86/mm: Memory block size: 128MB833lb # [ 0.286854] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)834worker2 # [ 0.292895] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)835lb # [ 0.287297] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)836lb # [ 0.288372] devtmpfs: initialized837worker2 # [ 0.293942] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).838worker1 # [ 0.263666] Freeing SMP alternatives memory: 44K839lb # [ 0.289188] x86/mm: Memory block size: 128MB840worker2 # [ 0.295155] pinctrl core: initialized pinctrl subsystem841worker1 # [ 0.263966] pid_max: default: 32768 minimum: 301842client # [ 0.283552] smp: Bringing up secondary CPUs ...843client # [ 0.284073] smp: Brought up 1 node, 1 CPU844worker2 # [ 0.296311] PM: RTC time: 09:04:41, date: 2026-09-20845worker1 # [ 0.265043] LSM: initializing lsm=capability,landlock,yama,bpf,ima846lb # [ 0.291030] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)847worker1 # [ 0.266071] landlock: Up and running.848client # [ 0.284745] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)849worker1 # [ 0.266964] Yama: becoming mindful.850worker1 # [ 0.267761] LSM support for eBPF active851lb # [ 0.292049] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).852client # [ 0.285210] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)853lb # [ 0.293231] pinctrl core: initialized pinctrl subsystem854worker1 # [ 0.268515] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)855worker2 # [ 0.300153] NET: Registered PF_NETLINK/PF_ROUTE protocol family856client # [ 0.286315] devtmpfs: initialized857lb # [ 0.294355] PM: RTC time: 09:04:41, date: 2026-09-20858worker1 # [ 0.269000] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)859client # [ 0.287117] x86/mm: Memory block size: 128MB860worker2 # [ 0.301583] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations861worker2 # [ 0.302076] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations862client # [ 0.288830] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)863worker1 # [ 0.272026] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)864lb # [ 0.297855] NET: Registered PF_NETLINK/PF_ROUTE protocol family865worker2 # [ 0.303331] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations866client # [ 0.289955] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).867worker1 # [ 0.273480] Performance Events: Fam17h+ core perfctr, AMD PMU driver.868worker2 # [ 0.304068] audit: initializing netlink subsys (disabled)869lb # [ 0.298620] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations870client # [ 0.291141] pinctrl core: initialized pinctrl subsystem871worker1 # [ 0.273972] ... version: 2872worker1 # [ 0.274636] ... bit width: 48873worker2 # [ 0.305211] thermal_sys: Registered thermal governor 'fair_share'874client # [ 0.292240] PM: RTC time: 09:04:41, date: 2026-09-20875lb # [ 0.299157] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations876worker1 # [ 0.274965] ... generic counters: 6877worker2 # [ 0.305214] thermal_sys: Registered thermal governor 'bang_bang'878worker1 # [ 0.275673] ... generic bitmap: 000000000000003f879lb # [ 0.300399] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations880worker2 # [ 0.306055] thermal_sys: Registered thermal governor 'step_wise'881worker1 # [ 0.275969] ... fixed-purpose counters: 0882lb # [ 0.301149] audit: initializing netlink subsys (disabled)883worker2 # [ 0.306984] thermal_sys: Registered thermal governor 'user_space'884worker1 # [ 0.276638] ... fixed-purpose bitmap: 0000000000000000885client # [ 0.295713] NET: Registered PF_NETLINK/PF_ROUTE protocol family886worker1 # [ 0.276965] ... value mask: 0000ffffffffffff887worker2 # [ 0.307749] audit: type=2000 audit(1789895081.684:1): state=initialized audit_enabled=0 res=1888lb # [ 0.302141] audit: type=2000 audit(1789895081.679:1): state=initialized audit_enabled=0 res=1889worker1 # [ 0.277823] ... max period: 00007fffffffffff890worker2 # [ 0.309057] thermal_sys: Registered thermal governor 'power_allocator'891lb # [ 0.303258] thermal_sys: Registered thermal governor 'fair_share'892client # [ 0.296524] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations893worker1 # [ 0.278661] ... global_ctrl mask: 000000000000003f894worker2 # [ 0.309074] cpuidle: using governor menu895lb # [ 0.303260] thermal_sys: Registered thermal governor 'bang_bang'896worker1 # [ 0.279073] signal: max sigframe size: 3376897client # [ 0.297077] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations898lb # [ 0.304140] thermal_sys: Registered thermal governor 'step_wise'899worker1 # [ 0.279847] rcu: Hierarchical SRCU implementation.900worker2 # [ 0.311275] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5901worker1 # [ 0.280515] rcu: Max phase no-delay instances is 400.902client # [ 0.298316] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations903lb # [ 0.305100] thermal_sys: Registered thermal governor 'user_space'904client # [ 0.299068] audit: initializing netlink subsys (disabled)905worker2 # [ 0.312303] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]906lb # [ 0.305907] thermal_sys: Registered thermal governor 'power_allocator'907lb # [ 0.306161] cpuidle: using governor menu908worker2 # [ 0.313058] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry909client # [ 0.300172] thermal_sys: Registered thermal governor 'fair_share'910worker2 # [ 0.314067] PCI: Using configuration type 1 for base access911client # [ 0.300174] thermal_sys: Registered thermal governor 'bang_bang'912lb # [ 0.308350] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5913client # [ 0.301059] thermal_sys: Registered thermal governor 'step_wise'914worker2 # [ 0.315155] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.915client # [ 0.301991] thermal_sys: Registered thermal governor 'user_space'916lb # [ 0.309392] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]917worker1 # [ 0.285418] smp: Bringing up secondary CPUs ...918worker1 # [ 0.285979] smp: Brought up 1 node, 1 CPU919lb # [ 0.310142] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry920client # [ 0.302801] audit: type=2000 audit(1789895081.689:1): state=initialized audit_enabled=0 res=1921worker1 # [ 0.286627] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)922lb # [ 0.311152] PCI: Using configuration type 1 for base access923client # [ 0.304061] thermal_sys: Registered thermal governor 'power_allocator'924client # [ 0.304075] cpuidle: using governor menu925lb # [ 0.312240] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.926worker1 # [ 0.287168] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)927client # [ 0.306246] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5928worker1 # [ 0.288234] devtmpfs: initialized929worker1 # [ 0.289004] x86/mm: Memory block size: 128MB930client # [ 0.307285] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]931worker2 # [ 0.322277] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages932client # [ 0.308061] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry933worker2 # [ 0.323056] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page934worker1 # [ 0.290683] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)935client # [ 0.309071] PCI: Using configuration type 1 for base access936worker1 # [ 0.291873] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).937client # [ 0.310169] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.938worker1 # [ 0.293046] pinctrl core: initialized pinctrl subsystem939lb # [ 0.319157] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages940worker1 # [ 0.294152] PM: RTC time: 09:04:41, date: 2026-09-20941lb # [ 0.320140] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page942worker2 # [ 0.328055] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages943worker2 # [ 0.329055] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page944client # [ 0.315149] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages945worker1 # [ 0.297553] NET: Registered PF_NETLINK/PF_ROUTE protocol family946client # [ 0.316060] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page947worker1 # [ 0.298435] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations948lb # [ 0.325140] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages949worker1 # [ 0.298983] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations950lb # [ 0.326140] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page951worker1 # [ 0.300215] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations952worker1 # [ 0.300975] audit: initializing netlink subsys (disabled)953client # [ 0.321060] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages954worker1 # [ 0.302109] thermal_sys: Registered thermal governor 'fair_share'955worker2 # [ 0.337680] ACPI: Added _OSI(Module Device)956client # [ 0.322059] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page957worker1 # [ 0.302111] thermal_sys: Registered thermal governor 'bang_bang'958worker2 # [ 0.338056] ACPI: Added _OSI(Processor Device)959worker1 # [ 0.302967] thermal_sys: Registered thermal governor 'step_wise'960worker2 # [ 0.338795] ACPI: Added _OSI(Processor Aggregator Device)961worker1 # [ 0.303889] thermal_sys: Registered thermal governor 'user_space'962worker1 # [ 0.304698] audit: type=2000 audit(1789895081.716:1): state=initialized audit_enabled=0 res=1963worker1 # [ 0.305969] thermal_sys: Registered thermal governor 'power_allocator'964worker1 # [ 0.305983] cpuidle: using governor menu965lb # [ 0.337373] ACPI: Added _OSI(Module Device)966worker1 # [ 0.308176] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5967lb # [ 0.338088] ACPI: Added _OSI(Processor Device)968lb # [ 0.338717] ACPI: Added _OSI(Processor Aggregator Device)969worker1 # [ 0.309180] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]970worker2 # [ 0.345578] ACPI: 1 ACPI AML tables successfully acquired and loaded971worker1 # [ 0.309969] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry972client # [ 0.332395] ACPI: Added _OSI(Module Device)973worker1 # [ 0.310978] PCI: Using configuration type 1 for base access974client # [ 0.333061] ACPI: Added _OSI(Processor Device)975client # [ 0.333804] ACPI: Added _OSI(Processor Aggregator Device)976worker1 # [ 0.312102] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.977worker2 # [ 0.348994] ACPI: Interpreter enabled978worker2 # [ 0.349546] ACPI: PM: (supports S0 S3 S4 S5)979worker2 # [ 0.350055] ACPI: Using IOAPIC for interrupt routing980lb # [ 0.344706] ACPI: 1 ACPI AML tables successfully acquired and loaded981worker2 # [ 0.350924] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug982worker1 # [ 0.317225] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages983worker1 # [ 0.317967] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page984lb # [ 0.348537] ACPI: Interpreter enabled985lb # [ 0.349154] ACPI: PM: (supports S0 S3 S4 S5)986lb # [ 0.349907] ACPI: Using IOAPIC for interrupt routing987client # [ 0.342225] ACPI: 1 ACPI AML tables successfully acquired and loaded988worker2 # [ 0.356055] PCI: Using E820 reservations for host bridge windows989worker2 # [ 0.357116] ACPI: Enabled 2 GPEs in block 00 to 3F990worker1 # [ 0.322966] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages991lb # [ 0.352201] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug992worker1 # [ 0.323965] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page993client # [ 0.346481] ACPI: Interpreter enabled994lb # [ 0.353140] PCI: Using E820 reservations for host bridge windows995client # [ 0.347074] ACPI: PM: (supports S0 S3 S4 S5)996client # [ 0.347821] ACPI: Using IOAPIC for interrupt routing997lb # [ 0.356255] ACPI: Enabled 2 GPEs in block 00 to 3F998client # [ 0.350104] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug999worker2 # [ 0.365749] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1000client # [ 0.351059] PCI: Using E820 reservations for host bridge windows1001worker2 # [ 0.366496] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1002worker2 # [ 0.367133] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1003client # [ 0.354171] ACPI: Enabled 2 GPEs in block 00 to 3F1004worker1 # [ 0.334302] ACPI: Added _OSI(Module Device)1005worker2 # [ 0.368176] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1006worker1 # [ 0.334967] ACPI: Added _OSI(Processor Device)1007lb # [ 0.363579] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1008worker2 # [ 0.369407] PCI host bridge to bus 0000:001009worker1 # [ 0.335705] ACPI: Added _OSI(Processor Aggregator Device)1010worker2 # [ 0.370059] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1011lb # [ 0.364146] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1012worker2 # [ 0.371055] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1013lb # [ 0.365217] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1014worker2 # [ 0.372054] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1015lb # [ 0.366261] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1016worker2 # [ 0.373054] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1017lb # [ 0.367477] PCI host bridge to bus 0000:001018worker2 # [ 0.374054] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1019client # [ 0.361550] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1020lb # [ 0.368143] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1021worker2 # [ 0.375054] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1022lb # [ 0.369140] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1023client # [ 0.362065] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1024worker2 # [ 0.376055] pci_bus 0000:00: root bus resource [bus 00-ff]1025lb # [ 0.370140] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1026client # [ 0.363137] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1027worker2 # [ 0.376968] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1028lb # [ 0.371139] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1029client # [ 0.364181] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1030worker1 # [ 0.344474] ACPI: 1 ACPI AML tables successfully acquired and loaded1031client # [ 0.365403] PCI host bridge to bus 0000:001032worker2 # [ 0.378447] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1033lb # [ 0.372139] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1034client # [ 0.366063] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1035lb # [ 0.373139] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1036client # [ 0.367059] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1037lb # [ 0.374140] pci_bus 0000:00: root bus resource [bus 00-ff]1038worker1 # [ 0.348384] ACPI: Interpreter enabled1039client # [ 0.368059] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1040lb # [ 0.375130] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1041worker1 # [ 0.348982] ACPI: PM: (supports S0 S3 S4 S5)1042client # [ 0.369059] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1043worker1 # [ 0.349717] ACPI: Using IOAPIC for interrupt routing1044lb # [ 0.376583] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1045client # [ 0.370059] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1046worker1 # [ 0.350021] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1047client # [ 0.371059] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1048worker1 # [ 0.350967] PCI: Using E820 reservations for host bridge windows1049worker2 # [ 0.381118] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1050client # [ 0.372059] pci_bus 0000:00: root bus resource [bus 00-ff]1051worker2 # [ 0.382067] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1052client # [ 0.373029] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1053worker2 # [ 0.382991] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1054worker1 # [ 0.354046] ACPI: Enabled 2 GPEs in block 00 to 3F1055worker2 # [ 0.383945] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1056client # [ 0.374498] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1057lb # [ 0.379148] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1058worker2 # [ 0.385838] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1059lb # [ 0.380151] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1060lb # [ 0.381144] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1061worker2 # [ 0.388063] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1062lb # [ 0.382315] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1063worker2 # [ 0.388878] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1064client # [ 0.377118] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1065worker2 # [ 0.389767] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1066lb # [ 0.383870] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1067client # [ 0.378071] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1068worker2 # [ 0.390061] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1069worker1 # [ 0.362605] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1070client # [ 0.379025] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1071worker1 # [ 0.362972] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1072worker2 # [ 0.391701] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1073client # [ 0.380167] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1074lb # [ 0.387153] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1075worker1 # [ 0.364490] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1076lb # [ 0.388061] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1077worker1 # [ 0.365088] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1078client # [ 0.381837] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1079lb # [ 0.388911] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1080worker1 # [ 0.366328] PCI host bridge to bus 0000:001081worker2 # [ 0.393965] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1082lb # [ 0.389974] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1083worker2 # [ 0.394666] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1084worker1 # [ 0.366970] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1085client # [ 0.384066] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1086worker2 # [ 0.395076] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1087worker1 # [ 0.367966] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1088lb # [ 0.391607] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1089client # [ 0.384886] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1090worker1 # [ 0.368965] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1091client # [ 0.385784] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1092worker2 # [ 0.396611] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1093worker1 # [ 0.369966] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1094client # [ 0.386064] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1095lb # [ 0.394206] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1096worker1 # [ 0.370966] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1097client # [ 0.387611] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1098worker2 # [ 0.398918] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1099lb # [ 0.395145] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1100worker1 # [ 0.371966] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1101worker2 # [ 0.399657] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1102lb # [ 0.396090] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1103worker1 # [ 0.372966] pci_bus 0000:00: root bus resource [bus 00-ff]1104worker2 # [ 0.400076] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1105worker1 # [ 0.373894] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1106client # [ 0.389868] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1107lb # [ 0.397560] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1108client # [ 0.390692] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1109worker2 # [ 0.401870] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1110worker1 # [ 0.375437] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1111client # [ 0.391082] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1112lb # [ 0.399170] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1113worker2 # [ 0.404062] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1114lb # [ 0.400067] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1115client # [ 0.392604] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1116worker2 # [ 0.404873] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1117lb # [ 0.400902] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1118worker2 # [ 0.405806] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1119client # [ 0.394068] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1120lb # [ 0.402836] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1121worker2 # [ 0.406605] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1122client # [ 0.394929] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1123worker1 # [ 0.378007] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1124client # [ 0.395759] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1125worker1 # [ 0.378979] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1126lb # [ 0.405170] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1127worker1 # [ 0.379938] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1128lb # [ 0.406063] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1129worker2 # [ 0.408062] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1130client # [ 0.396904] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1131worker2 # [ 0.409062] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1132lb # [ 0.406903] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1133worker1 # [ 0.381067] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1134worker2 # [ 0.409995] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1135client # [ 0.399082] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1136lb # [ 0.407675] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1137client # [ 0.399990] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1138worker1 # [ 0.382741] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1139worker2 # [ 0.411497] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1140client # [ 0.400787] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1141lb # [ 0.409167] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1142worker2 # [ 0.413062] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1143client # [ 0.401599] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1144worker2 # [ 0.413908] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1145worker1 # [ 0.386000] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1146lb # [ 0.410139] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1147worker1 # [ 0.386836] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1148worker2 # [ 0.414761] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1149lb # [ 0.411161] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1150worker1 # [ 0.387693] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1151client # [ 0.403088] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1152worker1 # [ 0.387971] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1153lb # [ 0.412689] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1154worker2 # [ 0.415635] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1155client # [ 0.404065] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1156client # [ 0.405080] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1157worker1 # [ 0.389492] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1158worker2 # [ 0.417061] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1159lb # [ 0.414174] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1160worker2 # [ 0.417884] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1161lb # [ 0.415023] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1162client # [ 0.406612] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1163worker2 # [ 0.418794] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1164lb # [ 0.415901] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1165worker2 # [ 0.419060] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1166worker1 # [ 0.391998] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1167client # [ 0.408067] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1168lb # [ 0.416718] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1169worker1 # [ 0.392972] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1170worker2 # [ 0.420634] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1171client # [ 0.408955] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1172worker1 # [ 0.393910] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1173client # [ 0.409801] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1174lb # [ 0.418767] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1175worker2 # [ 0.422067] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1176worker1 # [ 0.395390] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1177lb # [ 0.419146] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1178worker2 # [ 0.422990] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1179client # [ 0.410656] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1180lb # [ 0.420077] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1181lb # [ 0.421032] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1182worker1 # [ 0.396997] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1183worker2 # [ 0.424616] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1184client # [ 0.412097] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1185worker1 # [ 0.397837] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1186client # [ 0.412961] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1187lb # [ 0.422426] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1188worker2 # [ 0.426062] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1189worker1 # [ 0.398776] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1190client # [ 0.413805] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1191worker2 # [ 0.426895] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1192client # [ 0.414065] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1193lb # [ 0.424152] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1194worker2 # [ 0.427776] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1195worker1 # [ 0.400311] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1196lb # [ 0.425051] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1197client # [ 0.415590] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1198worker2 # [ 0.428585] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1199worker1 # [ 0.402973] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1200lb # [ 0.427010] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1201client # [ 0.417050] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1202worker1 # [ 0.403808] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1203worker2 # [ 0.430070] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1204worker1 # [ 0.404704] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1205client # [ 0.417836] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1206worker2 # [ 0.430897] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1207lb # [ 0.429170] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1208lb # [ 0.430068] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1209worker2 # [ 0.432060] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1210worker1 # [ 0.405537] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1211client # [ 0.419599] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1212lb # [ 0.430867] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1213worker2 # [ 0.433631] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1214client # [ 0.421104] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1215worker1 # [ 0.406998] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1216lb # [ 0.431681] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1217worker2 # [ 0.434585] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1218client # [ 0.421984] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1219worker1 # [ 0.407858] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1220client # [ 0.422781] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1221worker2 # [ 0.435252] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1222lb # [ 0.433167] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1223worker1 # [ 0.408987] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1224worker2 # [ 0.436577] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1225client # [ 0.423608] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1226lb # [ 0.434027] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1227worker1 # [ 0.410554] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1228lb # [ 0.434878] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1229client # [ 0.425086] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1230worker1 # [ 0.412003] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1231client # [ 0.426065] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1232lb # [ 0.435700] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1233worker1 # [ 0.412831] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1234client # [ 0.427039] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1235lb # [ 0.436685] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1236worker1 # [ 0.413680] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1237lb # [ 0.437340] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1238client # [ 0.428573] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1239worker1 # [ 0.414576] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1240lb # [ 0.438678] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1241client # [ 0.429614] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1242client # [ 0.430259] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1243worker1 # [ 0.416897] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1244worker1 # [ 0.417622] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1245client # [ 0.431618] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1246worker1 # [ 0.417988] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1247worker2 # [ 0.437257] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1248worker1 # [ 0.418971] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1249worker2 # [ 0.439582] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1250worker2 # [ 0.440285] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1251worker1 # [ 0.420526] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1252worker2 # [ 0.441543] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1253worker1 # [ 0.421845] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1254worker2 # [ 0.442309] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1255worker1 # [ 0.422773] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1256worker2 # [ 0.443342] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1257worker1 # [ 0.424834] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1258worker2 # [ 0.444306] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1259lb # [ 0.439329] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1260worker1 # [ 0.427012] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1261worker2 # [ 0.445914] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1262worker1 # [ 0.427878] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1263worker2 # [ 0.446665] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1264client # [ 0.432259] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1265worker1 # [ 0.428726] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1266worker2 # [ 0.447446] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1267client # [ 0.435087] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1268lb # [ 0.442681] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1269worker1 # [ 0.429546] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1270worker2 # [ 0.448955] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1271client # [ 0.436174] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1272lb # [ 0.443373] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1273worker1 # [ 0.430973] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1274client # [ 0.437949] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1275lb # [ 0.445090] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1276worker1 # [ 0.431882] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1277client # [ 0.439106] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1278lb # [ 0.446155] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1279worker2 # [ 0.452594] ACPI: PCI: Interrupt link LNKA configured for IRQ 101280worker1 # [ 0.432988] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1281worker2 # [ 0.453163] ACPI: PCI: Interrupt link LNKB configured for IRQ 101282client # [ 0.440356] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1283lb # [ 0.447433] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1284worker1 # [ 0.434523] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1285worker2 # [ 0.454155] ACPI: PCI: Interrupt link LNKC configured for IRQ 111286client # [ 0.441305] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1287lb # [ 0.448401] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1288worker2 # [ 0.455156] ACPI: PCI: Interrupt link LNKD configured for IRQ 111289worker1 # [ 0.435513] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1290worker2 # [ 0.456151] ACPI: PCI: Interrupt link LNKE configured for IRQ 101291worker1 # [ 0.436160] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1292worker2 # [ 0.457151] ACPI: PCI: Interrupt link LNKF configured for IRQ 101293lb # [ 0.450637] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1294client # [ 0.443776] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1295worker2 # [ 0.458160] ACPI: PCI: Interrupt link LNKG configured for IRQ 111296worker1 # [ 0.437513] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1297lb # [ 0.451146] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1298client # [ 0.444066] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1299worker2 # [ 0.459151] ACPI: PCI: Interrupt link LNKH configured for IRQ 111300lb # [ 0.452371] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1301worker2 # [ 0.460093] ACPI: PCI: Interrupt link GSIA configured for IRQ 161302client # [ 0.445318] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1303worker2 # [ 0.461004] ACPI: PCI: Interrupt link GSIB configured for IRQ 171304lb # [ 0.453899] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1305client # [ 0.446736] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1306worker2 # [ 0.461777] ACPI: PCI: Interrupt link GSIC configured for IRQ 181307worker2 # [ 0.462067] ACPI: PCI: Interrupt link GSID configured for IRQ 191308worker2 # [ 0.463017] ACPI: PCI: Interrupt link GSIE configured for IRQ 201309worker2 # [ 0.463871] ACPI: PCI: Interrupt link GSIF configured for IRQ 211310lb # [ 0.457089] ACPI: PCI: Interrupt link LNKA configured for IRQ 101311client # [ 0.450033] ACPI: PCI: Interrupt link LNKA configured for IRQ 101312worker2 # [ 0.464871] ACPI: PCI: Interrupt link GSIG configured for IRQ 221313worker2 # [ 0.465805] ACPI: PCI: Interrupt link GSIH configured for IRQ 231314lb # [ 0.457994] ACPI: PCI: Interrupt link LNKB configured for IRQ 101315client # [ 0.450898] ACPI: PCI: Interrupt link LNKB configured for IRQ 101316lb # [ 0.459240] ACPI: PCI: Interrupt link LNKC configured for IRQ 111317client # [ 0.452157] ACPI: PCI: Interrupt link LNKC configured for IRQ 111318worker2 # [ 0.467212] iommu: Default domain type: Translated1319lb # [ 0.460261] ACPI: PCI: Interrupt link LNKD configured for IRQ 111320client # [ 0.453157] ACPI: PCI: Interrupt link LNKD configured for IRQ 111321worker2 # [ 0.468007] iommu: DMA domain TLB invalidation policy: lazy mode1322lb # [ 0.461237] ACPI: PCI: Interrupt link LNKE configured for IRQ 101323client # [ 0.454168] ACPI: PCI: Interrupt link LNKE configured for IRQ 101324worker2 # [ 0.469065] ACPI: bus type USB registered1325worker1 # [ 0.438155] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1326lb # [ 0.462235] ACPI: PCI: Interrupt link LNKF configured for IRQ 101327client # [ 0.455158] ACPI: PCI: Interrupt link LNKF configured for IRQ 101328worker2 # [ 0.469822] usbcore: registered new interface driver usbfs1329client # [ 0.456159] ACPI: PCI: Interrupt link LNKG configured for IRQ 111330lb # [ 0.463239] ACPI: PCI: Interrupt link LNKG configured for IRQ 111331worker1 # [ 0.440553] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1332worker2 # [ 0.470072] usbcore: registered new interface driver hub1333client # [ 0.457153] ACPI: PCI: Interrupt link LNKH configured for IRQ 111334lb # [ 0.464238] ACPI: PCI: Interrupt link LNKH configured for IRQ 111335worker2 # [ 0.470915] usbcore: registered new device driver usb1336worker1 # [ 0.441202] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1337client # [ 0.458094] ACPI: PCI: Interrupt link GSIA configured for IRQ 161338lb # [ 0.465176] ACPI: PCI: Interrupt link GSIA configured for IRQ 161339worker2 # [ 0.472492] NetLabel: Initializing1340client # [ 0.459073] ACPI: PCI: Interrupt link GSIB configured for IRQ 171341lb # [ 0.466155] ACPI: PCI: Interrupt link GSIB configured for IRQ 171342worker2 # [ 0.473055] NetLabel: domain hash size = 1281343worker1 # [ 0.442865] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1344client # [ 0.460028] ACPI: PCI: Interrupt link GSIC configured for IRQ 181345lb # [ 0.467106] ACPI: PCI: Interrupt link GSIC configured for IRQ 181346worker2 # [ 0.473755] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1347client # [ 0.460768] ACPI: PCI: Interrupt link GSID configured for IRQ 191348worker2 # [ 0.474132] NetLabel: unlabeled traffic allowed by default1349lb # [ 0.467873] ACPI: PCI: Interrupt link GSID configured for IRQ 191350worker1 # [ 0.443937] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1351worker2 # [ 0.474981] PCI: Using ACPI for IRQ routing1352client # [ 0.461075] ACPI: PCI: Interrupt link GSIE configured for IRQ 201353lb # [ 0.468151] ACPI: PCI: Interrupt link GSIE configured for IRQ 201354worker1 # [ 0.445235] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1355client # [ 0.462070] ACPI: PCI: Interrupt link GSIF configured for IRQ 211356lb # [ 0.469152] ACPI: PCI: Interrupt link GSIF configured for IRQ 211357client # [ 0.463062] ACPI: PCI: Interrupt link GSIG configured for IRQ 221358lb # [ 0.470153] ACPI: PCI: Interrupt link GSIG configured for IRQ 221359worker1 # [ 0.446208] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1360client # [ 0.464060] ACPI: PCI: Interrupt link GSIH configured for IRQ 231361lb # [ 0.471153] ACPI: PCI: Interrupt link GSIH configured for IRQ 231362client # [ 0.466092] iommu: Default domain type: Translated1363worker1 # [ 0.448018] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1364lb # [ 0.473128] iommu: Default domain type: Translated1365client # [ 0.466909] iommu: DMA domain TLB invalidation policy: lazy mode1366lb # [ 0.473786] iommu: DMA domain TLB invalidation policy: lazy mode1367worker1 # [ 0.448898] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1368client # [ 0.468108] ACPI: bus type USB registered1369lb # [ 0.474381] ACPI: bus type USB registered1370client # [ 0.468864] usbcore: registered new interface driver usbfs1371worker1 # [ 0.450281] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1372lb # [ 0.475173] usbcore: registered new interface driver usbfs1373client # [ 0.469776] usbcore: registered new interface driver hub1374lb # [ 0.476101] usbcore: registered new interface driver hub1375worker1 # [ 0.451521] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1376client # [ 0.470069] usbcore: registered new device driver usb1377lb # [ 0.476842] usbcore: registered new device driver usb1378client # [ 0.471844] NetLabel: Initializing1379lb # [ 0.477968] NetLabel: Initializing1380client # [ 0.472065] NetLabel: domain hash size = 1281381lb # [ 0.478604] NetLabel: domain hash size = 1281382client # [ 0.472837] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1383lb # [ 0.479139] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1384worker1 # [ 0.454915] ACPI: PCI: Interrupt link LNKA configured for IRQ 101385client # [ 0.473113] NetLabel: unlabeled traffic allowed by default1386lb # [ 0.480131] NetLabel: unlabeled traffic allowed by default1387worker1 # [ 0.455801] ACPI: PCI: Interrupt link LNKB configured for IRQ 101388lb # [ 0.480863] PCI: Using ACPI for IRQ routing1389client # [ 0.474059] PCI: Using ACPI for IRQ routing1390worker1 # [ 0.456792] ACPI: PCI: Interrupt link LNKC configured for IRQ 111391worker1 # [ 0.457852] ACPI: PCI: Interrupt link LNKD configured for IRQ 111392worker1 # [ 0.458993] ACPI: PCI: Interrupt link LNKE configured for IRQ 101393worker1 # [ 0.460062] ACPI: PCI: Interrupt link LNKF configured for IRQ 101394worker1 # [ 0.461066] ACPI: PCI: Interrupt link LNKG configured for IRQ 111395worker1 # [ 0.462062] ACPI: PCI: Interrupt link LNKH configured for IRQ 111396worker1 # [ 0.463002] ACPI: PCI: Interrupt link GSIA configured for IRQ 161397worker1 # [ 0.463978] ACPI: PCI: Interrupt link GSIB configured for IRQ 171398worker1 # [ 0.464981] ACPI: PCI: Interrupt link GSIC configured for IRQ 181399worker1 # [ 0.465978] ACPI: PCI: Interrupt link GSID configured for IRQ 191400worker1 # [ 0.466980] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401worker1 # [ 0.467979] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402worker1 # [ 0.468977] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403worker1 # [ 0.469976] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404worker1 # [ 0.472046] iommu: Default domain type: Translated1405worker1 # [ 0.472887] iommu: DMA domain TLB invalidation policy: lazy mode1406worker1 # [ 0.474007] ACPI: bus type USB registered1407worker1 # [ 0.474767] usbcore: registered new interface driver usbfs1408worker1 # [ 0.475682] usbcore: registered new interface driver hub1409worker1 # [ 0.475976] usbcore: registered new device driver usb1410worker1 # [ 0.477780] NetLabel: Initializing1411worker1 # [ 0.477973] NetLabel: domain hash size = 1281412worker1 # [ 0.478766] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker1 # [ 0.479785] NetLabel: unlabeled traffic allowed by default1414worker1 # [ 0.480741] PCI: Using ACPI for IRQ routing1415worker2 # [ 0.517645] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416worker2 # [ 0.518051] pci 0000:00:01.0: vgaarb: bridge control possible1417worker2 # [ 0.518051] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418worker2 # [ 0.518059] vgaarb: loaded1419worker2 # [ 0.518780] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker2 # [ 0.519056] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421worker2 # [ 0.521135] clocksource: Switched to clocksource kvm-clock1422worker2 # [ 0.522838] VFS: Disk quotas dquot_6.6.01423worker2 # [ 0.525321] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424worker2 # [ 0.526660] pnp: PnP ACPI init1425worker2 # [ 0.527456] ACPI: IRQ 4 override to edge(!), high(!)1426lb # [ 0.523653] pci 0000:00:01.0: vgaarb: setting as boot VGA device1427lb # [ 0.524135] pci 0000:00:01.0: vgaarb: bridge control possible1428worker2 # [ 0.528411] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1429worker2 # [ 0.529933] pnp: PnP ACPI: found 6 devices1430client # [ 0.518420] pci 0000:00:01.0: vgaarb: setting as boot VGA device1431lb # [ 0.524135] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1432lb # [ 0.524144] vgaarb: loaded1433client # [ 0.519055] pci 0000:00:01.0: vgaarb: bridge control possible1434lb # [ 0.524889] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01435client # [ 0.519055] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1436lb # [ 0.525139] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1437client # [ 0.519063] vgaarb: loaded1438client # [ 0.519836] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01439client # [ 0.520060] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1440lb # [ 0.529224] clocksource: Switched to clocksource kvm-clock1441worker2 # [ 0.537475] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1442worker2 # [ 0.538975] clocksource: Switched to clocksource acpi_pm1443worker2 # [ 0.539944] NET: Registered PF_INET protocol family1444client # [ 0.525147] clocksource: Switched to clocksource kvm-clock1445lb # [ 0.532632] VFS: Disk quotas dquot_6.6.01446lb # [ 0.533320] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1447worker2 # [ 0.541086] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1448lb # [ 0.534628] pnp: PnP ACPI init1449lb # [ 0.535406] ACPI: IRQ 4 override to edge(!), high(!)1450client # [ 0.528549] VFS: Disk quotas dquot_6.6.01451client # [ 0.529235] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1452lb # [ 0.536339] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1453client # [ 0.530630] pnp: PnP ACPI init1454lb # [ 0.537916] pnp: PnP ACPI: found 6 devices1455client # [ 0.531444] ACPI: IRQ 4 override to edge(!), high(!)1456client # [ 0.532468] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1457client # [ 0.534071] pnp: PnP ACPI: found 6 devices1458lb # [ 0.545595] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1459lb # [ 0.547075] clocksource: Switched to clocksource acpi_pm1460lb # [ 0.548064] NET: Registered PF_INET protocol family1461worker1 # [ 0.524823] pci 0000:00:01.0: vgaarb: setting as boot VGA device1462client # [ 0.541652] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1463lb # [ 0.549294] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1464worker1 # [ 0.524962] pci 0000:00:01.0: vgaarb: bridge control possible1465worker2 # [ 0.557302] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1466client # [ 0.543112] clocksource: Switched to clocksource acpi_pm1467worker1 # [ 0.524962] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1468client # [ 0.544073] NET: Registered PF_INET protocol family1469worker2 # [ 0.558753] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1470worker1 # [ 0.524971] vgaarb: loaded1471worker1 # [ 0.525709] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01472client # [ 0.545223] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1473worker2 # [ 0.560013] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1474worker1 # [ 0.525967] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1475worker2 # [ 0.561278] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1476worker2 # [ 0.562451] TCP: Hash tables configured (established 16384 bind 16384)1477worker2 # [ 0.563506] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1478worker2 # [ 0.564706] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1479worker2 # [ 0.565738] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1480worker1 # [ 0.530052] clocksource: Switched to clocksource kvm-clock1481worker2 # [ 0.566898] NET: Registered PF_UNIX/PF_LOCAL protocol family1482worker2 # [ 0.567837] NET: Registered PF_XDP protocol family1483worker2 # [ 0.568646] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1484worker1 # [ 0.533467] VFS: Disk quotas dquot_6.6.01485worker2 # [ 0.569621] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1486worker1 # [ 0.534188] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1487worker2 # [ 0.570590] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1488worker1 # [ 0.535594] pnp: PnP ACPI init1489worker2 # [ 0.571830] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1490worker1 # [ 0.536387] ACPI: IRQ 4 override to edge(!), high(!)1491worker2 # [ 0.572986] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1492worker1 # [ 0.537333] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1493worker2 # [ 0.574049] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1494lb # [ 0.566343] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1495worker1 # [ 0.538861] pnp: PnP ACPI: found 6 devices1496worker2 # [ 0.575947] ACPI: \_SB_.GSIA: Enabled at IRQ 161497lb # [ 0.567863] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1498client # [ 0.561265] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1499lb # [ 0.569190] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1500client # [ 0.562812] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1501worker2 # [ 0.578395] ACPI: \_SB_.GSIB: Enabled at IRQ 171502lb # [ 0.570567] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1503client # [ 0.564162] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1504lb # [ 0.571788] TCP: Hash tables configured (established 16384 bind 16384)1505worker2 # [ 0.580243] ACPI: \_SB_.GSIC: Enabled at IRQ 181506client # [ 0.565542] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1507lb # [ 0.572941] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1508client # [ 0.566817] TCP: Hash tables configured (established 16384 bind 16384)1509worker2 # [ 0.582127] ACPI: \_SB_.GSID: Enabled at IRQ 191510lb # [ 0.574220] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1511lb # [ 0.575261] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1512client # [ 0.567986] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1513worker1 # [ 0.546470] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1514worker2 # [ 0.583711] PCI: CLS 0 bytes, default 641515lb # [ 0.576476] NET: Registered PF_UNIX/PF_LOCAL protocol family1516worker1 # [ 0.547916] clocksource: Switched to clocksource acpi_pm1517client # [ 0.569296] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1518lb # [ 0.577445] NET: Registered PF_XDP protocol family1519worker1 # [ 0.548878] NET: Registered PF_INET protocol family1520worker2 # [ 0.584557] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1521client # [ 0.570368] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1522lb # [ 0.578245] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1523worker2 # [ 0.586197] Trying to unpack rootfs image as initramfs...1524client # [ 0.571535] NET: Registered PF_UNIX/PF_LOCAL protocol family1525worker1 # [ 0.550030] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1526lb # [ 0.579224] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1527client # [ 0.572435] NET: Registered PF_XDP protocol family1528lb # [ 0.580248] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1529client # [ 0.573318] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1530lb # [ 0.581361] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1531client # [ 0.574360] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1532lb # [ 0.582500] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1533client # [ 0.575413] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1534client # [ 0.576554] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1535lb # [ 0.583641] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1536client # [ 0.577684] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1537lb # [ 0.585435] ACPI: \_SB_.GSIA: Enabled at IRQ 161538client # [ 0.578836] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1539client # [ 0.580692] ACPI: \_SB_.GSIA: Enabled at IRQ 161540lb # [ 0.587761] ACPI: \_SB_.GSIB: Enabled at IRQ 171541client # [ 0.582861] ACPI: \_SB_.GSIB: Enabled at IRQ 171542lb # [ 0.590209] ACPI: \_SB_.GSIC: Enabled at IRQ 181543client # [ 0.584859] ACPI: \_SB_.GSIC: Enabled at IRQ 181544lb # [ 0.592116] ACPI: \_SB_.GSID: Enabled at IRQ 191545lb # [ 0.593820] PCI: CLS 0 bytes, default 641546client # [ 0.586778] ACPI: \_SB_.GSID: Enabled at IRQ 191547worker1 # [ 0.566091] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1548client # [ 0.588649] PCI: CLS 0 bytes, default 641549lb # [ 0.594774] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1550lb # [ 0.596591] Trying to unpack rootfs image as initramfs...1551worker1 # [ 0.567651] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1552client # [ 0.589525] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1553worker1 # [ 0.568968] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1554client # [ 0.591270] Trying to unpack rootfs image as initramfs...1555worker1 # [ 0.570326] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1556worker1 # [ 0.571630] TCP: Hash tables configured (established 16384 bind 16384)1557worker1 # [ 0.572779] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1558worker1 # [ 0.574074] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1559worker1 # [ 0.575191] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1560worker1 # [ 0.576444] NET: Registered PF_UNIX/PF_LOCAL protocol family1561worker1 # [ 0.577445] NET: Registered PF_XDP protocol family1562worker1 # [ 0.578291] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1563worker1 # [ 0.579308] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1564worker1 # [ 0.580338] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565worker1 # [ 0.581494] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566worker1 # [ 0.582616] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567worker1 # [ 0.583736] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568worker1 # [ 0.585543] ACPI: \_SB_.GSIA: Enabled at IRQ 161569worker1 # [ 0.587768] ACPI: \_SB_.GSIB: Enabled at IRQ 171570worker1 # [ 0.589838] ACPI: \_SB_.GSIC: Enabled at IRQ 181571worker1 # [ 0.591816] ACPI: \_SB_.GSID: Enabled at IRQ 191572worker1 # [ 0.593718] PCI: CLS 0 bytes, default 641573worker2 # [ 0.629996] Initialise system trusted keyrings1574worker1 # [ 0.594646] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1575worker1 # [ 0.596435] Trying to unpack rootfs image as initramfs...1576worker2 # [ 0.633028] workingset: timestamp_bits=40 max_order=19 bucket_order=01577lb # [ 0.641082] Initialise system trusted keyrings1578client # [ 0.635416] Initialise system trusted keyrings1579lb # [ 0.643937] workingset: timestamp_bits=40 max_order=19 bucket_order=01580client # [ 0.638204] workingset: timestamp_bits=40 max_order=19 bucket_order=01581worker2 # [ 0.654247] Key type asymmetric registered1582worker2 # [ 0.654952] Asymmetric key parser 'x509' registered1583worker2 # [ 0.655786] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1584worker2 # [ 0.661134] io scheduler mq-deadline registered1585worker2 # [ 0.661877] io scheduler kyber registered1586worker2 # [ 0.665539] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1587worker2 # [ 0.666777] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1588worker2 # [ 0.670793] Linux agpgart interface v0.1031589worker2 # [ 0.671552] ACPI: bus type drm_connector registered1590worker2 # [ 0.674394] usbcore: registered new interface driver usbserial_generic1591lb # [ 0.667085] Key type asymmetric registered1592client # [ 0.660285] Key type asymmetric registered1593lb # [ 0.667808] Asymmetric key parser 'x509' registered1594worker2 # [ 0.675459] usbserial: USB Serial support registered for generic1595client # [ 0.660996] Asymmetric key parser 'x509' registered1596lb # [ 0.668685] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1597client # [ 0.661887] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1598worker1 # [ 0.642842] Initialise system trusted keyrings1599worker2 # [ 0.678992] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1600worker2 # [ 0.678992] Please enable it if your BIOS has the CPPC option.1601lb # [ 0.673059] io scheduler mq-deadline registered1602lb # [ 0.673849] io scheduler kyber registered1603worker2 # [ 0.681267] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1604client # [ 0.667367] io scheduler mq-deadline registered1605client # [ 0.668197] io scheduler kyber registered1606worker1 # [ 0.646414] workingset: timestamp_bits=40 max_order=19 bucket_order=01607lb # [ 0.677451] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1608worker2 # [ 0.685113] drop_monitor: Initializing network drop monitor service1609client # [ 0.670700] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1610worker2 # [ 0.686245] NET: Registered PF_INET6 protocol family1611lb # [ 0.678695] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1612client # [ 0.671945] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1613worker2 # [ 0.689426] Segment Routing with IPv61614lb # [ 0.682669] Linux agpgart interface v0.1031615lb # [ 0.683489] ACPI: bus type drm_connector registered1616worker2 # [ 0.692008] In-situ OAM (IOAM) with IPv61617client # [ 0.677768] Linux agpgart interface v0.1031618worker2 # [ 0.693069] IPI shorthand broadcast: enabled1619client # [ 0.678588] ACPI: bus type drm_connector registered1620lb # [ 0.686368] usbcore: registered new interface driver usbserial_generic1621lb # [ 0.687491] usbserial: USB Serial support registered for generic1622client # [ 0.681608] usbcore: registered new interface driver usbserial_generic1623client # [ 0.682721] usbserial: USB Serial support registered for generic1624lb # [ 0.690906] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1625lb # [ 0.690906] Please enable it if your BIOS has the CPPC option.1626client # [ 0.685175] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1627lb # [ 0.693181] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1628client # [ 0.685175] Please enable it if your BIOS has the CPPC option.1629worker2 # [ 0.701205] sched_clock: Marking stable (570013679, 130959495)->(768633956, -67660782)1630worker1 # [ 0.665739] Key type asymmetric registered1631client # [ 0.687366] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1632worker1 # [ 0.668405] Asymmetric key parser 'x509' registered1633lb # [ 0.697025] drop_monitor: Initializing network drop monitor service1634lb # [ 0.698224] NET: Registered PF_INET6 protocol family1635worker1 # [ 0.669261] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1636worker2 # [ 0.706150] registered taskstats version 11637client # [ 0.691326] drop_monitor: Initializing network drop monitor service1638worker2 # [ 0.707107] Loading compiled-in X.509 certificates1639client # [ 0.692462] NET: Registered PF_INET6 protocol family1640lb # [ 0.701335] Segment Routing with IPv61641client # [ 0.695620] Segment Routing with IPv61642worker1 # [ 0.674406] io scheduler mq-deadline registered1643worker1 # [ 0.675192] io scheduler kyber registered1644lb # [ 0.703921] In-situ OAM (IOAM) with IPv61645lb # [ 0.704989] IPI shorthand broadcast: enabled1646client # [ 0.698188] In-situ OAM (IOAM) with IPv61647client # [ 0.699290] IPI shorthand broadcast: enabled1648worker1 # [ 0.678557] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1649worker1 # [ 0.679866] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1650worker1 # [ 0.685149] Linux agpgart interface v0.1031651lb # [ 0.713411] sched_clock: Marking stable (578013406, 134869105)->(785554252, -72671741)1652worker1 # [ 0.685970] ACPI: bus type drm_connector registered1653client # [ 0.707576] sched_clock: Marking stable (574013909, 133136514)->(777534212, -70383789)1654worker2 # [ 0.723507] Demotion targets for Node 0: null1655worker1 # [ 0.688526] usbcore: registered new interface driver usbserial_generic1656worker2 # [ 0.726024] Key type .fscrypt registered1657worker1 # [ 0.689642] usbserial: USB Serial support registered for generic1658worker2 # [ 0.726695] Key type fscrypt-provisioning registered1659lb # [ 0.719214] registered taskstats version 11660worker2 # [ 0.727644] ima: No TPM chip found, activating TPM-bypass!1661lb # [ 0.720158] Loading compiled-in X.509 certificates1662client # [ 0.713370] registered taskstats version 11663client # [ 0.714337] Loading compiled-in X.509 certificates1664worker1 # [ 0.693378] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1665worker1 # [ 0.693378] Please enable it if your BIOS has the CPPC option.1666worker2 # [ 0.731987] ima: Allocated hash algorithm: sha11667worker1 # [ 0.695698] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1668worker2 # [ 0.732768] ima: No architecture policies found1669worker2 # [ 0.733752] PM: Magic number: 10:986:701670worker2 # [ 0.734556] memory: hash matches1671worker1 # [ 0.699511] drop_monitor: Initializing network drop monitor service1672worker1 # [ 0.700731] NET: Registered PF_INET6 protocol family1673worker2 # [ 0.737766] RAS: Correctable Errors collector initialized.1674worker1 # [ 0.703848] Segment Routing with IPv61675worker1 # [ 0.707387] In-situ OAM (IOAM) with IPv61676worker1 # [ 0.708436] IPI shorthand broadcast: enabled1677client # [ 0.730824] Demotion targets for Node 0: null1678worker2 # [ 0.746415] clk: Disabling unused clocks1679lb # [ 0.738899] Demotion targets for Node 0: null1680lb # [ 0.739826] Key type .fscrypt registered1681client # [ 0.733215] Key type .fscrypt registered1682lb # [ 0.740581] Key type fscrypt-provisioning registered1683client # [ 0.733924] Key type fscrypt-provisioning registered1684worker2 # [ 0.748991] PM: genpd: Disabling unused power domains1685client # [ 0.734893] ima: No TPM chip found, activating TPM-bypass!1686lb # [ 0.743019] ima: No TPM chip found, activating TPM-bypass!1687lb # [ 0.743923] ima: Allocated hash algorithm: sha11688lb # [ 0.744693] ima: No architecture policies found1689client # [ 0.738170] ima: Allocated hash algorithm: sha11690worker1 # [ 0.716680] sched_clock: Marking stable (584015091, 132343198)->(783705662, -67347373)1691client # [ 0.738999] ima: No architecture policies found1692lb # [ 0.749071] PM: Magic number: 10:986:701693lb # [ 0.749930] memory: hash matches1694worker1 # [ 0.721461] registered taskstats version 11695client # [ 0.743174] PM: Magic number: 10:986:701696client # [ 0.743937] memory: hash matches1697worker1 # [ 0.722436] Loading compiled-in X.509 certificates1698lb # [ 0.753452] RAS: Correctable Errors collector initialized.1699client # [ 0.747435] RAS: Correctable Errors collector initialized.1700lb # [ 0.762224] clk: Disabling unused clocks1701client # [ 0.756158] clk: Disabling unused clocks1702client # [ 0.756874] PM: genpd: Disabling unused power domains1703lb # [ 0.764912] PM: genpd: Disabling unused power domains1704worker1 # [ 0.738923] Demotion targets for Node 0: null1705worker1 # [ 0.742428] Key type .fscrypt registered1706worker1 # [ 0.743126] Key type fscrypt-provisioning registered1707worker1 # [ 0.744107] ima: No TPM chip found, activating TPM-bypass!1708worker1 # [ 0.746370] ima: Allocated hash algorithm: sha11709worker1 # [ 0.747171] ima: No architecture policies found1710worker1 # [ 0.751382] PM: Magic number: 10:986:701711worker1 # [ 0.752156] memory: hash matches1712worker1 # [ 0.755749] RAS: Correctable Errors collector initialized.1713worker1 # [ 0.764466] clk: Disabling unused clocks1714worker1 # [ 0.765165] PM: genpd: Disabling unused power domains1715worker2 # [ 0.911691] Freeing initrd memory: 29092K1716worker2 # [ 0.914995] Freeing unused decrypted memory: 2028K1717worker2 # [ 0.917496] Freeing unused kernel image (initmem) memory: 3644K1718worker2 # [ 0.918512] Write protecting the kernel read-only data: 32768k1719worker2 # [ 0.920294] Freeing unused kernel image (text/rodata gap) memory: 1208K1720worker2 # [ 0.921713] Freeing unused kernel image (rodata/data gap) memory: 752K1721client # [ 0.916244] Freeing initrd memory: 29096K1722lb # [ 0.924507] Freeing initrd memory: 29092K1723client # [ 0.919391] Freeing unused decrypted memory: 2028K1724lb # [ 0.927547] Freeing unused decrypted memory: 2028K1725client # [ 0.921926] Freeing unused kernel image (initmem) memory: 3644K1726lb # [ 0.930108] Freeing unused kernel image (initmem) memory: 3644K1727client # [ 0.923044] Write protecting the kernel read-only data: 32768k1728lb # [ 0.931150] Write protecting the kernel read-only data: 32768k1729client # [ 0.924867] Freeing unused kernel image (text/rodata gap) memory: 1208K1730lb # [ 0.932935] Freeing unused kernel image (text/rodata gap) memory: 1208K1731client # [ 0.926398] Freeing unused kernel image (rodata/data gap) memory: 752K1732lb # [ 0.934369] Freeing unused kernel image (rodata/data gap) memory: 752K1733worker1 # [ 0.923870] Freeing initrd memory: 29092K1734worker1 # [ 0.926932] Freeing unused decrypted memory: 2028K1735worker1 # [ 0.929417] Freeing unused kernel image (initmem) memory: 3644K1736worker1 # [ 0.930447] Write protecting the kernel read-only data: 32768k1737worker1 # [ 0.932214] Freeing unused kernel image (text/rodata gap) memory: 1208K1738worker1 # [ 0.933697] Freeing unused kernel image (rodata/data gap) memory: 752K1739worker2 # [ 0.972613] x86/mm: Checked W+X mappings: passed, no W+X pages found.1740worker2 # [ 0.973656] Run /init as init process1741worker2 # [ 0.983576] systemd[1]: Inserted module 'autofs4'1742client # [ 0.977483] x86/mm: Checked W+X mappings: passed, no W+X pages found.1743lb # [ 0.985095] x86/mm: Checked W+X mappings: passed, no W+X pages found.1744client # [ 0.978542] Run /init as init process1745lb # [ 0.986131] Run /init as init process1746worker2 # [ 0.999731] fuse: init (API version 7.45)1747client # [ 0.988467] systemd[1]: Inserted module 'autofs4'1748lb # [ 0.995937] systemd[1]: Inserted module 'autofs4'1749worker2 # [ 1.005376] ACPI: \_SB_.GSIG: Enabled at IRQ 221750worker2 # [ 1.007830] ACPI: \_SB_.GSIH: Enabled at IRQ 231751worker2 # [ 1.011442] ACPI: \_SB_.GSIE: Enabled at IRQ 201752worker2 # [ 1.013786] ACPI: \_SB_.GSIF: Enabled at IRQ 211753client # [ 1.004665] fuse: init (API version 7.45)1754lb # [ 1.012209] fuse: init (API version 7.45)1755worker1 # [ 0.984724] x86/mm: Checked W+X mappings: passed, no W+X pages found.1756worker1 # [ 0.985750] Run /init as init process1757client # [ 1.010467] ACPI: \_SB_.GSIG: Enabled at IRQ 221758lb # [ 1.017958] ACPI: \_SB_.GSIG: Enabled at IRQ 221759client # [ 1.012776] ACPI: \_SB_.GSIH: Enabled at IRQ 231760lb # [ 1.020225] ACPI: \_SB_.GSIH: Enabled at IRQ 231761lb # [ 1.023139] ACPI: \_SB_.GSIE: Enabled at IRQ 201762client # [ 1.016104] ACPI: \_SB_.GSIE: Enabled at IRQ 201763worker1 # [ 0.995674] systemd[1]: Inserted module 'autofs4'1764lb # [ 1.025339] ACPI: \_SB_.GSIF: Enabled at IRQ 211765client # [ 1.018950] ACPI: \_SB_.GSIF: Enabled at IRQ 211766worker2 # [ 1.038950] systemd[1]: Successfully made /usr/ read-only.1767worker1 # [ 1.012012] fuse: init (API version 7.45)1768worker1 # [ 1.017994] ACPI: \_SB_.GSIG: Enabled at IRQ 221769worker1 # [ 1.020422] ACPI: \_SB_.GSIH: Enabled at IRQ 231770worker1 # [ 1.023262] ACPI: \_SB_.GSIE: Enabled at IRQ 201771lb # [ 1.051969] systemd[1]: Successfully made /usr/ read-only.1772worker1 # [ 1.025437] ACPI: \_SB_.GSIF: Enabled at IRQ 211773client # [ 1.047273] systemd[1]: Successfully made /usr/ read-only.1774worker1 # [ 1.051567] systemd[1]: Successfully made /usr/ read-only.1775worker2 # [ 1.375627] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1776worker2 # [ 1.387315] systemd[1]: Detected virtualization kvm.1777worker2 # [ 1.389360] systemd[1]: Detected architecture x86-64.1778worker2 # [ 1.391448] systemd[1]: Running in initrd.1779worker2 # [ 1.393848] systemd[1]: Initializing machine ID from random generator.1780worker2 # [ 1.396650] systemd[1]: Hostname set to <worker2>.1781lb # [ 1.388577] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1782lb # [ 1.403004] systemd[1]: Detected virtualization kvm.1783client # [ 1.384558] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784lb # [ 1.405597] systemd[1]: Detected architecture x86-64.1785client # [ 1.399226] systemd[1]: Detected virtualization kvm.1786lb # [ 1.408244] systemd[1]: Running in initrd.1787client # [ 1.401808] systemd[1]: Detected architecture x86-64.1788client # [ 1.404520] systemd[1]: Running in initrd.1789lb # [ 1.411365] systemd[1]: Initializing machine ID from random generator.1790lb # [ 1.415034] systemd[1]: Hostname set to <lb>.1791client # [ 1.407708] systemd[1]: Initializing machine ID from random generator.1792client # [ 1.411423] systemd[1]: Hostname set to <client>.1793worker1 # [ 1.387161] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1794worker1 # [ 1.397600] systemd[1]: Detected virtualization kvm.1795worker1 # [ 1.399726] systemd[1]: Detected architecture x86-64.1796worker1 # [ 1.401886] systemd[1]: Running in initrd.1797worker1 # [ 1.404522] systemd[1]: Initializing machine ID from random generator.1798worker1 # [ 1.407321] systemd[1]: Hostname set to <worker1>.1799worker2 # [ 1.617514] systemd[1]: bpf-restrict-fs: LSM BPF program attached1800lb # [ 1.636403] systemd[1]: bpf-restrict-fs: LSM BPF program attached1801client # [ 1.630305] systemd[1]: bpf-restrict-fs: LSM BPF program attached1802worker2 # [ 1.667311] systemd[1]: Queued start job for default target Initrd Default Target.1803worker1 # [ 1.631437] systemd[1]: bpf-restrict-fs: LSM BPF program attached1804worker2 # [ 1.671309] systemd[1]: Created slice Slice /system/modprobe.1805worker2 # [ 1.672447] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1806worker2 # [ 1.673775] systemd[1]: Expecting device /dev/disk/by-label/nixos...1807worker2 # [ 1.674823] systemd[1]: Reached target Path Units.1808worker2 # [ 1.675659] systemd[1]: Reached target Slice Units.1809worker2 # [ 1.676489] systemd[1]: Reached target Swaps.1810worker2 # [ 1.677257] systemd[1]: Reached target Timer Units.1811worker2 # [ 1.678261] systemd[1]: Listening on D-Bus System Message Bus Socket.1812worker2 # [ 1.679403] systemd[1]: Listening on Journal Socket (/dev/log).1813worker2 # [ 1.680501] systemd[1]: Listening on Journal Sockets.1814worker2 # [ 1.681446] systemd[1]: Listening on udev Control Socket.1815worker2 # [ 1.682408] systemd[1]: Listening on udev Kernel Socket.1816worker2 # [ 1.683315] systemd[1]: Reached target Socket Units.1817worker2 # [ 1.685316] systemd[1]: Starting Create List of Static Device Nodes...1818worker2 # [ 1.691064] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1819worker2 # [ 1.697180] systemd[1]: Starting Load Kernel Module configfs...1820lb # [ 1.691200] systemd[1]: Queued start job for default target Initrd Default Target.1821client # [ 1.686542] systemd[1]: Queued start job for default target Initrd Default Target.1822lb # [ 1.695618] systemd[1]: Created slice Slice /system/modprobe.1823lb # [ 1.696916] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1824client # [ 1.690936] systemd[1]: Created slice Slice /system/modprobe.1825lb # [ 1.698272] systemd[1]: Expecting device /dev/disk/by-label/nixos...1826lb # [ 1.699492] systemd[1]: Reached target Path Units.1827client # [ 1.692286] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1828lb # [ 1.700425] systemd[1]: Reached target Slice Units.1829client # [ 1.693807] systemd[1]: Expecting device /dev/disk/by-label/nixos...1830lb # [ 1.701369] systemd[1]: Reached target Swaps.1831client # [ 1.695029] systemd[1]: Reached target Path Units.1832lb # [ 1.702280] systemd[1]: Reached target Timer Units.1833client # [ 1.695989] systemd[1]: Reached target Slice Units.1834lb # [ 1.703360] systemd[1]: Listening on D-Bus System Message Bus Socket.1835client # [ 1.696935] systemd[1]: Reached target Swaps.1836lb # [ 1.704708] systemd[1]: Listening on Journal Socket (/dev/log).1837client # [ 1.697848] systemd[1]: Reached target Timer Units.1838worker2 # [ 1.713638] systemd[1]: Starting Journal Service...1839lb # [ 1.706025] systemd[1]: Listening on Journal Sockets.1840client # [ 1.698960] systemd[1]: Listening on D-Bus System Message Bus Socket.1841lb # [ 1.707194] systemd[1]: Listening on udev Control Socket.1842client # [ 1.700297] systemd[1]: Listening on Journal Socket (/dev/log).1843lb # [ 1.708285] systemd[1]: Listening on udev Kernel Socket.1844client # [ 1.701656] systemd[1]: Listening on Journal Sockets.1845lb # [ 1.709286] systemd[1]: Reached target Socket Units.1846client # [ 1.702756] systemd[1]: Listening on udev Control Socket.1847client # [ 1.703827] systemd[1]: Listening on udev Kernel Socket.1848lb # [ 1.711577] systemd[1]: Starting Create List of Static Device Nodes...1849client # [ 1.704755] systemd[1]: Reached target Socket Units.1850client # [ 1.706867] systemd[1]: Starting Create List of Static Device Nodes...1851lb # [ 1.716963] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1852worker1 # [ 1.688457] systemd[1]: Queued start job for default target Initrd Default Target.1853client # [ 1.711227] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1854worker1 # [ 1.692899] systemd[1]: Created slice Slice /system/modprobe.1855lb # [ 1.722003] systemd[1]: Starting Load Kernel Module configfs...1856worker1 # [ 1.694144] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1857client # [ 1.716662] systemd[1]: Starting Load Kernel Module configfs...1858worker1 # [ 1.695644] systemd[1]: Expecting device /dev/disk/by-label/nixos...1859worker1 # [ 1.696784] systemd[1]: Reached target Path Units.1860worker1 # [ 1.697692] systemd[1]: Reached target Slice Units.1861worker1 # [ 1.698605] systemd[1]: Reached target Swaps.1862worker1 # [ 1.699446] systemd[1]: Reached target Timer Units.1863worker2 # [ 1.725063] systemd[1]: Starting Load Kernel Modules...1864worker1 # [ 1.700574] systemd[1]: Listening on D-Bus System Message Bus Socket.1865worker1 # [ 1.701846] systemd[1]: Listening on Journal Socket (/dev/log).1866worker1 # [ 1.703076] systemd[1]: Listening on Journal Sockets.1867worker1 # [ 1.704116] systemd[1]: Listening on udev Control Socket.1868worker1 # [ 1.705173] systemd[1]: Listening on udev Kernel Socket.1869worker1 # [ 1.706160] systemd[1]: Reached target Socket Units.1870lb # [ 1.736084] systemd[1]: Starting Journal Service...1871worker2 # [ 1.744022] netfs: FS-Cache loaded1872worker1 # [ 1.708187] systemd[1]: Starting Create List of Static Device Nodes...1873worker2 # [ 1.748757] 9pnet: Installing 9P2000 support1874client # [ 1.733988] systemd[1]: Starting Journal Service...1875worker1 # [ 1.712430] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1876worker1 # [ 1.717765] systemd[1]: Starting Load Kernel Module configfs...1877worker2 # [ 1.757170] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1878worker2 # [ 1.766239] systemd[1]: Starting Coldplug All udev Devices...1879lb # [ 1.749967] systemd[1]: Starting Load Kernel Modules...1880worker1 # [ 1.733457] systemd[1]: Starting Journal Service...1881client # [ 1.744466] systemd[1]: Starting Load Kernel Modules...1882lb # [ 1.771706] netfs: FS-Cache loaded1883worker2 # [ 1.779484] systemd[1]: Finished Create List of Static Device Nodes.1884client # [ 1.769018] netfs: FS-Cache loaded1885worker2 # [ 1.784594] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1886lb # [ 1.778703] 9pnet: Installing 9P2000 support1887client # [ 1.776869] 9pnet: Installing 9P2000 support1888worker2 # [ 1.791529] systemd-journald[67]: Collecting audit messages is disabled.1889lb # [ 1.783606] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1890worker2 # [ 1.793063] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1891worker1 # [ 1.746438] systemd[1]: Starting Load Kernel Modules...1892client # [ 1.780716] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1893worker2 # [ 1.797426] systemd[1]: modprobe@configfs.service: Deactivated successfully.1894lb # [ 1.795149] systemd[1]: Starting Coldplug All udev Devices...1895worker2 # [ 1.805346] systemd[1]: Finished Load Kernel Module configfs.1896worker1 # [ 1.769469] netfs: FS-Cache loaded1897client # [ 1.791454] systemd[1]: Starting Coldplug All udev Devices...1898worker2 # [ 1.808478] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1899worker1 # [ 1.775291] 9pnet: Installing 9P2000 support1900worker2 # [ 1.810627] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1901worker2 # [ 1.817788] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1902lb # [ 1.810986] systemd[1]: Finished Create List of Static Device Nodes.1903worker1 # [ 1.783708] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1904worker2 # [ 1.822057] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1905client # [ 1.808321] systemd[1]: Finished Create List of Static Device Nodes.1906lb # [ 1.815575] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1907client # [ 1.814825] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1908lb # [ 1.822386] systemd-journald[67]: Collecting audit messages is disabled.1909worker1 # [ 1.794647] systemd[1]: Starting Coldplug All udev Devices...1910lb # [ 1.823924] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1911client # [ 1.817887] systemd-journald[67]: Collecting audit messages is disabled.1912client # [ 1.821599] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1913lb # [ 1.830300] systemd[1]: modprobe@configfs.service: Deactivated successfully.1914lb # [ 1.835333] systemd[1]: Finished Load Kernel Module configfs.1915client # [ 1.828583] systemd[1]: modprobe@configfs.service: Deactivated successfully.1916worker1 # [ 1.810543] systemd[1]: Finished Create List of Static Device Nodes.1917worker2 # [ 1.848101] systemd[1]: Finished Load Kernel Modules.1918lb # [ 1.839499] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1919client # [ 1.834044] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1920lb # [ 1.843442] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1921client # [ 1.837524] systemd[1]: Finished Load Kernel Module configfs.1922worker1 # [ 1.816037] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1923worker1 # [ 1.817998] systemd-journald[67]: Collecting audit messages is disabled.1924worker2 # [ 1.856068] systemd[1]: Starting Apply Kernel Variables...1925client # [ 1.841643] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1926lb # [ 1.849786] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1927lb # [ 1.853977] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1928worker1 # [ 1.825725] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1929client # [ 1.848231] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1930worker1 # [ 1.831933] systemd[1]: modprobe@configfs.service: Deactivated successfully.1931client # [ 1.853363] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1932worker2 # [ 1.871056] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1933worker1 # [ 1.838776] systemd[1]: Finished Load Kernel Module configfs.1934worker1 # [ 1.842841] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1935worker2 # [ 1.880159] systemd[1]: Starting Create Static Device Nodes in /dev...1936worker1 # [ 1.846587] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1937lb # [ 1.881425] systemd[1]: Finished Load Kernel Modules.1938worker1 # [ 1.853094] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1939worker2 # [ 1.891078] systemd[1]: Finished Apply Kernel Variables.1940worker1 # [ 1.857447] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1941client # [ 1.880243] systemd[1]: Finished Load Kernel Modules.1942lb # [ 1.889080] systemd[1]: Starting Apply Kernel Variables...1943client # [ 1.887340] systemd[1]: Starting Apply Kernel Variables...1944worker2 # [ 1.906590] systemd[1]: Started Journal Service.1945worker2 # [ 1.776639] systemd-modules-load[68]: Inserted module 'dm_mod'1946worker2 # [ 1.780543] systemd-modules-load[68]: Inserted module 'virtio_balloon'1947lb # [ 1.903965] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1948worker2 # [ 1.781570] systemd-modules-load[68]: Inserted module 'virtio_gpu'1949client # [ 1.902244] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1950worker2 # [ 1.787235] systemd[1]: Finished Create Static Device Nodes in /dev.1951worker1 # [ 1.883883] systemd[1]: Finished Load Kernel Modules.1952lb # [ 1.913067] systemd[1]: Starting Create Static Device Nodes in /dev...1953worker2 # [ 1.792025] systemd[1]: Reached target Preparation for Local File Systems.1954worker2 # [ 1.794475] systemd[1]: Reached target Local File Systems.1955client # [ 1.911422] systemd[1]: Starting Create Static Device Nodes in /dev...1956worker1 # [ 1.891555] systemd[1]: Starting Apply Kernel Variables...1957worker2 # [ 1.798037] systemd[1]: Starting Create System Files and Directories...1958lb # [ 1.924996] systemd[1]: Finished Apply Kernel Variables.1959worker2 # [ 1.804461] systemd[1]: Starting Rule-based Manager for Device Events and Files...1960client # [ 1.928308] systemd[1]: Finished Apply Kernel Variables.1961worker1 # [ 1.907684] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1962lb # [ 1.938998] systemd[1]: Started Journal Service.1963lb # [ 1.807219] systemd-modules-load[68]: Inserted module 'dm_mod'1964client # [ 1.938878] systemd[1]: Started Journal Service.1965worker1 # [ 1.917574] systemd[1]: Starting Create Static Device Nodes in /dev...1966lb # [ 1.812109] systemd-modules-load[68]: Inserted module 'virtio_balloon'1967lb # [ 1.813198] systemd-modules-load[68]: Inserted module 'virtio_gpu'1968client # [ 1.806810] systemd-modules-load[68]: Inserted module 'dm_mod'1969worker2 # [ 1.827230] systemd[1]: Finished Create System Files and Directories.1970client # [ 1.810621] systemd-modules-load[68]: Inserted module 'virtio_balloon'1971lb # [ 1.818187] systemd[1]: Finished Create Static Device Nodes in /dev.1972client # [ 1.813332] systemd-modules-load[68]: Inserted module 'virtio_gpu'1973client # [ 1.817094] systemd[1]: Finished Create Static Device Nodes in /dev.1974lb # [ 1.823443] systemd[1]: Reached target Preparation for Local File Systems.1975worker1 # [ 1.930464] systemd[1]: Finished Apply Kernel Variables.1976lb # [ 1.825216] systemd[1]: Reached target Local File Systems.1977lb # [ 1.828057] systemd[1]: Starting Create System Files and Directories...1978client # [ 1.825697] systemd[1]: Reached target Preparation for Local File Systems.1979worker1 # [ 1.806234] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.939702] systemd[1]: Started Journal Service.1980worker1 # 1981client # [ 1.829085] systemd[1]: Reached target Local File Systems.1982worker1 # [ 1.808307] systemd-modules-load[68]: Inserted module 'virtio_balloon'1983lb # [ 1.834455] systemd[1]: Starting Rule-based Manager for Device Events and Files...1984client # [ 1.830138] systemd[1]: Starting Create System Files and Directories...1985worker1 # [ 1.811282] systemd-modules-load[68]: Inserted module 'virtio_gpu'1986worker2 # [ 1.850781] systemd-udevd[83]: Using default interface naming scheme 'v261'.1987client # [ 1.836067] systemd[1]: Starting Rule-based Manager for Device Events and Files...1988worker1 # [ 1.827101] systemd[1]: Finished Create Static Device Nodes in /dev.1989worker1 # [ 1.828100] systemd[1]: Reached target Preparation for Local File Systems.1990worker1 # [ 1.830504] systemd[1]: Reached target Local File Systems.1991worker1 # [ 1.832063] systemd[1]: Starting Create System Files and Directories...1992lb # [ 1.859960] systemd[1]: Finished Create System Files and Directories.1993worker1 # [ 1.836594] systemd[1]: Starting Rule-based Manager for Device Events and Files...1994worker2 # [ 1.875323] systemd[1]: Started Rule-based Manager for Device Events and Files.1995client # [ 1.863433] systemd[1]: Finished Create System Files and Directories.1996lb # [ 1.882369] systemd-udevd[82]: Using default interface naming scheme 'v261'.1997worker1 # [ 1.862197] systemd[1]: Finished Create System Files and Directories.1998client # [ 1.886244] systemd-udevd[83]: Using default interface naming scheme 'v261'.1999lb # [ 1.907298] systemd[1]: Started Rule-based Manager for Device Events and Files.2000worker2 # [ 1.919729] systemd[1]: Finished Coldplug All udev Devices.
loading 1,917 hidden lines…
3918lb # [ 12.354379] postgresql-pre-start[723]: running bootstrap script ... ok3919client # [ 12.486257] dhcpcd[564]: eth0: soliciting an IPv6 router3920client # [ 12.489204] dhcpcd[564]: eth0: Router Advertisement from fe80::23921client # [ 12.491334] dhcpcd[564]: eth0: adding address fec0::5054:ff:fe12:3456/643922worker1 # [ 12.473054] dhcpcd[699]: eth0: soliciting a DHCP lease3923client # [ 12.493497] dhcpcd[564]: eth0: adding route to fec0::/643924client # [ 12.495420] dhcpcd[564]: eth0: adding default route via fe80::23925worker1 # [ 12.622441] NET: Registered PF_PACKET protocol family3926worker1 # [ 12.494700] dhcpcd[699]: eth0: offered 10.0.2.15 from 10.0.2.23927worker1 # [ 12.497183] dhcpcd[699]: eth0: probing address 10.0.2.15/243928worker1 # [ 12.670811] dhcpcd[699]: eth0: soliciting an IPv6 router3929worker1 # [ 12.671982] dhcpcd[699]: eth0: Router Advertisement from fe80::23930worker1 # [ 12.672987] dhcpcd[699]: eth0: adding address fec0::5054:ff:fe12:3456/643931worker1 # [ 12.673891] dhcpcd[699]: eth0: adding route to fec0::/643932worker1 # [ 12.674692] dhcpcd[699]: eth0: adding default route via fe80::23933lb # [ 12.950918] postgresql-pre-start[723]: performing post-bootstrap initialization ... ok3934lb # [ 13.064727] postgresql-pre-start[723]: syncing data to disk ... ok3935lb # [ 13.065690] postgresql-pre-start[723]: initdb: warning: enabling "trust" authentication for local connections3936lb # [ 13.067052] postgresql-pre-start[723]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3937lb # [ 13.069040] postgresql-pre-start[723]: Success. You can now start the database server using:3938lb # [ 13.070283] postgresql-pre-start[723]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3939lb # [ 13.161793] postgres[792]: [792] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3940lb # [ 13.165589] postgres[792]: [792] LOG: listening on IPv6 address "::1", port 54323941lb # [ 13.166624] postgres[792]: [792] LOG: listening on IPv4 address "127.0.0.1", port 54323942lb # [ 13.169621] postgres[792]: [792] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3943lb # [ 13.179640] postgres[801]: [801] LOG: database system was shut down at 2026-09-20 09:04:54 GMT3944lb # [ 13.185290] postgres[792]: [792] LOG: database system is ready to accept connections3945lb # [ 13.191324] systemd[1]: Started PostgreSQL Server.3946lb # [ 13.195611] systemd[1]: Starting PostgreSQL Setup Scripts...3947lb # [ 13.350049] postgresql-setup-start[812]: CREATE DATABASE3948lb # [ 13.385904] postgresql-setup-start[817]: CREATE ROLE3949lb # [ 13.402480] postgresql-setup-start[819]: ALTER DATABASE3950lb # [ 13.407081] systemd[1]: Finished PostgreSQL Setup Scripts.3951lb # [ 13.408760] systemd[1]: Reached target PostgreSQL.3952worker2 # [ 14.140583] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds3953worker2 # [ 14.142777] dhcpcd[690]: eth0: adding route to 10.0.2.0/243954worker2 # [ 14.144759] dhcpcd[690]: eth0: adding default route via 10.0.2.23955worker2 # [ 14.266701] systemd[1]: Started DHCP Client.3956worker2 # [ 14.268564] systemd[1]: Reached target Multi-User System.3957worker2 # [ 14.269643] systemd[1]: Startup finished in 846ms (kernel) + 3.913s (initrd) + 9.508s (userspace) = 14.267s.3958client # [ 14.358503] dhcpcd[564]: eth0: leased 10.0.2.15 for 86400 seconds3959client # [ 14.360790] dhcpcd[564]: eth0: adding route to 10.0.2.0/243960client # [ 14.362814] dhcpcd[564]: eth0: adding default route via 10.0.2.23961client # [ 14.480068] systemd[1]: Started DHCP Client.3962client # [ 14.482257] systemd[1]: Reached target Multi-User System.3963client # [ 14.483638] systemd[1]: Startup finished in 848ms (kernel) + 4.084s (initrd) + 9.550s (userspace) = 14.483s.3964lb # [ 16.171329] dhcpcd[713]: eth0: leased 10.0.2.15 for 86400 seconds3965lb # [ 16.172502] dhcpcd[713]: eth0: adding route to 10.0.2.0/243966lb # [ 16.173339] dhcpcd[713]: eth0: adding default route via 10.0.2.23967lb # [ 16.251214] systemd[1]: Started DHCP Client.3968lb # [ 16.253462] systemd[1]: Reached target Network is Online.3969lb # [ 16.256702] systemd[1]: Started Envoy reverse proxy.3970lb # [ 16.259731] systemd[1]: Started mock-oidc.service.3971lb # [ 16.354395] mock-oidc-server[910]: Mock OIDC Server running3972lb # [ 16.356122] mock-oidc-server[910]: OIDC Address: 192.168.1.2:80803973lb # [ 16.357305] mock-oidc-server[910]: Issue Address: 0.0.0.0:80813974lb # [ 16.358360] mock-oidc-server[910]: Issuer: http://192.168.1.2:8080/oidc3975lb # [ 16.359417] mock-oidc-server[910]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3976lb # [ 16.360663] mock-oidc-server[910]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3977lb # [ 16.362125] mock-oidc-server[910]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3978lb # [ 16.729319] envoy[909]: [2026-09-20 09:04:58.705][909][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3979lb # [ 16.731106] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:469] statically linked extensions:3980lb # [ 16.732453] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3981lb # [ 16.735916] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3982lb # [ 16.749361] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3983lb # [ 16.755499] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3984lb # [ 16.760916] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3985lb # [ 16.763213] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3986lb # [ 16.765203] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3987lb # [ 16.767543] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3988lb # [ 16.769619] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3989lb # [ 16.772330] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3990lb # [ 16.774422] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3991lb # [ 16.776252] envoy[909]: [2026-09-20 09:04:58.706][909][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3992lb # [ 16.780618] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3993lb # [ 16.784405] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3994lb # [ 16.786149] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13995lb # [ 16.788175] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3996lb # [ 16.790209] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3997lb # [ 16.792763] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3998lb # [ 16.803531] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3999lb # [ 16.805950] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4000lb # [ 16.807687] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4001lb # [ 16.809281] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4002lb # [ 16.811082] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4003lb # [ 16.813773] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4004lb # [ 16.815507] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4005lb # [ 16.817073] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4006lb # [ 16.818895] envoy[909]: [2026-09-20 09:04:58.712][909][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4007lb # [ 16.820631] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4008lb # [ 16.827117] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4009lb # [ 16.829396] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24010lb # [ 16.831423] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4011lb # [ 16.833617] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4012lb # [ 16.836148] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4013lb # [ 16.838792] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4014lb # [ 16.844794] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4015lb # [ 16.846568] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4016lb # [ 16.848021] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4017lb # [ 16.849645] envoy[909]: [2026-09-20 09:04:58.719][909][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4018lb # [ 16.851234] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4019lb # [ 16.852841] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4020lb # [ 16.854271] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24021lb # [ 16.855933] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4022lb # [ 16.857892] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4023lb # [ 16.859570] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4024lb # [ 16.861192] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4025lb # [ 16.862877] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4026lb # [ 16.867239] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4027lb # [ 16.869064] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4028lb # [ 16.870857] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4029lb # [ 16.872737] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4030lb # [ 16.874526] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4031lb # [ 16.877445] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4032lb # [ 16.879092] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4033lb # [ 16.884699] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24034lb # [ 16.886141] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4035lb # [ 16.887812] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4036lb # [ 16.889595] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4037lb # [ 16.892494] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4038lb # [ 16.894100] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4039lb # [ 16.918486] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4040lb # [ 16.920143] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4041lb # [ 16.922177] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84042lb # [ 16.924057] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4043lb # [ 16.926602] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4044lb # [ 16.929086] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4045lb # [ 16.934822] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4046lb # [ 16.936386] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4047lb # [ 16.938632] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4048lb # [ 16.941052] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4049lb # [ 16.943376] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4050lb # [ 16.946924] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4051lb # [ 16.950962] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4052lb # [ 16.952669] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4053lb # [ 16.956343] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4054lb # [ 16.958268] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4055lb # [ 16.960425] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4056lb # [ 16.963267] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4057lb # [ 16.965904] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4058lb # [ 16.974647] envoy[909]: [2026-09-20 09:04:58.720][909][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4059lb # [ 16.976971] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4060lb # [ 16.981465] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4061lb # [ 16.983771] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4062lb # [ 16.986875] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4063lb # [ 16.989129] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4064lb # [ 16.993071] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4065lb # [ 16.995944] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4066lb # [ 16.998118] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4067lb # [ 17.000643] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4068lb # [ 17.002244] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4069lb # [ 17.003910] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4070lb # [ 17.005662] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4071lb # [ 17.007707] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4072lb # [ 17.010030] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4073lb # [ 17.011773] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4074lb # [ 17.014779] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4075lb # [ 17.017348] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4076lb # [ 17.019711] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4077lb # [ 17.021919] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4078lb # [ 17.023717] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4079lb # [ 17.025298] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4080lb # [ 17.027878] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4081lb # [ 17.029950] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4082lb # [ 17.033763] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4083lb # [ 17.035143] envoy[909]: [2026-09-20 09:04:58.721][909][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4084lb # [ 17.037317] envoy[909]: [2026-09-20 09:04:58.838][909][info][main] [source/server/server.cc:531] HTTP header map info:4085lb # [ 17.038516] envoy[909]: [2026-09-20 09:04:58.901][909][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4086lb # [ 17.050898] envoy[909]: [2026-09-20 09:04:58.901][909][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4087lb # [ 17.052203] envoy[909]: [2026-09-20 09:04:58.901][909][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4088lb # [ 17.059879] envoy[909]: [2026-09-20 09:04:58.901][909][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4089lb # [ 17.088300] envoy[909]: [2026-09-20 09:04:59.065][909][info][main] [source/server/server.cc:968] runtime: {}4090lb # [ 17.093434] envoy[909]: [2026-09-20 09:04:59.070][909][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4091lb # [ 17.095334] envoy[909]: [2026-09-20 09:04:59.072][909][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014092lb # [ 17.097610] envoy[909]: [2026-09-20 09:04:59.074][909][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014093lb # [ 17.100110] envoy[909]: [2026-09-20 09:04:59.077][909][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4094lb # [ 17.101643] envoy[909]: [2026-09-20 09:04:59.078][909][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4095lb # [ 17.103250] envoy[909]: [2026-09-20 09:04:59.078][909][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4096lb # [ 17.138494] envoy[909]: [2026-09-20 09:04:59.115][909][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4097worker1 # [ 17.113152] systemd[1]: Starting Nix worker-protocol over gRPC...4098worker2 # [ 17.158669] systemd[1]: Starting Nix worker-protocol over gRPC...4099lb # [ 17.156596] envoy[909]: [2026-09-20 09:04:59.133][909][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4100lb # [ 17.159366] envoy[909]: [2026-09-20 09:04:59.136][909][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4101lb # [ 17.162297] envoy[909]: [2026-09-20 09:04:59.136][909][info][main] [source/server/server.cc:1077] starting main dispatch loop4102worker1 # [ 17.230680] dhcpcd[699]: eth0: leased 10.0.2.15 for 86400 seconds4103worker1 # [ 17.232287] dhcpcd[699]: eth0: adding route to 10.0.2.0/244104worker1 # [ 17.233465] dhcpcd[699]: eth0: adding default route via 10.0.2.24105worker1 # [ 17.324244] nix-grpc-daemon[734]: ts=2026-09-20T09:04:58Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4106worker2 # [ 17.373539] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4107worker1 # [ 17.339937] nix-grpc-daemon[734]: ts=2026-09-20T09:04:58Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14108worker2 # [ 17.384857] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14109worker1 # [ 17.378853] systemd[1]: Started DHCP Client.4110worker1 # [ 17.380353] systemd[1]: Reached target Multi-User System.4111worker1 # [ 17.381568] nix-grpc-daemon[734]: ts=2026-09-20T09:04:58Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4112worker1 # [ 17.384826] systemd[1]: Started Nix worker-protocol over gRPC.4113worker2 # [ 17.422244] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4114worker2 # [ 17.424976] systemd[1]: Started Nix worker-protocol over gRPC.4115worker1 # [ 17.387704] systemd[1]: Startup finished in 856ms (kernel) + 4.940s (initrd) + 11.588s (userspace) = 17.385s.4116lb # [ 17.460638] envoy[909]: [2026-09-20 09:04:59.437][909][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4117lb # [ 17.464860] envoy[909]: [2026-09-20 09:04:59.441][909][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4118lb # [ 17.469218] envoy[909]: [2026-09-20 09:04:59.446][909][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4119worker1 # [ 17.449217] nix-grpc-daemon[734]: ts=2026-09-20T09:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4120lb # [ 17.473606] envoy[909]: [2026-09-20 09:04:59.446][909][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4121worker2 # [ 17.506383] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=scheduler_connected addr=lb:500514122worker2 # [ 17.528186] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4123worker1 # [ 17.650445] nix-grpc-daemon[734]: ts=2026-09-20T09:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4124worker2 # [ 17.729428] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=scheduler_connected addr=lb:500514125worker2 # [ 17.743557] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4126worker2 # [ 17.944675] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=scheduler_connected addr=lb:500514127worker2 # [ 17.948726] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4128worker1 # [ 18.050749] nix-grpc-daemon[734]: ts=2026-09-20T09:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4129worker2 # [ 18.149718] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=scheduler_connected addr=lb:500514130worker2 # [ 18.155188] nix-grpc-daemon[782]: ts=2026-09-20T09:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4131worker2 # [ 18.356281] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_connected addr=lb:500514132worker2 # [ 18.360359] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4133worker2 # [ 18.563799] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 18.566951] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4135worker2 # [ 18.764217] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_connected addr=lb:500514136worker2 # [ 18.767123] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4137worker1 # [ 18.855342] nix-grpc-daemon[734]: ts=2026-09-20T09:05:00Z level=info event=scheduler_connected addr=lb:500514138worker1 # [ 18.859395] nix-grpc-daemon[734]: ts=2026-09-20T09:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4139worker2 # [ 18.968346] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_connected addr=lb:500514140worker2 # [ 18.972492] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4141worker1 # [ 19.059955] nix-grpc-daemon[734]: ts=2026-09-20T09:05:00Z level=info event=scheduler_connected addr=lb:500514142worker1 # [ 19.062948] nix-grpc-daemon[734]: ts=2026-09-20T09:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4143worker2 # [ 19.172392] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_connected addr=lb:500514144worker2 # [ 19.174609] nix-grpc-daemon[782]: ts=2026-09-20T09:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4145worker1 # [ 19.264143] nix-grpc-daemon[734]: ts=2026-09-20T09:05:00Z level=info event=scheduler_connected addr=lb:500514146worker1 # [ 19.268157] nix-grpc-daemon[734]: ts=2026-09-20T09:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4147worker2 # [ 19.375264] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514148worker2 # [ 19.377217] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4149worker1 # [ 19.468643] nix-grpc-daemon[734]: ts=2026-09-20T09:05:00Z level=info event=scheduler_connected addr=lb:500514150worker1 # [ 19.472553] nix-grpc-daemon[734]: ts=2026-09-20T09:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4151worker2 # [ 19.578274] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514152worker2 # [ 19.579920] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4153worker1 # [ 19.673730] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514154worker1 # [ 19.676328] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4155worker2 # [ 19.780802] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514156worker2 # [ 19.784828] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4157worker1 # [ 19.878370] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514158worker1 # [ 19.882100] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4159worker2 # [ 19.985200] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514160worker2 # [ 19.987683] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4161worker1 # [ 20.082927] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514162worker1 # [ 20.086847] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4163worker2 # [ 20.188785] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514164worker2 # [ 20.192677] nix-grpc-daemon[782]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4165worker1 # [ 20.287602] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514166worker1 # [ 20.291428] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4167worker2 # [ 20.393078] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514168worker2 # [ 20.396289] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4169worker1 # [ 20.491824] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_connected addr=lb:500514170worker1 # [ 20.493565] nix-grpc-daemon[734]: ts=2026-09-20T09:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4171worker2 # [ 20.597388] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514172worker2 # [ 20.599222] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4173worker1 # [ 20.694503] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514174worker1 # [ 20.698358] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4175worker2 # [ 20.800256] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514176worker2 # [ 20.804128] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4177worker1 # [ 20.900373] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514178worker1 # [ 20.904972] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4179worker2 # [ 21.004495] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514180worker2 # [ 21.007049] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4181worker1 # [ 21.105532] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514182worker1 # [ 21.109282] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4183worker2 # [ 21.207904] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514184worker2 # [ 21.212108] nix-grpc-daemon[782]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4185worker1 # [ 21.309677] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514186worker1 # [ 21.313204] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4187worker2 # [ 21.412555] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514188worker2 # [ 21.416388] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4189worker1 # [ 21.514191] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_connected addr=lb:500514190worker1 # [ 21.518632] nix-grpc-daemon[734]: ts=2026-09-20T09:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4191worker2 # [ 21.617963] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514192worker2 # [ 21.621740] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4193worker1 # [ 21.719227] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514194worker1 # [ 21.723914] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4195worker2 # [ 21.822841] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514196worker2 # [ 21.827212] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4197worker1 # [ 21.924691] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514198worker1 # [ 21.927561] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4199worker2 # [ 22.027802] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514200worker2 # [ 22.031818] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4201worker1 # [ 22.128329] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514202worker1 # [ 22.130782] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4203worker2 # [ 22.232718] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514204worker2 # [ 22.236731] nix-grpc-daemon[782]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4205worker1 # [ 22.331982] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514206worker1 # [ 22.336248] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4207worker2 # [ 22.437498] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514208worker2 # [ 22.441440] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4209worker1 # [ 22.537077] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_connected addr=lb:500514210worker1 # [ 22.541286] nix-grpc-daemon[734]: ts=2026-09-20T09:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4211worker2 # [ 22.643295] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514212worker2 # [ 22.647060] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4213worker1 # [ 22.742082] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514214worker1 # [ 22.746135] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4215worker2 # [ 22.847970] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514216worker2 # [ 22.852085] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4217worker1 # [ 22.946988] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514218worker1 # [ 22.949498] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4219worker2 # [ 23.052901] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514220worker2 # [ 23.056906] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4221worker1 # [ 23.150570] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514222worker1 # [ 23.154652] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4223worker2 # [ 23.257292] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514224worker2 # [ 23.260281] nix-grpc-daemon[782]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4225worker1 # [ 23.355111] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514226worker1 # [ 23.357813] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4227worker2 # [ 23.461346] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514228worker2 # [ 23.465246] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4229worker1 # [ 23.558546] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_connected addr=lb:500514230worker1 # [ 23.560959] nix-grpc-daemon[734]: ts=2026-09-20T09:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4231worker2 # [ 23.666608] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514232worker2 # [ 23.670311] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4233worker1 # [ 23.762057] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514234worker1 # [ 23.766106] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4235worker2 # [ 23.871174] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514236worker2 # [ 23.875199] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4237worker1 # [ 23.966809] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514238worker1 # [ 23.969646] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4239worker2 # [ 24.075976] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514240worker2 # [ 24.079973] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4241worker1 # [ 24.170389] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514242worker1 # [ 24.173308] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4243worker2 # [ 24.280752] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514244worker2 # [ 24.284693] nix-grpc-daemon[782]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4245worker1 # [ 24.374245] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514246worker1 # [ 24.378209] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4247worker2 # [ 24.485491] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514248worker2 # [ 24.489779] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4249worker1 # [ 24.578621] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_connected addr=lb:500514250worker1 # [ 24.581470] nix-grpc-daemon[734]: ts=2026-09-20T09:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4251worker2 # [ 24.691439] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514252worker2 # [ 24.695584] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4253worker1 # [ 24.782118] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514254worker1 # [ 24.784715] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4255worker2 # [ 24.896261] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514256worker2 # [ 24.900148] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4257worker1 # [ 24.985717] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514258worker1 # [ 24.988377] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4259worker2 # [ 25.100891] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514260worker2 # [ 25.105216] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4261worker1 # [ 25.188972] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514262worker1 # [ 25.191815] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4263worker2 # [ 25.305458] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514264worker2 # [ 25.309542] nix-grpc-daemon[782]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4265worker1 # [ 25.392537] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514266worker1 # [ 25.395094] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4267worker2 # [ 25.509754] nix-grpc-daemon[782]: ts=2026-09-20T09:05:07Z level=info event=scheduler_connected addr=lb:500514268worker2 # [ 25.511400] nix-grpc-daemon[782]: ts=2026-09-20T09:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4269worker1 # [ 25.595750] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_connected addr=lb:500514270worker1 # [ 25.598530] nix-grpc-daemon[734]: ts=2026-09-20T09:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4271worker2 # [ 25.713211] nix-grpc-daemon[782]: ts=2026-09-20T09:05:07Z level=info event=scheduler_connected addr=lb:500514272worker2 # [ 25.716996] nix-grpc-daemon[782]: ts=2026-09-20T09:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4273worker1 # [ 25.799604] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_connected addr=lb:500514274worker1 # [ 25.803541] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4275worker2 # [ 25.917792] nix-grpc-daemon[782]: ts=2026-09-20T09:05:07Z level=info event=scheduler_connected addr=lb:500514276worker2 # [ 25.921649] nix-grpc-daemon[782]: ts=2026-09-20T09:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4277worker1 # [ 26.004988] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_connected addr=lb:500514278worker1 # [ 26.008884] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4279worker2 # [ 26.122513] nix-grpc-daemon[782]: ts=2026-09-20T09:05:07Z level=info event=scheduler_connected addr=lb:500514280worker2 # [ 26.126358] nix-grpc-daemon[782]: ts=2026-09-20T09:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4281worker1 # [ 26.209759] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_connected addr=lb:500514282worker1 # [ 26.213896] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4283worker2 # [ 26.326809] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_connected addr=lb:500514284worker2 # [ 26.329242] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4285worker1 # [ 26.414603] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 26.418444] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4287worker2 # [ 26.529693] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_connected addr=lb:500514288worker2 # [ 26.531891] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4289worker1 # [ 26.619662] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_connected addr=lb:500514290worker1 # [ 26.623612] nix-grpc-daemon[734]: ts=2026-09-20T09:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4291worker2 # [ 26.733935] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_connected addr=lb:500514292worker2 # [ 26.737822] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4293worker1 # [ 26.824545] nix-grpc-daemon[734]: ts=2026-09-20T09:05:08Z level=info event=scheduler_connected addr=lb:500514294worker1 # [ 26.828653] nix-grpc-daemon[734]: ts=2026-09-20T09:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4295worker2 # [ 26.938465] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_connected addr=lb:500514296worker2 # [ 26.940226] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4297worker1 # [ 27.030489] nix-grpc-daemon[734]: ts=2026-09-20T09:05:08Z level=info event=scheduler_connected addr=lb:500514298worker1 # [ 27.034339] nix-grpc-daemon[734]: ts=2026-09-20T09:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4299worker2 # [ 27.140884] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_connected addr=lb:500514300worker2 # [ 27.142879] nix-grpc-daemon[782]: ts=2026-09-20T09:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4301worker1 # [ 27.239573] nix-grpc-daemon[734]: ts=2026-09-20T09:05:08Z level=info event=scheduler_connected addr=lb:500514302worker1 # [ 27.243815] nix-grpc-daemon[734]: ts=2026-09-20T09:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4303worker2 # [ 27.343907] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514304worker2 # [ 27.348069] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4305worker1 # [ 27.444278] nix-grpc-daemon[734]: ts=2026-09-20T09:05:08Z level=info event=scheduler_connected addr=lb:500514306worker1 # [ 27.447710] nix-grpc-daemon[734]: ts=2026-09-20T09:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4307worker2 # [ 27.548557] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514308worker2 # [ 27.550483] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4309worker1 # [ 27.648395] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514310worker1 # [ 27.650708] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4311worker2 # [ 27.751607] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514312worker2 # [ 27.753373] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4313worker1 # [ 27.851310] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514314worker1 # [ 27.854266] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4315worker2 # [ 27.954101] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514316worker2 # [ 27.956914] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4317worker1 # [ 28.056259] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514318worker1 # [ 28.060359] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4319worker2 # [ 28.157503] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514320worker2 # [ 28.160608] nix-grpc-daemon[782]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4321worker1 # [ 28.260788] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514322worker1 # [ 28.263613] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4323worker2 # [ 28.361429] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514324worker2 # [ 28.363570] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4325worker1 # [ 28.464056] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_connected addr=lb:500514326worker1 # [ 28.466583] nix-grpc-daemon[734]: ts=2026-09-20T09:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4327worker2 # [ 28.564259] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514328worker2 # [ 28.566488] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4329worker1 # [ 28.667340] nix-grpc-daemon[734]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514330worker1 # [ 28.669997] nix-grpc-daemon[734]: ts=2026-09-20T09:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4331worker2 # [ 28.767772] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514332worker2 # [ 28.769536] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4333worker1 # [ 28.870626] nix-grpc-daemon[734]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514334worker1 # [ 28.873691] nix-grpc-daemon[734]: ts=2026-09-20T09:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4335lb # [ 28.948575] rustfs-bucket-start[1029]: mb s3://farm4336lb # [ 28.954241] systemd[1]: Finished rustfs-bucket.service.4337lb # [ 28.960987] systemd[1]: Starting niks3 server...4338worker2 # [ 28.970823] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514339worker2 # [ 28.975564] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4340worker1 # [ 29.074783] nix-grpc-daemon[734]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514341worker1 # [ 29.076940] nix-grpc-daemon[734]: ts=2026-09-20T09:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4342worker2 # [ 29.176102] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514343worker2 # [ 29.177957] nix-grpc-daemon[782]: ts=2026-09-20T09:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4344lb # [ 29.196046] postgres[1049]: [1049] ERROR: relation "goose_db_version" does not exist at character 364345lb # [ 29.197255] postgres[1049]: [1049] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4346lb # [ 29.232290] niks3-server[1037]: 2026/09/20 09:05:11 OK 20241026095416_initial_model.sql (18.3ms)4347lb # [ 29.236226] niks3-server[1037]: 2026/09/20 09:05:11 OK 20251210153512_drop_unused_gin_index.sql (2.19ms)4348lb # [ 29.240839] niks3-server[1037]: 2026/09/20 09:05:11 OK 20251218171726_add_pins.sql (4.48ms)4349lb # [ 29.246050] niks3-server[1037]: 2026/09/20 09:05:11 OK 20260628120000_add_object_size_and_stats.sql (5.33ms)4350lb # [ 29.250712] niks3-server[1037]: 2026/09/20 09:05:11 OK 20260905000000_add_claims.sql (3.43ms)4351lb # [ 29.255096] niks3-server[1037]: 2026/09/20 09:05:11 OK 20260920000000_drop_claims.sql (3.02ms)4352lb # [ 29.256299] niks3-server[1037]: 2026/09/20 09:05:11 goose: successfully migrated database to version: 202609200000004353lb # [ 29.261764] niks3-server[1037]: 2026/09/20 09:05:11 OK 1_commit_pending_closure.sql (6.75ms)4354lb # [ 29.264491] niks3-server[1037]: 2026/09/20 09:05:11 OK 2_object_stats_trigger.sql (1.52ms)4355lb # [ 29.265711] niks3-server[1037]: 2026/09/20 09:05:11 goose: up to current file version: 24356lb # [ 29.272512] niks3-server[1037]: 2026/09/20 09:05:11 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4357worker1 # [ 29.277986] nix-grpc-daemon[734]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514358worker1 # [ 29.281937] nix-grpc-daemon[734]: ts=2026-09-20T09:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4359lb # [ 29.345193] niks3-server[1037]: 2026/09/20 09:05:11 INFO Read proxy enabled — serving cache objects from S34360lb # [ 29.347178] niks3-server[1037]: 2026/09/20 09:05:11 INFO Using socket-activated listener address=0.0.0.0:57514361lb # [ 29.353057] niks3-server[1037]: 2026/09/20 09:05:11 INFO systemd watchdog enabled interval=15s4362lb # [ 29.354295] systemd[1]: Started niks3 server.4363lb # [ 29.354919] systemd[1]: Reached target Multi-User System.4364lb # [ 29.357367] systemd[1]: Startup finished in 854ms (kernel) + 4.127s (initrd) + 24.375s (userspace) = 29.357s.4365lb # [ 29.359366] niks3-server[1037]: 2026/09/20 09:05:11 INFO Starting HTTP server address=0.0.0.0:57514366lb # [ 29.365250] niks3-server[1037]: 2026/09/20 09:05:11 INFO lead: acquired remote=192.168.1.4:544364367worker2 # [ 29.378931] nix-grpc-daemon[782]: ts=2026-09-20T09:05:11Z level=info event=scheduler_connected addr=lb:500514368worker2 # [ 29.384313] nix-grpc-daemon[782]: ts=2026-09-20T09:05:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4369worker2 # [ 29.389834] nix-grpc-daemon[782]: ts=2026-09-20T09:05:11Z level=info event=scheduler_take_over4370worker1 # [ 29.482723] nix-grpc-daemon[734]: ts=2026-09-20T09:05:10Z level=info event=scheduler_connected addr=lb:500514371worker2 # [ 29.524916] nix-grpc-daemon[782]: ts=2026-09-20T09:05:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04372worker2 # [ 29.584394] nix-grpc-daemon[782]: ts=2026-09-20T09:05:11Z level=info event=scheduler_connected addr=lb:500514373worker2 # [ 29.586252] nix-grpc-daemon[782]: ts=2026-09-20T09:05:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04374lb: (finished: waiting for unit niks3.service, in 18.40 seconds)4375lb: waiting for TCP port 5751 on localhost4376lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4377lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4378lb: waiting for unit envoy.service4379lb: (finished: waiting for unit envoy.service, in 0.04 seconds)4380lb: waiting for TCP port 50051 on localhost4381lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4382lb # [ 30.284828] envoy[909]: conn peer=[::1]:50022 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24383lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4384lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4385??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4386 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284387lb: must succeed: curl -sf localhost:9901/clusters4388lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4389lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.10 seconds)4390subtest: one node schedules and both builders hold a WorkerSession on it4391lb: must succeed: curl -sf localhost:9901/clusters4392lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4393worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4394worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4395(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.12 seconds)4396subtest: balancer auth: client cert, bearer token, nothing, unknown CN4397worker2 # [ 30.942932] nix-grpc-daemon[782]: ts=2026-09-20T09:05:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:413324398worker2 # [ 30.954499] systemd[1]: Started Nix Daemon.4399worker2 # [ 31.164927] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)4400worker2 # [ 31.216956] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5)4401worker2 # [ 31.287889] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 19 ms (attempt 2/5)4402worker2 # [ 31.307234] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 285 ms (attempt 3/5)4403worker2 # [ 31.598320] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 763 ms (attempt 4/5)4404worker2 # [ 32.374877] nix-grpc-daemon[782]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4405worker1 # [ 32.372395] nix-grpc-daemon[734]: ts=2026-09-20T09:05:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:411644406worker1 # [ 32.384894] systemd[1]: Started Nix Daemon.4407worker1 # [ 32.600120] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4408worker1 # [ 32.631832] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 1/5)4409worker1 # [ 32.638878] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 185 ms (attempt 2/5)4410worker1 # [ 32.826571] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 282 ms (attempt 3/5)4411worker1 # [ 33.114444] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 4/5)4412worker1 # [ 33.159297] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4413worker1 # [ 33.179732] nix-grpc-daemon[734]: ts=2026-09-20T09:05:14Z level=debug event=path_info_miss path=bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test error="error: path '/nix/store/bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test' is required, but there is no substituter that can build it"4414worker1 # [ 33.192794] nix-grpc-daemon[734]: ts=2026-09-20T09:05:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:411644415worker1 # [ 33.202943] nix-grpc-daemon[734]: ts=2026-09-20T09:05:14Z level=debug event=path_info_miss path=bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test error="error: path '/nix/store/bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test' is required, but there is no substituter that can build it"4416client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4417client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4418client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4419client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4420worker2 # [ 33.596758] nix-grpc-daemon[782]: ts=2026-09-20T09:05:15Z level=info event=oidc_jwks provider=mock keys=14421worker2 # [ 33.600713] nix-grpc-daemon[782]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:413324422worker2 # [ 33.615380] nix-grpc-daemon[782]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:413324423worker2 # [ 33.634129] nix-grpc-daemon[782]: ts=2026-09-20T09:05:15Z level=debug event=path_info_miss path=bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test error="error: path '/nix/store/bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test' is required, but there is no substituter that can build it"4424worker1 # [ 33.615567] nix-grpc-daemon[734]: ts=2026-09-20T09:05:14Z level=info event=oidc_jwks provider=mock keys=14425worker1 # [ 33.619540] nix-grpc-daemon[734]: ts=2026-09-20T09:05:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:411644426worker1 # [ 33.625316] nix-grpc-daemon[734]: ts=2026-09-20T09:05:14Z level=debug event=path_info_miss path=bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test error="error: path '/nix/store/bgb9qwzhklrxfjy4awx25fzniv721g1y-nixos-system-client-test' is required, but there is no substituter that can build it"4427client: must succeed: rm -r /var/lib/nix-grpc-store4428client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4429worker1 # [ 33.868279] nix-grpc-daemon[734]: ts=2026-09-20T09:05:15Z level=info event=denied method=QueryMissing cn=- role=none4430worker1 # [ 34.077424] nix-grpc-daemon[734]: ts=2026-09-20T09:05:15Z level=info event=denied method=QueryMissing cn=stranger role=none4431(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.49 seconds)4432subtest: DAG build is scheduled across workers and lands in the cache4433client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24434worker1 # [ 34.313124] nix-grpc-daemon[734]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:411644435client # don't know how to build these paths:4436client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4437worker2 # [ 34.368875] nix-grpc-daemon[782]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413324438worker2 # [ 34.398738] nix-grpc-daemon[782]: ts=2026-09-20T09:05:16Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04439worker2 # [ 34.402848] nix-grpc-daemon[782]: ts=2026-09-20T09:05:16Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14440worker1 # [ 34.420883] nix-grpc-daemon[734]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644441worker1 # [ 34.442987] nix-grpc-daemon[734]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644442client # copying 1 paths to 'lb:50051'...4443worker1 # [ 34.454260] nix-grpc-daemon[734]: ts=2026-09-20T09:05:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411644444client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4445worker1 # [ 34.480928] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4446worker1 # [ 34.510610] nix-grpc-daemon[734]: ts=2026-09-20T09:05:15Z level=info event=niks3_push_started pid=8584447worker1 # [ 35.022048] nix-daemon[848]: accepted connection from pid 870, user nix-grpc-daemon (trusted)4448worker1 # [ 35.036872] nix-daemon[848]: reaped child process 873, status = succeeded4449worker1 # [ 35.197495] nix-daemon[848]: accepted connection from pid 875, user nix-grpc-daemon (trusted)4450worker1 # [ 35.210408] nix-daemon[848]: reaped child process 878, status = succeeded4451lb # [ 35.249795] niks3-server[1037]: 2026/09/20 09:05:17 INFO Received uploads request method=POST path=/api/pending_closures4452worker1 # [ 35.239524] nix-grpc-daemon[858]: time=2026-09-20T09:05:16.604Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4453worker1 # [ 35.242878] nix-grpc-daemon[858]: time=2026-09-20T09:05:16.608Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4454lb # [ 35.305798] niks3-server[1037]: 2026/09/20 09:05:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4455lb # [ 35.317107] niks3-server[1037]: 2026/09/20 09:05:17 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4456lb # [ 35.327518] niks3-server[1037]: 2026/09/20 09:05:17 INFO Signed narinfos id=1 count=14457worker1 # [ 35.300803] nix-grpc-daemon[858]: time=2026-09-20T09:05:16.667Z level=INFO msg="Uploading 1 narinfos"4458lb # [ 35.336368] niks3-server[1037]: 2026/09/20 09:05:17 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4459lb # [ 35.339147] niks3-server[1037]: 2026/09/20 09:05:17 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4460lb # [ 35.348901] niks3-server[1037]: 2026/09/20 09:05:17 INFO Completed upload id=14461worker1 # [ 35.323261] nix-grpc-daemon[858]: time=2026-09-20T09:05:16.689Z level=INFO msg="Upload complete. (497ms)"4462lb # [ 35.352956] niks3-server[1037]: 2026/09/20 09:05:17 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4463worker1 # [ 35.328564] nix-grpc-daemon[734]: ts=2026-09-20T09:05:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_in=5044464worker1 # [ 35.335612] nix-grpc-daemon[734]: ts=2026-09-20T09:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644465worker1 # [ 35.347125] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4466worker1 # [ 35.351892] nix-daemon[848]: reaped child process 856, status = succeeded4467client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4468worker1 # [ 35.356837] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4469client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4470client # farm-a> LOG-farm-a-t14471worker1 # [ 36.770091] nix-daemon[848]: reaped child process 882, status = succeeded4472worker1 # [ 36.925078] nix-daemon[848]: accepted connection from pid 899, user nix-grpc-daemon (trusted)4473worker1 # [ 36.936539] nix-daemon[848]: reaped child process 902, status = succeeded4474lb # [ 36.978074] niks3-server[1037]: 2026/09/20 09:05:18 INFO Received uploads request method=POST path=/api/pending_closures4475worker1 # [ 36.958904] nix-grpc-daemon[858]: time=2026-09-20T09:05:18.325Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4476worker1 # [ 36.960567] nix-grpc-daemon[858]: time=2026-09-20T09:05:18.325Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4477lb # [ 37.009302] niks3-server[1037]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4478lb # [ 37.013443] niks3-server[1037]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4479lb # [ 37.016832] niks3-server[1037]: 2026/09/20 09:05:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4480lb # [ 37.018691] niks3-server[1037]: 2026/09/20 09:05:18 INFO Signed narinfos id=2 count=14481worker1 # [ 36.994395] nix-grpc-daemon[858]: time=2026-09-20T09:05:18.360Z level=INFO msg="Uploading 1 narinfos"4482lb # [ 37.022522] niks3-server[1037]: 2026/09/20 09:05:18 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4483lb # [ 37.027157] niks3-server[1037]: 2026/09/20 09:05:19 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4484lb # [ 37.032247] niks3-server[1037]: 2026/09/20 09:05:19 INFO Completed upload id=24485worker1 # [ 37.006345] nix-grpc-daemon[858]: time=2026-09-20T09:05:18.372Z level=INFO msg="Upload complete. (240ms)"4486lb # [ 37.034186] niks3-server[1037]: 2026/09/20 09:05:19 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4487worker1 # [ 37.009098] nix-grpc-daemon[734]: ts=2026-09-20T09:05:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14488worker1 # [ 37.015312] nix-daemon[848]: reaped child process 880, status = succeeded4489worker2 # [ 37.058593] nix-grpc-daemon[782]: ts=2026-09-20T09:05:18Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04490worker2 # [ 37.060476] nix-grpc-daemon[782]: ts=2026-09-20T09:05:18Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14491worker1 # [ 37.064803] nix-grpc-daemon[734]: ts=2026-09-20T09:05:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644492worker1 # [ 37.074768] nix-grpc-daemon[734]: ts=2026-09-20T09:05:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644493worker1 # [ 37.084692] nix-grpc-daemon[858]: time=2026-09-20T09:05:18.451Z level=INFO msg="All 1 paths already cached"4494client # copying 1 paths to 'lb:50051'...4495client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4496worker1 # [ 37.090812] nix-grpc-daemon[734]: ts=2026-09-20T09:05:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411644497worker1 # [ 37.101214] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4498lb # [ 37.145754] envoy[909]: conn peer=[2001:db8:1::1]:36820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=23434499lb # [ 37.147313] envoy[909]: conn peer=[2001:db8:1::1]:56974 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=984500lb # [ 37.148652] envoy[909]: conn peer=[2001:db8:1::1]:56984 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=144501lb # [ 37.150066] envoy[909]: conn peer=[2001:db8:1::1]:56990 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84502worker1 # [ 37.272522] nix-daemon[848]: accepted connection from pid 906, user nix-grpc-daemon (trusted)4503worker1 # [ 37.285162] nix-daemon[848]: reaped child process 909, status = succeeded4504worker1 # [ 37.455124] nix-daemon[848]: accepted connection from pid 911, user nix-grpc-daemon (trusted)4505worker1 # [ 37.466986] nix-daemon[848]: reaped child process 914, status = succeeded4506lb # [ 37.508363] niks3-server[1037]: 2026/09/20 09:05:19 INFO Received uploads request method=POST path=/api/pending_closures4507worker1 # [ 37.487979] nix-grpc-daemon[858]: time=2026-09-20T09:05:18.854Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4508worker1 # [ 37.489472] nix-grpc-daemon[858]: time=2026-09-20T09:05:18.855Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4509lb # [ 37.534628] niks3-server[1037]: 2026/09/20 09:05:19 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4510lb # [ 37.546804] niks3-server[1037]: 2026/09/20 09:05:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4511worker1 # [ 37.527987] nix-grpc-daemon[858]: time=2026-09-20T09:05:18.894Z level=INFO msg="Uploading 1 narinfos"4512lb # [ 37.553814] niks3-server[1037]: 2026/09/20 09:05:19 INFO Signed narinfos id=3 count=14513lb # [ 37.558049] niks3-server[1037]: 2026/09/20 09:05:19 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4514lb # [ 37.568451] niks3-server[1037]: 2026/09/20 09:05:19 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4515lb # [ 37.575186] niks3-server[1037]: 2026/09/20 09:05:19 INFO Completed upload id=34516worker1 # [ 37.549315] nix-grpc-daemon[858]: time=2026-09-20T09:05:18.915Z level=INFO msg="Upload complete. (437ms)"4517lb # [ 37.578179] niks3-server[1037]: 2026/09/20 09:05:19 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4518worker1 # [ 37.552966] nix-grpc-daemon[734]: ts=2026-09-20T09:05:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_in=6244519worker1 # [ 37.558429] nix-grpc-daemon[734]: ts=2026-09-20T09:05:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644520worker1 # [ 37.566307] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4521worker1 # [ 37.571408] nix-daemon[848]: reaped child process 904, status = succeeded4522client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4523client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4524worker1 # [ 37.576202] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4525client # farm-b> LOG-farm-b-t14526worker1 # [ 38.802537] nix-daemon[848]: reaped child process 918, status = succeeded4527worker1 # [ 38.966984] nix-daemon[848]: accepted connection from pid 933, user nix-grpc-daemon (trusted)4528worker1 # [ 38.977728] nix-daemon[848]: reaped child process 936, status = succeeded4529lb # [ 39.020184] niks3-server[1037]: 2026/09/20 09:05:20 INFO Received uploads request method=POST path=/api/pending_closures4530worker1 # [ 39.004534] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.370Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4531worker1 # [ 39.006166] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.372Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4532lb # [ 39.053704] niks3-server[1037]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4533lb # [ 39.064736] niks3-server[1037]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4534lb # [ 39.075922] niks3-server[1037]: 2026/09/20 09:05:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4535lb # [ 39.082383] niks3-server[1037]: 2026/09/20 09:05:21 INFO Signed narinfos id=4 count=14536worker1 # [ 39.057109] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.423Z level=INFO msg="Uploading 1 narinfos"4537lb # [ 39.086179] niks3-server[1037]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4538lb # [ 39.095870] niks3-server[1037]: 2026/09/20 09:05:21 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4539lb # [ 39.100499] niks3-server[1037]: 2026/09/20 09:05:21 INFO Completed upload id=44540lb # [ 39.103160] niks3-server[1037]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4541worker1 # [ 39.075861] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.442Z level=INFO msg="Upload complete. (291ms)"4542worker1 # [ 39.082372] nix-grpc-daemon[734]: ts=2026-09-20T09:05:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14543worker2 # [ 39.126872] nix-grpc-daemon[782]: ts=2026-09-20T09:05:20Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04544worker1 # [ 39.095325] nix-daemon[848]: reaped child process 916, status = succeeded4545worker2 # [ 39.131116] nix-grpc-daemon[782]: ts=2026-09-20T09:05:20Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14546worker1 # [ 39.133705] nix-grpc-daemon[734]: ts=2026-09-20T09:05:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644547worker1 # [ 39.151696] nix-grpc-daemon[734]: ts=2026-09-20T09:05:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644548worker1 # [ 39.165125] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.531Z level=INFO msg="All 2 paths already cached"4549client # copying 1 paths to 'lb:50051'...4550worker1 # [ 39.173570] nix-grpc-daemon[734]: ts=2026-09-20T09:05:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411644551client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4552worker1 # [ 39.191764] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4553worker1 # [ 39.360658] nix-daemon[848]: accepted connection from pid 940, user nix-grpc-daemon (trusted)4554worker1 # [ 39.372831] nix-daemon[848]: reaped child process 943, status = succeeded4555worker1 # [ 39.535369] nix-daemon[848]: accepted connection from pid 945, user nix-grpc-daemon (trusted)4556worker1 # [ 39.546311] nix-daemon[848]: reaped child process 948, status = succeeded4557lb # [ 39.587151] niks3-server[1037]: 2026/09/20 09:05:21 INFO Received uploads request method=POST path=/api/pending_closures4558worker1 # [ 39.571084] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.937Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4559worker1 # [ 39.572586] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.939Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4560lb # [ 39.617206] niks3-server[1037]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4561lb # [ 39.628109] niks3-server[1037]: 2026/09/20 09:05:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4562worker1 # [ 39.607307] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.973Z level=INFO msg="Uploading 1 narinfos"4563lb # [ 39.633645] niks3-server[1037]: 2026/09/20 09:05:21 INFO Signed narinfos id=5 count=14564lb # [ 39.640145] niks3-server[1037]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4565lb # [ 39.650984] niks3-server[1037]: 2026/09/20 09:05:21 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4566lb # [ 39.656477] niks3-server[1037]: 2026/09/20 09:05:21 INFO Completed upload id=54567worker1 # [ 39.633504] nix-grpc-daemon[858]: time=2026-09-20T09:05:20.999Z level=INFO msg="Upload complete. (426ms)"4568worker1 # [ 39.636075] nix-grpc-daemon[734]: ts=2026-09-20T09:05:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_in=7524569lb # [ 39.662046] niks3-server[1037]: 2026/09/20 09:05:21 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4570worker1 # [ 39.641433] nix-grpc-daemon[734]: ts=2026-09-20T09:05:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644571worker1 # [ 39.645665] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4572worker1 # [ 39.648058] nix-daemon[848]: reaped child process 938, status = succeeded4573worker1 # [ 39.654621] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4574client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4575client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4576worker1 # [ 40.668511] nix-daemon[848]: reaped child process 952, status = succeeded4577client # farm-top> LOG-farm-top-t14578worker1 # [ 40.815980] nix-daemon[848]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4579worker1 # [ 40.827767] nix-daemon[848]: reaped child process 971, status = succeeded4580lb # [ 40.870294] niks3-server[1037]: 2026/09/20 09:05:22 INFO Received uploads request method=POST path=/api/pending_closures4581worker1 # [ 40.853106] nix-grpc-daemon[858]: time=2026-09-20T09:05:22.219Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4582worker1 # [ 40.854700] nix-grpc-daemon[858]: time=2026-09-20T09:05:22.221Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4583lb # [ 40.907153] niks3-server[1037]: 2026/09/20 09:05:22 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4584lb # [ 40.915325] niks3-server[1037]: 2026/09/20 09:05:22 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4585lb # [ 40.927053] niks3-server[1037]: 2026/09/20 09:05:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4586worker1 # [ 40.904786] nix-grpc-daemon[858]: time=2026-09-20T09:05:22.271Z level=INFO msg="Uploading 1 narinfos"4587lb # [ 40.930749] niks3-server[1037]: 2026/09/20 09:05:22 INFO Signed narinfos id=6 count=14588lb # [ 40.940329] niks3-server[1037]: 2026/09/20 09:05:22 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4589lb # [ 40.946738] niks3-server[1037]: 2026/09/20 09:05:22 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4590lb # [ 40.950286] niks3-server[1037]: 2026/09/20 09:05:22 INFO Completed upload id=64591lb # [ 40.952430] niks3-server[1037]: 2026/09/20 09:05:22 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4592worker1 # [ 40.925941] nix-grpc-daemon[858]: time=2026-09-20T09:05:22.292Z level=INFO msg="Upload complete. (263ms)"4593worker1 # [ 40.931570] nix-grpc-daemon[734]: ts=2026-09-20T09:05:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14594worker1 # [ 40.944761] nix-daemon[848]: reaped child process 950, status = succeeded4595client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 6.88 seconds)4596client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4597client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.22 seconds)4598client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4599client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4600client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4601client # copying 3 paths...4602client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4603client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4604client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4605client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4606(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.48 seconds)4607subtest: repeat is answered Cached by the scheduler without building4608worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4609worker1 # finding garbage collector roots...4610worker1 # deleting specified paths...4611worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4612worker1 # deleting unused links...4613worker1 # note: hard linking is currently saving 0.0 KiB4614worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4615worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4616worker2 # finding garbage collector roots...4617worker2 # deleting specified paths...4618worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4619worker2 # deleting unused links...4620worker2 # note: hard linking is currently saving 0.0 KiB4621worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.29 seconds)4622client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24623worker2 # [ 42.334728] nix-grpc-daemon[782]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:413324624client # don't know how to build these paths:4625client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4626worker2 # [ 42.343739] nix-grpc-daemon[782]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413324627worker2 # [ 42.369422] nix-grpc-daemon[782]: ts=2026-09-20T09:05:24Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14628client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.25 seconds)4629client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4630client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.16 seconds)4631lb: must succeed: curl -sf localhost:9901/clusters4632lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4633lb: must succeed: curl -sf localhost:9901/clusters4634lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4635worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4636worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.04 seconds)4637(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.16 seconds)4638subtest: inputs already in the cache are not sent to the scheduler4639lb: must succeed: curl -sf localhost:9901/clusters4640lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4641lb: must succeed: curl -sf localhost:9901/clusters4642lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4643worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4644worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4645client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24646worker2 # [ 43.109908] nix-grpc-daemon[782]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:413324647client # don't know how to build these paths:4648client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4649worker1 # [ 43.079291] nix-grpc-daemon[734]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644650worker1 # [ 43.088205] nix-grpc-daemon[858]: time=2026-09-20T09:05:24.454Z level=INFO msg="All 2 paths already cached"4651worker2 # [ 43.138931] nix-grpc-daemon[782]: ts=2026-09-20T09:05:24Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04652worker2 # [ 43.143555] nix-grpc-daemon[782]: ts=2026-09-20T09:05:24Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14653worker1 # [ 43.108338] nix-grpc-daemon[734]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644654worker1 # [ 43.119868] nix-grpc-daemon[734]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644655worker1 # [ 43.131988] nix-grpc-daemon[858]: time=2026-09-20T09:05:24.498Z level=INFO msg="All 2 paths already cached"4656client # copying 1 paths to 'lb:50051'...4657client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4658worker1 # [ 43.138902] nix-grpc-daemon[734]: ts=2026-09-20T09:05:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411644659worker1 # [ 43.147885] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4660worker1 # [ 43.337386] nix-daemon[848]: accepted connection from pid 989, user nix-grpc-daemon (trusted)4661worker1 # [ 43.349945] nix-daemon[848]: reaped child process 992, status = succeeded4662worker1 # [ 43.536041] nix-daemon[848]: accepted connection from pid 994, user nix-grpc-daemon (trusted)4663worker1 # [ 43.547635] nix-daemon[848]: reaped child process 997, status = succeeded4664lb # [ 43.592504] niks3-server[1037]: 2026/09/20 09:05:25 INFO Received uploads request method=POST path=/api/pending_closures4665worker1 # [ 43.575069] nix-grpc-daemon[858]: time=2026-09-20T09:05:24.941Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4666worker1 # [ 43.576483] nix-grpc-daemon[858]: time=2026-09-20T09:05:24.941Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4667lb # [ 43.616762] niks3-server[1037]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4668lb # [ 43.629603] niks3-server[1037]: 2026/09/20 09:05:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4669lb # [ 43.634492] niks3-server[1037]: 2026/09/20 09:05:25 INFO Signed narinfos id=7 count=14670worker1 # [ 43.611518] nix-grpc-daemon[858]: time=2026-09-20T09:05:24.977Z level=INFO msg="Uploading 1 narinfos"4671lb # [ 43.641208] niks3-server[1037]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4672lb # [ 43.651681] niks3-server[1037]: 2026/09/20 09:05:25 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4673lb # [ 43.658391] niks3-server[1037]: 2026/09/20 09:05:25 INFO Completed upload id=74674worker1 # [ 43.632270] nix-grpc-daemon[858]: time=2026-09-20T09:05:24.998Z level=INFO msg="Upload complete. (470ms)"4675lb # [ 43.661881] niks3-server[1037]: 2026/09/20 09:05:25 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4676worker1 # [ 43.635507] nix-grpc-daemon[734]: ts=2026-09-20T09:05:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_in=7524677worker1 # [ 43.640535] nix-grpc-daemon[734]: ts=2026-09-20T09:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644678worker1 # [ 43.648076] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4679worker1 # [ 43.653929] nix-daemon[848]: reaped child process 987, status = succeeded4680worker1 # [ 43.658101] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4681client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4682client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4683client # farm-top> LOG-farm-top-t1b4684worker1 # [ 44.873839] nix-daemon[848]: reaped child process 1001, status = succeeded4685worker1 # [ 45.037663] nix-daemon[848]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)4686worker1 # [ 45.049516] nix-daemon[848]: reaped child process 1019, status = succeeded4687lb # [ 45.094689] niks3-server[1037]: 2026/09/20 09:05:27 INFO Received uploads request method=POST path=/api/pending_closures4688worker1 # [ 45.077160] nix-grpc-daemon[858]: time=2026-09-20T09:05:26.443Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4689worker1 # [ 45.078720] nix-grpc-daemon[858]: time=2026-09-20T09:05:26.445Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4690lb # [ 45.132740] niks3-server[1037]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4691lb # [ 45.142097] niks3-server[1037]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4692lb # [ 45.151602] niks3-server[1037]: 2026/09/20 09:05:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4693worker1 # [ 45.131214] nix-grpc-daemon[858]: time=2026-09-20T09:05:26.497Z level=INFO msg="Uploading 1 narinfos"4694lb # [ 45.156901] niks3-server[1037]: 2026/09/20 09:05:27 INFO Signed narinfos id=8 count=14695lb # [ 45.162355] niks3-server[1037]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4696lb # [ 45.171973] niks3-server[1037]: 2026/09/20 09:05:27 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4697lb # [ 45.176943] niks3-server[1037]: 2026/09/20 09:05:27 INFO Completed upload id=84698lb # [ 45.180895] niks3-server[1037]: 2026/09/20 09:05:27 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4699worker1 # [ 45.153581] nix-grpc-daemon[858]: time=2026-09-20T09:05:26.519Z level=INFO msg="Upload complete. (287ms)"4700worker1 # [ 45.159608] nix-grpc-daemon[734]: ts=2026-09-20T09:05:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14701worker1 # [ 45.172463] nix-daemon[848]: reaped child process 999, status = succeeded4702client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.34 seconds)4703client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4704client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.21 seconds)4705lb: must succeed: curl -sf localhost:9901/clusters4706lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4707lb: must succeed: curl -sf localhost:9901/clusters4708lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4709worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4710worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4711(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.83 seconds)4712subtest: two clients wanting the same drv build it once4713client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4714client # [ 45.653337] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4715client # Running as unit: dedup1.service; invocation ID: a67ab0f951cb40f286924d031b9661ee4716client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.08 seconds)4717client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4718worker2 # [ 45.848509] nix-grpc-daemon[782]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:413324719client # [ 45.837670] nix[887]: don't know how to build these paths:4720client # [ 45.838576] nix[887]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4721worker2 # [ 45.861366] nix-grpc-daemon[782]: ts=2026-09-20T09:05:27Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04722worker2 # [ 45.866805] nix-grpc-daemon[782]: ts=2026-09-20T09:05:27Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14723worker2 # [ 45.872145] nix-grpc-daemon[782]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413324724worker2 # [ 45.889586] nix-grpc-daemon[782]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413324725client # [ 45.883080] nix[887]: copying 1 paths to 'lb:50051'...4726client # [ 45.883893] nix[887]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4727worker2 # [ 45.900822] nix-grpc-daemon[782]: ts=2026-09-20T09:05:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413324728worker2 # [ 45.912546] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)4729worker2 # [ 45.933579] nix-grpc-daemon[782]: ts=2026-09-20T09:05:27Z level=info event=niks3_push_started pid=8984730worker2 # [ 46.379198] nix-daemon[845]: accepted connection from pid 911, user nix-grpc-daemon (trusted)4731worker2 # [ 46.395616] nix-daemon[845]: reaped child process 914, status = succeeded4732worker2 # [ 46.543073] nix-daemon[845]: accepted connection from pid 916, user nix-grpc-daemon (trusted)4733worker2 # [ 46.556701] nix-daemon[845]: reaped child process 919, status = succeeded4734lb # [ 46.561229] niks3-server[1037]: 2026/09/20 09:05:28 INFO Received uploads request method=POST path=/api/pending_closures4735worker2 # [ 46.583953] nix-grpc-daemon[898]: time=2026-09-20T09:05:28.257Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4736worker2 # [ 46.587921] nix-grpc-daemon[898]: time=2026-09-20T09:05:28.261Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4737lb # [ 46.602054] niks3-server[1037]: 2026/09/20 09:05:28 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4738lb # [ 46.612081] niks3-server[1037]: 2026/09/20 09:05:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4739lb # [ 46.617115] niks3-server[1037]: 2026/09/20 09:05:28 INFO Signed narinfos id=9 count=14740worker2 # [ 46.631823] nix-grpc-daemon[898]: time=2026-09-20T09:05:28.307Z level=INFO msg="Uploading 1 narinfos"4741lb # [ 46.626700] niks3-server[1037]: 2026/09/20 09:05:28 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4742lb # [ 46.636673] niks3-server[1037]: 2026/09/20 09:05:28 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4743worker2 # [ 46.654729] nix-grpc-daemon[898]: time=2026-09-20T09:05:28.330Z level=INFO msg="Upload complete. (436ms)"4744lb # [ 46.642996] niks3-server[1037]: 2026/09/20 09:05:28 INFO Completed upload id=94745worker2 # [ 46.656744] nix-grpc-daemon[782]: ts=2026-09-20T09:05:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=0 paths=1 nar_bytes_in=4324746lb # [ 46.646058] niks3-server[1037]: 2026/09/20 09:05:28 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4747worker2 # [ 46.661737] nix-grpc-daemon[782]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413324748worker2 # [ 46.667088] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)4749worker2 # [ 46.669246] nix-daemon[845]: reaped child process 896, status = succeeded4750worker2 # [ 46.674804] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)4751client # [ 46.657167] nix[887]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4752client # [ 46.734601] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4753client # Running as unit: dedup2.service; invocation ID: 55cf220b6ed5499d9ff109bdf6fe4ad34754client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.09 seconds)4755client # [ 47.008094] nix[903]: don't know how to build these paths:4756client # [ 47.009479] nix[903]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4757worker1 # [ 46.986836] nix-grpc-daemon[734]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:411644758worker2 # [ 47.034383] nix-grpc-daemon[782]: ts=2026-09-20T09:05:28Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04759worker2 # [ 47.042885] nix-grpc-daemon[782]: ts=2026-09-20T09:05:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413324760client # [ 47.029891] nix[903]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4761lb # [ 47.146152] envoy[909]: conn peer=[2001:db8:1::1]:56992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9537 tx=3835 ms=66644762lb # [ 47.149882] envoy[909]: conn peer=[2001:db8:1::1]:57006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=494763lb # [ 47.153335] envoy[909]: conn peer=[2001:db8:1::1]:47164 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4182 tx=1728 ms=20964764client: must succeed: sleep 24765client: (finished: must succeed: sleep 2, in 2.04 seconds)4766??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4767 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394768client: waiting for success: ! systemctl is-active dedup1 dedup24769??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4770 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394771worker2 # [ 50.290707] nix-daemon[845]: reaped child process 923, status = succeeded4772worker2 # [ 50.442624] nix-daemon[845]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4773worker2 # [ 50.454848] nix-daemon[845]: reaped child process 957, status = succeeded4774lb # [ 50.458394] niks3-server[1037]: 2026/09/20 09:05:32 INFO Received uploads request method=POST path=/api/pending_closures4775worker2 # [ 50.475296] nix-grpc-daemon[898]: time=2026-09-20T09:05:32.150Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4776worker2 # [ 50.476981] nix-grpc-daemon[898]: time=2026-09-20T09:05:32.150Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4777lb # [ 50.481148] niks3-server[1037]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4778lb # [ 50.488220] niks3-server[1037]: 2026/09/20 09:05:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4779lb # [ 50.490074] niks3-server[1037]: 2026/09/20 09:05:32 INFO Signed narinfos id=10 count=14780worker2 # [ 50.503672] nix-grpc-daemon[898]: time=2026-09-20T09:05:32.178Z level=INFO msg="Uploading 1 narinfos"4781lb # [ 50.492983] niks3-server[1037]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4782lb # [ 50.498491] niks3-server[1037]: 2026/09/20 09:05:32 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4783lb # [ 50.501599] niks3-server[1037]: 2026/09/20 09:05:32 INFO Completed upload id=104784worker2 # [ 50.513390] nix-grpc-daemon[898]: time=2026-09-20T09:05:32.188Z level=INFO msg="Upload complete. (228ms)"4785lb # [ 50.503374] niks3-server[1037]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4786worker2 # [ 50.516468] nix-grpc-daemon[782]: ts=2026-09-20T09:05:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14787lb # [ 50.506148] niks3-server[1037]: 2026/09/20 09:05:32 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4788worker2 # [ 50.520349] nix-grpc-daemon[782]: ts=2026-09-20T09:05:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14789worker2 # [ 50.526049] nix-daemon[845]: reaped child process 921, status = succeeded4790client # [ 50.551376] systemd[1]: dedup1.service: Deactivated successfully.4791client # [ 50.555169] systemd[1]: dedup1.service: Consumed 108ms CPU time over 4.902s wall clock time, 37.1M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.4792client # [ 50.562429] systemd[1]: dedup2.service: Deactivated successfully.4793client # [ 50.564356] systemd[1]: dedup2.service: Consumed 136ms CPU time over 3.827s wall clock time, 33.1M memory peak, 7.4K incoming IP traffic, 6.4K outgoing IP traffic.4794client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.12 seconds)4795client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4796client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4797worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4798worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4799worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4800worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4801worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4802worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4803worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4804worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4805(finished: subtest: two clients wanting the same drv build it once, in 6.02 seconds)4806subtest: build hook: nix-daemon with builders = grpc://lb4807client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4808client # [ 51.824279] systemd[1]: Started Nix Daemon.4809client # [ 52.013631] nix-daemon[945]: accepted connection from pid 942, user root (trusted)4810worker2 # [ 52.211152] nix-grpc-daemon[782]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:413324811worker2 # [ 52.220418] nix-grpc-daemon[782]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413324812worker2 # [ 52.236956] nix-grpc-daemon[782]: ts=2026-09-20T09:05:33Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04813worker2 # [ 52.241227] nix-grpc-daemon[782]: ts=2026-09-20T09:05:33Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14814worker1 # [ 52.243263] nix-grpc-daemon[734]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644815worker1 # [ 52.249068] nix-grpc-daemon[734]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644816worker1 # [ 52.256069] nix-grpc-daemon[734]: ts=2026-09-20T09:05:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411644817worker1 # [ 52.261334] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4818worker1 # [ 52.441868] nix-daemon[848]: accepted connection from pid 1046, user nix-grpc-daemon (trusted)4819worker1 # [ 52.454710] nix-daemon[848]: reaped child process 1049, status = succeeded4820worker1 # [ 52.625305] nix-daemon[848]: accepted connection from pid 1051, user nix-grpc-daemon (trusted)4821worker1 # [ 52.636835] nix-daemon[848]: reaped child process 1054, status = succeeded4822lb # [ 52.679388] niks3-server[1037]: 2026/09/20 09:05:34 INFO Received uploads request method=POST path=/api/pending_closures4823worker1 # [ 52.661970] nix-grpc-daemon[858]: time=2026-09-20T09:05:34.027Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4824worker1 # [ 52.663352] nix-grpc-daemon[858]: time=2026-09-20T09:05:34.028Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4825lb # [ 52.710302] niks3-server[1037]: 2026/09/20 09:05:34 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4826lb # [ 52.717407] niks3-server[1037]: 2026/09/20 09:05:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4827lb # [ 52.722500] niks3-server[1037]: 2026/09/20 09:05:34 INFO Signed narinfos id=11 count=14828worker1 # [ 52.699770] nix-grpc-daemon[858]: time=2026-09-20T09:05:34.066Z level=INFO msg="Uploading 1 narinfos"4829lb # [ 52.734462] niks3-server[1037]: 2026/09/20 09:05:34 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4830lb # [ 52.741499] niks3-server[1037]: 2026/09/20 09:05:34 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4831lb # [ 52.746404] niks3-server[1037]: 2026/09/20 09:05:34 INFO Completed upload id=114832worker1 # [ 52.722819] nix-grpc-daemon[858]: time=2026-09-20T09:05:34.089Z level=INFO msg="Upload complete. (456ms)"4833lb # [ 52.751635] niks3-server[1037]: 2026/09/20 09:05:34 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4834worker1 # [ 52.725651] nix-grpc-daemon[734]: ts=2026-09-20T09:05:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_in=5124835worker1 # [ 52.731120] nix-grpc-daemon[734]: ts=2026-09-20T09:05:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644836worker1 # [ 52.739238] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4837worker1 # [ 52.746448] nix-daemon[848]: reaped child process 1044, status = succeeded4838worker1 # [ 52.751920] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4839worker1 # [ 53.764516] nix-daemon[848]: reaped child process 1058, status = succeeded4840worker1 # [ 53.904118] nix-daemon[848]: accepted connection from pid 1073, user nix-grpc-daemon (trusted)4841worker1 # [ 53.915507] nix-daemon[848]: reaped child process 1076, status = succeeded4842lb # [ 53.958833] niks3-server[1037]: 2026/09/20 09:05:35 INFO Received uploads request method=POST path=/api/pending_closures4843worker1 # [ 53.941470] nix-grpc-daemon[858]: time=2026-09-20T09:05:35.307Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4844worker1 # [ 53.943033] nix-grpc-daemon[858]: time=2026-09-20T09:05:35.309Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4845lb # [ 53.998245] niks3-server[1037]: 2026/09/20 09:05:35 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4846lb # [ 54.010138] niks3-server[1037]: 2026/09/20 09:05:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4847lb # [ 54.014327] niks3-server[1037]: 2026/09/20 09:05:35 INFO Signed narinfos id=12 count=14848worker1 # [ 53.991520] nix-grpc-daemon[858]: time=2026-09-20T09:05:35.357Z level=INFO msg="Uploading 1 narinfos"4849lb # [ 54.022485] niks3-server[1037]: 2026/09/20 09:05:35 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4850lb # [ 54.026597] niks3-server[1037]: 2026/09/20 09:05:36 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4851lb # [ 54.036343] niks3-server[1037]: 2026/09/20 09:05:36 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4852lb # [ 54.043123] niks3-server[1037]: 2026/09/20 09:05:36 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4853lb # [ 54.046117] niks3-server[1037]: 2026/09/20 09:05:36 INFO Completed upload id=124854worker1 # [ 54.020576] nix-grpc-daemon[858]: time=2026-09-20T09:05:35.386Z level=INFO msg="Upload complete. (263ms)"4855worker1 # [ 54.026607] nix-grpc-daemon[734]: ts=2026-09-20T09:05:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14856worker2 # [ 54.067481] nix-grpc-daemon[782]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:413324857worker1 # [ 54.039425] nix-daemon[848]: reaped child process 1056, status = succeeded4858worker2 # [ 54.080920] nix-grpc-daemon[782]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4859worker2 # [ 54.110438] nix-grpc-daemon[782]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:413324860worker2 # [ 54.116155] nix-grpc-daemon[782]: ts=2026-09-20T09:05:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=0 paths=1 nar_bytes_out=1284861worker1 # [ 54.341246] nix-grpc-daemon[734]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:411644862worker1 # [ 54.348634] nix-grpc-daemon[734]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644863worker1 # [ 54.358326] nix-grpc-daemon[858]: time=2026-09-20T09:05:35.724Z level=INFO msg="All 1 paths already cached"4864worker2 # [ 54.410689] nix-grpc-daemon[782]: ts=2026-09-20T09:05:36Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04865worker1 # [ 54.375517] nix-grpc-daemon[734]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644866worker2 # [ 54.415254] nix-grpc-daemon[782]: ts=2026-09-20T09:05:36Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14867worker1 # [ 54.386806] nix-grpc-daemon[734]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644868worker1 # [ 54.398209] nix-grpc-daemon[858]: time=2026-09-20T09:05:35.764Z level=INFO msg="All 1 paths already cached"4869worker1 # [ 54.404687] nix-grpc-daemon[734]: ts=2026-09-20T09:05:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411644870worker1 # [ 54.412650] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4871worker1 # [ 54.592889] nix-daemon[848]: accepted connection from pid 1080, user nix-grpc-daemon (trusted)4872worker1 # [ 54.605668] nix-daemon[848]: reaped child process 1083, status = succeeded4873worker1 # [ 54.769894] nix-daemon[848]: accepted connection from pid 1085, user nix-grpc-daemon (trusted)4874worker1 # [ 54.781484] nix-daemon[848]: reaped child process 1088, status = succeeded4875lb # [ 54.822878] niks3-server[1037]: 2026/09/20 09:05:36 INFO Received uploads request method=POST path=/api/pending_closures4876worker1 # [ 54.805304] nix-grpc-daemon[858]: time=2026-09-20T09:05:36.171Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4877worker1 # [ 54.806650] nix-grpc-daemon[858]: time=2026-09-20T09:05:36.171Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4878lb # [ 54.846628] niks3-server[1037]: 2026/09/20 09:05:36 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4879lb # [ 54.858585] niks3-server[1037]: 2026/09/20 09:05:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4880worker1 # [ 54.837398] nix-grpc-daemon[858]: time=2026-09-20T09:05:36.203Z level=INFO msg="Uploading 1 narinfos"4881lb # [ 54.864127] niks3-server[1037]: 2026/09/20 09:05:36 INFO Signed narinfos id=13 count=14882lb # [ 54.870320] niks3-server[1037]: 2026/09/20 09:05:36 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4883lb # [ 54.881184] niks3-server[1037]: 2026/09/20 09:05:36 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4884lb # [ 54.887766] niks3-server[1037]: 2026/09/20 09:05:36 INFO Completed upload id=134885worker1 # [ 54.861695] nix-grpc-daemon[858]: time=2026-09-20T09:05:36.228Z level=INFO msg="Upload complete. (435ms)"4886lb # [ 54.890440] niks3-server[1037]: 2026/09/20 09:05:36 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4887worker1 # [ 54.865292] nix-grpc-daemon[734]: ts=2026-09-20T09:05:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_in=6244888worker1 # [ 54.871602] nix-grpc-daemon[734]: ts=2026-09-20T09:05:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644889worker1 # [ 54.881164] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4890worker1 # [ 54.882480] nix-daemon[848]: reaped child process 1078, status = succeeded4891worker1 # [ 54.887859] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4892worker1 # [ 56.515482] nix-daemon[848]: reaped child process 1092, status = succeeded4893worker1 # [ 56.675921] nix-daemon[848]: accepted connection from pid 1107, user nix-grpc-daemon (trusted)4894worker1 # [ 56.686646] nix-daemon[848]: reaped child process 1110, status = succeeded4895lb # [ 56.724726] niks3-server[1037]: 2026/09/20 09:05:38 INFO Received uploads request method=POST path=/api/pending_closures4896worker1 # [ 56.706680] nix-grpc-daemon[858]: time=2026-09-20T09:05:38.072Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4897worker1 # [ 56.708132] nix-grpc-daemon[858]: time=2026-09-20T09:05:38.074Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4898lb # [ 56.759524] niks3-server[1037]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4899lb # [ 56.770207] niks3-server[1037]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4900lb # [ 56.779488] niks3-server[1037]: 2026/09/20 09:05:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4901worker1 # [ 56.758847] nix-grpc-daemon[858]: time=2026-09-20T09:05:38.125Z level=INFO msg="Uploading 1 narinfos"4902lb # [ 56.784868] niks3-server[1037]: 2026/09/20 09:05:38 INFO Signed narinfos id=14 count=14903lb # [ 56.789159] niks3-server[1037]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4904lb # [ 56.799218] niks3-server[1037]: 2026/09/20 09:05:38 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4905lb # [ 56.804184] niks3-server[1037]: 2026/09/20 09:05:38 INFO Completed upload id=144906lb # [ 56.806827] niks3-server[1037]: 2026/09/20 09:05:38 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4907worker1 # [ 56.779845] nix-grpc-daemon[858]: time=2026-09-20T09:05:38.146Z level=INFO msg="Upload complete. (283ms)"4908worker1 # [ 56.785606] nix-grpc-daemon[734]: ts=2026-09-20T09:05:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14909worker1 # [ 56.793530] nix-grpc-daemon[734]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:411644910worker1 # [ 56.802912] nix-daemon[848]: reaped child process 1090, status = succeeded4911worker2 # [ 56.847808] nix-grpc-daemon[782]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:413324912worker2 # [ 56.858655] nix-grpc-daemon[782]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4913worker2 # [ 56.870879] nix-grpc-daemon[782]: ts=2026-09-20T09:05:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=0 paths=1 nar_bytes_out=1764914worker2 # [ 57.143170] nix-grpc-daemon[782]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:413324915worker1 # [ 57.113214] nix-grpc-daemon[734]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644916lb # [ 57.146932] envoy[909]: conn peer=[2001:db8:1::1]:47178 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2968 tx=1355 ms=46874917lb # [ 57.151535] envoy[909]: conn peer=[2001:db8:1::1]:47184 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=35144918lb # [ 57.155322] envoy[909]: conn peer=[2001:db8:1::1]:45312 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=564919lb # [ 57.158719] envoy[909]: conn peer=[2001:db8:1::1]:47198 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3384 tx=1725 ms=19624920worker1 # [ 57.137220] nix-grpc-daemon[858]: time=2026-09-20T09:05:38.503Z level=INFO msg="All 2 paths already cached"4921lb # [ 57.163055] envoy[909]: conn peer=[2001:db8:1::1]:45316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3867 tx=1849 ms=25484922lb # [ 57.166772] envoy[909]: conn peer=[2001:db8:1::1]:45324 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=784923worker2 # [ 57.193640] nix-grpc-daemon[782]: ts=2026-09-20T09:05:38Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04924worker2 # [ 57.197685] nix-grpc-daemon[782]: ts=2026-09-20T09:05:38Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14925worker1 # [ 57.201496] nix-grpc-daemon[734]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644926worker1 # [ 57.213625] nix-grpc-daemon[734]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411644927worker1 # [ 57.225574] nix-grpc-daemon[858]: time=2026-09-20T09:05:38.591Z level=INFO msg="All 2 paths already cached"4928worker1 # [ 57.233236] nix-grpc-daemon[734]: ts=2026-09-20T09:05:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411644929worker1 # [ 57.243137] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4930worker1 # [ 57.392585] nix-daemon[848]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)4931worker1 # [ 57.404769] nix-daemon[848]: reaped child process 1117, status = succeeded4932worker1 # [ 57.544198] nix-daemon[848]: accepted connection from pid 1119, user nix-grpc-daemon (trusted)4933worker1 # [ 57.555870] nix-daemon[848]: reaped child process 1122, status = succeeded4934lb # [ 57.594149] niks3-server[1037]: 2026/09/20 09:05:39 INFO Received uploads request method=POST path=/api/pending_closures4935worker1 # [ 57.575653] nix-grpc-daemon[858]: time=2026-09-20T09:05:38.942Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4936worker1 # [ 57.577429] nix-grpc-daemon[858]: time=2026-09-20T09:05:38.943Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4937lb # [ 57.619913] niks3-server[1037]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4938lb # [ 57.631205] niks3-server[1037]: 2026/09/20 09:05:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4939worker1 # [ 57.612478] nix-grpc-daemon[858]: time=2026-09-20T09:05:38.978Z level=INFO msg="Uploading 1 narinfos"4940lb # [ 57.638146] niks3-server[1037]: 2026/09/20 09:05:39 INFO Signed narinfos id=15 count=14941lb # [ 57.642740] niks3-server[1037]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4942lb # [ 57.655734] niks3-server[1037]: 2026/09/20 09:05:39 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4943lb # [ 57.660427] niks3-server[1037]: 2026/09/20 09:05:39 INFO Completed upload id=154944worker1 # [ 57.636773] nix-grpc-daemon[858]: time=2026-09-20T09:05:39.003Z level=INFO msg="Upload complete. (381ms)"4945lb # [ 57.663185] niks3-server[1037]: 2026/09/20 09:05:39 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4946worker1 # [ 57.638734] nix-grpc-daemon[734]: ts=2026-09-20T09:05:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_in=7524947worker1 # [ 57.643206] nix-grpc-daemon[734]: ts=2026-09-20T09:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411644948worker1 # [ 57.647532] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4949worker1 # [ 57.650438] nix-daemon[848]: reaped child process 1112, status = succeeded4950worker1 # [ 57.655628] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)4951worker1 # [ 58.867525] nix-daemon[848]: reaped child process 1126, status = succeeded4952worker1 # [ 59.005067] nix-daemon[848]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)4953worker1 # [ 59.016616] nix-daemon[848]: reaped child process 1144, status = succeeded4954lb # [ 59.054874] niks3-server[1037]: 2026/09/20 09:05:41 INFO Received uploads request method=POST path=/api/pending_closures4955worker1 # [ 59.036593] nix-grpc-daemon[858]: time=2026-09-20T09:05:40.402Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4956worker1 # [ 59.038045] nix-grpc-daemon[858]: time=2026-09-20T09:05:40.404Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4957lb # [ 59.096823] niks3-server[1037]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4958lb # [ 59.105574] niks3-server[1037]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4959lb # [ 59.113964] niks3-server[1037]: 2026/09/20 09:05:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4960lb # [ 59.119160] niks3-server[1037]: 2026/09/20 09:05:41 INFO Signed narinfos id=16 count=14961worker1 # [ 59.098154] nix-grpc-daemon[858]: time=2026-09-20T09:05:40.464Z level=INFO msg="Uploading 1 narinfos"4962lb # [ 59.126908] niks3-server[1037]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4963lb # [ 59.138957] niks3-server[1037]: 2026/09/20 09:05:41 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4964lb # [ 59.141854] niks3-server[1037]: 2026/09/20 09:05:41 INFO Completed upload id=164965lb # [ 59.143871] niks3-server[1037]: 2026/09/20 09:05:41 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4966worker1 # [ 59.117464] nix-grpc-daemon[858]: time=2026-09-20T09:05:40.483Z level=INFO msg="Upload complete. (253ms)"4967worker2 # [ 59.164422] nix-grpc-daemon[782]: ts=2026-09-20T09:05:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:413324968worker1 # [ 59.122973] nix-grpc-daemon[734]: ts=2026-09-20T09:05:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14969worker2 # [ 59.169140] nix-grpc-daemon[782]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4970worker1 # [ 59.136270] nix-daemon[848]: reaped child process 1124, status = succeeded4971worker2 # [ 59.188233] nix-grpc-daemon[782]: ts=2026-09-20T09:05:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:413324972worker2 # [ 59.190167] nix-grpc-daemon[782]: ts=2026-09-20T09:05:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=0 paths=1 nar_bytes_out=2324973client # [ 59.283469] nix-daemon[945]: reaped child process 947, status = succeeded4974client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.69 seconds)4975client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4976client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4977client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4978client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4979client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4980client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds)4981(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.78 seconds)4982subtest: an input only one worker has still reaches the builder4983client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4984client # this derivation will be built:4985client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4986client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4987client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.40 seconds)4988client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4989client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.18 seconds)4990worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4991worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds)4992worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4993worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4994client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24995client # [ 60.402491] nix-daemon[945]: accepted connection from pid 1028, user root (trusted)4996client # this derivation will be built:4997client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4998worker1 # [ 60.569856] nix-grpc-daemon[734]: ts=2026-09-20T09:05:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:411644999client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5000worker2 # [ 60.619847] nix-grpc-daemon[782]: ts=2026-09-20T09:05:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413325001client # copying 1 paths...5002client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...5003worker1 # [ 60.591758] nix-grpc-daemon[734]: ts=2026-09-20T09:05:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411645004worker1 # [ 60.602271] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)5005worker1 # [ 60.771293] nix-daemon[848]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)5006worker1 # [ 60.782945] nix-daemon[848]: reaped child process 1156, status = succeeded5007lb # [ 60.824633] niks3-server[1037]: 2026/09/20 09:05:42 INFO Received uploads request method=POST path=/api/pending_closures5008worker1 # [ 60.806746] nix-grpc-daemon[858]: time=2026-09-20T09:05:42.172Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5009worker1 # [ 60.808553] nix-grpc-daemon[858]: time=2026-09-20T09:05:42.174Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5010lb # [ 60.853494] niks3-server[1037]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5011lb # [ 60.862164] niks3-server[1037]: 2026/09/20 09:05:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign5012lb # [ 60.867494] niks3-server[1037]: 2026/09/20 09:05:42 INFO Signed narinfos id=17 count=15013worker1 # [ 60.844552] nix-grpc-daemon[858]: time=2026-09-20T09:05:42.210Z level=INFO msg="Uploading 1 narinfos"5014lb # [ 60.873907] niks3-server[1037]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5015lb # [ 60.885089] niks3-server[1037]: 2026/09/20 09:05:42 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5016worker1 # [ 60.865810] nix-grpc-daemon[858]: time=2026-09-20T09:05:42.232Z level=INFO msg="Upload complete. (253ms)"5017lb # [ 60.891974] niks3-server[1037]: 2026/09/20 09:05:42 INFO Completed upload id=175018lb # [ 60.895489] niks3-server[1037]: 2026/09/20 09:05:42 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5019worker1 # [ 60.868782] nix-grpc-daemon[734]: ts=2026-09-20T09:05:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_in=1205020worker1 # [ 60.879144] nix-daemon[848]: reaped child process 1151, status = succeeded5021worker2 # [ 60.919933] nix-grpc-daemon[782]: ts=2026-09-20T09:05:42Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05022worker2 # [ 60.922451] nix-grpc-daemon[782]: ts=2026-09-20T09:05:42Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=15023worker2 # [ 60.963619] nix-grpc-daemon[782]: ts=2026-09-20T09:05:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413325024worker2 # [ 60.970449] nix-grpc-daemon[782]: ts=2026-09-20T09:05:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413325025client # copying 2 paths to 'lb:50051'...5026worker2 # [ 60.979327] nix-grpc-daemon[782]: ts=2026-09-20T09:05:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413325027client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5028client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5029worker2 # [ 60.995123] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)5030worker2 # [ 61.181924] nix-daemon[845]: accepted connection from pid 986, user nix-grpc-daemon (trusted)5031worker2 # [ 61.196353] nix-daemon[845]: reaped child process 989, status = succeeded5032worker2 # [ 61.338757] nix-daemon[845]: accepted connection from pid 991, user nix-grpc-daemon (trusted)5033worker2 # [ 61.352595] nix-daemon[845]: reaped child process 994, status = succeeded5034lb # [ 61.350894] niks3-server[1037]: 2026/09/20 09:05:43 INFO Received uploads request method=POST path=/api/pending_closures5035lb # [ 61.356986] niks3-server[1037]: 2026/09/20 09:05:43 INFO Received uploads request method=POST path=/api/pending_closures5036worker2 # [ 61.372509] nix-grpc-daemon[898]: time=2026-09-20T09:05:43.047Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5037worker2 # [ 61.374444] nix-grpc-daemon[898]: time=2026-09-20T09:05:43.049Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5038worker2 # [ 61.376512] nix-grpc-daemon[898]: time=2026-09-20T09:05:43.049Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5039lb # [ 61.374828] niks3-server[1037]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5040lb # [ 61.381784] niks3-server[1037]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5041lb # [ 61.385031] niks3-server[1037]: 2026/09/20 09:05:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5042lb # [ 61.387589] niks3-server[1037]: 2026/09/20 09:05:43 INFO Signed narinfos id=18 count=15043lb # [ 61.388971] niks3-server[1037]: 2026/09/20 09:05:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5044lb # [ 61.392459] niks3-server[1037]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5045lb # [ 61.394466] niks3-server[1037]: 2026/09/20 09:05:43 INFO Signed narinfos id=19 count=25046worker2 # [ 61.406763] nix-grpc-daemon[898]: time=2026-09-20T09:05:43.081Z level=INFO msg="Uploading 3 narinfos"5047lb # [ 61.396360] niks3-server[1037]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5048lb # [ 61.408278] niks3-server[1037]: 2026/09/20 09:05:43 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5049lb # [ 61.413147] niks3-server[1037]: 2026/09/20 09:05:43 INFO Completed upload id=185050lb # [ 61.414638] niks3-server[1037]: 2026/09/20 09:05:43 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5051lb # [ 61.416763] niks3-server[1037]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5052lb # [ 61.419049] niks3-server[1037]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5053lb # [ 61.421123] niks3-server[1037]: 2026/09/20 09:05:43 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5054lb # [ 61.423264] niks3-server[1037]: 2026/09/20 09:05:43 INFO Completed upload id=195055worker2 # [ 61.436259] nix-grpc-daemon[898]: time=2026-09-20T09:05:43.111Z level=INFO msg="Upload complete. (425ms)"5056worker2 # [ 61.439068] nix-grpc-daemon[782]: ts=2026-09-20T09:05:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=0 paths=2 nar_bytes_in=9765057worker2 # [ 61.441754] nix-grpc-daemon[782]: ts=2026-09-20T09:05:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413325058worker2 # [ 61.447300] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)5059worker2 # [ 61.454120] nix-daemon[845]: reaped child process 984, status = succeeded5060worker2 # [ 61.458686] nix-grpc-daemon[782]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5061client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5062worker2 # [ 61.466647] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)5063client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5064worker2 # [ 62.681912] nix-daemon[845]: reaped child process 999, status = succeeded5065worker2 # [ 62.826692] nix-daemon[845]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)5066worker2 # [ 62.838906] nix-daemon[845]: reaped child process 1017, status = succeeded5067lb # [ 62.840761] niks3-server[1037]: 2026/09/20 09:05:44 INFO Received uploads request method=POST path=/api/pending_closures5068worker2 # [ 62.857241] nix-grpc-daemon[898]: time=2026-09-20T09:05:44.532Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5069lb # [ 62.856052] niks3-server[1037]: 2026/09/20 09:05:44 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5070lb # [ 62.858930] niks3-server[1037]: 2026/09/20 09:05:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5071lb # [ 62.860874] niks3-server[1037]: 2026/09/20 09:05:44 INFO Signed narinfos id=20 count=15072worker2 # [ 62.872592] nix-grpc-daemon[898]: time=2026-09-20T09:05:44.547Z level=INFO msg="Uploading 1 narinfos"5073lb # [ 62.863284] niks3-server[1037]: 2026/09/20 09:05:44 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5074lb # [ 62.867899] niks3-server[1037]: 2026/09/20 09:05:44 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5075lb # [ 62.870441] niks3-server[1037]: 2026/09/20 09:05:44 INFO Completed upload id=205076worker2 # [ 62.881964] nix-grpc-daemon[898]: time=2026-09-20T09:05:44.557Z level=INFO msg="Upload complete. (208ms)"5077lb # [ 62.873065] niks3-server[1037]: 2026/09/20 09:05:44 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5078worker2 # [ 62.885400] nix-grpc-daemon[782]: ts=2026-09-20T09:05:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=15079worker2 # [ 62.892591] nix-daemon[845]: reaped child process 996, status = succeeded5080client # copying 1 paths...5081worker2 # [ 62.930256] nix-grpc-daemon[782]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:413325082client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5083worker1 # [ 62.907993] nix-grpc-daemon[734]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:411645084worker1 # [ 62.917967] nix-grpc-daemon[734]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5085worker1 # [ 62.933470] nix-grpc-daemon[734]: ts=2026-09-20T09:05:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_out=1205086client # [ 63.050716] nix-daemon[945]: reaped child process 1031, status = succeeded5087client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.85 seconds)5088client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25089client # [ 63.213741] nix-daemon[945]: accepted connection from pid 1049, user root (trusted)5090client # this derivation will be built:5091client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5092worker2 # [ 63.406204] nix-grpc-daemon[782]: ts=2026-09-20T09:05:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:413325093client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5094worker2 # [ 63.412555] nix-grpc-daemon[782]: ts=2026-09-20T09:05:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413325095worker2 # [ 63.417542] nix-grpc-daemon[898]: time=2026-09-20T09:05:45.091Z level=INFO msg="All 1 paths already cached"5096worker2 # [ 63.427177] nix-grpc-daemon[782]: ts=2026-09-20T09:05:45Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05097worker1 # [ 63.396409] nix-grpc-daemon[734]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411645098worker2 # [ 63.432274] nix-grpc-daemon[782]: ts=2026-09-20T09:05:45Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15099worker1 # [ 63.404381] nix-grpc-daemon[734]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411645100client # copying 1 paths to 'lb:50051'...5101client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5102worker1 # [ 63.418854] nix-grpc-daemon[734]: ts=2026-09-20T09:05:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:411645103worker1 # [ 63.423456] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)5104worker1 # [ 63.432429] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)5105worker1 # [ 63.520572] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 2/5)5106worker1 # [ 63.644317] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 144 ms (attempt 3/5)5107worker1 # [ 63.790943] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 586 ms (attempt 4/5)5108worker1 # [ 64.377939] nix-grpc-daemon[734]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5109worker1 # [ 64.380108] nix-grpc-daemon[734]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5110worker1 # [ 64.565320] nix-daemon[848]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5111worker1 # [ 64.576957] nix-daemon[848]: reaped child process 1168, status = succeeded5112worker1 # [ 64.718974] nix-daemon[848]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5113worker1 # [ 64.731344] nix-daemon[848]: reaped child process 1173, status = succeeded5114lb # [ 64.769123] niks3-server[1037]: 2026/09/20 09:05:46 INFO Received uploads request method=POST path=/api/pending_closures5115worker1 # [ 64.752092] nix-grpc-daemon[858]: time=2026-09-20T09:05:46.118Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5116worker1 # [ 64.753409] nix-grpc-daemon[858]: time=2026-09-20T09:05:46.118Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5117lb # [ 64.792439] niks3-server[1037]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5118lb # [ 64.802961] niks3-server[1037]: 2026/09/20 09:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5119lb # [ 64.810300] niks3-server[1037]: 2026/09/20 09:05:46 INFO Signed narinfos id=21 count=15120worker1 # [ 64.786848] nix-grpc-daemon[858]: time=2026-09-20T09:05:46.153Z level=INFO msg="Uploading 1 narinfos"5121lb # [ 64.815792] niks3-server[1037]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5122lb # [ 64.826466] niks3-server[1037]: 2026/09/20 09:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5123lb # [ 64.832131] niks3-server[1037]: 2026/09/20 09:05:46 INFO Completed upload id=215124worker1 # [ 64.806368] nix-grpc-daemon[858]: time=2026-09-20T09:05:46.172Z level=INFO msg="Upload complete. (411ms)"5125lb # [ 64.833897] niks3-server[1037]: 2026/09/20 09:05:46 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5126worker1 # [ 64.810061] nix-grpc-daemon[734]: ts=2026-09-20T09:05:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=1 paths=1 nar_bytes_in=5605127worker1 # [ 64.814775] nix-grpc-daemon[734]: ts=2026-09-20T09:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:411645128worker1 # [ 64.823615] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)5129worker1 # [ 64.827391] nix-daemon[848]: reaped child process 1159, status = succeeded5130worker1 # [ 64.831984] nix-daemon[848]: accepted connection from pid 734, user nix-grpc-daemon (trusted)5131client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5132client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5133worker1 # [ 66.059502] nix-daemon[848]: reaped child process 1177, status = succeeded5134worker1 # [ 66.198282] nix-daemon[848]: accepted connection from pid 1192, user nix-grpc-daemon (trusted)5135worker1 # [ 66.209959] nix-daemon[848]: reaped child process 1195, status = succeeded5136lb # [ 66.249473] niks3-server[1037]: 2026/09/20 09:05:48 INFO Received uploads request method=POST path=/api/pending_closures5137worker1 # [ 66.229514] nix-grpc-daemon[858]: time=2026-09-20T09:05:47.595Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5138lb # [ 66.267181] niks3-server[1037]: 2026/09/20 09:05:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5139lb # [ 66.269463] niks3-server[1037]: 2026/09/20 09:05:48 INFO Signed narinfos id=22 count=15140worker1 # [ 66.245068] nix-grpc-daemon[858]: time=2026-09-20T09:05:47.611Z level=INFO msg="Uploading 1 narinfos"5141lb # [ 66.272184] niks3-server[1037]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5142lb # [ 66.276048] niks3-server[1037]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5143lb # [ 66.281117] niks3-server[1037]: 2026/09/20 09:05:48 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5144worker1 # [ 66.257984] nix-grpc-daemon[858]: time=2026-09-20T09:05:47.624Z level=INFO msg="Upload complete. (218ms)"5145lb # [ 66.284178] niks3-server[1037]: 2026/09/20 09:05:48 INFO Completed upload id=225146lb # [ 66.287057] niks3-server[1037]: 2026/09/20 09:05:48 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5147worker1 # [ 66.260209] nix-grpc-daemon[734]: ts=2026-09-20T09:05:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15148worker1 # [ 66.266570] nix-daemon[848]: reaped child process 1175, status = succeeded5149client # copying 1 paths...5150worker1 # [ 66.305250] nix-grpc-daemon[734]: ts=2026-09-20T09:05:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:411645151client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5152worker2 # [ 66.364726] nix-grpc-daemon[782]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:413325153worker2 # [ 66.373549] nix-grpc-daemon[782]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5154worker2 # [ 66.384923] nix-grpc-daemon[782]: ts=2026-09-20T09:05:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=0 paths=1 nar_bytes_out=1205155client # [ 66.475642] nix-daemon[945]: reaped child process 1052, status = succeeded5156client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.43 seconds)5157client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25158client # [ 66.664924] nix-daemon[945]: accepted connection from pid 1071, user root (trusted)5159client # this derivation will be built:5160client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5161worker2 # [ 66.857283] nix-grpc-daemon[782]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:413325162client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5163worker1 # [ 66.826156] nix-grpc-daemon[734]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:411645164worker1 # [ 66.834299] nix-grpc-daemon[858]: time=2026-09-20T09:05:48.200Z level=INFO msg="All 1 paths already cached"5165worker2 # [ 66.885171] nix-grpc-daemon[782]: ts=2026-09-20T09:05:48Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05166worker2 # [ 66.889410] nix-grpc-daemon[782]: ts=2026-09-20T09:05:48Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15167worker2 # [ 66.938768] nix-grpc-daemon[782]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413325168worker2 # [ 66.951931] nix-grpc-daemon[782]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413325169worker2 # [ 66.965389] nix-grpc-daemon[898]: time=2026-09-20T09:05:48.640Z level=INFO msg="All 1 paths already cached"5170client # copying 1 paths to 'lb:50051'...5171client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5172worker2 # [ 66.974224] nix-grpc-daemon[782]: ts=2026-09-20T09:05:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413325173worker2 # [ 66.986123] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)5174lb # [ 67.147429] envoy[909]: conn peer=[2001:db8:1::1]:45332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4298 tx=2201 ms=21005175lb # [ 67.149399] envoy[909]: conn peer=[2001:db8:1::1]:45342 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=545176lb # [ 67.151286] envoy[909]: conn peer=[2001:db8:1::1]:45350 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4234 tx=1750 ms=24175177lb # [ 67.153160] envoy[909]: conn peer=[2001:db8:1::1]:43714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=755178lb # [ 67.154957] envoy[909]: conn peer=[2001:db8:1::1]:43722 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1802 ms=30325179lb # [ 67.156667] envoy[909]: conn peer=[2001:db8:1::1]:43730 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=745180worker2 # [ 67.187899] nix-daemon[845]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)5181worker2 # [ 67.202372] nix-daemon[845]: reaped child process 1029, status = succeeded5182worker2 # [ 67.390389] nix-daemon[845]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)5183worker2 # [ 67.404307] nix-daemon[845]: reaped child process 1034, status = succeeded5184lb # [ 67.411478] niks3-server[1037]: 2026/09/20 09:05:49 INFO Received uploads request method=POST path=/api/pending_closures5185worker2 # [ 67.429430] nix-grpc-daemon[898]: time=2026-09-20T09:05:49.104Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5186worker2 # [ 67.431036] nix-grpc-daemon[898]: time=2026-09-20T09:05:49.106Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5187lb # [ 67.443158] niks3-server[1037]: 2026/09/20 09:05:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5188lb # [ 67.451065] niks3-server[1037]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5189lb # [ 67.456088] niks3-server[1037]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5190lb # [ 67.461364] niks3-server[1037]: 2026/09/20 09:05:49 INFO Signed narinfos id=23 count=15191worker2 # [ 67.476213] nix-grpc-daemon[898]: time=2026-09-20T09:05:49.151Z level=INFO msg="Uploading 1 narinfos"5192lb # [ 67.474854] niks3-server[1037]: 2026/09/20 09:05:49 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5193lb # [ 67.479710] niks3-server[1037]: 2026/09/20 09:05:49 INFO Completed upload id=235194worker2 # [ 67.491549] nix-grpc-daemon[898]: time=2026-09-20T09:05:49.166Z level=INFO msg="Upload complete. (493ms)"5195worker2 # [ 67.494739] nix-grpc-daemon[782]: ts=2026-09-20T09:05:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=0 paths=1 nar_bytes_in=5605196lb # [ 67.484468] niks3-server[1037]: 2026/09/20 09:05:49 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5197worker2 # [ 67.499895] nix-grpc-daemon[782]: ts=2026-09-20T09:05:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413325198worker2 # [ 67.506380] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)5199worker2 # [ 67.508926] nix-daemon[845]: reaped child process 1024, status = succeeded5200client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5201worker2 # [ 67.514721] nix-daemon[845]: accepted connection from pid 782, user nix-grpc-daemon (trusted)5202client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5203worker2 # [ 68.328841] nix-daemon[845]: reaped child process 1038, status = succeeded5204worker2 # [ 68.466620] nix-daemon[845]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)5205worker2 # [ 68.480145] nix-daemon[845]: reaped child process 1056, status = succeeded5206lb # [ 68.485720] niks3-server[1037]: 2026/09/20 09:05:50 INFO Received uploads request method=POST path=/api/pending_closures5207worker2 # [ 68.505314] nix-grpc-daemon[898]: time=2026-09-20T09:05:50.180Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5208lb # [ 68.516615] niks3-server[1037]: 2026/09/20 09:05:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5209lb # [ 68.521246] niks3-server[1037]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5210worker2 # [ 68.541679] nix-grpc-daemon[898]: time=2026-09-20T09:05:50.216Z level=INFO msg="Uploading 1 narinfos"5211lb # [ 68.529796] niks3-server[1037]: 2026/09/20 09:05:50 INFO Signed narinfos id=24 count=15212lb # [ 68.534103] niks3-server[1037]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5213lb # [ 68.547581] niks3-server[1037]: 2026/09/20 09:05:50 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5214lb # [ 68.552574] niks3-server[1037]: 2026/09/20 09:05:50 INFO Completed upload id=245215worker2 # [ 68.567088] nix-grpc-daemon[898]: time=2026-09-20T09:05:50.242Z level=INFO msg="Upload complete. (246ms)"5216lb # [ 68.555690] niks3-server[1037]: 2026/09/20 09:05:50 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5217worker2 # [ 68.570659] nix-grpc-daemon[782]: ts=2026-09-20T09:05:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41332 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15218worker2 # [ 68.580130] nix-daemon[845]: reaped child process 1036, status = succeeded5219client # copying 1 paths...5220worker2 # [ 68.618146] nix-grpc-daemon[782]: ts=2026-09-20T09:05:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:413325221client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5222worker1 # [ 68.600481] nix-grpc-daemon[734]: ts=2026-09-20T09:05:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:411645223worker1 # [ 68.612418] nix-grpc-daemon[734]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5224worker1 # [ 68.625823] nix-grpc-daemon[734]: ts=2026-09-20T09:05:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41164 duration_s=0 paths=1 nar_bytes_out=1205225client # [ 68.754244] nix-daemon[945]: reaped child process 1074, status = succeeded5226client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.27 seconds)5227(finished: subtest: an input only one worker has still reaches the builder, in 9.37 seconds)5228subtest: upload whose reference the worker lacks is completed from the cache5229client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5230client # this derivation will be built:5231client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5232client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5233client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.39 seconds)5234client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5235client # this derivation will be built:5236client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5237client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5238client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.36 seconds)5239client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5240client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.17 seconds)5241worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5242worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.19 seconds)5243worker2 # [ 69.947658] systemd[1]: Stopping Nix worker-protocol over gRPC...5244worker2 # [ 70.446156] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=signal_exit5245worker2 # [ 70.698706] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=scheduler_yield5246lb # [ 70.688907] niks3-server[1037]: 2026/09/20 09:05:52 INFO lead: released remote=192.168.1.4:544365247worker2 # [ 70.702826] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=scheduler_restarting addr=lb:500515248worker1 # [ 70.669727] nix-grpc-daemon[734]: ts=2026-09-20T09:05:52Z level=info event=scheduler_restarting addr=lb:500515249worker2 # [ 70.707302] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:514385250worker2 # [ 70.711702] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=worker_gone addr=192.168.1.4:500515251worker2 # [ 70.714693] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:514385252worker2 # [ 70.717978] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=worker_gone addr=192.168.1.3:500515253worker2 # [ 70.903822] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500515254worker1 # [ 70.872210] nix-grpc-daemon[734]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500515255worker2 # [ 70.911507] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5256worker1 # [ 70.875551] nix-grpc-daemon[734]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5257worker1 # [ 71.073275] nix-grpc-daemon[734]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500515258worker2 # [ 71.112791] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500515259worker2 # [ 71.117594] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5260worker1 # [ 71.080617] nix-grpc-daemon[734]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5261worker2 # [ 71.318111] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500515262worker1 # [ 71.281652] nix-grpc-daemon[734]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500515263worker2 # [ 71.322967] nix-grpc-daemon[782]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5264worker1 # [ 71.286619] nix-grpc-daemon[734]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5265worker2 # [ 71.523984] nix-grpc-daemon[782]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500515266worker2 # [ 71.526807] nix-grpc-daemon[782]: ts=2026-09-20T09:05:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5267worker1 # [ 71.487616] nix-grpc-daemon[734]: ts=2026-09-20T09:05:52Z level=info event=scheduler_connected addr=lb:500515268worker1 # [ 71.492656] nix-grpc-daemon[734]: ts=2026-09-20T09:05:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5269worker2 # [ 71.698381] nix-grpc-daemon[782]: ts=2026-09-20T09:05:53Z level=info event=scheduler_restarting5270worker2 # [ 71.714361] nix-daemon[845]: reaped child process 847, status = succeeded5271worker2 # [ 71.733181] nix-grpc-daemon[782]: ts=2026-09-20T09:05:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5272worker1 # [ 71.694577] nix-grpc-daemon[734]: ts=2026-09-20T09:05:53Z level=info event=scheduler_connected addr=lb:500515273worker2 # [ 71.735093] nix-grpc-daemon[782]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5274worker2 # [ 71.736415] nix-grpc-daemon[782]: E0000 00:00:1789895153.408541 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5275worker2 # [ 72.594168] nix-grpc-daemon[782]: E0000 00:00:1789895154.268583 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5276worker2 # [ 72.598992] nix-grpc-daemon[782]: E0000 00:00:1789895154.268723 825 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5277worker1 # [ 73.617991] nix-grpc-daemon[734]: ts=2026-09-20T09:05:54Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5278worker2 # [ 73.669445] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5279worker2 # [ 73.673937] systemd[1]: Stopped Nix worker-protocol over gRPC.5280worker2 # [ 73.676584] systemd[1]: nix-grpc-daemon.service: Consumed 1.472s CPU time over 56.511s wall clock time, 52.9M memory peak, 53.8K incoming IP traffic, 103.7K outgoing IP traffic.5281worker2 # [ 73.687628] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5282worker2 # [ 73.691808] systemd[1]: Closed Nix worker-protocol over gRPC.5283worker2 # [ 73.695139] systemd[1]: nix-grpc-daemon.socket: Consumed 285us CPU time over 1min 5.008s wall clock time, 256K memory peak, 104.4K incoming IP traffic, 82.8K outgoing IP traffic.5284lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5285lb: must succeed: curl -sf localhost:9901/clusters5286lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5287lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5288client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25289worker1 # [ 73.818248] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500515290worker1 # [ 73.823133] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5291worker1 # [ 73.947374] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:411645292worker1 # [ 73.954501] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:411645293client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5294client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.25 seconds)5295worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5296worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5297worker1 # [ 74.023864] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500515298worker1 # [ 74.027721] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5299worker2 # [ 74.100716] systemd[1]: Listening on Nix worker-protocol over gRPC.5300worker1 # [ 74.120896] systemd[1]: Stopping Nix worker-protocol over gRPC...5301worker1 # [ 74.228497] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500515302worker1 # [ 74.233492] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5303lb # [ 74.364985] niks3-server[1037]: 2026/09/20 09:05:56 INFO lead: acquired remote=192.168.1.3:385985304worker1 # [ 74.341713] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=info event=scheduler_take_over5305worker1 # [ 74.404996] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=info event=signal_exit5306worker1 # [ 74.433988] nix-grpc-daemon[734]: ts=2026-09-20T09:05:55Z level=info event=scheduler_connected addr=lb:500515307worker2 # [ 74.479176] systemd[1]: Starting Nix worker-protocol over gRPC...5308worker2 # [ 74.660416] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5309worker2 # [ 74.663747] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15310worker2 # [ 74.670509] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5311worker2 # [ 74.674290] systemd[1]: Started Nix worker-protocol over gRPC.5312worker1 # [ 74.646141] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5313lb # [ 74.684175] niks3-server[1037]: 2026/09/20 09:05:56 INFO lead: released remote=192.168.1.3:385985314worker1 # [ 74.657478] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_yield5315worker2 # [ 74.701620] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500515316worker2 # [ 74.703281] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5317worker1 # [ 74.846236] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500515318worker1 # [ 74.850344] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5319worker2 # [ 74.904110] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500515320worker2 # [ 74.908115] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5321worker1 # [ 75.050616] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500515322worker1 # [ 75.052704] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5323worker2 # [ 75.108678] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500515324worker2 # [ 75.112651] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5325worker1 # [ 75.253430] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500515326worker1 # [ 75.255720] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5327worker2 # [ 75.313468] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500515328worker2 # [ 75.317400] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5329worker1 # [ 75.456458] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_connected addr=lb:500515330worker1 # [ 75.459269] nix-grpc-daemon[734]: ts=2026-09-20T09:05:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5331worker2 # [ 75.517987] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:57Z level=info event=scheduler_connected addr=lb:500515332worker2 # [ 75.521890] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5333worker1 # [ 75.662739] nix-grpc-daemon[734]: ts=2026-09-20T09:05:57Z level=info event=scheduler_restarting5334worker1 # [ 75.667517] nix-grpc-daemon[734]: ts=2026-09-20T09:05:57Z level=info event=scheduler_connected addr=lb:500515335worker1 # [ 75.670545] nix-grpc-daemon[734]: ts=2026-09-20T09:05:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5336worker2 # [ 75.723410] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:57Z level=info event=scheduler_connected addr=lb:500515337worker1 # [ 75.690716] nix-grpc-daemon[734]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5338worker1 # [ 75.694399] nix-grpc-daemon[734]: E0000 00:00:1789895157.054597 833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5339worker1 # [ 75.700191] nix-daemon[848]: reaped child process 850, status = succeeded5340worker1 # [ 75.880777] nix-grpc-daemon[734]: ts=2026-09-20T09:05:57Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5341worker1 # [ 76.524092] nix-grpc-daemon[734]: E0000 00:00:1789895157.890276 833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5342worker1 # [ 76.530519] nix-grpc-daemon[734]: E0000 00:00:1789895157.896643 833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5343lb # [ 77.147100] envoy[909]: conn peer=[2001:db8:1::1]:43744 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=795344lb # [ 77.148829] envoy[909]: conn peer=[2001:db8:1::1]:43738 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3733 tx=1817 ms=18605345lb # [ 77.150273] envoy[909]: conn peer=192.168.1.4:42398 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=13397 tx=2610 ms=542365346lb # [ 77.151745] envoy[909]: conn peer=[2001:db8:1::1]:52024 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=205347lb # [ 77.153145] envoy[909]: conn peer=[2001:db8:1::3]:37266 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=15250 tx=3210 ms=574825348worker2 # [ 77.588507] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5349worker1 # [ 77.571734] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5350worker1 # [ 77.574675] systemd[1]: Stopped Nix worker-protocol over gRPC.5351worker1 # [ 77.578646] systemd[1]: nix-grpc-daemon.service: Consumed 2.603s CPU time over 1min 458ms wall clock time, 61.4M memory peak, 91.2K incoming IP traffic, 168.1K outgoing IP traffic.5352worker1 # [ 77.590765] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5353worker1 # [ 77.595134] systemd[1]: Closed Nix worker-protocol over gRPC.5354worker1 # [ 77.597881] systemd[1]: nix-grpc-daemon.socket: Consumed 293us CPU time over 1min 7.536s wall clock time, 256K memory peak, 111.6K incoming IP traffic, 86.4K outgoing IP traffic.5355lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5356lb: must succeed: curl -sf localhost:9901/clusters5357lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5358lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.08 seconds)5359client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25360worker2 # [ 77.788624] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:59Z level=info event=scheduler_connected addr=lb:500515361worker2 # [ 77.791414] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5362worker2 # [ 77.955156] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:494385363worker2 # [ 77.966930] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5364worker2 # [ 77.983638] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5)5365worker2 # [ 77.991341] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 113 ms (attempt 2/5)5366worker2 # [ 77.997466] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:59Z level=info event=scheduler_connected addr=lb:500515367worker2 # [ 78.001437] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5368worker2 # [ 78.110976] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 3/5)5369worker2 # [ 78.202344] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:59Z level=info event=scheduler_connected addr=lb:500515370worker2 # [ 78.207434] nix-grpc-daemon[1077]: ts=2026-09-20T09:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5371worker2 # [ 78.284137] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 419 ms (attempt 4/5)5372worker2 # [ 78.407957] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_connected addr=lb:500515373worker2 # [ 78.410561] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5374worker2 # [ 78.611669] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_connected addr=lb:500515375worker2 # [ 78.614720] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5376worker2 # [ 78.709398] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5377client # copying 2 paths...5378client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5379client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5380worker2 # [ 78.729803] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:494385381worker2 # [ 78.740159] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5382worker2 # [ 78.760451] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=niks3_push_started pid=11335383worker2 # [ 78.815338] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_connected addr=lb:500515384worker2 # [ 78.817830] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5385worker2 # [ 79.018394] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_connected addr=lb:500515386worker2 # [ 79.021136] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5387worker2 # [ 79.082882] nix-daemon[845]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)5388worker2 # [ 79.093981] nix-daemon[845]: reaped child process 1149, status = succeeded5389lb # [ 79.097686] niks3-server[1037]: 2026/09/20 09:06:01 INFO Received uploads request method=POST path=/api/pending_closures5390lb # [ 79.105846] niks3-server[1037]: 2026/09/20 09:06:01 INFO Received uploads request method=POST path=/api/pending_closures5391worker2 # [ 79.124846] nix-grpc-daemon[1133]: time=2026-09-20T09:06:00.799Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5392worker2 # [ 79.128060] nix-grpc-daemon[1133]: time=2026-09-20T09:06:00.801Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5393worker2 # [ 79.129634] nix-grpc-daemon[1133]: time=2026-09-20T09:06:00.801Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5394lb # [ 79.154190] niks3-server[1037]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5395lb # [ 79.161843] niks3-server[1037]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5396lb # [ 79.177936] niks3-server[1037]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5397lb # [ 79.179422] niks3-server[1037]: 2026/09/20 09:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5398lb # [ 79.181772] niks3-server[1037]: 2026/09/20 09:06:01 INFO Signed narinfos id=26 count=25399lb # [ 79.184201] niks3-server[1037]: 2026/09/20 09:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5400lb # [ 79.185767] niks3-server[1037]: 2026/09/20 09:06:01 INFO Signed narinfos id=25 count=15401worker2 # [ 79.197130] nix-grpc-daemon[1133]: time=2026-09-20T09:06:00.871Z level=INFO msg="Uploading 3 narinfos"5402lb # [ 79.188629] niks3-server[1037]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5403lb # [ 79.197429] niks3-server[1037]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5404lb # [ 79.203451] niks3-server[1037]: 2026/09/20 09:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5405lb # [ 79.207777] niks3-server[1037]: 2026/09/20 09:06:01 INFO Completed upload id=255406lb # [ 79.209285] niks3-server[1037]: 2026/09/20 09:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5407worker2 # [ 79.221943] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_connected addr=lb:500515408lb # [ 79.212751] niks3-server[1037]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5409lb # [ 79.216049] niks3-server[1037]: 2026/09/20 09:06:01 INFO Completed upload id=265410worker2 # [ 79.227512] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5411worker2 # [ 79.234874] nix-grpc-daemon[1133]: time=2026-09-20T09:06:00.902Z level=INFO msg="Upload complete. (280ms)"5412lb # [ 79.224337] niks3-server[1037]: 2026/09/20 09:06:01 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5413worker2 # [ 79.238241] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=0 paths=2 nar_bytes_in=3125414worker2 # [ 79.248732] nix-daemon[845]: reaped child process 1131, status = succeeded5415client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.55 seconds)5416worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5417worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5418worker1 # [ 79.323472] systemd[1]: Listening on Nix worker-protocol over gRPC.5419worker1 # [ 79.330355] systemd[1]: Starting Nix worker-protocol over gRPC...5420worker2 # [ 79.428630] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515421worker2 # [ 79.433642] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5422worker1 # [ 79.499606] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5423worker1 # [ 79.502928] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15424worker1 # [ 79.509769] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5425worker1 # [ 79.514164] systemd[1]: Started Nix worker-protocol over gRPC.5426worker1 # [ 79.521107] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:00Z level=info event=scheduler_take_over5427lb # [ 79.545795] niks3-server[1037]: 2026/09/20 09:06:01 INFO lead: acquired remote=192.168.1.3:355605428lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5429lb: must succeed: curl -sf localhost:9901/clusters5430worker1 # [ 79.546244] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:00Z level=info event=scheduler_connected addr=lb:500515431worker1 # [ 79.560880] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:00Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05432lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5433lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5434(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.86 seconds)5435subtest: scheduler down: the other node takes the lock and keeps it5436lb: must succeed: curl -sf localhost:9901/clusters5437worker1 # [ 79.597745] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:00Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05438worker2 # [ 79.635434] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:01Z level=info event=scheduler_connected addr=lb:500515439lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5440lb: must succeed: curl -sf localhost:9901/clusters5441lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5442lb: must succeed: curl -sf localhost:9901/clusters5443lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5444lb: must succeed: curl -sf localhost:9901/clusters5445lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5446worker1 # [ 79.820574] systemd[1]: Stopping Nix worker-protocol over gRPC...5447worker1 # [ 80.510698] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:01Z level=info event=signal_exit5448worker1 # [ 80.520921] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:01Z level=info event=scheduler_yield5449worker2 # [ 80.561231] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:02Z level=info event=scheduler_restarting addr=lb:500515450lb # [ 80.549848] niks3-server[1037]: 2026/09/20 09:06:02 INFO lead: released remote=192.168.1.3:355605451worker1 # [ 80.527816] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:551705452worker1 # [ 80.529464] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:01Z level=info event=worker_gone addr=192.168.1.4:500515453worker1 # [ 80.531250] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:01Z level=info event=scheduler_restarting addr=lb:500515454worker1 # [ 80.532471] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:551705455worker1 # [ 80.533763] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:01Z level=info event=worker_gone addr=192.168.1.3:500515456worker2 # [ 80.762926] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515457worker1 # [ 80.729796] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515458worker2 # [ 80.766946] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5459worker1 # [ 80.732274] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5460worker2 # [ 80.967618] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515461worker2 # [ 80.970299] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5462worker1 # [ 80.933223] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515463worker1 # [ 80.937773] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5464worker2 # [ 81.170948] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515465worker2 # [ 81.173602] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5466worker1 # [ 81.138540] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515467worker1 # [ 81.143091] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5468worker2 # [ 81.374568] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500515469worker2 # [ 81.378454] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5470worker1 # [ 81.343424] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:02Z level=info event=scheduler_connected addr=lb:500515471worker1 # [ 81.345853] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5472worker1 # [ 81.525307] nix-grpc-daemon[1219]: ts=2026-09-20T09:06:02Z level=info event=scheduler_restarting5473worker2 # [ 81.579407] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:03Z level=info event=scheduler_connected addr=lb:500515474worker1 # [ 81.543323] nix-grpc-daemon[1219]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5475worker1 # [ 81.548237] nix-grpc-daemon[1219]: E0000 00:00:1789895162.909602 1262 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5476worker1 # [ 81.568574] nix-grpc-daemon[1219]: E0000 00:00:1789895162.934808 1262 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5477worker1 # [ 81.573315] nix-grpc-daemon[1219]: E0000 00:00:1789895162.934933 1262 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5478worker2 # [ 83.554820] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5479worker1 # [ 83.533438] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5480worker1 # [ 83.536625] systemd[1]: Stopped Nix worker-protocol over gRPC.5481worker1 # [ 83.540403] systemd[1]: nix-grpc-daemon.service: Consumed 137ms CPU time over 4.202s wall clock time, 12.3M memory peak, 7.3K incoming IP traffic, 7.4K outgoing IP traffic.5482worker1 # [ 83.550807] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5483worker1 # [ 83.554971] systemd[1]: Closed Nix worker-protocol over gRPC.5484worker1 # [ 83.558472] systemd[1]: nix-grpc-daemon.socket: Consumed 537us CPU time over 4.238s wall clock time, 256K memory peak, 20.5K incoming IP traffic, 15.9K outgoing IP traffic.5485worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5486worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds)5487worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5488worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5489worker2 # [ 83.754821] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:05Z level=info event=scheduler_connected addr=lb:500515490worker2 # [ 83.757807] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5491worker2 # [ 83.958904] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:05Z level=info event=scheduler_connected addr=lb:500515492worker2 # [ 83.962827] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5493worker2 # [ 84.163987] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:05Z level=info event=scheduler_connected addr=lb:500515494worker2 # [ 84.169121] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5495worker2 # [ 84.369949] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:06Z level=info event=scheduler_connected addr=lb:500515496worker2 # [ 84.373966] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5497worker2 # [ 84.576463] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:06Z level=info event=scheduler_connected addr=lb:500515498worker2 # [ 84.580630] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5499lb # [ 84.675271] niks3-server[1037]: 2026/09/20 09:06:06 INFO lead: acquired remote=192.168.1.4:600865500worker2 # [ 84.691093] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:06Z level=info event=scheduler_take_over5501worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5502worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5503worker2 # [ 84.780841] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:06Z level=info event=scheduler_connected addr=lb:500515504worker2 # [ 84.782658] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05505worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5506worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5507client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25508worker2 # [ 85.992207] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:494385509client # don't know how to build these paths:5510client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5511worker2 # [ 86.000633] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:494385512worker2 # [ 86.016565] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:07Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05513worker2 # [ 86.021668] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:07Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.4:50051 clients=15514worker2 # [ 86.059317] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:494385515worker2 # [ 86.069768] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:494385516client # copying 1 paths to 'lb:50051'...5517client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5518worker2 # [ 86.079974] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:494385519worker2 # [ 86.088823] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5520worker2 # [ 86.240937] nix-daemon[845]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)5521worker2 # [ 86.253512] nix-daemon[845]: reaped child process 1182, status = succeeded5522worker2 # [ 86.391612] nix-daemon[845]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)5523worker2 # [ 86.402730] nix-daemon[845]: reaped child process 1187, status = succeeded5524lb # [ 86.402251] niks3-server[1037]: 2026/09/20 09:06:08 INFO Received uploads request method=POST path=/api/pending_closures5525worker2 # [ 86.418419] nix-grpc-daemon[1133]: time=2026-09-20T09:06:08.093Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5526worker2 # [ 86.419950] nix-grpc-daemon[1133]: time=2026-09-20T09:06:08.095Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5527lb # [ 86.421324] niks3-server[1037]: 2026/09/20 09:06:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5528lb # [ 86.423400] niks3-server[1037]: 2026/09/20 09:06:08 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5529lb # [ 86.440571] niks3-server[1037]: 2026/09/20 09:06:08 INFO Signed narinfos id=27 count=15530worker2 # [ 86.452399] nix-grpc-daemon[1133]: time=2026-09-20T09:06:08.127Z level=INFO msg="Uploading 1 narinfos"5531lb # [ 86.447873] niks3-server[1037]: 2026/09/20 09:06:08 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5532lb # [ 86.455151] niks3-server[1037]: 2026/09/20 09:06:08 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5533lb # [ 86.458463] niks3-server[1037]: 2026/09/20 09:06:08 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5534lb # [ 86.460683] niks3-server[1037]: 2026/09/20 09:06:08 INFO Completed upload id=275535worker2 # [ 86.472418] nix-grpc-daemon[1133]: time=2026-09-20T09:06:08.147Z level=INFO msg="Upload complete. (369ms)"5536worker2 # [ 86.474471] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=0 paths=1 nar_bytes_in=5205537worker2 # [ 86.477443] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:494385538worker2 # [ 86.484259] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5539worker2 # [ 86.487097] nix-daemon[845]: reaped child process 1177, status = succeeded5540client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5541worker2 # [ 86.492992] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5542client # farm-a> worker2: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5543lb # [ 87.147953] envoy[909]: conn peer=[2001:db8:1::1]:52028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1009 tx=304 ms=12935544lb # [ 87.153633] envoy[909]: conn peer=[2001:db8:1::3]:51524 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1348 tx=362 ms=20085545client # farm-a> LOG-farm-a-on-standby5546worker2 # [ 87.305348] nix-daemon[845]: reaped child process 1191, status = succeeded5547worker2 # [ 87.460334] nix-daemon[845]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5548worker2 # [ 87.472388] nix-daemon[845]: reaped child process 1209, status = succeeded5549lb # [ 87.479188] niks3-server[1037]: 2026/09/20 09:06:09 INFO Received uploads request method=POST path=/api/pending_closures5550worker2 # [ 87.500462] nix-grpc-daemon[1133]: time=2026-09-20T09:06:09.175Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5551worker2 # [ 87.502050] nix-grpc-daemon[1133]: time=2026-09-20T09:06:09.177Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5552lb # [ 87.520956] niks3-server[1037]: 2026/09/20 09:06:09 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5553lb # [ 87.526089] niks3-server[1037]: 2026/09/20 09:06:09 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5554lb # [ 87.537793] niks3-server[1037]: 2026/09/20 09:06:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5555lb # [ 87.543089] niks3-server[1037]: 2026/09/20 09:06:09 INFO Signed narinfos id=28 count=15556worker2 # [ 87.558685] nix-grpc-daemon[1133]: time=2026-09-20T09:06:09.233Z level=INFO msg="Uploading 1 narinfos"5557lb # [ 87.552951] niks3-server[1037]: 2026/09/20 09:06:09 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5558lb # [ 87.561455] niks3-server[1037]: 2026/09/20 09:06:09 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5559lb # [ 87.566689] niks3-server[1037]: 2026/09/20 09:06:09 INFO Completed upload id=285560worker2 # [ 87.578490] nix-grpc-daemon[1133]: time=2026-09-20T09:06:09.253Z level=INFO msg="Upload complete. (279ms)"5561lb # [ 87.568302] niks3-server[1037]: 2026/09/20 09:06:09 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5562worker2 # [ 87.582761] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15563worker2 # [ 87.588339] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:09Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05564worker2 # [ 87.590545] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:09Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.4:50051 clients=15565worker2 # [ 87.594586] nix-daemon[845]: reaped child process 1189, status = succeeded5566worker2 # [ 87.631751] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:494385567worker2 # [ 87.639802] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:494385568worker2 # [ 87.648891] nix-grpc-daemon[1133]: time=2026-09-20T09:06:09.324Z level=INFO msg="All 1 paths already cached"5569client # copying 1 paths to 'lb:50051'...5570client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5571worker2 # [ 87.654210] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:494385572worker2 # [ 87.659765] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5573worker2 # [ 87.821258] nix-daemon[845]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5574worker2 # [ 87.833920] nix-daemon[845]: reaped child process 1218, status = succeeded5575worker2 # [ 87.999590] nix-daemon[845]: accepted connection from pid 1220, user nix-grpc-daemon (trusted)5576worker2 # [ 88.011554] nix-daemon[845]: reaped child process 1223, status = succeeded5577lb # [ 88.016574] niks3-server[1037]: 2026/09/20 09:06:09 INFO Received uploads request method=POST path=/api/pending_closures5578worker2 # [ 88.037225] nix-grpc-daemon[1133]: time=2026-09-20T09:06:09.712Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5579worker2 # [ 88.038712] nix-grpc-daemon[1133]: time=2026-09-20T09:06:09.712Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5580lb # [ 88.044318] niks3-server[1037]: 2026/09/20 09:06:10 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5581lb # [ 88.052354] niks3-server[1037]: 2026/09/20 09:06:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5582lb # [ 88.059279] niks3-server[1037]: 2026/09/20 09:06:10 INFO Signed narinfos id=29 count=15583worker2 # [ 88.074158] nix-grpc-daemon[1133]: time=2026-09-20T09:06:09.749Z level=INFO msg="Uploading 1 narinfos"5584lb # [ 88.066420] niks3-server[1037]: 2026/09/20 09:06:10 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5585lb # [ 88.077471] niks3-server[1037]: 2026/09/20 09:06:10 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5586worker2 # [ 88.095877] nix-grpc-daemon[1133]: time=2026-09-20T09:06:09.771Z level=INFO msg="Upload complete. (431ms)"5587lb # [ 88.084093] niks3-server[1037]: 2026/09/20 09:06:10 INFO Completed upload id=295588worker2 # [ 88.097890] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=0 paths=1 nar_bytes_in=6405589lb # [ 88.087894] niks3-server[1037]: 2026/09/20 09:06:10 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5590worker2 # [ 88.104409] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:494385591worker2 # [ 88.108486] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5592worker2 # [ 88.110818] nix-daemon[845]: reaped child process 1213, status = succeeded5593worker2 # [ 88.116401] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5594client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5595client # farm-b> worker2: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5596client # farm-b> LOG-farm-b-on-standby5597worker2 # [ 89.329847] nix-daemon[845]: reaped child process 1227, status = succeeded5598worker2 # [ 89.460089] nix-daemon[845]: accepted connection from pid 1242, user nix-grpc-daemon (trusted)5599worker2 # [ 89.471990] nix-daemon[845]: reaped child process 1245, status = succeeded5600lb # [ 89.477304] niks3-server[1037]: 2026/09/20 09:06:11 INFO Received uploads request method=POST path=/api/pending_closures5601worker2 # [ 89.501139] nix-grpc-daemon[1133]: time=2026-09-20T09:06:11.176Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5602worker2 # [ 89.502621] nix-grpc-daemon[1133]: time=2026-09-20T09:06:11.177Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5603lb # [ 89.518950] niks3-server[1037]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5604lb # [ 89.531133] niks3-server[1037]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5605lb # [ 89.536246] niks3-server[1037]: 2026/09/20 09:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5606worker2 # [ 89.555931] nix-grpc-daemon[1133]: time=2026-09-20T09:06:11.231Z level=INFO msg="Uploading 1 narinfos"5607lb # [ 89.544052] niks3-server[1037]: 2026/09/20 09:06:11 INFO Signed narinfos id=30 count=15608lb # [ 89.547811] niks3-server[1037]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5609lb # [ 89.557384] niks3-server[1037]: 2026/09/20 09:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5610lb # [ 89.563127] niks3-server[1037]: 2026/09/20 09:06:11 INFO Completed upload id=305611worker2 # [ 89.574914] nix-grpc-daemon[1133]: time=2026-09-20T09:06:11.250Z level=INFO msg="Upload complete. (250ms)"5612lb # [ 89.565417] niks3-server[1037]: 2026/09/20 09:06:11 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5613worker2 # [ 89.577814] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15614worker2 # [ 89.584264] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:11Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05615worker2 # [ 89.586262] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:11Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.4:50051 clients=15616worker2 # [ 89.590602] nix-daemon[845]: reaped child process 1225, status = succeeded5617worker2 # [ 89.627753] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:494385618worker2 # [ 89.635831] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:494385619worker2 # [ 89.644474] nix-grpc-daemon[1133]: time=2026-09-20T09:06:11.319Z level=INFO msg="All 2 paths already cached"5620client # copying 1 paths to 'lb:50051'...5621client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5622worker2 # [ 89.649059] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:494385623worker2 # [ 89.653069] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5624worker2 # [ 89.812593] nix-daemon[845]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5625worker2 # [ 89.824946] nix-daemon[845]: reaped child process 1254, status = succeeded5626worker2 # [ 89.985639] nix-daemon[845]: accepted connection from pid 1256, user nix-grpc-daemon (trusted)5627worker2 # [ 89.998036] nix-daemon[845]: reaped child process 1259, status = succeeded5628lb # [ 90.001330] niks3-server[1037]: 2026/09/20 09:06:11 INFO Received uploads request method=POST path=/api/pending_closures5629worker2 # [ 90.022068] nix-grpc-daemon[1133]: time=2026-09-20T09:06:11.697Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5630worker2 # [ 90.023433] nix-grpc-daemon[1133]: time=2026-09-20T09:06:11.697Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5631lb # [ 90.026384] niks3-server[1037]: 2026/09/20 09:06:12 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5632lb # [ 90.037770] niks3-server[1037]: 2026/09/20 09:06:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5633worker2 # [ 90.054380] nix-grpc-daemon[1133]: time=2026-09-20T09:06:11.729Z level=INFO msg="Uploading 1 narinfos"5634lb # [ 90.042793] niks3-server[1037]: 2026/09/20 09:06:12 INFO Signed narinfos id=31 count=15635lb # [ 90.048330] niks3-server[1037]: 2026/09/20 09:06:12 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5636lb # [ 90.058828] niks3-server[1037]: 2026/09/20 09:06:12 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5637worker2 # [ 90.077608] nix-grpc-daemon[1133]: time=2026-09-20T09:06:11.752Z level=INFO msg="Upload complete. (418ms)"5638lb # [ 90.065818] niks3-server[1037]: 2026/09/20 09:06:12 INFO Completed upload id=315639worker2 # [ 90.079549] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=0 paths=1 nar_bytes_in=7685640lb # [ 90.068922] niks3-server[1037]: 2026/09/20 09:06:12 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5641worker2 # [ 90.084611] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:494385642worker2 # [ 90.089952] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5643worker2 # [ 90.092458] nix-daemon[845]: reaped child process 1249, status = succeeded5644worker2 # [ 90.097515] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5645client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5646client # farm-top> worker2: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5647client # farm-top> LOG-farm-top-on-standby5648worker2 # [ 91.312258] nix-daemon[845]: reaped child process 1263, status = succeeded5649worker2 # [ 91.464121] nix-daemon[845]: accepted connection from pid 1278, user nix-grpc-daemon (trusted)5650worker2 # [ 91.475553] nix-daemon[845]: reaped child process 1281, status = succeeded5651lb # [ 91.480073] niks3-server[1037]: 2026/09/20 09:06:13 INFO Received uploads request method=POST path=/api/pending_closures5652worker2 # [ 91.502818] nix-grpc-daemon[1133]: time=2026-09-20T09:06:13.177Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5653worker2 # [ 91.504416] nix-grpc-daemon[1133]: time=2026-09-20T09:06:13.179Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5654lb # [ 91.519595] niks3-server[1037]: 2026/09/20 09:06:13 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5655lb # [ 91.528268] niks3-server[1037]: 2026/09/20 09:06:13 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5656lb # [ 91.538581] niks3-server[1037]: 2026/09/20 09:06:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5657worker2 # [ 91.556049] nix-grpc-daemon[1133]: time=2026-09-20T09:06:13.231Z level=INFO msg="Uploading 1 narinfos"5658lb # [ 91.544138] niks3-server[1037]: 2026/09/20 09:06:13 INFO Signed narinfos id=32 count=15659lb # [ 91.549504] niks3-server[1037]: 2026/09/20 09:06:13 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5660lb # [ 91.559277] niks3-server[1037]: 2026/09/20 09:06:13 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5661lb # [ 91.565892] niks3-server[1037]: 2026/09/20 09:06:13 INFO Completed upload id=325662lb # [ 91.567624] niks3-server[1037]: 2026/09/20 09:06:13 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5663worker2 # [ 91.579203] nix-grpc-daemon[1133]: time=2026-09-20T09:06:13.254Z level=INFO msg="Upload complete. (274ms)"5664worker2 # [ 91.587444] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15665worker2 # [ 91.600435] nix-daemon[845]: reaped child process 1261, status = succeeded5666client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 5.79 seconds)5667client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5668client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.20 seconds)5669worker1 # [ 91.841534] systemd[1]: Listening on Nix worker-protocol over gRPC.5670worker1 # [ 91.847928] systemd[1]: Starting Nix worker-protocol over gRPC...5671worker1 # [ 91.994831] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5672worker1 # [ 91.998578] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15673worker1 # [ 92.004704] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5674worker1 # [ 92.008150] systemd[1]: Started Nix worker-protocol over gRPC.5675lb: must succeed: curl -sf localhost:9901/clusters5676worker1 # [ 92.032113] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:13Z level=info event=scheduler_connected addr=lb:500515677worker2 # [ 92.071466] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05678lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5679worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5680worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5681lb: must succeed: curl -sf localhost:9901/clusters5682lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5683lb: must succeed: curl -sf localhost:9901/clusters5684lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5685worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5686worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5687(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.68 seconds)5688subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5689client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5690client # [ 92.353294] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5691client # Running as unit: rs.service; invocation ID: a7261e590f804a0fa18f689f35fcd65a5692client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5693worker1 # [ 92.547846] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511645694worker1 # [ 92.559747] nix-daemon[848]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5695client # [ 92.592183] nix[1175]: don't know how to build these paths:5696client # [ 92.593113] nix[1175]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5697worker2 # [ 92.613942] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:14Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05698worker2 # [ 92.616382] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:14Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.4:50051 clients=15699worker2 # [ 92.618518] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:494385700worker2 # [ 92.623836] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:494385701client # [ 92.612711] nix[1175]: copying 1 paths to 'lb:50051'...5702client # [ 92.613706] nix[1175]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5703worker2 # [ 92.630107] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:494385704worker2 # [ 92.641103] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5705worker2 # [ 92.797500] nix-daemon[845]: accepted connection from pid 1296, user nix-grpc-daemon (trusted)5706worker2 # [ 92.809813] nix-daemon[845]: reaped child process 1299, status = succeeded5707worker2 # [ 92.965260] nix-daemon[845]: accepted connection from pid 1301, user nix-grpc-daemon (trusted)5708worker2 # [ 92.977294] nix-daemon[845]: reaped child process 1304, status = succeeded5709lb # [ 92.981931] niks3-server[1037]: 2026/09/20 09:06:14 INFO Received uploads request method=POST path=/api/pending_closures5710worker2 # [ 92.998263] nix-grpc-daemon[1133]: time=2026-09-20T09:06:14.673Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5711worker2 # [ 92.999658] nix-grpc-daemon[1133]: time=2026-09-20T09:06:14.673Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5712lb # [ 92.994645] niks3-server[1037]: 2026/09/20 09:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5713lb # [ 92.997641] niks3-server[1037]: 2026/09/20 09:06:14 INFO Signed narinfos id=33 count=15714worker2 # [ 93.009525] nix-grpc-daemon[1133]: time=2026-09-20T09:06:14.684Z level=INFO msg="Uploading 1 narinfos"5715lb # [ 93.001108] niks3-server[1037]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5716lb # [ 93.003518] niks3-server[1037]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5717lb # [ 93.009135] niks3-server[1037]: 2026/09/20 09:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5718lb # [ 93.011974] niks3-server[1037]: 2026/09/20 09:06:14 INFO Completed upload id=335719worker2 # [ 93.023784] nix-grpc-daemon[1133]: time=2026-09-20T09:06:14.699Z level=INFO msg="Upload complete. (373ms)"5720lb # [ 93.013658] niks3-server[1037]: 2026/09/20 09:06:14 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5721worker2 # [ 93.025881] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=0 paths=1 nar_bytes_in=4165722worker2 # [ 93.029586] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:494385723worker2 # [ 93.035703] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5724worker2 # [ 93.037978] nix-daemon[845]: reaped child process 1294, status = succeeded5725worker2 # [ 93.043149] nix-daemon[845]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)5726client # [ 93.025847] nix[1175]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5727lb: must succeed: curl -sf localhost:9901/clusters5728lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5729lb: must succeed: curl -sf localhost:9901/clusters5730lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5731lb: must succeed: curl -sf localhost:9901/clusters5732lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5733lb: must succeed: curl -sf localhost:9901/clusters5734lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5735worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5736worker1 # [ 95.112519] systemd-journald[289]: Received client request to rotate journal, rotating.5737worker1 # [ 95.121612] systemd-journald[289]: Vacuuming done, freed 0B of archived journals from /var/log/journal/95e31aec263342a68aca69f25c9467d0.5738worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.03 seconds)5739worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5740worker2 # [ 95.067744] systemd[1]: Stopping Nix worker-protocol over gRPC...5741worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5742??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5743 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735744client: must succeed: sleep 5.05745worker2 # [ 95.678032] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:17Z level=info event=draining5746lb # [ 97.149848] envoy[909]: conn peer=[2001:db8:1::1]:41192 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9590 tx=3813 ms=56035747client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5748worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5749worker2 # [ 100.473918] nix-daemon[845]: reaped child process 1308, status = succeeded5750worker2 # [ 100.631856] nix-daemon[845]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5751worker2 # [ 100.642737] nix-daemon[845]: reaped child process 1351, status = succeeded5752lb # [ 100.648517] niks3-server[1037]: 2026/09/20 09:06:22 INFO Received uploads request method=POST path=/api/pending_closures5753worker2 # [ 100.670860] nix-grpc-daemon[1133]: time=2026-09-20T09:06:22.345Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5754worker2 # [ 100.672473] nix-grpc-daemon[1133]: time=2026-09-20T09:06:22.347Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5755lb # [ 100.696194] niks3-server[1037]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5756worker2 # [ 100.719604] nix-grpc-daemon[1133]: time=2026-09-20T09:06:22.394Z level=INFO msg="Uploading 1 narinfos"5757lb # [ 100.707826] niks3-server[1037]: 2026/09/20 09:06:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5758lb # [ 100.711458] niks3-server[1037]: 2026/09/20 09:06:22 INFO Signed narinfos id=34 count=15759lb # [ 100.720560] niks3-server[1037]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5760lb # [ 100.725563] niks3-server[1037]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5761lb # [ 100.736681] niks3-server[1037]: 2026/09/20 09:06:22 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5762lb # [ 100.740358] niks3-server[1037]: 2026/09/20 09:06:22 INFO Completed upload id=345763lb # [ 100.741886] niks3-server[1037]: 2026/09/20 09:06:22 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5764worker2 # [ 100.752314] nix-grpc-daemon[1133]: time=2026-09-20T09:06:22.427Z level=INFO msg="Upload complete. (296ms)"5765worker2 # [ 100.761117] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15766worker2 # [ 100.773471] nix-daemon[845]: reaped child process 1306, status = succeeded5767client # [ 100.774363] systemd[1]: rs.service: Deactivated successfully.5768client # [ 100.777851] systemd[1]: rs.service: Consumed 116ms CPU time over 8.424s wall clock time, 37.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.5769worker2 # [ 101.679793] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=signal_exit5770worker2 # [ 101.906975] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=scheduler_yield5771worker1 # [ 101.871791] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:23Z level=info event=scheduler_restarting addr=lb:500515772lb # [ 101.897687] niks3-server[1037]: 2026/09/20 09:06:23 INFO lead: released remote=192.168.1.4:600865773worker2 # [ 101.910977] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=scheduler_restarting addr=lb:500515774worker2 # [ 101.916155] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:494085775worker2 # [ 101.919607] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=worker_gone addr=192.168.1.4:500515776worker2 # [ 101.922541] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:494085777worker2 # [ 101.925754] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=worker_gone addr=192.168.1.3:500515778lb # [ 102.041431] niks3-server[1037]: 2026/09/20 09:06:24 INFO lead: acquired remote=192.168.1.3:356285779worker1 # [ 102.019146] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:23Z level=info event=scheduler_take_over5780worker1 # [ 102.072449] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515781worker2 # [ 102.111822] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515782worker1 # [ 102.078973] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05783worker2 # [ 102.122499] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5784worker2 # [ 102.323663] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:23Z level=info event=scheduler_connected addr=lb:500515785worker1 # [ 102.287606] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=05786worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.18 seconds)5787client: waiting for success: ! systemctl is-active rs5788client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5789client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5790client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5791client: must fail: journalctl -u rs | grep -q 'reconnecting'5792client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5793lb: must succeed: curl -sf localhost:9901/clusters5794lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5795worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5796worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5797(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.48 seconds)5798subtest: scheduler restart mid-build: build finishes, no double build5799client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5800client # [ 102.828133] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5801client # Running as unit: mid.service; invocation ID: b2860a38107b4b65b612abbe6a7b509e5802client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.06 seconds)5803worker1 # [ 102.876116] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:425885804worker2 # [ 102.914649] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:24Z level=info event=scheduler_restarting5805worker1 # [ 102.879333] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:24Z level=info event=worker_gone addr=192.168.1.4:500515806worker2 # [ 102.928932] nix-grpc-daemon[1077]: ts=2026-09-20T09:06:24Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5807worker2 # [ 102.952445] nix-daemon[845]: reaped child process 1126, status = succeeded5808worker1 # [ 103.000221] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:511645809client # [ 103.027508] nix[1211]: don't know how to build these paths:5810client # [ 103.028445] nix[1211]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5811worker2 # [ 103.046334] nix-grpc-daemon[1077]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5812worker2 # [ 103.049900] nix-grpc-daemon[1077]: E0000 00:00:1789895184.721521 1120 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5813worker2 # [ 103.732229] nix-grpc-daemon[1077]: E0000 00:00:1789895185.407123 1120 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5814worker2 # [ 103.737361] nix-grpc-daemon[1077]: E0000 00:00:1789895185.407501 1120 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5815client # [ 104.172840] nix[1211]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5816worker2 # [ 104.209499] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5817worker2 # [ 104.212373] systemd[1]: Stopped Nix worker-protocol over gRPC.5818worker2 # [ 104.214616] systemd[1]: nix-grpc-daemon.service: Consumed 1.351s CPU time over 29.729s wall clock time, 35.2M memory peak, 57.2K incoming IP traffic, 123.4K outgoing IP traffic.5819worker2 # [ 104.228811] systemd[1]: Starting Nix worker-protocol over gRPC...5820worker2 # [ 104.398553] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5821worker2 # [ 104.401863] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15822worker2 # [ 104.409129] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5823worker2 # [ 104.410747] systemd[1]: Started Nix worker-protocol over gRPC.5824worker2 # [ 104.433782] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:26Z level=info event=scheduler_connected addr=lb:500515825worker1 # [ 104.398711] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05826worker1 # [ 104.660834] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:26Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05827worker1 # [ 104.666445] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:26Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15828worker1 # [ 104.705409] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511645829worker1 # [ 104.717473] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5)5830worker1 # [ 104.794371] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 2/5)5831worker1 # [ 104.801950] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 3/5)5832worker1 # [ 104.865707] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 615 ms (attempt 4/5)5833worker1 # [ 105.487877] nix-grpc-daemon[1283]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5834worker1 # [ 105.501807] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:511645835client # [ 105.530807] nix[1211]: copying 1 paths to 'lb:50051'...5836client # [ 105.532798] nix[1211]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5837worker1 # [ 105.512420] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:511645838worker1 # [ 105.523356] nix-daemon[848]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5839worker1 # [ 105.541553] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:26Z level=info event=niks3_push_started pid=14105840worker1 # [ 105.905618] nix-daemon[848]: accepted connection from pid 1423, user nix-grpc-daemon (trusted)5841worker1 # [ 105.916096] nix-daemon[848]: reaped child process 1426, status = succeeded5842worker1 # [ 106.091659] nix-daemon[848]: accepted connection from pid 1428, user nix-grpc-daemon (trusted)5843worker1 # [ 106.103417] nix-daemon[848]: reaped child process 1431, status = succeeded5844lb # [ 106.144532] niks3-server[1037]: 2026/09/20 09:06:28 INFO Received uploads request method=POST path=/api/pending_closures5845worker1 # [ 106.128144] nix-grpc-daemon[1410]: time=2026-09-20T09:06:27.493Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5846worker1 # [ 106.129491] nix-grpc-daemon[1410]: time=2026-09-20T09:06:27.493Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5847lb # [ 106.172435] niks3-server[1037]: 2026/09/20 09:06:28 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5848lb # [ 106.180117] niks3-server[1037]: 2026/09/20 09:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5849lb # [ 106.184246] niks3-server[1037]: 2026/09/20 09:06:28 INFO Signed narinfos id=35 count=15850worker1 # [ 106.160911] nix-grpc-daemon[1410]: time=2026-09-20T09:06:27.527Z level=INFO msg="Uploading 1 narinfos"5851lb # [ 106.196903] niks3-server[1037]: 2026/09/20 09:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5852lb # [ 106.205220] niks3-server[1037]: 2026/09/20 09:06:28 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5853lb # [ 106.211434] niks3-server[1037]: 2026/09/20 09:06:28 INFO Completed upload id=355854worker1 # [ 106.185539] nix-grpc-daemon[1410]: time=2026-09-20T09:06:27.551Z level=INFO msg="Upload complete. (445ms)"5855worker1 # [ 106.187822] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51164 duration_s=0 paths=1 nar_bytes_in=4245856worker1 # [ 106.191149] nix-grpc-daemon[1283]: ts=2026-09-20T09:06:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:511645857worker1 # [ 106.192702] nix-grpc-daemon[1410]: time=2026-09-20T09:06:27.556Z level=WARN msg="Failed to register uploaded object" key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo error="server returned 404: object is not pending upload\n"5858worker1 # [ 106.197859] nix-daemon[848]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5859worker1 # [ 106.203182] nix-daemon[848]: reaped child process 1408, status = succeeded5860worker1 # [ 106.209500] nix-daemon[848]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5861client # [ 106.229116] nix[1211]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5862lb # [ 107.150334] envoy[909]: conn peer=[2001:db8:1::1]:41208 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2917 tx=1309 ms=81865863lb # [ 107.154165] envoy[909]: conn peer=[2001:db8:1::4]:38514 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6833 tx=1635 ms=282165864lb: must succeed: curl -sf localhost:9901/clusters5865lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5866lb: must succeed: curl -sf localhost:9901/clusters5867lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5868worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5869worker1 # [ 108.804641] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1283 (nix-grpc-daemon) on client request.5870worker1 # [ 108.808356] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5871worker2 # [ 108.852446] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5872lb # [ 108.841636] niks3-server[1037]: 2026/09/20 09:06:30 INFO lead: released remote=192.168.1.3:356285873client # [ 108.837243] nix[1211]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5874client # [ 108.842151] nix[1211]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5875worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5876client: must succeed: sleep 5.05877worker1 # [ 108.837916] nix-daemon[848]: reaped child process 1433, status = succeeded5878worker1 # [ 108.839122] nix-daemon[848]: reaped child process 1341, status = succeeded5879worker1 # [ 108.842413] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5880worker1 # [ 108.844145] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5881worker1 # [ 108.845867] systemd[1]: nix-grpc-daemon.service: Consumed 410ms CPU time over 16.994s wall clock time, 33.1M memory peak, 12.9K incoming IP traffic, 17.6K outgoing IP traffic.5882worker1 # [ 108.852246] nix-daemon[1435]: unexpected Nix daemon error: error: interrupted by the user5883worker1 # [ 108.855509] nix-daemon[848]: reaped child process 1435, status = failed with exit code 15884worker1 # [ 108.973650] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5885worker1 # [ 108.980609] systemd[1]: Starting Nix worker-protocol over gRPC...5886worker2 # [ 109.052747] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:30Z level=info event=scheduler_connected addr=lb:500515887worker1 # [ 109.165584] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5888worker1 # [ 109.169393] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15889worker1 # [ 109.175077] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5890worker1 # [ 109.178723] systemd[1]: Started Nix worker-protocol over gRPC.5891worker1 # [ 109.187045] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=info event=scheduler_take_over5892lb # [ 109.213126] niks3-server[1037]: 2026/09/20 09:06:31 INFO lead: acquired remote=192.168.1.3:592525893worker2 # [ 109.223992] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5894worker1 # [ 109.205333] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=info event=scheduler_connected addr=lb:500515895worker1 # [ 109.207093] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05896worker1 # [ 109.330251] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05897worker1 # [ 109.335444] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15898worker1 # [ 109.382932] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467765899worker2 # [ 109.424895] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:31Z level=info event=scheduler_connected addr=lb:500515900worker1 # [ 109.388432] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:30Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05901worker1 # [ 109.397438] nix-daemon[848]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5902worker1 # [ 109.412880] nix-daemon[848]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5903client # [ 109.446094] nix[1211]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5904worker1 # [ 109.426591] nix-daemon[848]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5905client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5906client: waiting for success: ! systemctl is-active mid5907worker1 # [ 114.249852] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:35Z level=info event=niks3_push_started pid=15545908worker1 # [ 114.273523] nix-daemon[848]: reaped child process 1530, status = succeeded5909worker1 # [ 114.622995] nix-daemon[848]: accepted connection from pid 1567, user nix-grpc-daemon (trusted)5910worker1 # [ 114.634928] nix-daemon[848]: reaped child process 1570, status = succeeded5911lb # [ 114.679968] niks3-server[1037]: 2026/09/20 09:06:36 INFO Received uploads request method=POST path=/api/pending_closures5912worker1 # [ 114.662785] nix-grpc-daemon[1554]: time=2026-09-20T09:06:36.028Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5913worker1 # [ 114.665053] nix-grpc-daemon[1554]: time=2026-09-20T09:06:36.030Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5914lb # [ 114.723540] niks3-server[1037]: 2026/09/20 09:06:36 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5915lb # [ 114.735480] niks3-server[1037]: 2026/09/20 09:06:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5916worker1 # [ 114.718450] nix-grpc-daemon[1554]: time=2026-09-20T09:06:36.084Z level=INFO msg="Uploading 1 narinfos"5917lb # [ 114.744102] niks3-server[1037]: 2026/09/20 09:06:36 INFO Signed narinfos id=36 count=15918lb # [ 114.762076] niks3-server[1037]: 2026/09/20 09:06:36 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5919lb # [ 114.763758] niks3-server[1037]: 2026/09/20 09:06:36 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5920lb # [ 114.766753] niks3-server[1037]: 2026/09/20 09:06:36 INFO Completed upload id=365921worker1 # [ 114.741085] nix-grpc-daemon[1554]: time=2026-09-20T09:06:36.107Z level=INFO msg="Upload complete. (279ms)"5922lb # [ 114.770393] niks3-server[1037]: 2026/09/20 09:06:36 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5923worker1 # [ 114.745514] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46776 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15924lb # [ 114.775071] niks3-server[1037]: 2026/09/20 09:06:36 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5925worker1 # [ 114.758868] nix-daemon[848]: reaped child process 1528, status = succeeded5926client # [ 114.812538] systemd[1]: mid.service: Deactivated successfully.5927client # [ 114.814060] systemd[1]: mid.service: Consumed 126ms CPU time over 11.987s wall clock time, 37.4M memory peak, 10K incoming IP traffic, 11K outgoing IP traffic.5928client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds)5929client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5930client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5931(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 12.48 seconds)5932subtest: interrupting the client stops the build on the worker5933client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5934client # [ 115.286731] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5935client # Running as unit: intr.service; invocation ID: be7666bcc0de477db680ba86ad72a15f5936client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5937worker2 # [ 115.509677] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417645938worker2 # [ 115.520654] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5939client # [ 115.515855] nix[1247]: don't know how to build these paths:5940client # [ 115.516828] nix[1247]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5941worker1 # [ 115.506587] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:36Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05942worker1 # [ 115.510988] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:36Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=15943worker2 # [ 115.588291] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417645944worker2 # [ 115.600488] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5)5945worker2 # [ 115.703379] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 185 ms (attempt 2/5)5946worker2 # [ 115.893957] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 399 ms (attempt 3/5)5947worker2 # [ 116.293326] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 4/5)5948worker2 # [ 116.419668] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5949worker2 # [ 116.432431] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417645950client # [ 116.422283] nix[1247]: copying 1 paths to 'lb:50051'...5951worker2 # [ 116.443280] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417645952client # [ 116.426138] nix[1247]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5953worker2 # [ 116.449391] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5954worker2 # [ 116.461429] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:38Z level=info event=niks3_push_started pid=14545955worker2 # [ 116.780152] nix-daemon[845]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5956worker2 # [ 116.792413] nix-daemon[845]: reaped child process 1474, status = succeeded5957worker2 # [ 116.955717] nix-daemon[845]: accepted connection from pid 1476, user nix-grpc-daemon (trusted)5958worker2 # [ 116.967803] nix-daemon[845]: reaped child process 1479, status = succeeded5959lb # [ 116.972440] niks3-server[1037]: 2026/09/20 09:06:38 INFO Received uploads request method=POST path=/api/pending_closures5960worker2 # [ 116.994910] nix-grpc-daemon[1454]: time=2026-09-20T09:06:38.669Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5961worker2 # [ 116.996435] nix-grpc-daemon[1454]: time=2026-09-20T09:06:38.671Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5962lb # [ 117.008627] niks3-server[1037]: 2026/09/20 09:06:38 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5963lb # [ 117.016603] niks3-server[1037]: 2026/09/20 09:06:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5964lb # [ 117.021530] niks3-server[1037]: 2026/09/20 09:06:38 INFO Signed narinfos id=37 count=15965worker2 # [ 117.036439] nix-grpc-daemon[1454]: time=2026-09-20T09:06:38.711Z level=INFO msg="Uploading 1 narinfos"5966lb # [ 117.031909] niks3-server[1037]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5967lb # [ 117.041382] niks3-server[1037]: 2026/09/20 09:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5968lb # [ 117.048279] niks3-server[1037]: 2026/09/20 09:06:39 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5969lb # [ 117.053217] niks3-server[1037]: 2026/09/20 09:06:39 INFO Completed upload id=375970worker2 # [ 117.065098] nix-grpc-daemon[1454]: time=2026-09-20T09:06:38.740Z level=INFO msg="Upload complete. (433ms)"5971worker2 # [ 117.069297] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=0 paths=1 nar_bytes_in=4245972worker2 # [ 117.074759] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417645973worker2 # [ 117.084099] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5974worker2 # [ 117.088598] nix-daemon[845]: reaped child process 1452, status = succeeded5975worker2 # [ 117.093425] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5976client # [ 117.076816] nix[1247]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5977lb # [ 117.152106] envoy[909]: conn peer=[2001:db8:1::3]:38010 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=794 tx=311 ms=167855978lb # [ 117.155854] envoy[909]: conn peer=[2001:db8:1::1]:48588 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4033 tx=1805 ms=117725979client: must succeed: systemctl kill -s INT intr5980client # [ 118.833484] systemd[1]: intr.service: Sent signal SIGINT to main process 1247 (nix) on client request.5981client # [ 118.836317] nix[1247]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5982client: (finished: must succeed: systemctl kill -s INT intr, in 0.03 seconds)5983client # [ 118.839511] nix[1247]: error: interrupted by the user5984client # [ 118.865489] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5985client # [ 118.867416] systemd[1]: intr.service: Failed with result 'exit-code'.5986client # [ 118.869094] systemd[1]: intr.service: Consumed 107ms CPU time over 3.580s wall clock time, 39.3M memory peak, 7.8K incoming IP traffic, 8.9K outgoing IP traffic.5987worker2 # [ 118.915759] nix-daemon[845]: reaped child process 1481, status = succeeded5988worker2 # [ 118.920245] nix-daemon[1483]: unexpected Nix daemon error: error: interrupted by the user5989worker2 # [ 118.925844] nix-daemon[845]: reaped child process 1483, status = failed with exit code 15990(finished: subtest: interrupting the client stops the build on the worker, in 3.67 seconds)5991subtest: a deploy mid-build drains: the build finishes, the new generation takes over5992client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5993client # [ 118.958813] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5994client # Running as unit: sw.service; invocation ID: 83034ffad9954a0ca00f560f4327ef8c5995client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds)5996client # [ 119.158544] nix[1268]: don't know how to build these paths:5997client # [ 119.159915] nix[1268]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5998worker2 # [ 119.175392] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417645999worker1 # [ 119.149344] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:40Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06000worker1 # [ 119.153444] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:40Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=16001worker1 # [ 119.191753] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467766002worker1 # [ 119.204614] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5)6003worker1 # [ 119.253418] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 2/5)6004worker1 # [ 119.313070] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 3/5)6005worker1 # [ 119.349896] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 269 ms (attempt 4/5)6006worker1 # [ 119.625142] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6007worker1 # [ 119.640443] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:467766008client # [ 119.669600] nix[1268]: copying 1 paths to 'lb:50051'...6009client # [ 119.673255] nix[1268]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6010worker1 # [ 119.652868] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:467766011worker1 # [ 119.661835] nix-daemon[848]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6012worker1 # [ 119.851547] nix-daemon[848]: accepted connection from pid 1605, user nix-grpc-daemon (trusted)6013worker1 # [ 119.863625] nix-daemon[848]: reaped child process 1608, status = succeeded6014worker1 # [ 120.011827] nix-daemon[848]: accepted connection from pid 1610, user nix-grpc-daemon (trusted)6015worker1 # [ 120.023364] nix-daemon[848]: reaped child process 1613, status = succeeded6016lb # [ 120.064695] niks3-server[1037]: 2026/09/20 09:06:42 INFO Received uploads request method=POST path=/api/pending_closures6017worker1 # [ 120.043286] nix-grpc-daemon[1554]: time=2026-09-20T09:06:41.409Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6018worker1 # [ 120.044794] nix-grpc-daemon[1554]: time=2026-09-20T09:06:41.411Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6019lb # [ 120.080608] niks3-server[1037]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6020lb # [ 120.085097] niks3-server[1037]: 2026/09/20 09:06:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6021lb # [ 120.087117] niks3-server[1037]: 2026/09/20 09:06:42 INFO Signed narinfos id=38 count=16022worker1 # [ 120.061219] nix-grpc-daemon[1554]: time=2026-09-20T09:06:41.427Z level=INFO msg="Uploading 1 narinfos"6023lb # [ 120.090153] niks3-server[1037]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6024lb # [ 120.094651] niks3-server[1037]: 2026/09/20 09:06:42 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6025lb # [ 120.097244] niks3-server[1037]: 2026/09/20 09:06:42 INFO Completed upload id=386026worker1 # [ 120.072587] nix-grpc-daemon[1554]: time=2026-09-20T09:06:41.438Z level=INFO msg="Upload complete. (396ms)"6027lb # [ 120.099904] niks3-server[1037]: 2026/09/20 09:06:42 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6028worker1 # [ 120.074767] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46776 duration_s=0 paths=1 nar_bytes_in=4166029worker1 # [ 120.078225] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:467766030worker1 # [ 120.084585] nix-daemon[848]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6031worker1 # [ 120.090631] nix-daemon[848]: reaped child process 1603, status = succeeded6032client # [ 120.115346] nix[1268]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6033worker1 # [ 120.096214] nix-daemon[848]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6034worker1: must succeed: systemctl reload nix-grpc-daemon.service6035worker1 # [ 121.387824] systemd[1]: Reloading Nix worker-protocol over gRPC...6036worker1 # [ 121.431772] systemd[1]: Reloaded Nix worker-protocol over gRPC.6037worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.09 seconds)6038worker1: must succeed: pgrep -f 'read -t [9]0 x'6039worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6040client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&26041worker2 # [ 121.766465] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417646042client # don't know how to build these paths:6043client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6044worker2 # [ 121.774791] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646045worker1 # [ 121.752602] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:43Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06046worker1 # [ 121.755159] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:43Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=16047worker2 # [ 121.833662] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646048worker2 # [ 121.846478] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646049client # copying 1 paths to 'lb:50051'...6050worker2 # [ 121.854832] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417646051client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6052worker2 # [ 121.873894] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6053worker2 # [ 122.023798] nix-daemon[845]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)6054worker2 # [ 122.037381] nix-daemon[845]: reaped child process 1532, status = succeeded6055worker2 # [ 122.184257] nix-daemon[845]: accepted connection from pid 1534, user nix-grpc-daemon (trusted)6056worker2 # [ 122.196879] nix-daemon[845]: reaped child process 1537, status = succeeded6057lb # [ 122.198779] niks3-server[1037]: 2026/09/20 09:06:44 INFO Received uploads request method=POST path=/api/pending_closures6058worker2 # [ 122.217453] nix-grpc-daemon[1454]: time=2026-09-20T09:06:43.892Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6059worker2 # [ 122.218886] nix-grpc-daemon[1454]: time=2026-09-20T09:06:43.892Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6060worker1 # [ 122.183086] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:43Z level=info event=draining6061lb # [ 122.238376] niks3-server[1037]: 2026/09/20 09:06:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6062worker2 # [ 122.257319] nix-grpc-daemon[1454]: time=2026-09-20T09:06:43.932Z level=INFO msg="Uploading 1 narinfos"6063lb # [ 122.245409] niks3-server[1037]: 2026/09/20 09:06:44 INFO Signed narinfos id=39 count=16064lb # [ 122.250107] niks3-server[1037]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6065lb # [ 122.262129] niks3-server[1037]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6066lb # [ 122.270367] niks3-server[1037]: 2026/09/20 09:06:44 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6067lb # [ 122.276042] niks3-server[1037]: 2026/09/20 09:06:44 INFO Completed upload id=396068worker2 # [ 122.289274] nix-grpc-daemon[1454]: time=2026-09-20T09:06:43.964Z level=INFO msg="Upload complete. (410ms)"6069lb # [ 122.277773] niks3-server[1037]: 2026/09/20 09:06:44 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6070worker2 # [ 122.291469] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=0 paths=1 nar_bytes_in=5286071worker2 # [ 122.293863] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646072worker2 # [ 122.300529] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6073worker2 # [ 122.304034] nix-daemon[845]: reaped child process 1527, status = succeeded6074worker2 # [ 122.309293] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6075client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6076client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6077client # farm-a> LOG-farm-a-during-drain6078worker2 # [ 123.923893] nix-daemon[845]: reaped child process 1541, status = succeeded6079worker2 # [ 124.069052] nix-daemon[845]: accepted connection from pid 1556, user nix-grpc-daemon (trusted)6080worker2 # [ 124.079934] nix-daemon[845]: reaped child process 1559, status = succeeded6081lb # [ 124.083315] niks3-server[1037]: 2026/09/20 09:06:46 INFO Received uploads request method=POST path=/api/pending_closures6082worker2 # [ 124.103940] nix-grpc-daemon[1454]: time=2026-09-20T09:06:45.779Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6083worker2 # [ 124.105432] nix-grpc-daemon[1454]: time=2026-09-20T09:06:45.780Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6084lb # [ 124.122154] niks3-server[1037]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6085lb # [ 124.133791] niks3-server[1037]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6086lb # [ 124.139987] niks3-server[1037]: 2026/09/20 09:06:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6087worker2 # [ 124.157364] nix-grpc-daemon[1454]: time=2026-09-20T09:06:45.832Z level=INFO msg="Uploading 1 narinfos"6088lb # [ 124.145615] niks3-server[1037]: 2026/09/20 09:06:46 INFO Signed narinfos id=40 count=16089lb # [ 124.151345] niks3-server[1037]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6090lb # [ 124.159944] niks3-server[1037]: 2026/09/20 09:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6091lb # [ 124.164628] niks3-server[1037]: 2026/09/20 09:06:46 INFO Completed upload id=406092worker2 # [ 124.178496] nix-grpc-daemon[1454]: time=2026-09-20T09:06:45.853Z level=INFO msg="Upload complete. (262ms)"6093lb # [ 124.168112] niks3-server[1037]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6094worker1 # [ 124.150775] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:45Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06095worker2 # [ 124.185174] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16096worker1 # [ 124.153269] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:45Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=16097worker2 # [ 124.198309] nix-daemon[845]: reaped child process 1539, status = succeeded6098worker2 # [ 124.234454] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646099worker2 # [ 124.247993] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646100worker2 # [ 124.261085] nix-grpc-daemon[1454]: time=2026-09-20T09:06:45.936Z level=INFO msg="All 1 paths already cached"6101client # copying 1 paths to 'lb:50051'...6102worker2 # [ 124.269284] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417646103client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6104worker2 # [ 124.289221] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6105worker2 # [ 124.463840] nix-daemon[845]: accepted connection from pid 1563, user nix-grpc-daemon (trusted)6106worker2 # [ 124.476509] nix-daemon[845]: reaped child process 1566, status = succeeded6107worker2 # [ 124.627061] nix-daemon[845]: accepted connection from pid 1568, user nix-grpc-daemon (trusted)6108worker2 # [ 124.639154] nix-daemon[845]: reaped child process 1571, status = succeeded6109lb # [ 124.641083] niks3-server[1037]: 2026/09/20 09:06:46 INFO Received uploads request method=POST path=/api/pending_closures6110worker2 # [ 124.660651] nix-grpc-daemon[1454]: time=2026-09-20T09:06:46.335Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6111worker2 # [ 124.662155] nix-grpc-daemon[1454]: time=2026-09-20T09:06:46.337Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6112lb # [ 124.672682] niks3-server[1037]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6113lb # [ 124.682188] niks3-server[1037]: 2026/09/20 09:06:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6114lb # [ 124.687285] niks3-server[1037]: 2026/09/20 09:06:46 INFO Signed narinfos id=41 count=16115worker2 # [ 124.701628] nix-grpc-daemon[1454]: time=2026-09-20T09:06:46.376Z level=INFO msg="Uploading 1 narinfos"6116lb # [ 124.693949] niks3-server[1037]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6117lb # [ 124.704716] niks3-server[1037]: 2026/09/20 09:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6118lb # [ 124.709941] niks3-server[1037]: 2026/09/20 09:06:46 INFO Completed upload id=416119worker2 # [ 124.724064] nix-grpc-daemon[1454]: time=2026-09-20T09:06:46.399Z level=INFO msg="Upload complete. (422ms)"6120worker2 # [ 124.725478] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=0 paths=1 nar_bytes_in=6406121lb # [ 124.714476] niks3-server[1037]: 2026/09/20 09:06:46 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6122worker2 # [ 124.732445] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646123worker2 # [ 124.736456] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6124worker2 # [ 124.738676] nix-daemon[845]: reaped child process 1561, status = succeeded6125worker2 # [ 124.744046] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6126client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6127client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6128client # farm-b> LOG-farm-b-during-drain6129worker2 # [ 125.958075] nix-daemon[845]: reaped child process 1575, status = succeeded6130worker2 # [ 126.100332] nix-daemon[845]: accepted connection from pid 1590, user nix-grpc-daemon (trusted)6131worker2 # [ 126.111453] nix-daemon[845]: reaped child process 1593, status = succeeded6132lb # [ 126.114600] niks3-server[1037]: 2026/09/20 09:06:48 INFO Received uploads request method=POST path=/api/pending_closures6133worker2 # [ 126.134575] nix-grpc-daemon[1454]: time=2026-09-20T09:06:47.809Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6134worker2 # [ 126.136136] nix-grpc-daemon[1454]: time=2026-09-20T09:06:47.811Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6135lb # [ 126.142061] niks3-server[1037]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6136lb # [ 126.160612] niks3-server[1037]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6137lb # [ 126.167648] niks3-server[1037]: 2026/09/20 09:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6138worker2 # [ 126.184157] nix-grpc-daemon[1454]: time=2026-09-20T09:06:47.859Z level=INFO msg="Uploading 1 narinfos"6139lb # [ 126.172685] niks3-server[1037]: 2026/09/20 09:06:48 INFO Signed narinfos id=42 count=16140lb # [ 126.178700] niks3-server[1037]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6141lb # [ 126.187100] niks3-server[1037]: 2026/09/20 09:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6142lb # [ 126.192853] niks3-server[1037]: 2026/09/20 09:06:48 INFO Completed upload id=426143worker2 # [ 126.204723] nix-grpc-daemon[1454]: time=2026-09-20T09:06:47.879Z level=INFO msg="Upload complete. (252ms)"6144lb # [ 126.196168] niks3-server[1037]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6145worker2 # [ 126.210827] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16146worker1 # [ 126.177566] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:47Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06147worker1 # [ 126.180301] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:47Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16148worker2 # [ 126.225370] nix-daemon[845]: reaped child process 1573, status = succeeded6149worker2 # [ 126.261570] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646150worker2 # [ 126.273996] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646151worker2 # [ 126.286155] nix-grpc-daemon[1454]: time=2026-09-20T09:06:47.961Z level=INFO msg="All 2 paths already cached"6152client # copying 1 paths to 'lb:50051'...6153worker2 # [ 126.294166] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417646154client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6155worker2 # [ 126.314352] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6156worker2 # [ 126.471635] nix-daemon[845]: accepted connection from pid 1597, user nix-grpc-daemon (trusted)6157worker2 # [ 126.484306] nix-daemon[845]: reaped child process 1600, status = succeeded6158worker2 # [ 126.633324] nix-daemon[845]: accepted connection from pid 1602, user nix-grpc-daemon (trusted)6159worker2 # [ 126.646301] nix-daemon[845]: reaped child process 1605, status = succeeded6160lb # [ 126.645204] niks3-server[1037]: 2026/09/20 09:06:48 INFO Received uploads request method=POST path=/api/pending_closures6161worker2 # [ 126.664371] nix-grpc-daemon[1454]: time=2026-09-20T09:06:48.339Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6162worker2 # [ 126.666410] nix-grpc-daemon[1454]: time=2026-09-20T09:06:48.341Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6163lb # [ 126.672448] niks3-server[1037]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6164lb # [ 126.683122] niks3-server[1037]: 2026/09/20 09:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6165lb # [ 126.687783] niks3-server[1037]: 2026/09/20 09:06:48 INFO Signed narinfos id=43 count=16166worker2 # [ 126.703635] nix-grpc-daemon[1454]: time=2026-09-20T09:06:48.378Z level=INFO msg="Uploading 1 narinfos"6167lb # [ 126.695379] niks3-server[1037]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6168lb # [ 126.707186] niks3-server[1037]: 2026/09/20 09:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6169worker2 # [ 126.724541] nix-grpc-daemon[1454]: time=2026-09-20T09:06:48.399Z level=INFO msg="Upload complete. (396ms)"6170lb # [ 126.712781] niks3-server[1037]: 2026/09/20 09:06:48 INFO Completed upload id=436171worker2 # [ 126.727675] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=0 paths=1 nar_bytes_in=7686172lb # [ 126.715977] niks3-server[1037]: 2026/09/20 09:06:48 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6173worker2 # [ 126.731469] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646174worker2 # [ 126.738469] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6175worker2 # [ 126.741098] nix-daemon[845]: reaped child process 1595, status = succeeded6176worker2 # [ 126.747269] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6177client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6178client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6179lb # [ 127.152440] envoy[909]: conn peer=[2001:db8:1::1]:42940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=732 ms=33666180client # farm-top> LOG-farm-top-during-drain6181worker2 # [ 127.962542] nix-daemon[845]: reaped child process 1609, status = succeeded6182worker2 # [ 128.118564] nix-daemon[845]: accepted connection from pid 1624, user nix-grpc-daemon (trusted)6183worker2 # [ 128.129863] nix-daemon[845]: reaped child process 1627, status = succeeded6184lb # [ 128.135719] niks3-server[1037]: 2026/09/20 09:06:50 INFO Received uploads request method=POST path=/api/pending_closures6185worker2 # [ 128.155723] nix-grpc-daemon[1454]: time=2026-09-20T09:06:49.830Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6186worker2 # [ 128.157534] nix-grpc-daemon[1454]: time=2026-09-20T09:06:49.832Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6187lb # [ 128.175266] niks3-server[1037]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6188lb # [ 128.181065] niks3-server[1037]: 2026/09/20 09:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6189worker2 # [ 128.200894] nix-grpc-daemon[1454]: time=2026-09-20T09:06:49.876Z level=INFO msg="Uploading 1 narinfos"6190lb # [ 128.189140] niks3-server[1037]: 2026/09/20 09:06:50 INFO Signed narinfos id=44 count=16191lb # [ 128.192729] niks3-server[1037]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6192lb # [ 128.196752] niks3-server[1037]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6193lb # [ 128.206051] niks3-server[1037]: 2026/09/20 09:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6194lb # [ 128.208573] niks3-server[1037]: 2026/09/20 09:06:50 INFO Completed upload id=446195worker2 # [ 128.221700] nix-grpc-daemon[1454]: time=2026-09-20T09:06:49.896Z level=INFO msg="Upload complete. (266ms)"6196lb # [ 128.211441] niks3-server[1037]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6197worker2 # [ 128.226951] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16198worker2 # [ 128.240158] nix-daemon[845]: reaped child process 1607, status = succeeded6199client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.73 seconds)6200client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6201client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.18 seconds)6202worker1: must succeed: pkill -f 'read -t [9]0 x'6203worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6204client: waiting for success: ! systemctl is-active sw6205worker1 # [ 128.518672] nix-daemon[848]: reaped child process 1621, status = succeeded6206worker1 # [ 128.672394] nix-daemon[848]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)6207worker1 # [ 128.684199] nix-daemon[848]: reaped child process 1666, status = succeeded6208lb # [ 128.724300] niks3-server[1037]: 2026/09/20 09:06:50 INFO Received uploads request method=POST path=/api/pending_closures6209worker1 # [ 128.706801] nix-grpc-daemon[1554]: time=2026-09-20T09:06:50.073Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6210worker1 # [ 128.708568] nix-grpc-daemon[1554]: time=2026-09-20T09:06:50.074Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6211lb # [ 128.757582] niks3-server[1037]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6212lb # [ 128.768123] niks3-server[1037]: 2026/09/20 09:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6213lb # [ 128.772170] niks3-server[1037]: 2026/09/20 09:06:50 INFO Signed narinfos id=45 count=16214worker1 # [ 128.749108] nix-grpc-daemon[1554]: time=2026-09-20T09:06:50.115Z level=INFO msg="Uploading 1 narinfos"6215lb # [ 128.778927] niks3-server[1037]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6216lb # [ 128.783345] niks3-server[1037]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6217lb # [ 128.791029] niks3-server[1037]: 2026/09/20 09:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6218lb # [ 128.793851] niks3-server[1037]: 2026/09/20 09:06:50 INFO Completed upload id=456219worker1 # [ 128.768121] nix-grpc-daemon[1554]: time=2026-09-20T09:06:50.134Z level=INFO msg="Upload complete. (257ms)"6220lb # [ 128.796533] niks3-server[1037]: 2026/09/20 09:06:50 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6221worker1 # [ 128.775206] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46776 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16222worker1 # [ 128.785139] nix-daemon[848]: reaped child process 1619, status = succeeded6223client # [ 128.816806] systemd[1]: sw.service: Deactivated successfully.6224client # [ 128.818295] systemd[1]: sw.service: Consumed 109ms CPU time over 9.857s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.6225worker1 # [ 129.186342] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=signal_exit6226worker1 # [ 129.407983] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=scheduler_yield6227worker2 # [ 129.448965] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:51Z level=info event=scheduler_restarting addr=lb:500516228worker1 # [ 129.413445] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:467666229lb # [ 129.438639] niks3-server[1037]: 2026/09/20 09:06:51 INFO lead: released remote=192.168.1.3:592526230worker1 # [ 129.417442] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=worker_gone addr=192.168.1.4:500516231worker1 # [ 129.421425] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=scheduler_restarting addr=lb:500516232worker1 # [ 129.424457] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:467666233worker1 # [ 129.427734] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=worker_gone addr=192.168.1.3:500516234client: (finished: waiting for success: ! systemctl is-active sw, in 1.08 seconds)6235client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6236client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6237worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6238worker2 # [ 129.649703] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:51Z level=info event=scheduler_connected addr=lb:500516239worker2 # [ 129.653873] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6240worker1 # [ 129.617969] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=scheduler_connected addr=lb:500516241worker1 # [ 129.626849] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6242worker2 # [ 129.854788] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:51Z level=info event=scheduler_connected addr=lb:500516243worker2 # [ 129.866702] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6244worker1 # [ 129.830570] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:51Z level=info event=scheduler_connected addr=lb:500516245worker1 # [ 129.833757] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6246worker2 # [ 130.067695] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:51Z level=info event=scheduler_connected addr=lb:500516247worker1 # [ 130.031306] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:51Z level=info event=scheduler_connected addr=lb:500516248worker2 # [ 130.073637] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6249worker1 # [ 130.036190] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6250worker2 # [ 130.274563] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:51Z level=info event=scheduler_connected addr=lb:500516251worker1 # [ 130.241422] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:51Z level=info event=scheduler_connected addr=lb:500516252worker2 # [ 130.280325] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6253worker1 # [ 130.246455] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6254worker1 # [ 130.409741] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:51Z level=info event=scheduler_restarting6255worker1 # [ 130.430812] nix-daemon[848]: reaped child process 1526, status = succeeded6256worker2 # [ 130.482871] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:52Z level=info event=scheduler_connected addr=lb:500516257worker2 # [ 130.487512] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6258worker1 # [ 130.457789] nix-grpc-daemon[1475]: ts=2026-09-20T09:06:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6259worker1 # [ 130.614824] nix-grpc-daemon[1475]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6260worker1 # [ 130.618227] nix-grpc-daemon[1475]: E0000 00:00:1789895211.981039 1518 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6261worker1 # [ 130.622925] nix-grpc-daemon[1475]: E0000 00:00:1789895211.981195 1518 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6262worker2 # [ 130.687903] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:52Z level=info event=scheduler_connected addr=lb:500516263worker1 # [ 130.651875] nix-grpc-daemon[1475]: E0000 00:00:1789895212.018239 1518 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true6264worker2 # [ 131.237366] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"6265worker1 # [ 131.215962] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6266worker1 # [ 131.219926] systemd[1]: nix-grpc-daemon.service: Consumed 658ms CPU time over 22.373s wall clock time, 33.6M memory peak, 24K incoming IP traffic, 32.9K outgoing IP traffic.6267worker1 # [ 131.235464] systemd[1]: Starting Nix worker-protocol over gRPC...6268worker1 # [ 131.401648] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6269worker2 # [ 131.438387] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:53Z level=info event=scheduler_connected addr=lb:500516270worker1 # [ 131.405468] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16271worker2 # [ 131.443793] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6272worker1 # [ 131.411061] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6273worker1 # [ 131.414547] systemd[1]: Started Nix worker-protocol over gRPC.6274worker1 # [ 131.422067] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:52Z level=info event=scheduler_take_over6275lb # [ 131.447468] niks3-server[1037]: 2026/09/20 09:06:53 INFO lead: acquired remote=192.168.1.3:588906276worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.86 seconds)6277lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6278lb: must succeed: curl -sf localhost:9901/clusters6279worker1 # [ 131.443244] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:52Z level=info event=scheduler_connected addr=lb:500516280worker1 # [ 131.451876] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06281lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6282worker2 # [ 131.645414] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:53Z level=info event=scheduler_connected addr=lb:500516283worker2 # [ 131.650378] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6284worker2 # [ 131.851305] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:53Z level=info event=scheduler_connected addr=lb:500516285worker1 # [ 131.815053] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06286lb: must succeed: curl -sf localhost:9901/clusters6287lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6288lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.14 seconds)6289lb: must succeed: curl -sf localhost:9901/clusters6290lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6291worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6292worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)6293(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.78 seconds)6294subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6295client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16296worker1 # [ 132.916427] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:363486297worker1 # [ 132.922155] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6298worker2 # [ 132.969338] nix-grpc-daemon[1366]: ts=2026-09-20T09:06:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646299worker1 # [ 132.966877] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:54Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06300worker1 # [ 132.968865] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:54Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16301worker1 # [ 132.971097] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:54Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06302worker1 # [ 132.972825] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:54Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06303worker1 # [ 133.013628] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486304worker1 # [ 133.019808] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 1/5)6305worker1 # [ 133.059464] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 2/5)6306worker1 # [ 133.119635] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 396 ms (attempt 3/5)6307worker1 # [ 133.518331] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 124 ms (attempt 4/5)6308worker1 # [ 133.642852] nix-grpc-daemon[1680]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6309worker1 # [ 133.655165] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363486310worker1 # [ 133.662230] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363486311worker1 # [ 133.667089] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6312worker1 # [ 133.678157] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:55Z level=info event=niks3_push_started pid=17436313worker1 # [ 134.003216] nix-daemon[848]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6314worker1 # [ 134.013570] nix-daemon[848]: reaped child process 1759, status = succeeded6315worker1 # [ 134.180054] nix-daemon[848]: accepted connection from pid 1761, user nix-grpc-daemon (trusted)6316worker1 # [ 134.191619] nix-daemon[848]: reaped child process 1764, status = succeeded6317lb # [ 134.237837] niks3-server[1037]: 2026/09/20 09:06:56 INFO Received uploads request method=POST path=/api/pending_closures6318worker1 # [ 134.223356] nix-grpc-daemon[1743]: time=2026-09-20T09:06:55.589Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6319worker1 # [ 134.226547] nix-grpc-daemon[1743]: time=2026-09-20T09:06:55.591Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6320lb # [ 134.274550] niks3-server[1037]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6321lb # [ 134.281824] niks3-server[1037]: 2026/09/20 09:06:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6322worker1 # [ 134.260554] nix-grpc-daemon[1743]: time=2026-09-20T09:06:55.626Z level=INFO msg="Uploading 1 narinfos"6323lb # [ 134.286217] niks3-server[1037]: 2026/09/20 09:06:56 INFO Signed narinfos id=46 count=16324lb # [ 134.299934] niks3-server[1037]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6325lb # [ 134.306457] niks3-server[1037]: 2026/09/20 09:06:56 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6326worker1 # [ 134.285204] nix-grpc-daemon[1743]: time=2026-09-20T09:06:55.651Z level=INFO msg="Upload complete. (433ms)"6327lb # [ 134.311374] niks3-server[1037]: 2026/09/20 09:06:56 INFO Completed upload id=466328worker1 # [ 134.287524] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 paths=1 nar_bytes_in=5046329lb # [ 134.314563] niks3-server[1037]: 2026/09/20 09:06:56 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6330worker1 # [ 134.293756] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486331worker1 # [ 134.301721] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6332worker1 # [ 134.305570] nix-daemon[848]: reaped child process 1741, status = succeeded6333worker1 # [ 134.310590] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6334worker1 # [ 134.922397] nix-daemon[848]: reaped child process 1768, status = succeeded6335worker1 # [ 135.063582] nix-daemon[848]: accepted connection from pid 1783, user nix-grpc-daemon (trusted)6336worker1 # [ 135.076222] nix-daemon[848]: reaped child process 1786, status = succeeded6337lb # [ 135.120645] niks3-server[1037]: 2026/09/20 09:06:57 INFO Received uploads request method=POST path=/api/pending_closures6338worker1 # [ 135.102813] nix-grpc-daemon[1743]: time=2026-09-20T09:06:56.469Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6339worker1 # [ 135.104311] nix-grpc-daemon[1743]: time=2026-09-20T09:06:56.470Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6340lb # [ 135.159101] niks3-server[1037]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6341lb # [ 135.164103] niks3-server[1037]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6342lb # [ 135.178474] niks3-server[1037]: 2026/09/20 09:06:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6343lb # [ 135.184123] niks3-server[1037]: 2026/09/20 09:06:57 INFO Signed narinfos id=47 count=16344worker1 # [ 135.158955] nix-grpc-daemon[1743]: time=2026-09-20T09:06:56.524Z level=INFO msg="Uploading 1 narinfos"6345lb # [ 135.188628] niks3-server[1037]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6346lb # [ 135.197819] niks3-server[1037]: 2026/09/20 09:06:57 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6347lb # [ 135.203247] niks3-server[1037]: 2026/09/20 09:06:57 INFO Completed upload id=476348worker1 # [ 135.177097] nix-grpc-daemon[1743]: time=2026-09-20T09:06:56.543Z level=INFO msg="Upload complete. (260ms)"6349lb # [ 135.207782] niks3-server[1037]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6350worker1 # [ 135.184427] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16351worker1 # [ 135.190941] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:56Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16352worker1 # [ 135.197327] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:56Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06353worker1 # [ 135.204447] nix-daemon[848]: reaped child process 1766, status = succeeded6354worker1 # [ 135.227710] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486355worker1 # [ 135.238260] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363486356worker1 # [ 135.248188] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363486357worker1 # [ 135.254831] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6358worker1 # [ 135.435106] nix-daemon[848]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)6359worker1 # [ 135.446826] nix-daemon[848]: reaped child process 1795, status = succeeded6360worker1 # [ 135.629102] nix-daemon[848]: accepted connection from pid 1797, user nix-grpc-daemon (trusted)6361worker1 # [ 135.641255] nix-daemon[848]: reaped child process 1800, status = succeeded6362lb # [ 135.683826] niks3-server[1037]: 2026/09/20 09:06:57 INFO Received uploads request method=POST path=/api/pending_closures6363worker1 # [ 135.665436] nix-grpc-daemon[1743]: time=2026-09-20T09:06:57.031Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6364worker1 # [ 135.667397] nix-grpc-daemon[1743]: time=2026-09-20T09:06:57.033Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6365lb # [ 135.711394] niks3-server[1037]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6366lb # [ 135.721342] niks3-server[1037]: 2026/09/20 09:06:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6367worker1 # [ 135.699918] nix-grpc-daemon[1743]: time=2026-09-20T09:06:57.066Z level=INFO msg="Uploading 1 narinfos"6368lb # [ 135.725621] niks3-server[1037]: 2026/09/20 09:06:57 INFO Signed narinfos id=48 count=16369lb # [ 135.732077] niks3-server[1037]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6370lb # [ 135.742227] niks3-server[1037]: 2026/09/20 09:06:57 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6371lb # [ 135.748816] niks3-server[1037]: 2026/09/20 09:06:57 INFO Completed upload id=486372worker1 # [ 135.722938] nix-grpc-daemon[1743]: time=2026-09-20T09:06:57.089Z level=INFO msg="Upload complete. (457ms)"6373lb # [ 135.751185] niks3-server[1037]: 2026/09/20 09:06:57 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6374worker1 # [ 135.726921] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 paths=1 nar_bytes_in=5046375worker1 # [ 135.732479] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486376worker1 # [ 135.741846] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6377worker1 # [ 135.746142] nix-daemon[848]: reaped child process 1790, status = succeeded6378worker1 # [ 135.750612] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6379worker1 # [ 136.574947] nix-daemon[848]: reaped child process 1804, status = succeeded6380worker1 # [ 136.745217] nix-daemon[848]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)6381worker1 # [ 136.756843] nix-daemon[848]: reaped child process 1822, status = succeeded6382lb # [ 136.800945] niks3-server[1037]: 2026/09/20 09:06:58 INFO Received uploads request method=POST path=/api/pending_closures6383worker1 # [ 136.784921] nix-grpc-daemon[1743]: time=2026-09-20T09:06:58.151Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6384worker1 # [ 136.787210] nix-grpc-daemon[1743]: time=2026-09-20T09:06:58.152Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6385lb # [ 136.833094] niks3-server[1037]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6386lb # [ 136.847162] niks3-server[1037]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6387lb # [ 136.855692] niks3-server[1037]: 2026/09/20 09:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6388worker1 # [ 136.834214] nix-grpc-daemon[1743]: time=2026-09-20T09:06:58.200Z level=INFO msg="Uploading 1 narinfos"6389lb # [ 136.860119] niks3-server[1037]: 2026/09/20 09:06:58 INFO Signed narinfos id=49 count=16390lb # [ 136.866981] niks3-server[1037]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6391lb # [ 136.874104] niks3-server[1037]: 2026/09/20 09:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6392lb # [ 136.880102] niks3-server[1037]: 2026/09/20 09:06:58 INFO Completed upload id=496393worker1 # [ 136.854344] nix-grpc-daemon[1743]: time=2026-09-20T09:06:58.220Z level=INFO msg="Upload complete. (296ms)"6394lb # [ 136.884182] niks3-server[1037]: 2026/09/20 09:06:58 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6395worker1 # [ 136.865364] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16396worker1 # [ 136.872115] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:58Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16397worker1 # [ 136.876418] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486398worker1 # [ 136.879744] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:58Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06399worker1 # [ 136.889777] nix-daemon[848]: reaped child process 1802, status = succeeded6400worker1 # [ 136.892190] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363486401worker1 # [ 136.899589] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363486402worker1 # [ 136.904552] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6403worker1 # [ 137.060943] nix-daemon[848]: accepted connection from pid 1828, user nix-grpc-daemon (trusted)6404worker1 # [ 137.073052] nix-daemon[848]: reaped child process 1831, status = succeeded6405lb # [ 137.153459] envoy[909]: conn peer=[2001:db8:1::1]:42956 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9555 tx=3838 ms=64766406lb # [ 137.157204] envoy[909]: conn peer=[2001:db8:1::1]:42946 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1350 ms=96496407lb # [ 137.160737] envoy[909]: conn peer=[2001:db8:1::3]:45062 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1746 tx=552 ms=212476408worker1 # [ 137.237431] nix-daemon[848]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)6409worker1 # [ 137.250599] nix-daemon[848]: reaped child process 1836, status = succeeded6410lb # [ 137.288970] niks3-server[1037]: 2026/09/20 09:06:59 INFO Received uploads request method=POST path=/api/pending_closures6411worker1 # [ 137.270603] nix-grpc-daemon[1743]: time=2026-09-20T09:06:58.637Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6412worker1 # [ 137.272141] nix-grpc-daemon[1743]: time=2026-09-20T09:06:58.638Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6413lb # [ 137.316444] niks3-server[1037]: 2026/09/20 09:06:59 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6414lb # [ 137.328508] niks3-server[1037]: 2026/09/20 09:06:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6415lb # [ 137.332594] niks3-server[1037]: 2026/09/20 09:06:59 INFO Signed narinfos id=50 count=16416worker1 # [ 137.309431] nix-grpc-daemon[1743]: time=2026-09-20T09:06:58.675Z level=INFO msg="Uploading 1 narinfos"6417lb # [ 137.338403] niks3-server[1037]: 2026/09/20 09:06:59 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6418lb # [ 137.348873] niks3-server[1037]: 2026/09/20 09:06:59 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6419worker1 # [ 137.328599] nix-grpc-daemon[1743]: time=2026-09-20T09:06:58.695Z level=INFO msg="Upload complete. (419ms)"6420lb # [ 137.354536] niks3-server[1037]: 2026/09/20 09:06:59 INFO Completed upload id=506421worker1 # [ 137.331383] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 paths=1 nar_bytes_in=5046422lb # [ 137.359124] niks3-server[1037]: 2026/09/20 09:06:59 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6423worker1 # [ 137.337298] nix-grpc-daemon[1680]: ts=2026-09-20T09:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486424worker1 # [ 137.345591] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6425worker1 # [ 137.349490] nix-daemon[848]: reaped child process 1826, status = succeeded6426worker1 # [ 137.354524] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6427worker1 # [ 138.780594] nix-daemon[848]: reaped child process 1840, status = succeeded6428worker1 # [ 138.953519] nix-daemon[848]: accepted connection from pid 1855, user nix-grpc-daemon (trusted)6429worker1 # [ 138.964155] nix-daemon[848]: reaped child process 1858, status = succeeded6430lb # [ 139.009907] niks3-server[1037]: 2026/09/20 09:07:00 INFO Received uploads request method=POST path=/api/pending_closures6431worker1 # [ 138.993646] nix-grpc-daemon[1743]: time=2026-09-20T09:07:00.359Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6432worker1 # [ 138.995137] nix-grpc-daemon[1743]: time=2026-09-20T09:07:00.361Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6433lb # [ 139.046682] niks3-server[1037]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6434lb # [ 139.054610] niks3-server[1037]: 2026/09/20 09:07:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6435lb # [ 139.058477] niks3-server[1037]: 2026/09/20 09:07:01 INFO Signed narinfos id=51 count=16436worker1 # [ 139.034946] nix-grpc-daemon[1743]: time=2026-09-20T09:07:00.401Z level=INFO msg="Uploading 1 narinfos"6437lb # [ 139.066124] niks3-server[1037]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6438lb # [ 139.073345] niks3-server[1037]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6439lb # [ 139.077225] niks3-server[1037]: 2026/09/20 09:07:01 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6440lb # [ 139.080597] niks3-server[1037]: 2026/09/20 09:07:01 INFO Completed upload id=516441worker1 # [ 139.054850] nix-grpc-daemon[1743]: time=2026-09-20T09:07:00.421Z level=INFO msg="Upload complete. (291ms)"6442lb # [ 139.082532] niks3-server[1037]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6443worker1 # [ 139.064222] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16444worker1 # [ 139.069804] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:00Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16445worker1 # [ 139.073149] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486446worker1 # [ 139.074790] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:00Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06447worker1 # [ 139.081366] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363486448worker1 # [ 139.083185] nix-daemon[848]: reaped child process 1838, status = succeeded6449worker1 # [ 139.088554] nix-grpc-daemon[1743]: time=2026-09-20T09:07:00.454Z level=INFO msg="All 1 paths already cached"6450worker1 # [ 139.092115] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363486451worker1 # [ 139.097137] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6452worker1 # [ 139.262160] nix-daemon[848]: accepted connection from pid 1864, user nix-grpc-daemon (trusted)6453worker1 # [ 139.274863] nix-daemon[848]: reaped child process 1867, status = succeeded6454worker1 # [ 139.451414] nix-daemon[848]: accepted connection from pid 1869, user nix-grpc-daemon (trusted)6455worker1 # [ 139.463439] nix-daemon[848]: reaped child process 1872, status = succeeded6456lb # [ 139.504849] niks3-server[1037]: 2026/09/20 09:07:01 INFO Received uploads request method=POST path=/api/pending_closures6457worker1 # [ 139.486902] nix-grpc-daemon[1743]: time=2026-09-20T09:07:00.853Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6458worker1 # [ 139.488290] nix-grpc-daemon[1743]: time=2026-09-20T09:07:00.853Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6459lb # [ 139.533670] niks3-server[1037]: 2026/09/20 09:07:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6460lb # [ 139.538605] niks3-server[1037]: 2026/09/20 09:07:01 INFO Signed narinfos id=52 count=16461worker1 # [ 139.515114] nix-grpc-daemon[1743]: time=2026-09-20T09:07:00.881Z level=INFO msg="Uploading 1 narinfos"6462lb # [ 139.544347] niks3-server[1037]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6463lb # [ 139.559040] niks3-server[1037]: 2026/09/20 09:07:01 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6464lb # [ 139.563144] niks3-server[1037]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6465lb # [ 139.566236] niks3-server[1037]: 2026/09/20 09:07:01 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6466lb # [ 139.571877] niks3-server[1037]: 2026/09/20 09:07:01 INFO Completed upload id=526467worker1 # [ 139.545939] nix-grpc-daemon[1743]: time=2026-09-20T09:07:00.912Z level=INFO msg="Upload complete. (444ms)"6468worker1 # [ 139.549116] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 paths=1 nar_bytes_in=6246469worker1 # [ 139.554280] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486470worker1 # [ 139.562498] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6471worker1 # [ 139.569249] nix-daemon[848]: reaped child process 1862, status = succeeded6472worker1 # [ 139.574490] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6473worker1 # [ 140.788196] nix-daemon[848]: reaped child process 1876, status = succeeded6474worker1 # [ 140.952155] nix-daemon[848]: accepted connection from pid 1891, user nix-grpc-daemon (trusted)6475worker1 # [ 140.964149] nix-daemon[848]: reaped child process 1894, status = succeeded6476lb # [ 141.006239] niks3-server[1037]: 2026/09/20 09:07:02 INFO Received uploads request method=POST path=/api/pending_closures6477worker1 # [ 140.997395] nix-grpc-daemon[1743]: time=2026-09-20T09:07:02.363Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6478worker1 # [ 140.998947] nix-grpc-daemon[1743]: time=2026-09-20T09:07:02.365Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6479lb # [ 141.058403] niks3-server[1037]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6480lb # [ 141.065098] niks3-server[1037]: 2026/09/20 09:07:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6481lb # [ 141.067913] niks3-server[1037]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6482lb # [ 141.072868] niks3-server[1037]: 2026/09/20 09:07:03 INFO Signed narinfos id=53 count=16483worker1 # [ 141.049641] nix-grpc-daemon[1743]: time=2026-09-20T09:07:02.415Z level=INFO msg="Uploading 1 narinfos"6484lb # [ 141.076701] niks3-server[1037]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6485lb # [ 141.084687] niks3-server[1037]: 2026/09/20 09:07:03 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6486lb # [ 141.088405] niks3-server[1037]: 2026/09/20 09:07:03 INFO Completed upload id=536487worker1 # [ 141.062538] nix-grpc-daemon[1743]: time=2026-09-20T09:07:02.428Z level=INFO msg="Upload complete. (280ms)"6488lb # [ 141.090204] niks3-server[1037]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6489worker1 # [ 141.073988] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16490worker1 # [ 141.079494] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:02Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16491worker1 # [ 141.083245] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486492worker1 # [ 141.086596] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:02Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06493worker1 # [ 141.095222] nix-daemon[848]: reaped child process 1874, status = succeeded6494worker1 # [ 141.097076] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363486495worker1 # [ 141.103734] nix-grpc-daemon[1743]: time=2026-09-20T09:07:02.470Z level=INFO msg="All 1 paths already cached"6496worker1 # [ 141.108080] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363486497worker1 # [ 141.111987] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6498worker1 # [ 141.279137] nix-daemon[848]: accepted connection from pid 1900, user nix-grpc-daemon (trusted)6499worker1 # [ 141.291406] nix-daemon[848]: reaped child process 1903, status = succeeded6500worker1 # [ 141.461816] nix-daemon[848]: accepted connection from pid 1905, user nix-grpc-daemon (trusted)6501worker1 # [ 141.473660] nix-daemon[848]: reaped child process 1908, status = succeeded6502lb # [ 141.514300] niks3-server[1037]: 2026/09/20 09:07:03 INFO Received uploads request method=POST path=/api/pending_closures6503worker1 # [ 141.493217] nix-grpc-daemon[1743]: time=2026-09-20T09:07:02.859Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6504worker1 # [ 141.494862] nix-grpc-daemon[1743]: time=2026-09-20T09:07:02.859Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6505lb # [ 141.529377] niks3-server[1037]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6506lb # [ 141.531589] niks3-server[1037]: 2026/09/20 09:07:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6507lb # [ 141.534054] niks3-server[1037]: 2026/09/20 09:07:03 INFO Signed narinfos id=54 count=16508worker1 # [ 141.508403] nix-grpc-daemon[1743]: time=2026-09-20T09:07:02.874Z level=INFO msg="Uploading 1 narinfos"6509lb # [ 141.537364] niks3-server[1037]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6510lb # [ 141.543588] niks3-server[1037]: 2026/09/20 09:07:03 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6511lb # [ 141.546338] niks3-server[1037]: 2026/09/20 09:07:03 INFO Completed upload id=546512worker1 # [ 141.520499] nix-grpc-daemon[1743]: time=2026-09-20T09:07:02.886Z level=INFO msg="Upload complete. (402ms)"6513lb # [ 141.548209] niks3-server[1037]: 2026/09/20 09:07:03 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6514worker1 # [ 141.522809] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 paths=1 nar_bytes_in=6246515worker1 # [ 141.527470] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486516worker1 # [ 141.533308] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6517worker1 # [ 141.535619] nix-daemon[848]: reaped child process 1898, status = succeeded6518worker1 # [ 141.541048] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6519worker1 # [ 142.766883] nix-daemon[848]: reaped child process 1912, status = succeeded6520worker1 # [ 142.935782] nix-daemon[848]: accepted connection from pid 1927, user nix-grpc-daemon (trusted)6521worker1 # [ 142.946308] nix-daemon[848]: reaped child process 1930, status = succeeded6522lb # [ 142.988741] niks3-server[1037]: 2026/09/20 09:07:04 INFO Received uploads request method=POST path=/api/pending_closures6523worker1 # [ 142.967227] nix-grpc-daemon[1743]: time=2026-09-20T09:07:04.333Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6524worker1 # [ 142.968715] nix-grpc-daemon[1743]: time=2026-09-20T09:07:04.335Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6525lb # [ 143.011408] niks3-server[1037]: 2026/09/20 09:07:04 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6526lb # [ 143.014986] niks3-server[1037]: 2026/09/20 09:07:04 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6527lb # [ 143.018271] niks3-server[1037]: 2026/09/20 09:07:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6528lb # [ 143.020912] niks3-server[1037]: 2026/09/20 09:07:04 INFO Signed narinfos id=55 count=16529worker1 # [ 142.996531] nix-grpc-daemon[1743]: time=2026-09-20T09:07:04.362Z level=INFO msg="Uploading 1 narinfos"6530lb # [ 143.024881] niks3-server[1037]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6531lb # [ 143.029052] niks3-server[1037]: 2026/09/20 09:07:05 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6532lb # [ 143.032036] niks3-server[1037]: 2026/09/20 09:07:05 INFO Completed upload id=556533worker1 # [ 143.007346] nix-grpc-daemon[1743]: time=2026-09-20T09:07:04.373Z level=INFO msg="Upload complete. (258ms)"6534lb # [ 143.033835] niks3-server[1037]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6535worker1 # [ 143.011521] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16536worker1 # [ 143.015458] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:04Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16537worker1 # [ 143.017884] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486538worker1 # [ 143.021224] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:04Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06539worker1 # [ 143.025883] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363486540worker1 # [ 143.031193] nix-daemon[848]: reaped child process 1910, status = succeeded6541worker1 # [ 143.033076] nix-grpc-daemon[1743]: time=2026-09-20T09:07:04.399Z level=INFO msg="All 1 paths already cached"6542worker1 # [ 143.036550] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363486543worker1 # [ 143.041590] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6544worker1 # [ 143.191612] nix-daemon[848]: accepted connection from pid 1936, user nix-grpc-daemon (trusted)6545worker1 # [ 143.203437] nix-daemon[848]: reaped child process 1939, status = succeeded6546worker1 # [ 143.367289] nix-daemon[848]: accepted connection from pid 1941, user nix-grpc-daemon (trusted)6547worker1 # [ 143.378764] nix-daemon[848]: reaped child process 1944, status = succeeded6548lb # [ 143.419431] niks3-server[1037]: 2026/09/20 09:07:05 INFO Received uploads request method=POST path=/api/pending_closures6549worker1 # [ 143.401220] nix-grpc-daemon[1743]: time=2026-09-20T09:07:04.767Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6550worker1 # [ 143.402577] nix-grpc-daemon[1743]: time=2026-09-20T09:07:04.767Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6551lb # [ 143.442244] niks3-server[1037]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6552lb # [ 143.451878] niks3-server[1037]: 2026/09/20 09:07:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6553lb # [ 143.455973] niks3-server[1037]: 2026/09/20 09:07:05 INFO Signed narinfos id=56 count=16554worker1 # [ 143.433100] nix-grpc-daemon[1743]: time=2026-09-20T09:07:04.799Z level=INFO msg="Uploading 1 narinfos"6555lb # [ 143.468142] niks3-server[1037]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6556lb # [ 143.475099] niks3-server[1037]: 2026/09/20 09:07:05 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6557worker1 # [ 143.454934] nix-grpc-daemon[1743]: time=2026-09-20T09:07:04.821Z level=INFO msg="Upload complete. (408ms)"6558lb # [ 143.481111] niks3-server[1037]: 2026/09/20 09:07:05 INFO Completed upload id=566559lb # [ 143.484826] niks3-server[1037]: 2026/09/20 09:07:05 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6560worker1 # [ 143.457479] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 paths=1 nar_bytes_in=6246561worker1 # [ 143.463394] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486562worker1 # [ 143.469786] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6563worker1 # [ 143.473446] nix-daemon[848]: reaped child process 1934, status = succeeded6564worker1 # [ 143.478350] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6565worker1 # [ 144.503122] nix-daemon[848]: reaped child process 1948, status = succeeded6566worker1 # [ 144.677569] nix-daemon[848]: accepted connection from pid 1963, user nix-grpc-daemon (trusted)6567worker1 # [ 144.688430] nix-daemon[848]: reaped child process 1966, status = succeeded6568lb # [ 144.734203] niks3-server[1037]: 2026/09/20 09:07:06 INFO Received uploads request method=POST path=/api/pending_closures6569worker1 # [ 144.717356] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.083Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6570worker1 # [ 144.718819] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.085Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6571lb # [ 144.772498] niks3-server[1037]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6572lb # [ 144.783990] niks3-server[1037]: 2026/09/20 09:07:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6573lb # [ 144.789372] niks3-server[1037]: 2026/09/20 09:07:06 INFO Signed narinfos id=57 count=16574worker1 # [ 144.766579] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.132Z level=INFO msg="Uploading 1 narinfos"6575lb # [ 144.797344] niks3-server[1037]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6576lb # [ 144.806519] niks3-server[1037]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6577lb # [ 144.812082] niks3-server[1037]: 2026/09/20 09:07:06 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6578lb # [ 144.817045] niks3-server[1037]: 2026/09/20 09:07:06 INFO Completed upload id=576579worker1 # [ 144.791404] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.157Z level=INFO msg="Upload complete. (305ms)"6580lb # [ 144.819913] niks3-server[1037]: 2026/09/20 09:07:06 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6581worker1 # [ 144.798847] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16582worker1 # [ 144.808503] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:06Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16583worker1 # [ 144.813335] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486584worker1 # [ 144.816665] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:06Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06585worker1 # [ 144.826305] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363486586worker1 # [ 144.829178] nix-daemon[848]: reaped child process 1946, status = succeeded6587worker1 # [ 144.833782] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.200Z level=INFO msg="All 2 paths already cached"6588worker1 # [ 144.838397] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363486589worker1 # [ 144.843209] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6590worker1 # [ 144.993482] nix-daemon[848]: accepted connection from pid 1972, user nix-grpc-daemon (trusted)6591worker1 # [ 145.005932] nix-daemon[848]: reaped child process 1975, status = succeeded6592worker1 # [ 145.178354] nix-daemon[848]: accepted connection from pid 1977, user nix-grpc-daemon (trusted)6593worker1 # [ 145.190455] nix-daemon[848]: reaped child process 1980, status = succeeded6594lb # [ 145.233413] niks3-server[1037]: 2026/09/20 09:07:07 INFO Received uploads request method=POST path=/api/pending_closures6595worker1 # [ 145.215192] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.581Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6596worker1 # [ 145.216741] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.583Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6597lb # [ 145.261254] niks3-server[1037]: 2026/09/20 09:07:07 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6598lb # [ 145.275413] niks3-server[1037]: 2026/09/20 09:07:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6599lb # [ 145.280497] niks3-server[1037]: 2026/09/20 09:07:07 INFO Signed narinfos id=58 count=16600worker1 # [ 145.257646] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.624Z level=INFO msg="Uploading 1 narinfos"6601lb # [ 145.287483] niks3-server[1037]: 2026/09/20 09:07:07 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6602lb # [ 145.298397] niks3-server[1037]: 2026/09/20 09:07:07 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6603lb # [ 145.303207] niks3-server[1037]: 2026/09/20 09:07:07 INFO Completed upload id=586604worker1 # [ 145.277043] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.643Z level=WARN msg="Failed to register uploaded object" key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo error="server returned 404: object is not pending upload\n"6605worker1 # [ 145.282791] nix-grpc-daemon[1743]: time=2026-09-20T09:07:06.647Z level=INFO msg="Upload complete. (433ms)"6606worker1 # [ 145.286816] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 paths=1 nar_bytes_in=7526607worker1 # [ 145.290349] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486608worker1 # [ 145.298580] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6609worker1 # [ 145.303158] nix-daemon[848]: reaped child process 1970, status = succeeded6610worker1 # [ 145.307531] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6611worker1 # [ 145.933644] nix-daemon[848]: reaped child process 1984, status = succeeded6612worker1 # [ 146.097527] nix-daemon[848]: accepted connection from pid 1999, user nix-grpc-daemon (trusted)6613worker1 # [ 146.108177] nix-daemon[848]: reaped child process 2002, status = succeeded6614lb # [ 146.150857] niks3-server[1037]: 2026/09/20 09:07:08 INFO Received uploads request method=POST path=/api/pending_closures6615worker1 # [ 146.133049] nix-grpc-daemon[1743]: time=2026-09-20T09:07:07.499Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6616worker1 # [ 146.134565] nix-grpc-daemon[1743]: time=2026-09-20T09:07:07.501Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6617lb # [ 146.191252] niks3-server[1037]: 2026/09/20 09:07:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6618worker1 # [ 146.170596] nix-grpc-daemon[1743]: time=2026-09-20T09:07:07.537Z level=INFO msg="Uploading 1 narinfos"6619lb # [ 146.197820] niks3-server[1037]: 2026/09/20 09:07:08 INFO Signed narinfos id=59 count=16620lb # [ 146.205589] niks3-server[1037]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6621lb # [ 146.211731] niks3-server[1037]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6622lb # [ 146.221111] niks3-server[1037]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6623lb # [ 146.226838] niks3-server[1037]: 2026/09/20 09:07:08 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6624lb # [ 146.232058] niks3-server[1037]: 2026/09/20 09:07:08 INFO Completed upload id=596625worker1 # [ 146.206424] nix-grpc-daemon[1743]: time=2026-09-20T09:07:07.572Z level=INFO msg="Upload complete. (292ms)"6626lb # [ 146.236488] niks3-server[1037]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6627worker1 # [ 146.211663] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16628worker1 # [ 146.218419] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:07Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16629worker1 # [ 146.222407] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486630worker1 # [ 146.232374] nix-daemon[848]: reaped child process 1982, status = succeeded6631worker1 # [ 146.233741] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363486632worker1 # [ 146.240553] nix-grpc-daemon[1743]: time=2026-09-20T09:07:07.607Z level=INFO msg="All 2 paths already cached"6633worker1 # [ 146.244929] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363486634worker1 # [ 146.249776] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6635worker1 # [ 146.410126] nix-daemon[848]: accepted connection from pid 2006, user nix-grpc-daemon (trusted)6636worker1 # [ 146.422549] nix-daemon[848]: reaped child process 2009, status = succeeded6637worker1 # [ 146.583270] nix-daemon[848]: accepted connection from pid 2011, user nix-grpc-daemon (trusted)6638worker1 # [ 146.595212] nix-daemon[848]: reaped child process 2014, status = succeeded6639lb # [ 146.633383] niks3-server[1037]: 2026/09/20 09:07:08 INFO Received uploads request method=POST path=/api/pending_closures6640worker1 # [ 146.614942] nix-grpc-daemon[1743]: time=2026-09-20T09:07:07.981Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6641worker1 # [ 146.616359] nix-grpc-daemon[1743]: time=2026-09-20T09:07:07.981Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6642lb # [ 146.657100] niks3-server[1037]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6643lb # [ 146.668556] niks3-server[1037]: 2026/09/20 09:07:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6644worker1 # [ 146.648327] nix-grpc-daemon[1743]: time=2026-09-20T09:07:08.014Z level=INFO msg="Uploading 1 narinfos"6645lb # [ 146.674208] niks3-server[1037]: 2026/09/20 09:07:08 INFO Signed narinfos id=60 count=16646lb # [ 146.678608] niks3-server[1037]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6647lb # [ 146.690168] niks3-server[1037]: 2026/09/20 09:07:08 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6648worker1 # [ 146.670773] nix-grpc-daemon[1743]: time=2026-09-20T09:07:08.037Z level=INFO msg="Upload complete. (416ms)"6649lb # [ 146.696821] niks3-server[1037]: 2026/09/20 09:07:08 INFO Completed upload id=606650worker1 # [ 146.672707] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 paths=1 nar_bytes_in=7526651lb # [ 146.699957] niks3-server[1037]: 2026/09/20 09:07:08 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6652worker1 # [ 146.679335] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486653worker1 # [ 146.685331] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6654worker1 # [ 146.687680] nix-daemon[848]: reaped child process 2004, status = succeeded6655worker1 # [ 146.693220] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6656worker1 # [ 147.907355] nix-daemon[848]: reaped child process 2018, status = succeeded6657worker1 # [ 148.067969] nix-daemon[848]: accepted connection from pid 2033, user nix-grpc-daemon (trusted)6658worker1 # [ 148.079921] nix-daemon[848]: reaped child process 2036, status = succeeded6659lb # [ 148.122573] niks3-server[1037]: 2026/09/20 09:07:10 INFO Received uploads request method=POST path=/api/pending_closures6660worker1 # [ 148.105651] nix-grpc-daemon[1743]: time=2026-09-20T09:07:09.471Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6661worker1 # [ 148.107199] nix-grpc-daemon[1743]: time=2026-09-20T09:07:09.473Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6662lb # [ 148.157834] niks3-server[1037]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6663lb # [ 148.165363] niks3-server[1037]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6664lb # [ 148.177246] niks3-server[1037]: 2026/09/20 09:07:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6665lb # [ 148.182899] niks3-server[1037]: 2026/09/20 09:07:10 INFO Signed narinfos id=61 count=16666worker1 # [ 148.157349] nix-grpc-daemon[1743]: time=2026-09-20T09:07:09.523Z level=INFO msg="Uploading 1 narinfos"6667lb # [ 148.187939] niks3-server[1037]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6668lb # [ 148.196895] niks3-server[1037]: 2026/09/20 09:07:10 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6669lb # [ 148.201382] niks3-server[1037]: 2026/09/20 09:07:10 INFO Completed upload id=616670worker1 # [ 148.175490] nix-grpc-daemon[1743]: time=2026-09-20T09:07:09.541Z level=INFO msg="Upload complete. (275ms)"6671worker1 # [ 148.181675] nix-grpc-daemon[1743]: time=2026-09-20T09:07:09.545Z level=WARN msg="Failed to register uploaded object" key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo error="server returned 404: object is not pending upload\n"6672worker1 # [ 148.190758] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16673worker1 # [ 148.196409] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:09Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16674worker1 # [ 148.199883] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486675worker1 # [ 148.209659] nix-daemon[848]: reaped child process 2016, status = succeeded6676worker1 # [ 148.231420] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363486677worker1 # [ 148.244138] nix-grpc-daemon[1743]: time=2026-09-20T09:07:09.610Z level=INFO msg="All 2 paths already cached"6678worker1 # [ 148.250800] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363486679worker1 # [ 148.259145] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6680worker1 # [ 148.415714] nix-daemon[848]: accepted connection from pid 2040, user nix-grpc-daemon (trusted)6681worker1 # [ 148.428396] nix-daemon[848]: reaped child process 2043, status = succeeded6682worker1 # [ 148.586060] nix-daemon[848]: accepted connection from pid 2045, user nix-grpc-daemon (trusted)6683worker1 # [ 148.598613] nix-daemon[848]: reaped child process 2048, status = succeeded6684lb # [ 148.638079] niks3-server[1037]: 2026/09/20 09:07:10 INFO Received uploads request method=POST path=/api/pending_closures6685worker1 # [ 148.619530] nix-grpc-daemon[1743]: time=2026-09-20T09:07:09.985Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6686worker1 # [ 148.621391] nix-grpc-daemon[1743]: time=2026-09-20T09:07:09.987Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6687lb # [ 148.666385] niks3-server[1037]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6688lb # [ 148.673878] niks3-server[1037]: 2026/09/20 09:07:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6689lb # [ 148.679272] niks3-server[1037]: 2026/09/20 09:07:10 INFO Signed narinfos id=62 count=16690worker1 # [ 148.657509] nix-grpc-daemon[1743]: time=2026-09-20T09:07:10.023Z level=INFO msg="Uploading 1 narinfos"6691lb # [ 148.685384] niks3-server[1037]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6692lb # [ 148.696940] niks3-server[1037]: 2026/09/20 09:07:10 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6693lb # [ 148.702705] niks3-server[1037]: 2026/09/20 09:07:10 INFO Completed upload id=626694worker1 # [ 148.676930] nix-grpc-daemon[1743]: time=2026-09-20T09:07:10.043Z level=INFO msg="Upload complete. (408ms)"6695lb # [ 148.707586] niks3-server[1037]: 2026/09/20 09:07:10 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6696worker1 # [ 148.681129] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=0 paths=1 nar_bytes_in=7526697worker1 # [ 148.685977] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363486698worker1 # [ 148.693844] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6699worker1 # [ 148.698615] nix-daemon[848]: reaped child process 2038, status = succeeded6700worker1 # [ 148.703788] nix-daemon[848]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6701worker1 # [ 149.921798] nix-daemon[848]: reaped child process 2052, status = succeeded6702worker1 # [ 150.097858] nix-daemon[848]: accepted connection from pid 2067, user nix-grpc-daemon (trusted)6703worker1 # [ 150.109605] nix-daemon[848]: reaped child process 2070, status = succeeded6704lb # [ 150.153413] niks3-server[1037]: 2026/09/20 09:07:12 INFO Received uploads request method=POST path=/api/pending_closures6705worker1 # [ 150.135457] nix-grpc-daemon[1743]: time=2026-09-20T09:07:11.501Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6706worker1 # [ 150.136937] nix-grpc-daemon[1743]: time=2026-09-20T09:07:11.503Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6707lb # [ 150.197485] niks3-server[1037]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6708lb # [ 150.203897] niks3-server[1037]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6709lb # [ 150.207699] niks3-server[1037]: 2026/09/20 09:07:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6710lb # [ 150.212104] niks3-server[1037]: 2026/09/20 09:07:12 INFO Signed narinfos id=63 count=16711worker1 # [ 150.189029] nix-grpc-daemon[1743]: time=2026-09-20T09:07:11.555Z level=INFO msg="Uploading 1 narinfos"6712lb # [ 150.219545] niks3-server[1037]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6713lb # [ 150.229774] niks3-server[1037]: 2026/09/20 09:07:12 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6714lb # [ 150.236169] niks3-server[1037]: 2026/09/20 09:07:12 INFO Completed upload id=636715worker1 # [ 150.210435] nix-grpc-daemon[1743]: time=2026-09-20T09:07:11.576Z level=INFO msg="Upload complete. (300ms)"6716lb # [ 150.239470] niks3-server[1037]: 2026/09/20 09:07:12 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6717worker1 # [ 150.215933] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36348 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16718worker1 # [ 150.231055] nix-daemon[848]: reaped child process 2050, status = succeeded6719client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.59 seconds)6720worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6721worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.07 seconds)6722client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16723worker1 # [ 150.564559] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:363486724worker2 # [ 150.610296] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646725worker1 # [ 150.589277] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:11Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06726lb # [ 157.153902] envoy[909]: conn peer=[2001:db8:1::1]:43806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27072 tx=10742 ms=173246727client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.28 seconds)6728(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 47.94 seconds)6729subtest: low disk drains a worker and builds go to the other6730worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6731worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.98 seconds)6732worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6733worker1 # [ 182.433723] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:43Z level=info event=unhealthy reason=min_free6734worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds)6735client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26736worker2 # [ 182.970707] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417646737client # don't know how to build these paths:6738client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6739worker2 # [ 182.975658] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646740worker1 # [ 182.950954] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:44Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06741worker1 # [ 182.955275] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:44Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16742worker2 # [ 183.031831] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646743worker2 # [ 183.040662] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646744client # copying 1 paths to 'lb:50051'...6745client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6746worker2 # [ 183.050787] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417646747worker2 # [ 183.063919] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6748worker2 # [ 183.236311] nix-daemon[845]: accepted connection from pid 1631, user nix-grpc-daemon (trusted)6749worker2 # [ 183.250481] nix-daemon[845]: reaped child process 1634, status = succeeded6750worker2 # [ 183.408688] nix-daemon[845]: accepted connection from pid 1636, user nix-grpc-daemon (trusted)6751worker2 # [ 183.422737] nix-daemon[845]: reaped child process 1639, status = succeeded6752lb # [ 183.423230] niks3-server[1037]: 2026/09/20 09:07:45 INFO Received uploads request method=POST path=/api/pending_closures6753worker2 # [ 183.440078] nix-grpc-daemon[1454]: time=2026-09-20T09:07:45.115Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6754worker2 # [ 183.441668] nix-grpc-daemon[1454]: time=2026-09-20T09:07:45.116Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6755lb # [ 183.441046] niks3-server[1037]: 2026/09/20 09:07:45 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6756lb # [ 183.445199] niks3-server[1037]: 2026/09/20 09:07:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6757lb # [ 183.447535] niks3-server[1037]: 2026/09/20 09:07:45 INFO Signed narinfos id=64 count=16758worker2 # [ 183.459124] nix-grpc-daemon[1454]: time=2026-09-20T09:07:45.134Z level=INFO msg="Uploading 1 narinfos"6759lb # [ 183.451590] niks3-server[1037]: 2026/09/20 09:07:45 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6760lb # [ 183.455363] niks3-server[1037]: 2026/09/20 09:07:45 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6761lb # [ 183.459429] niks3-server[1037]: 2026/09/20 09:07:45 INFO Completed upload id=646762worker2 # [ 183.472371] nix-grpc-daemon[1454]: time=2026-09-20T09:07:45.147Z level=INFO msg="Upload complete. (396ms)"6763lb # [ 183.461112] niks3-server[1037]: 2026/09/20 09:07:45 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6764worker2 # [ 183.474632] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=0 paths=1 nar_bytes_in=5126765worker2 # [ 183.477147] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646766worker2 # [ 183.485061] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6767worker2 # [ 183.487639] nix-daemon[845]: reaped child process 1629, status = succeeded6768client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6769client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6770worker2 # [ 183.493457] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6771client # farm-a> LOG-farm-a-drain6772worker2 # [ 184.923803] nix-daemon[845]: reaped child process 1643, status = succeeded6773worker2 # [ 185.055777] nix-daemon[845]: accepted connection from pid 1658, user nix-grpc-daemon (trusted)6774worker2 # [ 185.069757] nix-daemon[845]: reaped child process 1661, status = succeeded6775lb # [ 185.066255] niks3-server[1037]: 2026/09/20 09:07:47 INFO Received uploads request method=POST path=/api/pending_closures6776worker2 # [ 185.082448] nix-grpc-daemon[1454]: time=2026-09-20T09:07:46.757Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6777worker2 # [ 185.084806] nix-grpc-daemon[1454]: time=2026-09-20T09:07:46.759Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6778lb # [ 185.088446] niks3-server[1037]: 2026/09/20 09:07:47 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6779lb # [ 185.090945] niks3-server[1037]: 2026/09/20 09:07:47 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6780lb # [ 185.094144] niks3-server[1037]: 2026/09/20 09:07:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6781lb # [ 185.096917] niks3-server[1037]: 2026/09/20 09:07:47 INFO Signed narinfos id=65 count=16782worker2 # [ 185.108891] nix-grpc-daemon[1454]: time=2026-09-20T09:07:46.784Z level=INFO msg="Uploading 1 narinfos"6783lb # [ 185.100185] niks3-server[1037]: 2026/09/20 09:07:47 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6784lb # [ 185.104640] niks3-server[1037]: 2026/09/20 09:07:47 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6785lb # [ 185.107585] niks3-server[1037]: 2026/09/20 09:07:47 INFO Completed upload id=656786worker2 # [ 185.120480] nix-grpc-daemon[1454]: time=2026-09-20T09:07:46.795Z level=INFO msg="Upload complete. (218ms)"6787lb # [ 185.109177] niks3-server[1037]: 2026/09/20 09:07:47 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6788worker2 # [ 185.123329] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16789worker2 # [ 185.131145] nix-daemon[845]: reaped child process 1641, status = succeeded6790worker1 # [ 185.091576] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:46Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06791worker1 # [ 185.094778] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:46Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16792worker2 # [ 185.171777] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646793worker2 # [ 185.181359] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646794worker2 # [ 185.190354] nix-grpc-daemon[1454]: time=2026-09-20T09:07:46.865Z level=INFO msg="All 1 paths already cached"6795client # copying 1 paths to 'lb:50051'...6796client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6797worker2 # [ 185.197114] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417646798worker2 # [ 185.203998] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6799worker2 # [ 185.352832] nix-daemon[845]: accepted connection from pid 1665, user nix-grpc-daemon (trusted)6800worker2 # [ 185.369564] nix-daemon[845]: reaped child process 1668, status = succeeded6801worker2 # [ 185.495749] nix-daemon[845]: accepted connection from pid 1670, user nix-grpc-daemon (trusted)6802worker2 # [ 185.509785] nix-daemon[845]: reaped child process 1673, status = succeeded6803lb # [ 185.506325] niks3-server[1037]: 2026/09/20 09:07:47 INFO Received uploads request method=POST path=/api/pending_closures6804worker2 # [ 185.521931] nix-grpc-daemon[1454]: time=2026-09-20T09:07:47.197Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6805worker2 # [ 185.523894] nix-grpc-daemon[1454]: time=2026-09-20T09:07:47.198Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6806lb # [ 185.519362] niks3-server[1037]: 2026/09/20 09:07:47 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6807lb # [ 185.523242] niks3-server[1037]: 2026/09/20 09:07:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6808lb # [ 185.525774] niks3-server[1037]: 2026/09/20 09:07:47 INFO Signed narinfos id=66 count=16809worker2 # [ 185.538869] nix-grpc-daemon[1454]: time=2026-09-20T09:07:47.214Z level=INFO msg="Uploading 1 narinfos"6810lb # [ 185.528894] niks3-server[1037]: 2026/09/20 09:07:47 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6811lb # [ 185.533772] niks3-server[1037]: 2026/09/20 09:07:47 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6812lb # [ 185.536683] niks3-server[1037]: 2026/09/20 09:07:47 INFO Completed upload id=666813worker2 # [ 185.549580] nix-grpc-daemon[1454]: time=2026-09-20T09:07:47.224Z level=INFO msg="Upload complete. (334ms)"6814lb # [ 185.538391] niks3-server[1037]: 2026/09/20 09:07:47 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6815worker2 # [ 185.551614] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=0 paths=1 nar_bytes_in=6246816worker2 # [ 185.555178] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646817worker2 # [ 185.559616] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6818worker2 # [ 185.565660] nix-daemon[845]: reaped child process 1663, status = succeeded6819client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6820client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6821worker2 # [ 185.570210] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6822client # farm-b> LOG-farm-b-drain6823worker2 # [ 186.800327] nix-daemon[845]: reaped child process 1677, status = succeeded6824worker2 # [ 186.919684] nix-daemon[845]: accepted connection from pid 1692, user nix-grpc-daemon (trusted)6825worker2 # [ 186.933973] nix-daemon[845]: reaped child process 1695, status = succeeded6826lb # [ 186.932596] niks3-server[1037]: 2026/09/20 09:07:48 INFO Received uploads request method=POST path=/api/pending_closures6827worker2 # [ 186.952968] nix-grpc-daemon[1454]: time=2026-09-20T09:07:48.628Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6828worker2 # [ 186.956059] nix-grpc-daemon[1454]: time=2026-09-20T09:07:48.629Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6829lb # [ 186.964993] niks3-server[1037]: 2026/09/20 09:07:48 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6830lb # [ 186.979277] niks3-server[1037]: 2026/09/20 09:07:48 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6831lb # [ 186.989916] niks3-server[1037]: 2026/09/20 09:07:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6832worker2 # [ 187.005871] nix-grpc-daemon[1454]: time=2026-09-20T09:07:48.680Z level=INFO msg="Uploading 1 narinfos"6833lb # [ 186.994099] niks3-server[1037]: 2026/09/20 09:07:48 INFO Signed narinfos id=67 count=16834lb # [ 186.998847] niks3-server[1037]: 2026/09/20 09:07:48 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6835lb # [ 187.007031] niks3-server[1037]: 2026/09/20 09:07:48 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6836lb # [ 187.009981] niks3-server[1037]: 2026/09/20 09:07:48 INFO Completed upload id=676837worker2 # [ 187.021626] nix-grpc-daemon[1454]: time=2026-09-20T09:07:48.696Z level=INFO msg="Upload complete. (243ms)"6838lb # [ 187.011577] niks3-server[1037]: 2026/09/20 09:07:48 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6839worker2 # [ 187.024306] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16840worker2 # [ 187.032152] nix-daemon[845]: reaped child process 1675, status = succeeded6841worker1 # [ 186.996853] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:48Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06842worker1 # [ 187.001349] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:48Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16843worker2 # [ 187.078499] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646844worker2 # [ 187.091625] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417646845worker2 # [ 187.104304] nix-grpc-daemon[1454]: time=2026-09-20T09:07:48.779Z level=INFO msg="All 2 paths already cached"6846client # copying 1 paths to 'lb:50051'...6847client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6848worker2 # [ 187.112282] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417646849worker2 # [ 187.121341] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6850lb # [ 187.154615] envoy[909]: conn peer=[2001:db8:1::1]:38976 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=498 ms=300416851worker2 # [ 187.276353] nix-daemon[845]: accepted connection from pid 1699, user nix-grpc-daemon (trusted)6852worker2 # [ 187.291334] nix-daemon[845]: reaped child process 1702, status = succeeded6853worker2 # [ 187.426401] nix-daemon[845]: accepted connection from pid 1704, user nix-grpc-daemon (trusted)6854worker2 # [ 187.440150] nix-daemon[845]: reaped child process 1707, status = succeeded6855lb # [ 187.440421] niks3-server[1037]: 2026/09/20 09:07:49 INFO Received uploads request method=POST path=/api/pending_closures6856worker2 # [ 187.459650] nix-grpc-daemon[1454]: time=2026-09-20T09:07:49.134Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6857worker2 # [ 187.461562] nix-grpc-daemon[1454]: time=2026-09-20T09:07:49.136Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6858lb # [ 187.468542] niks3-server[1037]: 2026/09/20 09:07:49 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6859lb # [ 187.478964] niks3-server[1037]: 2026/09/20 09:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6860worker2 # [ 187.495601] nix-grpc-daemon[1454]: time=2026-09-20T09:07:49.170Z level=INFO msg="Uploading 1 narinfos"6861lb # [ 187.485051] niks3-server[1037]: 2026/09/20 09:07:49 INFO Signed narinfos id=68 count=16862lb # [ 187.490070] niks3-server[1037]: 2026/09/20 09:07:49 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6863lb # [ 187.500496] niks3-server[1037]: 2026/09/20 09:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6864lb # [ 187.505513] niks3-server[1037]: 2026/09/20 09:07:49 INFO Completed upload id=686865worker2 # [ 187.519658] nix-grpc-daemon[1454]: time=2026-09-20T09:07:49.194Z level=INFO msg="Upload complete. (384ms)"6866lb # [ 187.511059] niks3-server[1037]: 2026/09/20 09:07:49 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6867worker2 # [ 187.521902] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=0 paths=1 nar_bytes_in=7526868worker2 # [ 187.527190] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417646869worker2 # [ 187.535049] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6870worker2 # [ 187.543200] nix-daemon[845]: reaped child process 1697, status = succeeded6871client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6872client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6873worker2 # [ 187.547663] nix-daemon[845]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6874client # farm-top> LOG-farm-top-drain6875worker2 # [ 188.177186] nix-daemon[845]: reaped child process 1711, status = succeeded6876worker2 # [ 188.313667] nix-daemon[845]: accepted connection from pid 1726, user nix-grpc-daemon (trusted)6877worker2 # [ 188.326056] nix-daemon[845]: reaped child process 1729, status = succeeded6878lb # [ 188.326152] niks3-server[1037]: 2026/09/20 09:07:50 INFO Received uploads request method=POST path=/api/pending_closures6879worker2 # [ 188.342910] nix-grpc-daemon[1454]: time=2026-09-20T09:07:50.017Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6880worker2 # [ 188.344413] nix-grpc-daemon[1454]: time=2026-09-20T09:07:50.019Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6881lb # [ 188.348374] niks3-server[1037]: 2026/09/20 09:07:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6882lb # [ 188.351055] niks3-server[1037]: 2026/09/20 09:07:50 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6883lb # [ 188.355098] niks3-server[1037]: 2026/09/20 09:07:50 INFO Signed narinfos id=69 count=16884worker2 # [ 188.366875] nix-grpc-daemon[1454]: time=2026-09-20T09:07:50.042Z level=INFO msg="Uploading 1 narinfos"6885lb # [ 188.359101] niks3-server[1037]: 2026/09/20 09:07:50 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6886lb # [ 188.364547] niks3-server[1037]: 2026/09/20 09:07:50 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6887lb # [ 188.368474] niks3-server[1037]: 2026/09/20 09:07:50 INFO Completed upload id=696888worker2 # [ 188.381676] nix-grpc-daemon[1454]: time=2026-09-20T09:07:50.057Z level=INFO msg="Upload complete. (226ms)"6889lb # [ 188.369928] niks3-server[1037]: 2026/09/20 09:07:50 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6890lb # [ 188.372858] niks3-server[1037]: 2026/09/20 09:07:50 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6891worker2 # [ 188.384200] nix-grpc-daemon[1366]: ts=2026-09-20T09:07:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41764 duration_s=0 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16892worker2 # [ 188.391712] nix-daemon[845]: reaped child process 1709, status = succeeded6893client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 5.67 seconds)6894client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6895client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.19 seconds)6896worker1: must succeed: rm /nix/.rw-store/fill6897worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)6898worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6899worker1 # [ 189.434904] nix-grpc-daemon[1680]: ts=2026-09-20T09:07:50Z level=info event=healthy reason=min_free6900worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.07 seconds)6901(finished: subtest: low disk drains a worker and builds go to the other, in 9.21 seconds)6902(finished: run the VM test script, in 190.80 seconds)6903test script finished in 191.04s6904cleanup6905kill QemuMachine (pid 50)6906client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6907kill QemuMachine (pid 49)6908lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6909kill QemuMachine (pid 52)6910worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6911kill QemuMachine (pid 51)6912worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6913(finished: cleanup, in 0.98 seconds)6914additionally exposed symbols:6915 client, lb, worker1, worker2,6916 vlan1,6917 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh